[==========] Running 4 tests from 1 test suite.
[----------] Global test environment set-up.
[----------] 4 tests from TimestampAdvancementITest
[ RUN      ] TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260812 06:37:37.410405  3187 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.28.254:32975
I20260812 06:37:37.411665  3187 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:37.412417  3187 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:37:37.420356  3199 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:37.420252  3198 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:37.420387  3187 server_base.cc:1061] running on GCE node
W20260812 06:37:37.420238  3206 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:37.421195  3187 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 06:37:37.421295  3187 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 06:37:37.421324  3187 hybrid_clock.cc:648] HybridClock initialized: now 1786516657421321 us; error 0 us; skew 500 ppm
I20260812 06:37:37.423439  3187 webserver.cc:533] Webserver started at http://127.3.28.254:38409/ using document root <none> and password file <none>
I20260812 06:37:37.424254  3187 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:37.424341  3187 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:37.424666  3187 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:37:37.426353  3187 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1786516657398854-3187-0/minicluster-data/master-0-root/instance:
uuid: "da7ef9ed1cdc41998898235779895b2e"
format_stamp: "Formatted at 2026-08-12 06:37:37 on dist-test-slave-tk9z"
I20260812 06:37:37.430284  3187 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.001s
I20260812 06:37:37.432698  3211 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:37.433815  3187 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:37:37.433970  3187 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1786516657398854-3187-0/minicluster-data/master-0-root
uuid: "da7ef9ed1cdc41998898235779895b2e"
format_stamp: "Formatted at 2026-08-12 06:37:37 on dist-test-slave-tk9z"
I20260812 06:37:37.434095  3187 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1786516657398854-3187-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1786516657398854-3187-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1786516657398854-3187-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:37.450726  3187 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:37.451399  3187 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:37.451602  3187 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:37.452706  3218 maintenance_manager.cc:346] Maintenance manager is disabled (check --enable_maintenance_manager).
I20260812 06:37:37.460296  3187 rpc_server.cc:307] RPC server started. Bound to: 127.3.28.254:32975
I20260812 06:37:37.460345  3289 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.28.254:32975 every 8 connection(s)
I20260812 06:37:37.463362  3290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:37.468644  3290 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P da7ef9ed1cdc41998898235779895b2e: Bootstrap starting.
I20260812 06:37:37.471278  3290 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P da7ef9ed1cdc41998898235779895b2e: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:37.471971  3290 log.cc:826] T 00000000000000000000000000000000 P da7ef9ed1cdc41998898235779895b2e: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:37.473518  3290 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P da7ef9ed1cdc41998898235779895b2e: No bootstrap required, opened a new log
I20260812 06:37:37.476012  3290 raft_consensus.cc:359] T 00000000000000000000000000000000 P da7ef9ed1cdc41998898235779895b2e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da7ef9ed1cdc41998898235779895b2e" member_type: VOTER }
I20260812 06:37:37.476169  3290 raft_consensus.cc:385] T 00000000000000000000000000000000 P da7ef9ed1cdc41998898235779895b2e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:37.476202  3290 raft_consensus.cc:740] T 00000000000000000000000000000000 P da7ef9ed1cdc41998898235779895b2e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: da7ef9ed1cdc41998898235779895b2e, State: Initialized, Role: FOLLOWER
I20260812 06:37:37.476734  3290 consensus_queue.cc:260] T 00000000000000000000000000000000 P da7ef9ed1cdc41998898235779895b2e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da7ef9ed1cdc41998898235779895b2e" member_type: VOTER }
I20260812 06:37:37.476854  3290 raft_consensus.cc:399] T 00000000000000000000000000000000 P da7ef9ed1cdc41998898235779895b2e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:37:37.476953  3290 raft_consensus.cc:493] T 00000000000000000000000000000000 P da7ef9ed1cdc41998898235779895b2e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:37:37.477101  3290 raft_consensus.cc:3060] T 00000000000000000000000000000000 P da7ef9ed1cdc41998898235779895b2e [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:37.477876  3290 raft_consensus.cc:515] T 00000000000000000000000000000000 P da7ef9ed1cdc41998898235779895b2e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da7ef9ed1cdc41998898235779895b2e" member_type: VOTER }
I20260812 06:37:37.478183  3290 leader_election.cc:304] T 00000000000000000000000000000000 P da7ef9ed1cdc41998898235779895b2e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: da7ef9ed1cdc41998898235779895b2e; no voters: 
I20260812 06:37:37.478507  3290 leader_election.cc:290] T 00000000000000000000000000000000 P da7ef9ed1cdc41998898235779895b2e [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 06:37:37.478672  3295 raft_consensus.cc:2804] T 00000000000000000000000000000000 P da7ef9ed1cdc41998898235779895b2e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:37:37.478961  3295 raft_consensus.cc:697] T 00000000000000000000000000000000 P da7ef9ed1cdc41998898235779895b2e [term 1 LEADER]: Becoming Leader. State: Replica: da7ef9ed1cdc41998898235779895b2e, State: Running, Role: LEADER
I20260812 06:37:37.479218  3295 consensus_queue.cc:237] T 00000000000000000000000000000000 P da7ef9ed1cdc41998898235779895b2e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da7ef9ed1cdc41998898235779895b2e" member_type: VOTER }
I20260812 06:37:37.479553  3290 sys_catalog.cc:565] T 00000000000000000000000000000000 P da7ef9ed1cdc41998898235779895b2e [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:37:37.480786  3299 sys_catalog.cc:455] T 00000000000000000000000000000000 P da7ef9ed1cdc41998898235779895b2e [sys.catalog]: SysCatalogTable state changed. Reason: New leader da7ef9ed1cdc41998898235779895b2e. Latest consensus state: current_term: 1 leader_uuid: "da7ef9ed1cdc41998898235779895b2e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da7ef9ed1cdc41998898235779895b2e" member_type: VOTER } }
I20260812 06:37:37.480813  3298 sys_catalog.cc:455] T 00000000000000000000000000000000 P da7ef9ed1cdc41998898235779895b2e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "da7ef9ed1cdc41998898235779895b2e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "da7ef9ed1cdc41998898235779895b2e" member_type: VOTER } }
I20260812 06:37:37.480933  3298 sys_catalog.cc:458] T 00000000000000000000000000000000 P da7ef9ed1cdc41998898235779895b2e [sys.catalog]: This master's current role is: LEADER
I20260812 06:37:37.480934  3299 sys_catalog.cc:458] T 00000000000000000000000000000000 P da7ef9ed1cdc41998898235779895b2e [sys.catalog]: This master's current role is: LEADER
I20260812 06:37:37.481417  3318 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 06:37:37.484557  3318 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 06:37:37.485020  3187 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260812 06:37:37.489729  3318 catalog_manager.cc:1383] Generated new cluster ID: 93d09f2e92624c2a8d6f5c25b498d709
I20260812 06:37:37.489812  3318 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 06:37:37.500083  3318 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 06:37:37.501368  3318 catalog_manager.cc:1540] Loading token signing keys...
I20260812 06:37:37.512873  3318 catalog_manager.cc:6092] T 00000000000000000000000000000000 P da7ef9ed1cdc41998898235779895b2e: Generated new TSK 0
I20260812 06:37:37.513672  3318 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 06:37:37.517817  3187 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 06:37:37.518317  3187 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260812 06:37:37.520370  3333 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:37.520517  3334 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:37.520519  3337 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:37.521059  3187 server_base.cc:1061] running on GCE node
I20260812 06:37:37.521246  3187 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 06:37:37.521306  3187 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 06:37:37.521343  3187 hybrid_clock.cc:648] HybridClock initialized: now 1786516657521342 us; error 0 us; skew 500 ppm
I20260812 06:37:37.522329  3187 webserver.cc:533] Webserver started at http://127.3.28.193:36103/ using document root <none> and password file <none>
I20260812 06:37:37.522531  3187 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:37.522608  3187 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:37.522688  3187 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:37:37.523080  3187 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1786516657398854-3187-0/minicluster-data/ts-0-root/instance:
uuid: "0ef773995fe444dd8de3e1000823a871"
format_stamp: "Formatted at 2026-08-12 06:37:37 on dist-test-slave-tk9z"
I20260812 06:37:37.524700  3187 fs_manager.cc:696] Time spent creating directory manager: real 0.001s	user 0.000s	sys 0.002s
I20260812 06:37:37.525748  3350 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:37.526017  3187 fs_manager.cc:730] Time spent opening block manager: real 0.001s	user 0.000s	sys 0.001s
I20260812 06:37:37.526087  3187 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1786516657398854-3187-0/minicluster-data/ts-0-root
uuid: "0ef773995fe444dd8de3e1000823a871"
format_stamp: "Formatted at 2026-08-12 06:37:37 on dist-test-slave-tk9z"
I20260812 06:37:37.526180  3187 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1786516657398854-3187-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1786516657398854-3187-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1786516657398854-3187-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:37.556695  3187 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:37.557247  3187 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:37.557833  3187 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:37:37.558737  3187 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:37:37.558784  3187 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:37.558859  3187 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:37:37.558900  3187 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:37.567329  3187 rpc_server.cc:307] RPC server started. Bound to: 127.3.28.193:33201
I20260812 06:37:37.567377  3456 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.28.193:33201 every 8 connection(s)
I20260812 06:37:37.568542  3187 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 06:37:37.569062  3187 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260812 06:37:37.571151  3466 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:37.571249  3471 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:37.571666  3187 server_base.cc:1061] running on GCE node
W20260812 06:37:37.572016  3463 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:37.572324  3187 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 06:37:37.572383  3187 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 06:37:37.572413  3187 hybrid_clock.cc:648] HybridClock initialized: now 1786516657572412 us; error 0 us; skew 500 ppm
I20260812 06:37:37.573378  3187 webserver.cc:533] Webserver started at http://127.3.28.194:45551/ using document root <none> and password file <none>
I20260812 06:37:37.573570  3187 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:37.573645  3187 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:37.573733  3187 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:37:37.574142  3187 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1786516657398854-3187-0/minicluster-data/ts-1-root/instance:
uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e"
format_stamp: "Formatted at 2026-08-12 06:37:37 on dist-test-slave-tk9z"
I20260812 06:37:37.576730  3187 fs_manager.cc:696] Time spent creating directory manager: real 0.002s	user 0.000s	sys 0.002s
I20260812 06:37:37.578161  3483 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:37.578194  3458 heartbeater.cc:344] Connected to a master server at 127.3.28.254:32975
I20260812 06:37:37.578472  3458 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:37.578446  3187 fs_manager.cc:730] Time spent opening block manager: real 0.001s	user 0.000s	sys 0.001s
I20260812 06:37:37.578576  3187 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1786516657398854-3187-0/minicluster-data/ts-1-root
uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e"
format_stamp: "Formatted at 2026-08-12 06:37:37 on dist-test-slave-tk9z"
I20260812 06:37:37.578655  3187 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1786516657398854-3187-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1786516657398854-3187-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1786516657398854-3187-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:37.578960  3458 heartbeater.cc:507] Master 127.3.28.254:32975 requested a full tablet report, sending...
I20260812 06:37:37.580896  3232 ts_manager.cc:194] Registered new tserver with Master: 0ef773995fe444dd8de3e1000823a871 (127.3.28.193:33201)
I20260812 06:37:37.582947  3232 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37518
I20260812 06:37:37.589855  3187 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:37.590317  3187 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:37.590736  3187 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:37:37.591326  3187 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:37:37.591367  3187 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:37.591444  3187 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:37:37.591482  3187 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:37.599809  3187 rpc_server.cc:307] RPC server started. Bound to: 127.3.28.194:32899
I20260812 06:37:37.599912  3593 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.28.194:32899 every 8 connection(s)
I20260812 06:37:37.600850  3187 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 06:37:37.601318  3187 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260812 06:37:37.603310  3602 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:37.603447  3605 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:37.603637  3600 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:37.604579  3187 server_base.cc:1061] running on GCE node
I20260812 06:37:37.604791  3187 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 06:37:37.604851  3187 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 06:37:37.604871  3187 hybrid_clock.cc:648] HybridClock initialized: now 1786516657604871 us; error 0 us; skew 500 ppm
I20260812 06:37:37.605883  3187 webserver.cc:533] Webserver started at http://127.3.28.195:44243/ using document root <none> and password file <none>
I20260812 06:37:37.606083  3187 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:37.606115  3594 heartbeater.cc:344] Connected to a master server at 127.3.28.254:32975
I20260812 06:37:37.606159  3187 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:37.606204  3594 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:37.606249  3187 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:37:37.606490  3594 heartbeater.cc:507] Master 127.3.28.254:32975 requested a full tablet report, sending...
I20260812 06:37:37.606755  3187 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1786516657398854-3187-0/minicluster-data/ts-2-root/instance:
uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f"
format_stamp: "Formatted at 2026-08-12 06:37:37 on dist-test-slave-tk9z"
I20260812 06:37:37.607270  3232 ts_manager.cc:194] Registered new tserver with Master: 7ddeeaa5caab4672b6aaff6de27e3f8e (127.3.28.194:32899)
I20260812 06:37:37.607980  3232 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37520
I20260812 06:37:37.610826  3187 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.000s
I20260812 06:37:37.612001  3612 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:37.612277  3187 fs_manager.cc:730] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20260812 06:37:37.612387  3187 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1786516657398854-3187-0/minicluster-data/ts-2-root
uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f"
format_stamp: "Formatted at 2026-08-12 06:37:37 on dist-test-slave-tk9z"
I20260812 06:37:37.612497  3187 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1786516657398854-3187-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1786516657398854-3187-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1786516657398854-3187-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:37.642333  3187 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:37.642877  3187 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:37.643239  3187 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:37:37.643745  3187 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:37:37.643813  3187 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:37.643900  3187 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:37:37.643953  3187 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:37.652031  3187 rpc_server.cc:307] RPC server started. Bound to: 127.3.28.195:41179
I20260812 06:37:37.652122  3718 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.28.195:41179 every 8 connection(s)
I20260812 06:37:37.657476  3723 heartbeater.cc:344] Connected to a master server at 127.3.28.254:32975
I20260812 06:37:37.657622  3723 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:37.657850  3723 heartbeater.cc:507] Master 127.3.28.254:32975 requested a full tablet report, sending...
I20260812 06:37:37.658675  3232 ts_manager.cc:194] Registered new tserver with Master: e3c2253bb2e64cfc82b9f0c9f41c948f (127.3.28.195:41179)
I20260812 06:37:37.659366  3232 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37532
I20260812 06:37:37.659626  3187 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.007056418s
I20260812 06:37:37.686673  3232 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37576:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260812 06:37:37.687979  3232 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:37:37.701732  3526 tablet_service.cc:1511] Processing CreateTablet for tablet 11076e13df5649879f55117427940d3a (DEFAULT_TABLE table=test-workload [id=6d5b61662ea942769802ad963433e891]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:37:37.702200  3526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11076e13df5649879f55117427940d3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:37.702466  3395 tablet_service.cc:1511] Processing CreateTablet for tablet 11076e13df5649879f55117427940d3a (DEFAULT_TABLE table=test-workload [id=6d5b61662ea942769802ad963433e891]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:37:37.702736  3395 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11076e13df5649879f55117427940d3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:37.702692  3655 tablet_service.cc:1511] Processing CreateTablet for tablet 11076e13df5649879f55117427940d3a (DEFAULT_TABLE table=test-workload [id=6d5b61662ea942769802ad963433e891]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:37:37.702942  3655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11076e13df5649879f55117427940d3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:37.704417  3756 tablet_bootstrap.cc:492] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e: Bootstrap starting.
I20260812 06:37:37.704929  3761 tablet_bootstrap.cc:492] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f: Bootstrap starting.
I20260812 06:37:37.705471  3756 tablet_bootstrap.cc:654] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:37.705760  3761 tablet_bootstrap.cc:654] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:37.706295  3757 tablet_bootstrap.cc:492] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871: Bootstrap starting.
I20260812 06:37:37.706650  3756 tablet_bootstrap.cc:492] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e: No bootstrap required, opened a new log
I20260812 06:37:37.706753  3756 ts_tablet_manager.cc:1403] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e: Time spent bootstrapping tablet: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:37:37.706964  3761 tablet_bootstrap.cc:492] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f: No bootstrap required, opened a new log
I20260812 06:37:37.707034  3761 ts_tablet_manager.cc:1403] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f: Time spent bootstrapping tablet: real 0.002s	user 0.001s	sys 0.001s
I20260812 06:37:37.707096  3757 tablet_bootstrap.cc:654] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:37.707196  3756 raft_consensus.cc:359] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 } } peers { permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 } } peers { permanent_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 41179 } }
I20260812 06:37:37.707310  3756 raft_consensus.cc:385] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:37.707345  3756 raft_consensus.cc:740] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7ddeeaa5caab4672b6aaff6de27e3f8e, State: Initialized, Role: FOLLOWER
I20260812 06:37:37.707396  3761 raft_consensus.cc:359] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 } } peers { permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 } } peers { permanent_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 41179 } }
I20260812 06:37:37.707484  3756 consensus_queue.cc:260] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 } } peers { permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 } } peers { permanent_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 41179 } }
I20260812 06:37:37.707487  3761 raft_consensus.cc:385] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:37.707592  3761 raft_consensus.cc:740] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e3c2253bb2e64cfc82b9f0c9f41c948f, State: Initialized, Role: FOLLOWER
I20260812 06:37:37.707723  3761 consensus_queue.cc:260] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 } } peers { permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 } } peers { permanent_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 41179 } }
I20260812 06:37:37.707890  3756 ts_tablet_manager.cc:1434] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e: Time spent starting tablet: real 0.001s	user 0.001s	sys 0.000s
I20260812 06:37:37.708029  3761 ts_tablet_manager.cc:1434] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.001s
I20260812 06:37:37.708055  3757 tablet_bootstrap.cc:492] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871: No bootstrap required, opened a new log
I20260812 06:37:37.708153  3757 ts_tablet_manager.cc:1403] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871: Time spent bootstrapping tablet: real 0.002s	user 0.001s	sys 0.000s
I20260812 06:37:37.708154  3723 heartbeater.cc:499] Master 127.3.28.254:32975 was elected leader, sending a full tablet report...
I20260812 06:37:37.708493  3757 raft_consensus.cc:359] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 } } peers { permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 } } peers { permanent_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 41179 } }
I20260812 06:37:37.708606  3757 raft_consensus.cc:385] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:37.708652  3757 raft_consensus.cc:740] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ef773995fe444dd8de3e1000823a871, State: Initialized, Role: FOLLOWER
I20260812 06:37:37.708798  3757 consensus_queue.cc:260] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 } } peers { permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 } } peers { permanent_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 41179 } }
I20260812 06:37:37.708071  3594 heartbeater.cc:499] Master 127.3.28.254:32975 was elected leader, sending a full tablet report...
I20260812 06:37:37.709193  3757 ts_tablet_manager.cc:1434] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871: Time spent starting tablet: real 0.001s	user 0.001s	sys 0.000s
I20260812 06:37:37.709233  3458 heartbeater.cc:499] Master 127.3.28.254:32975 was elected leader, sending a full tablet report...
I20260812 06:37:37.713122  3769 raft_consensus.cc:493] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:37:37.713225  3769 raft_consensus.cc:515] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 } } peers { permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 } } peers { permanent_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 41179 } }
I20260812 06:37:37.714092  3769 leader_election.cc:290] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7ddeeaa5caab4672b6aaff6de27e3f8e (127.3.28.194:32899), 0ef773995fe444dd8de3e1000823a871 (127.3.28.193:33201)
I20260812 06:37:37.718155  3543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11076e13df5649879f55117427940d3a" candidate_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" is_pre_election: true
I20260812 06:37:37.718303  3411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11076e13df5649879f55117427940d3a" candidate_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ef773995fe444dd8de3e1000823a871" is_pre_election: true
I20260812 06:37:37.718384  3543 raft_consensus.cc:2468] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3c2253bb2e64cfc82b9f0c9f41c948f in term 0.
I20260812 06:37:37.718462  3411 raft_consensus.cc:2468] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3c2253bb2e64cfc82b9f0c9f41c948f in term 0.
I20260812 06:37:37.718809  3614 leader_election.cc:304] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7ddeeaa5caab4672b6aaff6de27e3f8e, e3c2253bb2e64cfc82b9f0c9f41c948f; no voters: 
I20260812 06:37:37.719024  3769 raft_consensus.cc:2804] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:37:37.719097  3769 raft_consensus.cc:493] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:37:37.719137  3769 raft_consensus.cc:3060] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:37.719962  3769 raft_consensus.cc:515] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 } } peers { permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 } } peers { permanent_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 41179 } }
I20260812 06:37:37.720364  3769 leader_election.cc:290] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [CANDIDATE]: Term 1 election: Requested vote from peers 7ddeeaa5caab4672b6aaff6de27e3f8e (127.3.28.194:32899), 0ef773995fe444dd8de3e1000823a871 (127.3.28.193:33201)
I20260812 06:37:37.720687  3411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11076e13df5649879f55117427940d3a" candidate_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ef773995fe444dd8de3e1000823a871"
I20260812 06:37:37.720703  3543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11076e13df5649879f55117427940d3a" candidate_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e"
I20260812 06:37:37.720846  3411 raft_consensus.cc:3060] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:37.720888  3543 raft_consensus.cc:3060] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:37.721640  3411 raft_consensus.cc:2468] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3c2253bb2e64cfc82b9f0c9f41c948f in term 1.
I20260812 06:37:37.721927  3614 leader_election.cc:304] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ef773995fe444dd8de3e1000823a871, e3c2253bb2e64cfc82b9f0c9f41c948f; no voters: 
I20260812 06:37:37.721961  3543 raft_consensus.cc:2468] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3c2253bb2e64cfc82b9f0c9f41c948f in term 1.
I20260812 06:37:37.722124  3769 raft_consensus.cc:2804] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:37:37.722481  3769 raft_consensus.cc:697] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [term 1 LEADER]: Becoming Leader. State: Replica: e3c2253bb2e64cfc82b9f0c9f41c948f, State: Running, Role: LEADER
I20260812 06:37:37.722669  3769 consensus_queue.cc:237] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 } } peers { permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 } } peers { permanent_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 41179 } }
I20260812 06:37:37.724597  3232 catalog_manager.cc:5719] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f reported cstate change: term changed from 0 to 1, leader changed from <none> to e3c2253bb2e64cfc82b9f0c9f41c948f (127.3.28.195). New cstate: current_term: 1 leader_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 41179 } health_report { overall_health: HEALTHY } } }
I20260812 06:37:37.741648  3411 raft_consensus.cc:1275] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 1 FOLLOWER]: Refusing update from remote peer e3c2253bb2e64cfc82b9f0c9f41c948f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:37:37.741648  3543 raft_consensus.cc:1275] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 1 FOLLOWER]: Refusing update from remote peer e3c2253bb2e64cfc82b9f0c9f41c948f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:37:37.742216  3769 consensus_queue.cc:1048] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:37:37.742405  3773 consensus_queue.cc:1048] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:37:37.812263  3187 test_workload.cc:405] TestWorkload: Skipping table creation because table test-workload already exists
I20260812 06:37:38.059623  3767 raft_consensus.cc:493] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 1 FOLLOWER]: Starting leader election (detected failure of leader e3c2253bb2e64cfc82b9f0c9f41c948f)
I20260812 06:37:38.059793  3767 raft_consensus.cc:3060] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 1 FOLLOWER]: Advancing to term 2
I20260812 06:37:38.060938  3767 raft_consensus.cc:515] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 } } peers { permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 } } peers { permanent_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 41179 } }
I20260812 06:37:38.061578  3767 leader_election.cc:290] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [CANDIDATE]: Term 2 election: Requested vote from peers 0ef773995fe444dd8de3e1000823a871 (127.3.28.193:33201), e3c2253bb2e64cfc82b9f0c9f41c948f (127.3.28.195:41179)
I20260812 06:37:38.065155  3411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11076e13df5649879f55117427940d3a" candidate_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 39 } } ignore_live_leader: false dest_uuid: "0ef773995fe444dd8de3e1000823a871"
I20260812 06:37:38.065290  3679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11076e13df5649879f55117427940d3a" candidate_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" candidate_term: 2 candidate_status { last_received { term: 1 index: 39 } } ignore_live_leader: false dest_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f"
I20260812 06:37:38.065326  3411 raft_consensus.cc:3060] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 1 FOLLOWER]: Advancing to term 2
I20260812 06:37:38.066258  3411 raft_consensus.cc:2468] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ddeeaa5caab4672b6aaff6de27e3f8e in term 2.
I20260812 06:37:38.066665  3489 leader_election.cc:304] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ef773995fe444dd8de3e1000823a871, 7ddeeaa5caab4672b6aaff6de27e3f8e; no voters: e3c2253bb2e64cfc82b9f0c9f41c948f
I20260812 06:37:38.066737  3542 raft_consensus.cc:1240] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 2 FOLLOWER]: Rejecting Update request from peer e3c2253bb2e64cfc82b9f0c9f41c948f for earlier term 1. Current term is 2. Ops: []
I20260812 06:37:38.066913  3767 raft_consensus.cc:2804] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 2 FOLLOWER]: Leader election won for term 2
I20260812 06:37:38.067186  3825 consensus_queue.cc:1059] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 }, Status: INVALID_TERM, Last received: 1.39, Next index: 40, Last known committed idx: 39, Time since last communication: 0.000s
I20260812 06:37:38.067238  3767 raft_consensus.cc:697] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 2 LEADER]: Becoming Leader. State: Replica: 7ddeeaa5caab4672b6aaff6de27e3f8e, State: Running, Role: LEADER
W20260812 06:37:38.067451  3825 fault_injection.cc:43] FAULT INJECTION ENABLED!
W20260812 06:37:38.067516  3825 fault_injection.cc:44] THIS SERVER MAY CRASH!
I20260812 06:37:38.067493  3767 consensus_queue.cc:237] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 39, Committed index: 39, Last appended: 1.39, Last appended by leader: 39, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 } } peers { permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 } } peers { permanent_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 41179 } }
I20260812 06:37:38.069340  3225 catalog_manager.cc:5719] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e reported cstate change: term changed from 1 to 2, leader changed from e3c2253bb2e64cfc82b9f0c9f41c948f (127.3.28.195) to 7ddeeaa5caab4672b6aaff6de27e3f8e (127.3.28.194). New cstate: current_term: 2 leader_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260812 06:37:38.070573  3411 raft_consensus.cc:1240] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 2 FOLLOWER]: Rejecting Update request from peer e3c2253bb2e64cfc82b9f0c9f41c948f for earlier term 1. Current term is 2. Ops: []
I20260812 06:37:38.071026  3769 consensus_queue.cc:1059] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 }, Status: INVALID_TERM, Last received: 1.39, Next index: 40, Last known committed idx: 39, Time since last communication: 0.000s
I20260812 06:37:38.130702  3825 raft_consensus.cc:3055] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [term 1 LEADER]: Stepping down as leader of term 1
I20260812 06:37:38.130867  3825 raft_consensus.cc:740] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e3c2253bb2e64cfc82b9f0c9f41c948f, State: Running, Role: LEADER
I20260812 06:37:38.131151  3825 consensus_queue.cc:260] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 39, Committed index: 39, Last appended: 1.39, Last appended by leader: 39, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 } } peers { permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 } } peers { permanent_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 41179 } }
I20260812 06:37:38.131542  3825 raft_consensus.cc:3060] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [term 1 FOLLOWER]: Advancing to term 2
I20260812 06:37:38.172231  3411 raft_consensus.cc:1275] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 2 FOLLOWER]: Refusing update from remote peer 7ddeeaa5caab4672b6aaff6de27e3f8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 39. Preceding OpId from leader: term: 2 index: 40. (index mismatch)
I20260812 06:37:38.172765  3767 consensus_queue.cc:1048] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 40, Last known committed idx: 39, Time since last communication: 0.000s
I20260812 06:37:38.179054  3679 raft_consensus.cc:1275] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [term 2 FOLLOWER]: Refusing update from remote peer 7ddeeaa5caab4672b6aaff6de27e3f8e: Log matching property violated. Preceding OpId in replica: term: 1 index: 39. Preceding OpId from leader: term: 2 index: 40. (index mismatch)
I20260812 06:37:38.179575  3767 consensus_queue.cc:1048] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 40, Last known committed idx: 39, Time since last communication: 0.000s
I20260812 06:37:38.276316  3770 raft_consensus.cc:493] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7ddeeaa5caab4672b6aaff6de27e3f8e)
I20260812 06:37:38.276472  3770 raft_consensus.cc:3060] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 2 FOLLOWER]: Advancing to term 3
I20260812 06:37:38.277545  3770 raft_consensus.cc:515] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 } } peers { permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 } } peers { permanent_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 41179 } }
I20260812 06:37:38.278062  3770 leader_election.cc:290] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [CANDIDATE]: Term 3 election: Requested vote from peers 7ddeeaa5caab4672b6aaff6de27e3f8e (127.3.28.194:32899), e3c2253bb2e64cfc82b9f0c9f41c948f (127.3.28.195:41179)
I20260812 06:37:38.281661  3679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11076e13df5649879f55117427940d3a" candidate_uuid: "0ef773995fe444dd8de3e1000823a871" candidate_term: 3 candidate_status { last_received { term: 2 index: 40 } } ignore_live_leader: false dest_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f"
I20260812 06:37:38.281853  3542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11076e13df5649879f55117427940d3a" candidate_uuid: "0ef773995fe444dd8de3e1000823a871" candidate_term: 3 candidate_status { last_received { term: 2 index: 40 } } ignore_live_leader: false dest_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e"
I20260812 06:37:38.282234  3353 leader_election.cc:304] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ef773995fe444dd8de3e1000823a871; no voters: 7ddeeaa5caab4672b6aaff6de27e3f8e, e3c2253bb2e64cfc82b9f0c9f41c948f
I20260812 06:37:38.282426  3770 raft_consensus.cc:2749] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260812 06:37:38.288646  3411 raft_consensus.cc:1240] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 3 FOLLOWER]: Rejecting Update request from peer 7ddeeaa5caab4672b6aaff6de27e3f8e for earlier term 2. Current term is 3. Ops: []
I20260812 06:37:38.289070  3767 consensus_queue.cc:1059] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 }, Status: INVALID_TERM, Last received: 2.40, Next index: 41, Last known committed idx: 40, Time since last communication: 0.000s
I20260812 06:37:38.393986  3767 raft_consensus.cc:3055] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 2 LEADER]: Stepping down as leader of term 2
I20260812 06:37:38.394119  3767 raft_consensus.cc:740] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7ddeeaa5caab4672b6aaff6de27e3f8e, State: Running, Role: LEADER
I20260812 06:37:38.394351  3767 consensus_queue.cc:260] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 40, Committed index: 40, Last appended: 2.40, Last appended by leader: 40, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 } } peers { permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 } } peers { permanent_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 41179 } }
I20260812 06:37:38.394680  3767 raft_consensus.cc:3060] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 2 FOLLOWER]: Advancing to term 3
I20260812 06:37:38.431139  3770 raft_consensus.cc:493] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:37:38.431283  3770 raft_consensus.cc:3060] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 3 FOLLOWER]: Advancing to term 4
I20260812 06:37:38.432300  3770 raft_consensus.cc:515] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 } } peers { permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 } } peers { permanent_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 41179 } }
I20260812 06:37:38.432770  3770 leader_election.cc:290] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [CANDIDATE]: Term 4 election: Requested vote from peers 7ddeeaa5caab4672b6aaff6de27e3f8e (127.3.28.194:32899), e3c2253bb2e64cfc82b9f0c9f41c948f (127.3.28.195:41179)
I20260812 06:37:38.433233  3542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11076e13df5649879f55117427940d3a" candidate_uuid: "0ef773995fe444dd8de3e1000823a871" candidate_term: 4 candidate_status { last_received { term: 2 index: 40 } } ignore_live_leader: false dest_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e"
I20260812 06:37:38.433231  3679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11076e13df5649879f55117427940d3a" candidate_uuid: "0ef773995fe444dd8de3e1000823a871" candidate_term: 4 candidate_status { last_received { term: 2 index: 40 } } ignore_live_leader: false dest_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f"
I20260812 06:37:38.433363  3542 raft_consensus.cc:3060] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 3 FOLLOWER]: Advancing to term 4
I20260812 06:37:38.434255  3542 raft_consensus.cc:2468] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ef773995fe444dd8de3e1000823a871 in term 4.
I20260812 06:37:38.434662  3353 leader_election.cc:304] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ef773995fe444dd8de3e1000823a871, 7ddeeaa5caab4672b6aaff6de27e3f8e; no voters: e3c2253bb2e64cfc82b9f0c9f41c948f
I20260812 06:37:38.434913  3770 raft_consensus.cc:2804] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 4 FOLLOWER]: Leader election won for term 4
I20260812 06:37:38.435099  3770 raft_consensus.cc:697] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 4 LEADER]: Becoming Leader. State: Replica: 0ef773995fe444dd8de3e1000823a871, State: Running, Role: LEADER
I20260812 06:37:38.435276  3770 consensus_queue.cc:237] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 40, Committed index: 40, Last appended: 2.40, Last appended by leader: 40, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 } } peers { permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 } } peers { permanent_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 41179 } }
I20260812 06:37:38.436810  3225 catalog_manager.cc:5719] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 reported cstate change: term changed from 2 to 4, leader changed from 7ddeeaa5caab4672b6aaff6de27e3f8e (127.3.28.194) to 0ef773995fe444dd8de3e1000823a871 (127.3.28.193). New cstate: current_term: 4 leader_uuid: "0ef773995fe444dd8de3e1000823a871" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260812 06:37:38.443929  3825 raft_consensus.cc:493] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 7ddeeaa5caab4672b6aaff6de27e3f8e)
I20260812 06:37:38.444015  3825 raft_consensus.cc:3060] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [term 2 FOLLOWER]: Advancing to term 3
I20260812 06:37:38.444891  3825 raft_consensus.cc:515] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 } } peers { permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 } } peers { permanent_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 41179 } }
I20260812 06:37:38.445283  3825 leader_election.cc:290] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [CANDIDATE]: Term 3 election: Requested vote from peers 7ddeeaa5caab4672b6aaff6de27e3f8e (127.3.28.194:32899), 0ef773995fe444dd8de3e1000823a871 (127.3.28.193:33201)
I20260812 06:37:38.445796  3411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11076e13df5649879f55117427940d3a" candidate_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" candidate_term: 3 candidate_status { last_received { term: 2 index: 40 } } ignore_live_leader: false dest_uuid: "0ef773995fe444dd8de3e1000823a871"
I20260812 06:37:38.445801  3542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11076e13df5649879f55117427940d3a" candidate_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" candidate_term: 3 candidate_status { last_received { term: 2 index: 40 } } ignore_live_leader: false dest_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e"
I20260812 06:37:38.445964  3542 raft_consensus.cc:2368] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e3c2253bb2e64cfc82b9f0c9f41c948f for earlier term 3. Current term is 4.
I20260812 06:37:38.446465  3614 leader_election.cc:400] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [CANDIDATE]: Term 3 election: Vote denied by peer 7ddeeaa5caab4672b6aaff6de27e3f8e (127.3.28.194:32899) with higher term. Message: Invalid argument: T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e3c2253bb2e64cfc82b9f0c9f41c948f for earlier term 3. Current term is 4.
I20260812 06:37:38.446520  3614 leader_election.cc:403] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260812 06:37:38.446662  3825 raft_consensus.cc:3060] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [term 3 FOLLOWER]: Advancing to term 4
I20260812 06:37:38.447453  3825 raft_consensus.cc:2749] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 7ddeeaa5caab4672b6aaff6de27e3f8e (127.3.28.194:32899) with higher term. Message: Invalid argument: T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e3c2253bb2e64cfc82b9f0c9f41c948f for earlier term 3. Current term is 4.
I20260812 06:37:38.549839  3542 raft_consensus.cc:1275] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 4 FOLLOWER]: Refusing update from remote peer 0ef773995fe444dd8de3e1000823a871: Log matching property violated. Preceding OpId in replica: term: 2 index: 40. Preceding OpId from leader: term: 4 index: 41. (index mismatch)
I20260812 06:37:38.550550  3770 consensus_queue.cc:1048] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 41, Last known committed idx: 40, Time since last communication: 0.000s
I20260812 06:37:38.553824  3679 raft_consensus.cc:1275] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [term 4 FOLLOWER]: Refusing update from remote peer 0ef773995fe444dd8de3e1000823a871: Log matching property violated. Preceding OpId in replica: term: 2 index: 40. Preceding OpId from leader: term: 4 index: 41. (index mismatch)
I20260812 06:37:38.554248  3838 consensus_queue.cc:1048] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 41, Last known committed idx: 40, Time since last communication: 0.000s
I20260812 06:37:38.751470  3767 raft_consensus.cc:493] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0ef773995fe444dd8de3e1000823a871)
I20260812 06:37:38.751634  3767 raft_consensus.cc:3060] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 4 FOLLOWER]: Advancing to term 5
I20260812 06:37:38.752692  3767 raft_consensus.cc:515] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 } } peers { permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 } } peers { permanent_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 41179 } }
I20260812 06:37:38.753116  3767 leader_election.cc:290] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [CANDIDATE]: Term 5 election: Requested vote from peers 0ef773995fe444dd8de3e1000823a871 (127.3.28.193:33201), e3c2253bb2e64cfc82b9f0c9f41c948f (127.3.28.195:41179)
I20260812 06:37:38.753656  3679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11076e13df5649879f55117427940d3a" candidate_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" candidate_term: 5 candidate_status { last_received { term: 4 index: 41 } } ignore_live_leader: false dest_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f"
I20260812 06:37:38.753664  3411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11076e13df5649879f55117427940d3a" candidate_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" candidate_term: 5 candidate_status { last_received { term: 4 index: 41 } } ignore_live_leader: false dest_uuid: "0ef773995fe444dd8de3e1000823a871"
I20260812 06:37:38.754196  3485 leader_election.cc:304] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ddeeaa5caab4672b6aaff6de27e3f8e; no voters: 0ef773995fe444dd8de3e1000823a871, e3c2253bb2e64cfc82b9f0c9f41c948f
I20260812 06:37:38.754457  3767 raft_consensus.cc:2749] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260812 06:37:38.759657  3542 raft_consensus.cc:1240] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 5 FOLLOWER]: Rejecting Update request from peer 0ef773995fe444dd8de3e1000823a871 for earlier term 4. Current term is 5. Ops: []
I20260812 06:37:38.760154  3770 consensus_queue.cc:1059] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 }, Status: INVALID_TERM, Last received: 4.41, Next index: 42, Last known committed idx: 41, Time since last communication: 0.000s
I20260812 06:37:38.787474  3838 raft_consensus.cc:3055] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 4 LEADER]: Stepping down as leader of term 4
I20260812 06:37:38.787609  3838 raft_consensus.cc:740] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0ef773995fe444dd8de3e1000823a871, State: Running, Role: LEADER
I20260812 06:37:38.787847  3838 consensus_queue.cc:260] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 41, Committed index: 41, Last appended: 4.41, Last appended by leader: 41, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 } } peers { permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 } } peers { permanent_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 41179 } }
I20260812 06:37:38.788058  3838 raft_consensus.cc:3060] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 4 FOLLOWER]: Advancing to term 5
I20260812 06:37:38.816020  3825 raft_consensus.cc:493] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0ef773995fe444dd8de3e1000823a871)
I20260812 06:37:38.816169  3825 raft_consensus.cc:3060] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [term 4 FOLLOWER]: Advancing to term 5
I20260812 06:37:38.817181  3825 raft_consensus.cc:515] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 } } peers { permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 } } peers { permanent_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 41179 } }
I20260812 06:37:38.817656  3825 leader_election.cc:290] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [CANDIDATE]: Term 5 election: Requested vote from peers 7ddeeaa5caab4672b6aaff6de27e3f8e (127.3.28.194:32899), 0ef773995fe444dd8de3e1000823a871 (127.3.28.193:33201)
I20260812 06:37:38.818251  3411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11076e13df5649879f55117427940d3a" candidate_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" candidate_term: 5 candidate_status { last_received { term: 4 index: 41 } } ignore_live_leader: false dest_uuid: "0ef773995fe444dd8de3e1000823a871"
I20260812 06:37:38.818259  3542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11076e13df5649879f55117427940d3a" candidate_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" candidate_term: 5 candidate_status { last_received { term: 4 index: 41 } } ignore_live_leader: false dest_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e"
I20260812 06:37:38.818596  3542 raft_consensus.cc:2393] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e3c2253bb2e64cfc82b9f0c9f41c948f in current term 5: Already voted for candidate 7ddeeaa5caab4672b6aaff6de27e3f8e in this term.
I20260812 06:37:38.819499  3411 raft_consensus.cc:2468] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3c2253bb2e64cfc82b9f0c9f41c948f in term 5.
I20260812 06:37:38.819844  3614 leader_election.cc:304] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ef773995fe444dd8de3e1000823a871, e3c2253bb2e64cfc82b9f0c9f41c948f; no voters: 7ddeeaa5caab4672b6aaff6de27e3f8e
I20260812 06:37:38.820084  3825 raft_consensus.cc:2804] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [term 5 FOLLOWER]: Leader election won for term 5
I20260812 06:37:38.820274  3825 raft_consensus.cc:697] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [term 5 LEADER]: Becoming Leader. State: Replica: e3c2253bb2e64cfc82b9f0c9f41c948f, State: Running, Role: LEADER
I20260812 06:37:38.820447  3825 consensus_queue.cc:237] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 41, Committed index: 41, Last appended: 4.41, Last appended by leader: 41, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 } } peers { permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 } } peers { permanent_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 41179 } }
I20260812 06:37:38.822160  3225 catalog_manager.cc:5719] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f reported cstate change: term changed from 4 to 5, leader changed from 0ef773995fe444dd8de3e1000823a871 (127.3.28.193) to e3c2253bb2e64cfc82b9f0c9f41c948f (127.3.28.195). New cstate: current_term: 5 leader_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 41179 } health_report { overall_health: HEALTHY } } }
I20260812 06:37:38.880234  3767 raft_consensus.cc:493] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:37:38.880465  3767 raft_consensus.cc:3060] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 5 FOLLOWER]: Advancing to term 6
I20260812 06:37:38.881633  3767 raft_consensus.cc:515] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 } } peers { permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 } } peers { permanent_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 41179 } }
I20260812 06:37:38.882184  3767 leader_election.cc:290] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [CANDIDATE]: Term 6 election: Requested vote from peers 0ef773995fe444dd8de3e1000823a871 (127.3.28.193:33201), e3c2253bb2e64cfc82b9f0c9f41c948f (127.3.28.195:41179)
I20260812 06:37:38.882798  3679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11076e13df5649879f55117427940d3a" candidate_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" candidate_term: 6 candidate_status { last_received { term: 4 index: 41 } } ignore_live_leader: false dest_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f"
I20260812 06:37:38.882809  3411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11076e13df5649879f55117427940d3a" candidate_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" candidate_term: 6 candidate_status { last_received { term: 4 index: 41 } } ignore_live_leader: false dest_uuid: "0ef773995fe444dd8de3e1000823a871"
I20260812 06:37:38.883005  3411 raft_consensus.cc:3060] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 5 FOLLOWER]: Advancing to term 6
I20260812 06:37:38.883960  3411 raft_consensus.cc:2468] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ddeeaa5caab4672b6aaff6de27e3f8e in term 6.
I20260812 06:37:38.884413  3489 leader_election.cc:304] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ef773995fe444dd8de3e1000823a871, 7ddeeaa5caab4672b6aaff6de27e3f8e; no voters: e3c2253bb2e64cfc82b9f0c9f41c948f
I20260812 06:37:38.884651  3767 raft_consensus.cc:2804] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 6 FOLLOWER]: Leader election won for term 6
I20260812 06:37:38.884831  3767 raft_consensus.cc:697] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 6 LEADER]: Becoming Leader. State: Replica: 7ddeeaa5caab4672b6aaff6de27e3f8e, State: Running, Role: LEADER
I20260812 06:37:38.885030  3767 consensus_queue.cc:237] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 41, Committed index: 41, Last appended: 4.41, Last appended by leader: 41, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 } } peers { permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 } } peers { permanent_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 41179 } }
I20260812 06:37:38.886708  3225 catalog_manager.cc:5719] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e reported cstate change: term changed from 5 to 6, leader changed from e3c2253bb2e64cfc82b9f0c9f41c948f (127.3.28.195) to 7ddeeaa5caab4672b6aaff6de27e3f8e (127.3.28.194). New cstate: current_term: 6 leader_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260812 06:37:38.905319  3411 raft_consensus.cc:1240] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 6 FOLLOWER]: Rejecting Update request from peer e3c2253bb2e64cfc82b9f0c9f41c948f for earlier term 5. Current term is 6. Ops: []
I20260812 06:37:38.905973  3825 consensus_queue.cc:1059] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 }, Status: INVALID_TERM, Last received: 0.0, Next index: 42, Last known committed idx: 41, Time since last communication: 0.000s
I20260812 06:37:38.913718  3542 raft_consensus.cc:1240] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 6 LEADER]: Rejecting Update request from peer e3c2253bb2e64cfc82b9f0c9f41c948f for earlier term 5. Current term is 6. Ops: []
I20260812 06:37:38.914202  3839 consensus_queue.cc:1059] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 }, Status: INVALID_TERM, Last received: 0.0, Next index: 42, Last known committed idx: 41, Time since last communication: 0.000s
I20260812 06:37:38.914434  3839 consensus_queue.cc:1243] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [LEADER]: Peer 7ddeeaa5caab4672b6aaff6de27e3f8e log is divergent from this leader: its last log entry 6.42 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 41
I20260812 06:37:38.949380  3825 raft_consensus.cc:3055] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [term 5 LEADER]: Stepping down as leader of term 5
I20260812 06:37:38.949508  3825 raft_consensus.cc:740] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e3c2253bb2e64cfc82b9f0c9f41c948f, State: Running, Role: LEADER
I20260812 06:37:38.949769  3825 consensus_queue.cc:260] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 41, Committed index: 41, Last appended: 5.42, Last appended by leader: 42, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 } } peers { permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 } } peers { permanent_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 41179 } }
I20260812 06:37:38.950044  3825 raft_consensus.cc:3060] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [term 5 FOLLOWER]: Advancing to term 6
I20260812 06:37:38.970777  3411 raft_consensus.cc:1275] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 6 FOLLOWER]: Refusing update from remote peer 7ddeeaa5caab4672b6aaff6de27e3f8e: Log matching property violated. Preceding OpId in replica: term: 4 index: 41. Preceding OpId from leader: term: 6 index: 42. (index mismatch)
I20260812 06:37:38.971307  3767 consensus_queue.cc:1048] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 42, Last known committed idx: 41, Time since last communication: 0.000s
I20260812 06:37:39.009631  3679 raft_consensus.cc:1275] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [term 6 FOLLOWER]: Refusing update from remote peer 7ddeeaa5caab4672b6aaff6de27e3f8e: Log matching property violated. Preceding OpId in replica: term: 5 index: 42. Preceding OpId from leader: term: 6 index: 42. (term mismatch)
I20260812 06:37:39.009795  3679 pending_rounds.cc:85] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f: Aborting all ops after (but not including) 41
I20260812 06:37:39.009866  3679 pending_rounds.cc:107] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f: Aborting uncommitted NO_OP operation due to leader change: 5.42
I20260812 06:37:39.009945  3679 raft_consensus.cc:2889] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 06:37:39.010648  3767 consensus_queue.cc:1048] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 42, Last known committed idx: 41, Time since last communication: 0.000s
I20260812 06:37:39.210652  3825 raft_consensus.cc:493] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7ddeeaa5caab4672b6aaff6de27e3f8e)
I20260812 06:37:39.210834  3825 raft_consensus.cc:3060] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [term 6 FOLLOWER]: Advancing to term 7
I20260812 06:37:39.211934  3825 raft_consensus.cc:515] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 } } peers { permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 } } peers { permanent_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 41179 } }
I20260812 06:37:39.212400  3825 leader_election.cc:290] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [CANDIDATE]: Term 7 election: Requested vote from peers 7ddeeaa5caab4672b6aaff6de27e3f8e (127.3.28.194:32899), 0ef773995fe444dd8de3e1000823a871 (127.3.28.193:33201)
I20260812 06:37:39.213038  3542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11076e13df5649879f55117427940d3a" candidate_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" candidate_term: 7 candidate_status { last_received { term: 6 index: 42 } } ignore_live_leader: false dest_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e"
I20260812 06:37:39.213094  3411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11076e13df5649879f55117427940d3a" candidate_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" candidate_term: 7 candidate_status { last_received { term: 6 index: 42 } } ignore_live_leader: false dest_uuid: "0ef773995fe444dd8de3e1000823a871"
I20260812 06:37:39.213603  3614 leader_election.cc:304] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3c2253bb2e64cfc82b9f0c9f41c948f; no voters: 0ef773995fe444dd8de3e1000823a871, 7ddeeaa5caab4672b6aaff6de27e3f8e
I20260812 06:37:39.213840  3825 raft_consensus.cc:2749] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260812 06:37:39.227630  3679 raft_consensus.cc:1240] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [term 7 FOLLOWER]: Rejecting Update request from peer 7ddeeaa5caab4672b6aaff6de27e3f8e for earlier term 6. Current term is 7. Ops: []
I20260812 06:37:39.228140  3841 consensus_queue.cc:1059] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 41179 }, Status: INVALID_TERM, Last received: 6.42, Next index: 43, Last known committed idx: 42, Time since last communication: 0.000s
I20260812 06:37:39.282511  3840 raft_consensus.cc:3055] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 6 LEADER]: Stepping down as leader of term 6
I20260812 06:37:39.282707  3840 raft_consensus.cc:740] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 7ddeeaa5caab4672b6aaff6de27e3f8e, State: Running, Role: LEADER
I20260812 06:37:39.283030  3840 consensus_queue.cc:260] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 42, Committed index: 42, Last appended: 6.42, Last appended by leader: 42, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 } } peers { permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 } } peers { permanent_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 41179 } }
I20260812 06:37:39.283327  3840 raft_consensus.cc:3060] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 6 FOLLOWER]: Advancing to term 7
I20260812 06:37:39.324528  3825 raft_consensus.cc:493] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:37:39.324677  3825 raft_consensus.cc:3060] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [term 7 FOLLOWER]: Advancing to term 8
I20260812 06:37:39.325632  3825 raft_consensus.cc:515] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 } } peers { permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 } } peers { permanent_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 41179 } }
I20260812 06:37:39.326050  3825 leader_election.cc:290] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [CANDIDATE]: Term 8 election: Requested vote from peers 7ddeeaa5caab4672b6aaff6de27e3f8e (127.3.28.194:32899), 0ef773995fe444dd8de3e1000823a871 (127.3.28.193:33201)
I20260812 06:37:39.326647  3542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11076e13df5649879f55117427940d3a" candidate_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" candidate_term: 8 candidate_status { last_received { term: 6 index: 42 } } ignore_live_leader: false dest_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e"
I20260812 06:37:39.326812  3542 raft_consensus.cc:3060] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 7 FOLLOWER]: Advancing to term 8
I20260812 06:37:39.326763  3411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11076e13df5649879f55117427940d3a" candidate_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" candidate_term: 8 candidate_status { last_received { term: 6 index: 42 } } ignore_live_leader: false dest_uuid: "0ef773995fe444dd8de3e1000823a871"
I20260812 06:37:39.327885  3542 raft_consensus.cc:2468] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3c2253bb2e64cfc82b9f0c9f41c948f in term 8.
I20260812 06:37:39.328325  3614 leader_election.cc:304] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ddeeaa5caab4672b6aaff6de27e3f8e, e3c2253bb2e64cfc82b9f0c9f41c948f; no voters: 0ef773995fe444dd8de3e1000823a871
I20260812 06:37:39.328552  3825 raft_consensus.cc:2804] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [term 8 FOLLOWER]: Leader election won for term 8
I20260812 06:37:39.328671  3825 raft_consensus.cc:697] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [term 8 LEADER]: Becoming Leader. State: Replica: e3c2253bb2e64cfc82b9f0c9f41c948f, State: Running, Role: LEADER
I20260812 06:37:39.328867  3825 consensus_queue.cc:237] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 42, Committed index: 42, Last appended: 6.42, Last appended by leader: 42, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 } } peers { permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 } } peers { permanent_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 41179 } }
I20260812 06:37:39.330547  3225 catalog_manager.cc:5719] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f reported cstate change: term changed from 6 to 8, leader changed from 7ddeeaa5caab4672b6aaff6de27e3f8e (127.3.28.194) to e3c2253bb2e64cfc82b9f0c9f41c948f (127.3.28.195). New cstate: current_term: 8 leader_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 41179 } health_report { overall_health: HEALTHY } } }
I20260812 06:37:39.349920  3838 raft_consensus.cc:493] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 7ddeeaa5caab4672b6aaff6de27e3f8e)
I20260812 06:37:39.350066  3838 raft_consensus.cc:3060] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 6 FOLLOWER]: Advancing to term 7
I20260812 06:37:39.351173  3838 raft_consensus.cc:515] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 } } peers { permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 } } peers { permanent_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 41179 } }
I20260812 06:37:39.351594  3838 leader_election.cc:290] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [CANDIDATE]: Term 7 election: Requested vote from peers 7ddeeaa5caab4672b6aaff6de27e3f8e (127.3.28.194:32899), e3c2253bb2e64cfc82b9f0c9f41c948f (127.3.28.195:41179)
I20260812 06:37:39.352100  3679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11076e13df5649879f55117427940d3a" candidate_uuid: "0ef773995fe444dd8de3e1000823a871" candidate_term: 7 candidate_status { last_received { term: 6 index: 42 } } ignore_live_leader: false dest_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f"
I20260812 06:37:39.352106  3542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11076e13df5649879f55117427940d3a" candidate_uuid: "0ef773995fe444dd8de3e1000823a871" candidate_term: 7 candidate_status { last_received { term: 6 index: 42 } } ignore_live_leader: false dest_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e"
I20260812 06:37:39.352309  3542 raft_consensus.cc:2368] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ef773995fe444dd8de3e1000823a871 for earlier term 7. Current term is 8.
I20260812 06:37:39.352696  3353 leader_election.cc:400] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [CANDIDATE]: Term 7 election: Vote denied by peer 7ddeeaa5caab4672b6aaff6de27e3f8e (127.3.28.194:32899) with higher term. Message: Invalid argument: T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ef773995fe444dd8de3e1000823a871 for earlier term 7. Current term is 8.
I20260812 06:37:39.352742  3353 leader_election.cc:403] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260812 06:37:39.352905  3838 raft_consensus.cc:3060] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 7 FOLLOWER]: Advancing to term 8
I20260812 06:37:39.353751  3838 raft_consensus.cc:2749] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 7ddeeaa5caab4672b6aaff6de27e3f8e (127.3.28.194:32899) with higher term. Message: Invalid argument: T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ef773995fe444dd8de3e1000823a871 for earlier term 7. Current term is 8.
I20260812 06:37:39.414052  3542 raft_consensus.cc:1275] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 8 FOLLOWER]: Refusing update from remote peer e3c2253bb2e64cfc82b9f0c9f41c948f: Log matching property violated. Preceding OpId in replica: term: 6 index: 42. Preceding OpId from leader: term: 8 index: 43. (index mismatch)
I20260812 06:37:39.414759  3825 consensus_queue.cc:1048] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 43, Last known committed idx: 42, Time since last communication: 0.000s
I20260812 06:37:39.415716  3411 raft_consensus.cc:1275] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 8 FOLLOWER]: Refusing update from remote peer e3c2253bb2e64cfc82b9f0c9f41c948f: Log matching property violated. Preceding OpId in replica: term: 6 index: 42. Preceding OpId from leader: term: 8 index: 43. (index mismatch)
I20260812 06:37:39.416213  3839 consensus_queue.cc:1048] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 43, Last known committed idx: 42, Time since last communication: 0.000s
I20260812 06:37:39.519544  3838 raft_consensus.cc:493] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e3c2253bb2e64cfc82b9f0c9f41c948f)
I20260812 06:37:39.519719  3838 raft_consensus.cc:3060] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 8 FOLLOWER]: Advancing to term 9
I20260812 06:37:39.520685  3838 raft_consensus.cc:515] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 } } peers { permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 } } peers { permanent_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 41179 } }
I20260812 06:37:39.521152  3838 leader_election.cc:290] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [CANDIDATE]: Term 9 election: Requested vote from peers 7ddeeaa5caab4672b6aaff6de27e3f8e (127.3.28.194:32899), e3c2253bb2e64cfc82b9f0c9f41c948f (127.3.28.195:41179)
I20260812 06:37:39.521564  3542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11076e13df5649879f55117427940d3a" candidate_uuid: "0ef773995fe444dd8de3e1000823a871" candidate_term: 9 candidate_status { last_received { term: 8 index: 43 } } ignore_live_leader: false dest_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e"
I20260812 06:37:39.521567  3679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11076e13df5649879f55117427940d3a" candidate_uuid: "0ef773995fe444dd8de3e1000823a871" candidate_term: 9 candidate_status { last_received { term: 8 index: 43 } } ignore_live_leader: false dest_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f"
I20260812 06:37:39.522007  3352 leader_election.cc:304] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ef773995fe444dd8de3e1000823a871; no voters: 7ddeeaa5caab4672b6aaff6de27e3f8e, e3c2253bb2e64cfc82b9f0c9f41c948f
I20260812 06:37:39.522198  3838 raft_consensus.cc:2749] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260812 06:37:39.526026  3411 raft_consensus.cc:1240] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 9 FOLLOWER]: Rejecting Update request from peer e3c2253bb2e64cfc82b9f0c9f41c948f for earlier term 8. Current term is 9. Ops: []
I20260812 06:37:39.526531  3839 consensus_queue.cc:1059] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 }, Status: INVALID_TERM, Last received: 8.43, Next index: 44, Last known committed idx: 43, Time since last communication: 0.000s
I20260812 06:37:39.601675  3411 raft_consensus.cc:1240] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 9 FOLLOWER]: Rejecting Update request from peer e3c2253bb2e64cfc82b9f0c9f41c948f for earlier term 8. Current term is 9. Ops: []
I20260812 06:37:39.602245  3825 consensus_queue.cc:1059] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 }, Status: INVALID_TERM, Last received: 8.43, Next index: 44, Last known committed idx: 43, Time since last communication: 0.000s
I20260812 06:37:39.617254  3840 raft_consensus.cc:493] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 8 FOLLOWER]: Starting leader election (detected failure of leader e3c2253bb2e64cfc82b9f0c9f41c948f)
I20260812 06:37:39.617396  3840 raft_consensus.cc:3060] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 8 FOLLOWER]: Advancing to term 9
I20260812 06:37:39.618467  3840 raft_consensus.cc:515] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 } } peers { permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 } } peers { permanent_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 41179 } }
I20260812 06:37:39.618908  3840 leader_election.cc:290] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [CANDIDATE]: Term 9 election: Requested vote from peers 0ef773995fe444dd8de3e1000823a871 (127.3.28.193:33201), e3c2253bb2e64cfc82b9f0c9f41c948f (127.3.28.195:41179)
I20260812 06:37:39.619496  3679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11076e13df5649879f55117427940d3a" candidate_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" candidate_term: 9 candidate_status { last_received { term: 8 index: 43 } } ignore_live_leader: false dest_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f"
I20260812 06:37:39.619496  3411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11076e13df5649879f55117427940d3a" candidate_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" candidate_term: 9 candidate_status { last_received { term: 8 index: 43 } } ignore_live_leader: false dest_uuid: "0ef773995fe444dd8de3e1000823a871"
I20260812 06:37:39.619699  3411 raft_consensus.cc:2393] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 7ddeeaa5caab4672b6aaff6de27e3f8e in current term 9: Already voted for candidate 0ef773995fe444dd8de3e1000823a871 in this term.
I20260812 06:37:39.620078  3489 leader_election.cc:304] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ddeeaa5caab4672b6aaff6de27e3f8e; no voters: 0ef773995fe444dd8de3e1000823a871, e3c2253bb2e64cfc82b9f0c9f41c948f
I20260812 06:37:39.620352  3840 raft_consensus.cc:2749] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260812 06:37:39.635962  3842 raft_consensus.cc:3055] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [term 8 LEADER]: Stepping down as leader of term 8
I20260812 06:37:39.636082  3842 raft_consensus.cc:740] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e3c2253bb2e64cfc82b9f0c9f41c948f, State: Running, Role: LEADER
I20260812 06:37:39.636337  3842 consensus_queue.cc:260] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 43, Committed index: 43, Last appended: 8.43, Last appended by leader: 43, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 } } peers { permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 } } peers { permanent_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 41179 } }
I20260812 06:37:39.636612  3842 raft_consensus.cc:3060] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [term 8 FOLLOWER]: Advancing to term 9
I20260812 06:37:39.638463  3838 raft_consensus.cc:493] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:37:39.638547  3838 raft_consensus.cc:3060] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 9 FOLLOWER]: Advancing to term 10
I20260812 06:37:39.639364  3838 raft_consensus.cc:515] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 } } peers { permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 } } peers { permanent_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 41179 } }
I20260812 06:37:39.639809  3838 leader_election.cc:290] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [CANDIDATE]: Term 10 election: Requested vote from peers 7ddeeaa5caab4672b6aaff6de27e3f8e (127.3.28.194:32899), e3c2253bb2e64cfc82b9f0c9f41c948f (127.3.28.195:41179)
I20260812 06:37:39.640268  3679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11076e13df5649879f55117427940d3a" candidate_uuid: "0ef773995fe444dd8de3e1000823a871" candidate_term: 10 candidate_status { last_received { term: 8 index: 43 } } ignore_live_leader: false dest_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f"
I20260812 06:37:39.640268  3542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11076e13df5649879f55117427940d3a" candidate_uuid: "0ef773995fe444dd8de3e1000823a871" candidate_term: 10 candidate_status { last_received { term: 8 index: 43 } } ignore_live_leader: false dest_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e"
I20260812 06:37:39.640431  3679 raft_consensus.cc:3060] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [term 9 FOLLOWER]: Advancing to term 10
I20260812 06:37:39.640431  3542 raft_consensus.cc:3060] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 9 FOLLOWER]: Advancing to term 10
I20260812 06:37:39.641436  3542 raft_consensus.cc:2468] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ef773995fe444dd8de3e1000823a871 in term 10.
I20260812 06:37:39.641443  3679 raft_consensus.cc:2468] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ef773995fe444dd8de3e1000823a871 in term 10.
I20260812 06:37:39.641795  3353 leader_election.cc:304] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ef773995fe444dd8de3e1000823a871, 7ddeeaa5caab4672b6aaff6de27e3f8e; no voters: 
I20260812 06:37:39.641993  3838 raft_consensus.cc:2804] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 10 FOLLOWER]: Leader election won for term 10
I20260812 06:37:39.642174  3838 raft_consensus.cc:697] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 10 LEADER]: Becoming Leader. State: Replica: 0ef773995fe444dd8de3e1000823a871, State: Running, Role: LEADER
I20260812 06:37:39.642331  3838 consensus_queue.cc:237] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 43, Committed index: 43, Last appended: 8.43, Last appended by leader: 43, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 } } peers { permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 } } peers { permanent_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 41179 } }
I20260812 06:37:39.643918  3229 catalog_manager.cc:5719] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 reported cstate change: term changed from 8 to 10, leader changed from e3c2253bb2e64cfc82b9f0c9f41c948f (127.3.28.195) to 0ef773995fe444dd8de3e1000823a871 (127.3.28.193). New cstate: current_term: 10 leader_uuid: "0ef773995fe444dd8de3e1000823a871" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260812 06:37:39.721578  3542 raft_consensus.cc:1275] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 10 FOLLOWER]: Refusing update from remote peer 0ef773995fe444dd8de3e1000823a871: Log matching property violated. Preceding OpId in replica: term: 8 index: 43. Preceding OpId from leader: term: 10 index: 44. (index mismatch)
I20260812 06:37:39.722080  3838 consensus_queue.cc:1048] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 44, Last known committed idx: 43, Time since last communication: 0.000s
I20260812 06:37:39.740979  3679 raft_consensus.cc:1275] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [term 10 FOLLOWER]: Refusing update from remote peer 0ef773995fe444dd8de3e1000823a871: Log matching property violated. Preceding OpId in replica: term: 8 index: 43. Preceding OpId from leader: term: 10 index: 44. (index mismatch)
I20260812 06:37:39.741559  3838 consensus_queue.cc:1048] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 44, Last known committed idx: 43, Time since last communication: 0.000s
I20260812 06:37:39.911499  3840 raft_consensus.cc:493] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0ef773995fe444dd8de3e1000823a871)
I20260812 06:37:39.911667  3840 raft_consensus.cc:3060] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 10 FOLLOWER]: Advancing to term 11
I20260812 06:37:39.912703  3840 raft_consensus.cc:515] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 } } peers { permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 } } peers { permanent_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 41179 } }
I20260812 06:37:39.913254  3840 leader_election.cc:290] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [CANDIDATE]: Term 11 election: Requested vote from peers 0ef773995fe444dd8de3e1000823a871 (127.3.28.193:33201), e3c2253bb2e64cfc82b9f0c9f41c948f (127.3.28.195:41179)
I20260812 06:37:39.913709  3411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11076e13df5649879f55117427940d3a" candidate_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" candidate_term: 11 candidate_status { last_received { term: 10 index: 44 } } ignore_live_leader: false dest_uuid: "0ef773995fe444dd8de3e1000823a871"
I20260812 06:37:39.913710  3679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11076e13df5649879f55117427940d3a" candidate_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" candidate_term: 11 candidate_status { last_received { term: 10 index: 44 } } ignore_live_leader: false dest_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f"
I20260812 06:37:39.914243  3489 leader_election.cc:304] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7ddeeaa5caab4672b6aaff6de27e3f8e; no voters: 0ef773995fe444dd8de3e1000823a871, e3c2253bb2e64cfc82b9f0c9f41c948f
I20260812 06:37:39.914464  3840 raft_consensus.cc:2749] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260812 06:37:39.918118  3542 raft_consensus.cc:1240] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 11 FOLLOWER]: Rejecting Update request from peer 0ef773995fe444dd8de3e1000823a871 for earlier term 10. Current term is 11. Ops: []
I20260812 06:37:39.918558  3838 consensus_queue.cc:1059] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 }, Status: INVALID_TERM, Last received: 10.44, Next index: 45, Last known committed idx: 44, Time since last communication: 0.000s
I20260812 06:37:40.015864  3848 raft_consensus.cc:3055] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 10 LEADER]: Stepping down as leader of term 10
I20260812 06:37:40.016014  3848 raft_consensus.cc:740] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0ef773995fe444dd8de3e1000823a871, State: Running, Role: LEADER
I20260812 06:37:40.016223  3848 consensus_queue.cc:260] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 44, Committed index: 44, Last appended: 10.44, Last appended by leader: 44, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 } } peers { permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 } } peers { permanent_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 41179 } }
I20260812 06:37:40.016479  3848 raft_consensus.cc:3060] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 10 FOLLOWER]: Advancing to term 11
I20260812 06:37:40.021075  3187 timestamp_advancement-itest.cc:267] GCing logs...
I20260812 06:37:40.022439  3187 timestamp_advancement-itest.cc:267] GCing logs...
I20260812 06:37:40.024685  3187 timestamp_advancement-itest.cc:267] GCing logs...
I20260812 06:37:40.028936  3187 timestamp_advancement-itest.cc:267] GCing logs...
I20260812 06:37:40.034039  3840 raft_consensus.cc:493] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:37:40.034150  3840 raft_consensus.cc:3060] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 11 FOLLOWER]: Advancing to term 12
I20260812 06:37:40.035252  3840 raft_consensus.cc:515] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 } } peers { permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 } } peers { permanent_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 41179 } }
I20260812 06:37:40.035710  3840 leader_election.cc:290] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [CANDIDATE]: Term 12 election: Requested vote from peers 0ef773995fe444dd8de3e1000823a871 (127.3.28.193:33201), e3c2253bb2e64cfc82b9f0c9f41c948f (127.3.28.195:41179)
I20260812 06:37:40.036144  3411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11076e13df5649879f55117427940d3a" candidate_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" candidate_term: 12 candidate_status { last_received { term: 10 index: 44 } } ignore_live_leader: false dest_uuid: "0ef773995fe444dd8de3e1000823a871"
I20260812 06:37:40.036150  3679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11076e13df5649879f55117427940d3a" candidate_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" candidate_term: 12 candidate_status { last_received { term: 10 index: 44 } } ignore_live_leader: false dest_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f"
I20260812 06:37:40.036290  3411 raft_consensus.cc:3060] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 11 FOLLOWER]: Advancing to term 12
I20260812 06:37:40.037166  3411 raft_consensus.cc:2468] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7ddeeaa5caab4672b6aaff6de27e3f8e in term 12.
I20260812 06:37:40.037207  3187 timestamp_advancement-itest.cc:267] GCing logs...
I20260812 06:37:40.037513  3489 leader_election.cc:304] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ef773995fe444dd8de3e1000823a871, 7ddeeaa5caab4672b6aaff6de27e3f8e; no voters: e3c2253bb2e64cfc82b9f0c9f41c948f
I20260812 06:37:40.037758  3840 raft_consensus.cc:2804] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 12 FOLLOWER]: Leader election won for term 12
I20260812 06:37:40.037984  3840 raft_consensus.cc:697] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 12 LEADER]: Becoming Leader. State: Replica: 7ddeeaa5caab4672b6aaff6de27e3f8e, State: Running, Role: LEADER
I20260812 06:37:40.038154  3840 consensus_queue.cc:237] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 44, Committed index: 44, Last appended: 10.44, Last appended by leader: 44, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 } } peers { permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 } } peers { permanent_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 41179 } }
I20260812 06:37:40.039681  3229 catalog_manager.cc:5719] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e reported cstate change: term changed from 10 to 12, leader changed from 0ef773995fe444dd8de3e1000823a871 (127.3.28.193) to 7ddeeaa5caab4672b6aaff6de27e3f8e (127.3.28.194). New cstate: current_term: 12 leader_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 41179 } health_report { overall_health: UNKNOWN } } }
I20260812 06:37:40.053552  3187 timestamp_advancement-itest.cc:267] GCing logs...
I20260812 06:37:40.085922  3187 timestamp_advancement-itest.cc:267] GCing logs...
I20260812 06:37:40.109761  3842 raft_consensus.cc:493] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0ef773995fe444dd8de3e1000823a871)
I20260812 06:37:40.109920  3842 raft_consensus.cc:3060] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [term 10 FOLLOWER]: Advancing to term 11
I20260812 06:37:40.111249  3842 raft_consensus.cc:515] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 } } peers { permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 } } peers { permanent_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 41179 } }
I20260812 06:37:40.111780  3842 leader_election.cc:290] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [CANDIDATE]: Term 11 election: Requested vote from peers 7ddeeaa5caab4672b6aaff6de27e3f8e (127.3.28.194:32899), 0ef773995fe444dd8de3e1000823a871 (127.3.28.193:33201)
I20260812 06:37:40.112305  3411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11076e13df5649879f55117427940d3a" candidate_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" candidate_term: 11 candidate_status { last_received { term: 10 index: 44 } } ignore_live_leader: false dest_uuid: "0ef773995fe444dd8de3e1000823a871"
I20260812 06:37:40.112305  3542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11076e13df5649879f55117427940d3a" candidate_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" candidate_term: 11 candidate_status { last_received { term: 10 index: 44 } } ignore_live_leader: false dest_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e"
I20260812 06:37:40.112495  3411 raft_consensus.cc:2368] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e3c2253bb2e64cfc82b9f0c9f41c948f for earlier term 11. Current term is 12.
I20260812 06:37:40.112779  3614 leader_election.cc:400] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [CANDIDATE]: Term 11 election: Vote denied by peer 0ef773995fe444dd8de3e1000823a871 (127.3.28.193:33201) with higher term. Message: Invalid argument: T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e3c2253bb2e64cfc82b9f0c9f41c948f for earlier term 11. Current term is 12.
I20260812 06:37:40.112825  3614 leader_election.cc:403] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260812 06:37:40.112974  3842 raft_consensus.cc:3060] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [term 11 FOLLOWER]: Advancing to term 12
I20260812 06:37:40.113794  3842 raft_consensus.cc:2749] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 0ef773995fe444dd8de3e1000823a871 (127.3.28.193:33201) with higher term. Message: Invalid argument: T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e3c2253bb2e64cfc82b9f0c9f41c948f for earlier term 11. Current term is 12.
I20260812 06:37:40.140223  3679 raft_consensus.cc:1275] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [term 12 FOLLOWER]: Refusing update from remote peer 7ddeeaa5caab4672b6aaff6de27e3f8e: Log matching property violated. Preceding OpId in replica: term: 10 index: 44. Preceding OpId from leader: term: 12 index: 45. (index mismatch)
I20260812 06:37:40.140877  3840 consensus_queue.cc:1048] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 41179 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 45, Last known committed idx: 44, Time since last communication: 0.000s
I20260812 06:37:40.143494  3411 raft_consensus.cc:1275] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 12 FOLLOWER]: Refusing update from remote peer 7ddeeaa5caab4672b6aaff6de27e3f8e: Log matching property violated. Preceding OpId in replica: term: 10 index: 44. Preceding OpId from leader: term: 12 index: 45. (index mismatch)
I20260812 06:37:40.144202  3849 consensus_queue.cc:1048] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 45, Last known committed idx: 44, Time since last communication: 0.000s
I20260812 06:37:40.150317  3187 timestamp_advancement-itest.cc:267] GCing logs...
I20260812 06:37:40.278726  3187 timestamp_advancement-itest.cc:267] GCing logs...
I20260812 06:37:40.279012  3187 log_reader.cc:385] T 11076e13df5649879f55117427940d3a: removed 1 log segments from log reader
I20260812 06:37:40.279062  3187 log.cc:1079] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871: Deleting log segment in path: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1786516657398854-3187-0/minicluster-data/ts-0-root/wals/11076e13df5649879f55117427940d3a/wal-000000001 (ops 1-39)
I20260812 06:37:40.280365  3187 timestamp_advancement-itest.cc:274] Shutting down cluster...
I20260812 06:37:40.280517  3187 master.cc:562] Master@127.3.28.254:32975 shutting down...
I20260812 06:37:40.330717  3842 raft_consensus.cc:493] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7ddeeaa5caab4672b6aaff6de27e3f8e)
I20260812 06:37:40.330859  3842 raft_consensus.cc:3060] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [term 12 FOLLOWER]: Advancing to term 13
I20260812 06:37:40.331825  3842 raft_consensus.cc:515] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 } } peers { permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 } } peers { permanent_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 41179 } }
I20260812 06:37:40.332118  3679 raft_consensus.cc:1240] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [term 13 FOLLOWER]: Rejecting Update request from peer 7ddeeaa5caab4672b6aaff6de27e3f8e for earlier term 12. Current term is 13. Ops: []
I20260812 06:37:40.332311  3842 leader_election.cc:290] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [CANDIDATE]: Term 13 election: Requested vote from peers 7ddeeaa5caab4672b6aaff6de27e3f8e (127.3.28.194:32899), 0ef773995fe444dd8de3e1000823a871 (127.3.28.193:33201)
I20260812 06:37:40.332674  3411 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11076e13df5649879f55117427940d3a" candidate_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" candidate_term: 13 candidate_status { last_received { term: 12 index: 45 } } ignore_live_leader: false dest_uuid: "0ef773995fe444dd8de3e1000823a871"
I20260812 06:37:40.332670  3542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11076e13df5649879f55117427940d3a" candidate_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" candidate_term: 13 candidate_status { last_received { term: 12 index: 45 } } ignore_live_leader: false dest_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e"
I20260812 06:37:40.332895  3850 consensus_queue.cc:1059] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 41179 }, Status: INVALID_TERM, Last received: 12.45, Next index: 46, Last known committed idx: 45, Time since last communication: 0.000s
I20260812 06:37:40.333079  3840 raft_consensus.cc:3055] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 12 LEADER]: Stepping down as leader of term 12
I20260812 06:37:40.333128  3614 leader_election.cc:304] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3c2253bb2e64cfc82b9f0c9f41c948f; no voters: 0ef773995fe444dd8de3e1000823a871, 7ddeeaa5caab4672b6aaff6de27e3f8e
I20260812 06:37:40.333168  3840 raft_consensus.cc:740] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 7ddeeaa5caab4672b6aaff6de27e3f8e, State: Running, Role: LEADER
I20260812 06:37:40.333351  3842 raft_consensus.cc:2749] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260812 06:37:40.333457  3840 consensus_queue.cc:260] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 45, Committed index: 45, Last appended: 12.45, Last appended by leader: 45, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 } } peers { permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 } } peers { permanent_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 41179 } }
I20260812 06:37:40.333662  3840 raft_consensus.cc:3060] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 12 FOLLOWER]: Advancing to term 13
I20260812 06:37:40.433785  3848 raft_consensus.cc:493] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 7ddeeaa5caab4672b6aaff6de27e3f8e)
I20260812 06:37:40.433959  3848 raft_consensus.cc:3060] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 12 FOLLOWER]: Advancing to term 13
I20260812 06:37:40.435154  3848 raft_consensus.cc:515] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 } } peers { permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 } } peers { permanent_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 41179 } }
I20260812 06:37:40.435760  3848 leader_election.cc:290] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [CANDIDATE]: Term 13 election: Requested vote from peers 7ddeeaa5caab4672b6aaff6de27e3f8e (127.3.28.194:32899), e3c2253bb2e64cfc82b9f0c9f41c948f (127.3.28.195:41179)
I20260812 06:37:40.436308  3542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11076e13df5649879f55117427940d3a" candidate_uuid: "0ef773995fe444dd8de3e1000823a871" candidate_term: 13 candidate_status { last_received { term: 12 index: 45 } } ignore_live_leader: false dest_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e"
I20260812 06:37:40.436327  3679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11076e13df5649879f55117427940d3a" candidate_uuid: "0ef773995fe444dd8de3e1000823a871" candidate_term: 13 candidate_status { last_received { term: 12 index: 45 } } ignore_live_leader: false dest_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f"
I20260812 06:37:40.436691  3679 raft_consensus.cc:2393] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ef773995fe444dd8de3e1000823a871 in current term 13: Already voted for candidate e3c2253bb2e64cfc82b9f0c9f41c948f in this term.
I20260812 06:37:40.437498  3542 raft_consensus.cc:2468] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ef773995fe444dd8de3e1000823a871 in term 13.
I20260812 06:37:40.437937  3353 leader_election.cc:304] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ef773995fe444dd8de3e1000823a871, 7ddeeaa5caab4672b6aaff6de27e3f8e; no voters: e3c2253bb2e64cfc82b9f0c9f41c948f
I20260812 06:37:40.438227  3848 raft_consensus.cc:2804] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 13 FOLLOWER]: Leader election won for term 13
I20260812 06:37:40.438411  3848 raft_consensus.cc:697] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 13 LEADER]: Becoming Leader. State: Replica: 0ef773995fe444dd8de3e1000823a871, State: Running, Role: LEADER
I20260812 06:37:40.438601  3848 consensus_queue.cc:237] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 45, Committed index: 45, Last appended: 12.45, Last appended by leader: 45, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 } } peers { permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 } } peers { permanent_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 41179 } }
W20260812 06:37:40.440305  3458 heartbeater.cc:646] Failed to heartbeat to 127.3.28.254:32975 (0 consecutive failures): Remote error: Failed to send heartbeat to master: Service unavailable: service kudu.master.MasterService not registered on Master
I20260812 06:37:40.455438  3187 raft_consensus.cc:2243] T 00000000000000000000000000000000 P da7ef9ed1cdc41998898235779895b2e [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:37:40.455717  3187 raft_consensus.cc:2272] T 00000000000000000000000000000000 P da7ef9ed1cdc41998898235779895b2e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:37:40.455832  3187 tablet_replica.cc:333] T 00000000000000000000000000000000 P da7ef9ed1cdc41998898235779895b2e: stopping tablet replica
I20260812 06:37:40.464591  3842 raft_consensus.cc:493] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:37:40.464744  3842 raft_consensus.cc:3060] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [term 13 FOLLOWER]: Advancing to term 14
I20260812 06:37:40.465732  3842 raft_consensus.cc:515] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 } } peers { permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 } } peers { permanent_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 41179 } }
I20260812 06:37:40.466178  3842 leader_election.cc:290] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [CANDIDATE]: Term 14 election: Requested vote from peers 7ddeeaa5caab4672b6aaff6de27e3f8e (127.3.28.194:32899), 0ef773995fe444dd8de3e1000823a871 (127.3.28.193:33201)
I20260812 06:37:40.466723  3542 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11076e13df5649879f55117427940d3a" candidate_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" candidate_term: 14 candidate_status { last_received { term: 12 index: 45 } } ignore_live_leader: false dest_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e"
I20260812 06:37:40.466849  3542 raft_consensus.cc:3060] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 13 FOLLOWER]: Advancing to term 14
I20260812 06:37:40.466795  3410 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11076e13df5649879f55117427940d3a" candidate_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" candidate_term: 14 candidate_status { last_received { term: 12 index: 45 } } ignore_live_leader: false dest_uuid: "0ef773995fe444dd8de3e1000823a871"
I20260812 06:37:40.467831  3542 raft_consensus.cc:2468] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3c2253bb2e64cfc82b9f0c9f41c948f in term 14.
I20260812 06:37:40.468209  3614 leader_election.cc:304] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7ddeeaa5caab4672b6aaff6de27e3f8e, e3c2253bb2e64cfc82b9f0c9f41c948f; no voters: 0ef773995fe444dd8de3e1000823a871
I20260812 06:37:40.468412  3842 raft_consensus.cc:2804] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [term 14 FOLLOWER]: Leader election won for term 14
I20260812 06:37:40.468616  3842 raft_consensus.cc:697] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [term 14 LEADER]: Becoming Leader. State: Replica: e3c2253bb2e64cfc82b9f0c9f41c948f, State: Running, Role: LEADER
I20260812 06:37:40.468801  3842 consensus_queue.cc:237] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 45, Committed index: 45, Last appended: 12.45, Last appended by leader: 45, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 } } peers { permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 } } peers { permanent_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 41179 } }
I20260812 06:37:40.470669  3187 master.cc:584] Master@127.3.28.254:32975 shutdown complete.
I20260812 06:37:40.476200  3187 tablet_server.cc:179] TabletServer@127.3.28.193:0 shutting down...
I20260812 06:37:40.540759  3542 raft_consensus.cc:1240] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 14 FOLLOWER]: Rejecting Update request from peer 0ef773995fe444dd8de3e1000823a871 for earlier term 13. Current term is 14. Ops: []
I20260812 06:37:40.541477  3848 consensus_queue.cc:1059] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 }, Status: INVALID_TERM, Last received: 0.0, Next index: 46, Last known committed idx: 45, Time since last communication: 0.000s
I20260812 06:37:40.541709  3848 raft_consensus.cc:3055] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 13 LEADER]: Stepping down as leader of term 13
I20260812 06:37:40.541814  3848 raft_consensus.cc:740] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0ef773995fe444dd8de3e1000823a871, State: Running, Role: LEADER
I20260812 06:37:40.542007  3848 consensus_queue.cc:260] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 45, Committed index: 45, Last appended: 13.46, Last appended by leader: 46, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 } } peers { permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 } } peers { permanent_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 41179 } }
I20260812 06:37:40.542203  3848 raft_consensus.cc:3060] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 13 FOLLOWER]: Advancing to term 14
I20260812 06:37:40.558018  3542 raft_consensus.cc:1275] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 14 FOLLOWER]: Refusing update from remote peer e3c2253bb2e64cfc82b9f0c9f41c948f: Log matching property violated. Preceding OpId in replica: term: 12 index: 45. Preceding OpId from leader: term: 14 index: 46. (index mismatch)
I20260812 06:37:40.558718  3842 consensus_queue.cc:1048] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [LEADER]: Connected to new peer: Peer: permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 46, Last known committed idx: 45, Time since last communication: 0.000s
W20260812 06:37:40.559839  3614 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260812 06:37:40.560704  3614 consensus_peers.cc:597] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f -> Peer 0ef773995fe444dd8de3e1000823a871 (127.3.28.193:33201): Couldn't send request to peer 0ef773995fe444dd8de3e1000823a871. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260812 06:37:40.570072  3187 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260812 06:37:40.570504  3187 tablet_replica.cc:333] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871: stopping tablet replica
I20260812 06:37:40.570672  3187 raft_consensus.cc:2243] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260812 06:37:40.570827  3187 pending_rounds.cc:70] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871: Trying to abort 1 pending ops.
I20260812 06:37:40.570923  3187 pending_rounds.cc:77] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871: Aborting op as it isn't in flight: id { term: 13 index: 46 } timestamp: 7317572241158217728 op_type: NO_OP noop_request { }
I20260812 06:37:40.571027  3187 raft_consensus.cc:2889] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260812 06:37:40.571117  3187 raft_consensus.cc:2272] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260812 06:37:40.574747  3187 tablet_server.cc:196] TabletServer@127.3.28.193:0 shutdown complete.
I20260812 06:37:40.577406  3187 tablet_server.cc:179] TabletServer@127.3.28.194:0 shutting down...
I20260812 06:37:40.602842  3187 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260812 06:37:40.603209  3187 tablet_replica.cc:333] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e: stopping tablet replica
I20260812 06:37:40.603386  3187 raft_consensus.cc:2243] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 14 FOLLOWER]: Raft consensus shutting down.
I20260812 06:37:40.603570  3187 raft_consensus.cc:2272] T 11076e13df5649879f55117427940d3a P 7ddeeaa5caab4672b6aaff6de27e3f8e [term 14 FOLLOWER]: Raft consensus is shut down!
I20260812 06:37:40.617336  3187 tablet_server.cc:196] TabletServer@127.3.28.194:0 shutdown complete.
I20260812 06:37:40.619622  3187 tablet_server.cc:179] TabletServer@127.3.28.195:0 shutting down...
W20260812 06:37:40.646813  3614 consensus_peers.cc:597] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f -> Peer 7ddeeaa5caab4672b6aaff6de27e3f8e (127.3.28.194:32899): Couldn't send request to peer 7ddeeaa5caab4672b6aaff6de27e3f8e. Status: Network error: Client connection negotiation failed: client connection to 127.3.28.194:32899: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 06:37:40.654976  3187 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260812 06:37:40.655223  3187 tablet_replica.cc:333] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f: stopping tablet replica
I20260812 06:37:40.655352  3187 raft_consensus.cc:2243] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [term 14 LEADER]: Raft consensus shutting down.
I20260812 06:37:40.655567  3187 raft_consensus.cc:2272] T 11076e13df5649879f55117427940d3a P e3c2253bb2e64cfc82b9f0c9f41c948f [term 14 FOLLOWER]: Raft consensus is shut down!
I20260812 06:37:40.669056  3187 tablet_server.cc:196] TabletServer@127.3.28.195:0 shutdown complete.
I20260812 06:37:40.671446  3187 timestamp_advancement-itest.cc:282] Restarting single tablet server...
I20260812 06:37:40.671793  3187 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 06:37:40.672254  3187 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260812 06:37:40.673929  3861 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:40.673957  3869 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:40.674311  3863 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:40.674335  3187 server_base.cc:1061] running on GCE node
I20260812 06:37:40.674569  3187 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 06:37:40.674641  3187 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 06:37:40.674667  3187 hybrid_clock.cc:648] HybridClock initialized: now 1786516660674666 us; error 0 us; skew 500 ppm
I20260812 06:37:40.675647  3187 webserver.cc:533] Webserver started at http://127.3.28.193:36103/ using document root <none> and password file <none>
I20260812 06:37:40.675870  3187 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:40.675941  3187 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260812 06:37:40.677232  3187 fs_manager.cc:714] Time spent opening directory manager: real 0.001s	user 0.001s	sys 0.000s
I20260812 06:37:40.680970  3882 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:40.681305  3187 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.001s	sys 0.000s
I20260812 06:37:40.681429  3187 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1786516657398854-3187-0/minicluster-data/ts-0-root
uuid: "0ef773995fe444dd8de3e1000823a871"
format_stamp: "Formatted at 2026-08-12 06:37:37 on dist-test-slave-tk9z"
I20260812 06:37:40.681545  3187 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1786516657398854-3187-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1786516657398854-3187-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1786516657398854-3187-0/minicluster-data/ts-0-root/data
Total live blocks: 12
Total live bytes: 10805
Total live bytes (after alignment): 57344
Total number of LBM containers: 6 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:40.687106  3187 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:40.687455  3187 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:40.687748  3187 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:37:40.688416  3893 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260812 06:37:40.689932  3187 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 06:37:40.690008  3187 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.002s	user 0.000s	sys 0.000s
I20260812 06:37:40.690079  3187 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260812 06:37:40.690948  3187 ts_tablet_manager.cc:616] Registered 1 tablets
I20260812 06:37:40.691017  3187 ts_tablet_manager.cc:595] Time spent register tablets: real 0.001s	user 0.000s	sys 0.000s
I20260812 06:37:40.691087  3893 tablet_bootstrap.cc:492] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871: Bootstrap starting.
I20260812 06:37:40.695524  3893 tablet_bootstrap.cc:492] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260812 06:37:40.695986  3893 tablet_bootstrap.cc:492] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871: Bootstrap complete.
I20260812 06:37:40.696194  3893 ts_tablet_manager.cc:1403] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871: Time spent bootstrapping tablet: real 0.005s	user 0.003s	sys 0.000s
I20260812 06:37:40.696530  3187 rpc_server.cc:307] RPC server started. Bound to: 127.3.28.193:33201
I20260812 06:37:40.696745  3893 raft_consensus.cc:359] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 14 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 } } peers { permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 } } peers { permanent_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 41179 } }
I20260812 06:37:40.696995  3893 raft_consensus.cc:740] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 14 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ef773995fe444dd8de3e1000823a871, State: Initialized, Role: FOLLOWER
I20260812 06:37:40.697250  3893 consensus_queue.cc:260] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 45, Last appended: 13.46, Last appended by leader: 46, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 } } peers { permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 } } peers { permanent_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 41179 } }
I20260812 06:37:40.697934  3893 ts_tablet_manager.cc:1434] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871: Time spent starting tablet: real 0.002s	user 0.003s	sys 0.000s
I20260812 06:37:40.698415  3980 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.28.193:33201 every 8 connection(s)
W20260812 06:37:40.702507  3983 heartbeater.cc:412] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 06:37:40.719193  3187 timestamp_advancement-itest.cc:274] Shutting down cluster...
I20260812 06:37:40.719379  3187 tablet_server.cc:179] TabletServer@127.3.28.193:33201 shutting down...
I20260812 06:37:40.787055  3987 raft_consensus.cc:493] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:37:40.787205  3987 raft_consensus.cc:3060] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 14 FOLLOWER]: Advancing to term 15
I20260812 06:37:40.788573  3987 raft_consensus.cc:515] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 } } peers { permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 } } peers { permanent_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 41179 } }
I20260812 06:37:40.789114  3987 leader_election.cc:290] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [CANDIDATE]: Term 15 election: Requested vote from peers 7ddeeaa5caab4672b6aaff6de27e3f8e (127.3.28.194:32899), e3c2253bb2e64cfc82b9f0c9f41c948f (127.3.28.195:41179)
W20260812 06:37:40.790844  3887 leader_election.cc:336] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 7ddeeaa5caab4672b6aaff6de27e3f8e (127.3.28.194:32899): Network error: Client connection negotiation failed: client connection to 127.3.28.194:32899: connect: Connection refused (error 111)
W20260812 06:37:40.791002  3883 leader_election.cc:336] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer e3c2253bb2e64cfc82b9f0c9f41c948f (127.3.28.195:41179): Network error: Client connection negotiation failed: client connection to 127.3.28.195:41179: connect: Connection refused (error 111)
I20260812 06:37:40.791108  3883 leader_election.cc:304] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ef773995fe444dd8de3e1000823a871; no voters: 7ddeeaa5caab4672b6aaff6de27e3f8e, e3c2253bb2e64cfc82b9f0c9f41c948f
I20260812 06:37:40.791342  3987 raft_consensus.cc:2749] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260812 06:37:40.930130  3987 raft_consensus.cc:493] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:37:40.930331  3987 raft_consensus.cc:3060] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 15 FOLLOWER]: Advancing to term 16
I20260812 06:37:40.931717  3987 raft_consensus.cc:515] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 } } peers { permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 } } peers { permanent_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 41179 } }
I20260812 06:37:40.932276  3987 leader_election.cc:290] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [CANDIDATE]: Term 16 election: Requested vote from peers 7ddeeaa5caab4672b6aaff6de27e3f8e (127.3.28.194:32899), e3c2253bb2e64cfc82b9f0c9f41c948f (127.3.28.195:41179)
W20260812 06:37:40.933543  3887 leader_election.cc:336] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 7ddeeaa5caab4672b6aaff6de27e3f8e (127.3.28.194:32899): Network error: Client connection negotiation failed: client connection to 127.3.28.194:32899: connect: Connection refused (error 111)
W20260812 06:37:40.933774  3883 leader_election.cc:336] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer e3c2253bb2e64cfc82b9f0c9f41c948f (127.3.28.195:41179): Network error: Client connection negotiation failed: client connection to 127.3.28.195:41179: connect: Connection refused (error 111)
I20260812 06:37:40.933874  3883 leader_election.cc:304] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ef773995fe444dd8de3e1000823a871; no voters: 7ddeeaa5caab4672b6aaff6de27e3f8e, e3c2253bb2e64cfc82b9f0c9f41c948f
I20260812 06:37:40.934017  3987 raft_consensus.cc:2749] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260812 06:37:40.951165  3187 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260812 06:37:40.951676  3187 tablet_replica.cc:333] stopping tablet replica
I20260812 06:37:40.951880  3187 raft_consensus.cc:2243] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260812 06:37:40.952055  3187 pending_rounds.cc:70] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871: Trying to abort 1 pending ops.
I20260812 06:37:40.952112  3187 pending_rounds.cc:77] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871: Aborting op as it isn't in flight: id { term: 13 index: 46 } timestamp: 7317572241158217728 op_type: NO_OP noop_request { }
I20260812 06:37:40.952214  3187 raft_consensus.cc:2889] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260812 06:37:40.952296  3187 raft_consensus.cc:2272] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260812 06:37:40.965704  3187 tablet_server.cc:196] TabletServer@127.3.28.193:33201 shutdown complete.
I20260812 06:37:40.968456  3187 timestamp_advancement-itest.cc:282] Restarting single tablet server...
I20260812 06:37:40.968711  3187 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 06:37:40.969044  3187 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260812 06:37:40.970444  4003 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:40.970722  4009 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:40.970783  4002 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:40.971282  3187 server_base.cc:1061] running on GCE node
I20260812 06:37:40.971458  3187 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 06:37:40.971514  3187 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 06:37:40.971531  3187 hybrid_clock.cc:648] HybridClock initialized: now 1786516660971531 us; error 0 us; skew 500 ppm
I20260812 06:37:40.972332  3187 webserver.cc:533] Webserver started at http://127.3.28.193:36103/ using document root <none> and password file <none>
I20260812 06:37:40.972555  3187 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:40.972611  3187 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260812 06:37:40.973832  3187 fs_manager.cc:714] Time spent opening directory manager: real 0.001s	user 0.001s	sys 0.000s
I20260812 06:37:40.976760  4026 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:40.977094  3187 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.000s
I20260812 06:37:40.977159  3187 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1786516657398854-3187-0/minicluster-data/ts-0-root
uuid: "0ef773995fe444dd8de3e1000823a871"
format_stamp: "Formatted at 2026-08-12 06:37:37 on dist-test-slave-tk9z"
I20260812 06:37:40.977265  3187 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1786516657398854-3187-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1786516657398854-3187-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData.1786516657398854-3187-0/minicluster-data/ts-0-root/data
Total live blocks: 10
Total live bytes: 10382
Total live bytes (after alignment): 49152
Total number of LBM containers: 6 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:40.998520  3187 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:40.998975  3187 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:40.999317  3187 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:37:41.001261  3187 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 06:37:41.001318  3187 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s	user 0.000s	sys 0.000s
I20260812 06:37:41.002086  3187 ts_tablet_manager.cc:616] Registered 1 tablets
I20260812 06:37:41.002161  3187 ts_tablet_manager.cc:595] Time spent register tablets: real 0.001s	user 0.000s	sys 0.000s
I20260812 06:37:41.002242  4036 tablet_bootstrap.cc:492] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871: Bootstrap starting.
I20260812 06:37:41.006824  4036 tablet_bootstrap.cc:492] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260812 06:37:41.007166  4036 tablet_bootstrap.cc:492] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871: Bootstrap complete.
I20260812 06:37:41.007381  4036 ts_tablet_manager.cc:1403] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871: Time spent bootstrapping tablet: real 0.005s	user 0.004s	sys 0.000s
I20260812 06:37:41.007858  3187 rpc_server.cc:307] RPC server started. Bound to: 127.3.28.193:33201
I20260812 06:37:41.007759  4036 raft_consensus.cc:359] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 16 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 } } peers { permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 } } peers { permanent_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 41179 } }
I20260812 06:37:41.008100  4036 raft_consensus.cc:740] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 16 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ef773995fe444dd8de3e1000823a871, State: Initialized, Role: FOLLOWER
I20260812 06:37:41.008291  4123 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.28.193:33201 every 8 connection(s)
I20260812 06:37:41.008322  4036 consensus_queue.cc:260] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 45, Last appended: 13.46, Last appended by leader: 46, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7ddeeaa5caab4672b6aaff6de27e3f8e" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 32899 } } peers { permanent_uuid: "0ef773995fe444dd8de3e1000823a871" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33201 } } peers { permanent_uuid: "e3c2253bb2e64cfc82b9f0c9f41c948f" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 41179 } }
I20260812 06:37:41.008656  4036 ts_tablet_manager.cc:1434] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871: Time spent starting tablet: real 0.001s	user 0.002s	sys 0.000s
W20260812 06:37:41.012109  4128 heartbeater.cc:412] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 06:37:41.017755  3187 ts_tablet_manager.cc:1993] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871: failing tablet
I20260812 06:37:41.017998  4036 tablet_replica.cc:333] stopping tablet replica
I20260812 06:37:41.018112  4036 raft_consensus.cc:2243] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260812 06:37:41.018224  4036 pending_rounds.cc:70] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871: Trying to abort 1 pending ops.
I20260812 06:37:41.018263  4036 pending_rounds.cc:77] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871: Aborting op as it isn't in flight: id { term: 13 index: 46 } timestamp: 7317572241158217728 op_type: NO_OP noop_request { }
I20260812 06:37:41.018411  4036 raft_consensus.cc:2889] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260812 06:37:41.018494  4036 raft_consensus.cc:2272] T 11076e13df5649879f55117427940d3a P 0ef773995fe444dd8de3e1000823a871 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260812 06:37:41.020023  3187 tablet_server.cc:179] TabletServer@127.3.28.193:33201 shutting down...
I20260812 06:37:41.259860  3187 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260812 06:37:41.273229  3187 tablet_server.cc:196] TabletServer@127.3.28.193:33201 shutdown complete.
[       OK ] TimestampAdvancementITest.TestUpgradeFromOlderCorruptedData (3871 ms)
[ RUN      ] TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap
I20260812 06:37:41.281195  3187 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.28.254:37251
I20260812 06:37:41.281625  3187 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:37:41.283699  4136 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:41.283816  3187 server_base.cc:1061] running on GCE node
W20260812 06:37:41.283759  4141 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:41.283735  4138 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:41.284207  3187 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 06:37:41.284252  3187 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 06:37:41.284268  3187 hybrid_clock.cc:648] HybridClock initialized: now 1786516661284268 us; error 0 us; skew 500 ppm
I20260812 06:37:41.285169  3187 webserver.cc:533] Webserver started at http://127.3.28.254:38689/ using document root <none> and password file <none>
I20260812 06:37:41.285359  3187 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:41.285421  3187 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:41.285526  3187 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:37:41.285970  3187 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1786516657398854-3187-0/minicluster-data/master-0-root/instance:
uuid: "726d86b4a3be4654b6d80bb8ac492087"
format_stamp: "Formatted at 2026-08-12 06:37:41 on dist-test-slave-tk9z"
I20260812 06:37:41.287597  3187 fs_manager.cc:696] Time spent creating directory manager: real 0.001s	user 0.000s	sys 0.002s
I20260812 06:37:41.288642  4155 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:41.289031  3187 fs_manager.cc:730] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20260812 06:37:41.289106  3187 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1786516657398854-3187-0/minicluster-data/master-0-root
uuid: "726d86b4a3be4654b6d80bb8ac492087"
format_stamp: "Formatted at 2026-08-12 06:37:41 on dist-test-slave-tk9z"
I20260812 06:37:41.289170  3187 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1786516657398854-3187-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1786516657398854-3187-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1786516657398854-3187-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:41.295490  3187 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:41.295830  3187 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:41.300911  3187 rpc_server.cc:307] RPC server started. Bound to: 127.3.28.254:37251
I20260812 06:37:41.301400  4246 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.28.254:37251 every 8 connection(s)
I20260812 06:37:41.302034  4248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:41.303974  4248 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 726d86b4a3be4654b6d80bb8ac492087: Bootstrap starting.
I20260812 06:37:41.304782  4248 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 726d86b4a3be4654b6d80bb8ac492087: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:41.305860  4248 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 726d86b4a3be4654b6d80bb8ac492087: No bootstrap required, opened a new log
I20260812 06:37:41.306272  4248 raft_consensus.cc:359] T 00000000000000000000000000000000 P 726d86b4a3be4654b6d80bb8ac492087 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "726d86b4a3be4654b6d80bb8ac492087" member_type: VOTER }
I20260812 06:37:41.306427  4248 raft_consensus.cc:385] T 00000000000000000000000000000000 P 726d86b4a3be4654b6d80bb8ac492087 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:41.306473  4248 raft_consensus.cc:740] T 00000000000000000000000000000000 P 726d86b4a3be4654b6d80bb8ac492087 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 726d86b4a3be4654b6d80bb8ac492087, State: Initialized, Role: FOLLOWER
I20260812 06:37:41.306640  4248 consensus_queue.cc:260] T 00000000000000000000000000000000 P 726d86b4a3be4654b6d80bb8ac492087 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "726d86b4a3be4654b6d80bb8ac492087" member_type: VOTER }
I20260812 06:37:41.306761  4248 raft_consensus.cc:399] T 00000000000000000000000000000000 P 726d86b4a3be4654b6d80bb8ac492087 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:37:41.306807  4248 raft_consensus.cc:493] T 00000000000000000000000000000000 P 726d86b4a3be4654b6d80bb8ac492087 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:37:41.306869  4248 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 726d86b4a3be4654b6d80bb8ac492087 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:41.307631  4248 raft_consensus.cc:515] T 00000000000000000000000000000000 P 726d86b4a3be4654b6d80bb8ac492087 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "726d86b4a3be4654b6d80bb8ac492087" member_type: VOTER }
I20260812 06:37:41.307790  4248 leader_election.cc:304] T 00000000000000000000000000000000 P 726d86b4a3be4654b6d80bb8ac492087 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 726d86b4a3be4654b6d80bb8ac492087; no voters: 
I20260812 06:37:41.308009  4248 leader_election.cc:290] T 00000000000000000000000000000000 P 726d86b4a3be4654b6d80bb8ac492087 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 06:37:41.308159  4251 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 726d86b4a3be4654b6d80bb8ac492087 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:37:41.308446  4251 raft_consensus.cc:697] T 00000000000000000000000000000000 P 726d86b4a3be4654b6d80bb8ac492087 [term 1 LEADER]: Becoming Leader. State: Replica: 726d86b4a3be4654b6d80bb8ac492087, State: Running, Role: LEADER
I20260812 06:37:41.308482  4248 sys_catalog.cc:565] T 00000000000000000000000000000000 P 726d86b4a3be4654b6d80bb8ac492087 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:37:41.308650  4251 consensus_queue.cc:237] T 00000000000000000000000000000000 P 726d86b4a3be4654b6d80bb8ac492087 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "726d86b4a3be4654b6d80bb8ac492087" member_type: VOTER }
I20260812 06:37:41.309134  4252 sys_catalog.cc:455] T 00000000000000000000000000000000 P 726d86b4a3be4654b6d80bb8ac492087 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "726d86b4a3be4654b6d80bb8ac492087" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "726d86b4a3be4654b6d80bb8ac492087" member_type: VOTER } }
I20260812 06:37:41.309257  4252 sys_catalog.cc:458] T 00000000000000000000000000000000 P 726d86b4a3be4654b6d80bb8ac492087 [sys.catalog]: This master's current role is: LEADER
I20260812 06:37:41.309612  4258 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 06:37:41.310076  4254 sys_catalog.cc:455] T 00000000000000000000000000000000 P 726d86b4a3be4654b6d80bb8ac492087 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 726d86b4a3be4654b6d80bb8ac492087. Latest consensus state: current_term: 1 leader_uuid: "726d86b4a3be4654b6d80bb8ac492087" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "726d86b4a3be4654b6d80bb8ac492087" member_type: VOTER } }
I20260812 06:37:41.310412  4254 sys_catalog.cc:458] T 00000000000000000000000000000000 P 726d86b4a3be4654b6d80bb8ac492087 [sys.catalog]: This master's current role is: LEADER
I20260812 06:37:41.310828  4258 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 06:37:41.312942  3187 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260812 06:37:41.313215  4258 catalog_manager.cc:1383] Generated new cluster ID: 19628f43762d4fc397cc0644cfe8ee9c
I20260812 06:37:41.313292  4258 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 06:37:41.330466  4258 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 06:37:41.331075  4258 catalog_manager.cc:1540] Loading token signing keys...
I20260812 06:37:41.340471  4258 catalog_manager.cc:6092] T 00000000000000000000000000000000 P 726d86b4a3be4654b6d80bb8ac492087: Generated new TSK 0
I20260812 06:37:41.340672  4258 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 06:37:41.345292  3187 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 06:37:41.345774  3187 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260812 06:37:41.347599  4281 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:41.347754  4284 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:41.347618  4280 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:41.347669  3187 server_base.cc:1061] running on GCE node
I20260812 06:37:41.348027  3187 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 06:37:41.348073  3187 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 06:37:41.348088  3187 hybrid_clock.cc:648] HybridClock initialized: now 1786516661348088 us; error 0 us; skew 500 ppm
I20260812 06:37:41.348904  3187 webserver.cc:533] Webserver started at http://127.3.28.193:33197/ using document root <none> and password file <none>
I20260812 06:37:41.349085  3187 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:41.349136  3187 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:41.349237  3187 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:37:41.349694  3187 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1786516657398854-3187-0/minicluster-data/ts-0-root/instance:
uuid: "b110da3f2aa14447a08587fe94967dde"
format_stamp: "Formatted at 2026-08-12 06:37:41 on dist-test-slave-tk9z"
I20260812 06:37:41.351362  3187 fs_manager.cc:696] Time spent creating directory manager: real 0.001s	user 0.000s	sys 0.002s
I20260812 06:37:41.352397  4294 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:41.352674  3187 fs_manager.cc:730] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20260812 06:37:41.352735  3187 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1786516657398854-3187-0/minicluster-data/ts-0-root
uuid: "b110da3f2aa14447a08587fe94967dde"
format_stamp: "Formatted at 2026-08-12 06:37:41 on dist-test-slave-tk9z"
I20260812 06:37:41.352829  3187 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1786516657398854-3187-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1786516657398854-3187-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1786516657398854-3187-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:41.365108  3187 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:41.365518  3187 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:41.365839  3187 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:37:41.366328  3187 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:37:41.366420  3187 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:41.366498  3187 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:37:41.366539  3187 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:41.370837  3187 rpc_server.cc:307] RPC server started. Bound to: 127.3.28.193:40241
I20260812 06:37:41.370879  4395 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.28.193:40241 every 8 connection(s)
I20260812 06:37:41.371677  3187 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 06:37:41.372162  3187 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260812 06:37:41.373788  4403 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:41.373790  4404 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:41.374127  4408 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:41.374349  3187 server_base.cc:1061] running on GCE node
I20260812 06:37:41.374588  3187 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 06:37:41.374639  3187 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 06:37:41.374660  3187 hybrid_clock.cc:648] HybridClock initialized: now 1786516661374660 us; error 0 us; skew 500 ppm
I20260812 06:37:41.375633  3187 webserver.cc:533] Webserver started at http://127.3.28.194:37189/ using document root <none> and password file <none>
I20260812 06:37:41.375823  3187 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:41.375895  3187 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:41.375976  3187 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:37:41.376427  3187 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1786516657398854-3187-0/minicluster-data/ts-1-root/instance:
uuid: "53f9350752f44cc3947f0853eceb9933"
format_stamp: "Formatted at 2026-08-12 06:37:41 on dist-test-slave-tk9z"
I20260812 06:37:41.376706  4396 heartbeater.cc:344] Connected to a master server at 127.3.28.254:37251
I20260812 06:37:41.376796  4396 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:41.377033  4396 heartbeater.cc:507] Master 127.3.28.254:37251 requested a full tablet report, sending...
I20260812 06:37:41.377691  4182 ts_manager.cc:194] Registered new tserver with Master: b110da3f2aa14447a08587fe94967dde (127.3.28.193:40241)
I20260812 06:37:41.378324  3187 fs_manager.cc:696] Time spent creating directory manager: real 0.002s	user 0.000s	sys 0.002s
I20260812 06:37:41.378612  4182 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57466
I20260812 06:37:41.379563  4417 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:41.379791  3187 fs_manager.cc:730] Time spent opening block manager: real 0.001s	user 0.000s	sys 0.001s
I20260812 06:37:41.379882  3187 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1786516657398854-3187-0/minicluster-data/ts-1-root
uuid: "53f9350752f44cc3947f0853eceb9933"
format_stamp: "Formatted at 2026-08-12 06:37:41 on dist-test-slave-tk9z"
I20260812 06:37:41.379982  3187 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1786516657398854-3187-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1786516657398854-3187-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1786516657398854-3187-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:41.413924  3187 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:41.414430  3187 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:41.414788  3187 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:37:41.415292  3187 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:37:41.415364  3187 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:41.415436  3187 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:37:41.415491  3187 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:41.420312  3187 rpc_server.cc:307] RPC server started. Bound to: 127.3.28.194:34069
I20260812 06:37:41.420372  4518 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.28.194:34069 every 8 connection(s)
I20260812 06:37:41.421187  3187 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 06:37:41.421741  3187 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260812 06:37:41.423363  4526 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:41.423398  4525 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:41.423659  3187 server_base.cc:1061] running on GCE node
W20260812 06:37:41.424062  4530 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:41.424332  3187 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 06:37:41.424397  3187 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 06:37:41.424420  3187 hybrid_clock.cc:648] HybridClock initialized: now 1786516661424420 us; error 0 us; skew 500 ppm
I20260812 06:37:41.425384  3187 webserver.cc:533] Webserver started at http://127.3.28.195:34655/ using document root <none> and password file <none>
I20260812 06:37:41.425535  3187 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:41.425616  4520 heartbeater.cc:344] Connected to a master server at 127.3.28.254:37251
I20260812 06:37:41.425624  3187 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:41.425726  4520 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:41.425748  3187 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:37:41.425948  4520 heartbeater.cc:507] Master 127.3.28.254:37251 requested a full tablet report, sending...
I20260812 06:37:41.426209  3187 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1786516657398854-3187-0/minicluster-data/ts-2-root/instance:
uuid: "c2c451feba984198a5bff0dd8325536c"
format_stamp: "Formatted at 2026-08-12 06:37:41 on dist-test-slave-tk9z"
I20260812 06:37:41.426656  4182 ts_manager.cc:194] Registered new tserver with Master: 53f9350752f44cc3947f0853eceb9933 (127.3.28.194:34069)
I20260812 06:37:41.427201  4182 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36806
I20260812 06:37:41.428201  3187 fs_manager.cc:696] Time spent creating directory manager: real 0.002s	user 0.000s	sys 0.001s
I20260812 06:37:41.429306  4541 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:41.429565  3187 fs_manager.cc:730] Time spent opening block manager: real 0.001s	user 0.000s	sys 0.001s
I20260812 06:37:41.429670  3187 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1786516657398854-3187-0/minicluster-data/ts-2-root
uuid: "c2c451feba984198a5bff0dd8325536c"
format_stamp: "Formatted at 2026-08-12 06:37:41 on dist-test-slave-tk9z"
I20260812 06:37:41.429778  3187 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1786516657398854-3187-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1786516657398854-3187-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1786516657398854-3187-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:41.437327  3187 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:41.437708  3187 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:41.438040  3187 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:37:41.438575  3187 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:37:41.438642  3187 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:41.438700  3187 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:37:41.438761  3187 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:41.443702  3187 rpc_server.cc:307] RPC server started. Bound to: 127.3.28.195:45153
I20260812 06:37:41.443810  4644 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.28.195:45153 every 8 connection(s)
I20260812 06:37:41.448764  4645 heartbeater.cc:344] Connected to a master server at 127.3.28.254:37251
I20260812 06:37:41.448907  4645 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:41.449131  4645 heartbeater.cc:507] Master 127.3.28.254:37251 requested a full tablet report, sending...
I20260812 06:37:41.449831  4182 ts_manager.cc:194] Registered new tserver with Master: c2c451feba984198a5bff0dd8325536c (127.3.28.195:45153)
I20260812 06:37:41.450019  3187 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.005805676s
I20260812 06:37:41.450542  4182 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36814
I20260812 06:37:41.470104  4182 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36836:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260812 06:37:41.470710  4182 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:37:41.481101  4582 tablet_service.cc:1511] Processing CreateTablet for tablet 40088c3774b040fcade8002ce521e52c (DEFAULT_TABLE table=test-workload [id=27dc255f49d542e680c38e507a7829de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:37:41.481449  4582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40088c3774b040fcade8002ce521e52c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:41.481680  4462 tablet_service.cc:1511] Processing CreateTablet for tablet 40088c3774b040fcade8002ce521e52c (DEFAULT_TABLE table=test-workload [id=27dc255f49d542e680c38e507a7829de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:37:41.481940  4462 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40088c3774b040fcade8002ce521e52c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:41.484113  4688 tablet_bootstrap.cc:492] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933: Bootstrap starting.
I20260812 06:37:41.484453  4685 tablet_bootstrap.cc:492] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c: Bootstrap starting.
I20260812 06:37:41.484728  4337 tablet_service.cc:1511] Processing CreateTablet for tablet 40088c3774b040fcade8002ce521e52c (DEFAULT_TABLE table=test-workload [id=27dc255f49d542e680c38e507a7829de]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:37:41.485016  4337 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40088c3774b040fcade8002ce521e52c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:41.485411  4688 tablet_bootstrap.cc:654] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:41.485509  4685 tablet_bootstrap.cc:654] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:41.486725  4685 tablet_bootstrap.cc:492] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c: No bootstrap required, opened a new log
I20260812 06:37:41.486848  4685 ts_tablet_manager.cc:1403] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c: Time spent bootstrapping tablet: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:37:41.487244  4695 tablet_bootstrap.cc:492] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde: Bootstrap starting.
I20260812 06:37:41.487398  4685 raft_consensus.cc:359] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f9350752f44cc3947f0853eceb9933" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 34069 } } peers { permanent_uuid: "c2c451feba984198a5bff0dd8325536c" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 45153 } } peers { permanent_uuid: "b110da3f2aa14447a08587fe94967dde" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40241 } }
I20260812 06:37:41.487519  4685 raft_consensus.cc:385] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:41.487555  4685 raft_consensus.cc:740] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c2c451feba984198a5bff0dd8325536c, State: Initialized, Role: FOLLOWER
I20260812 06:37:41.487676  4685 consensus_queue.cc:260] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f9350752f44cc3947f0853eceb9933" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 34069 } } peers { permanent_uuid: "c2c451feba984198a5bff0dd8325536c" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 45153 } } peers { permanent_uuid: "b110da3f2aa14447a08587fe94967dde" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40241 } }
I20260812 06:37:41.488049  4685 ts_tablet_manager.cc:1434] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c: Time spent starting tablet: real 0.001s	user 0.001s	sys 0.000s
I20260812 06:37:41.488085  4645 heartbeater.cc:499] Master 127.3.28.254:37251 was elected leader, sending a full tablet report...
I20260812 06:37:41.488334  4695 tablet_bootstrap.cc:654] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:41.488531  4688 tablet_bootstrap.cc:492] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933: No bootstrap required, opened a new log
I20260812 06:37:41.488651  4688 ts_tablet_manager.cc:1403] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933: Time spent bootstrapping tablet: real 0.005s	user 0.002s	sys 0.000s
I20260812 06:37:41.489075  4688 raft_consensus.cc:359] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f9350752f44cc3947f0853eceb9933" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 34069 } } peers { permanent_uuid: "c2c451feba984198a5bff0dd8325536c" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 45153 } } peers { permanent_uuid: "b110da3f2aa14447a08587fe94967dde" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40241 } }
I20260812 06:37:41.489192  4688 raft_consensus.cc:385] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:41.489245  4688 raft_consensus.cc:740] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 53f9350752f44cc3947f0853eceb9933, State: Initialized, Role: FOLLOWER
I20260812 06:37:41.489436  4688 consensus_queue.cc:260] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f9350752f44cc3947f0853eceb9933" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 34069 } } peers { permanent_uuid: "c2c451feba984198a5bff0dd8325536c" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 45153 } } peers { permanent_uuid: "b110da3f2aa14447a08587fe94967dde" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40241 } }
I20260812 06:37:41.489603  4695 tablet_bootstrap.cc:492] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde: No bootstrap required, opened a new log
I20260812 06:37:41.489717  4695 ts_tablet_manager.cc:1403] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde: Time spent bootstrapping tablet: real 0.003s	user 0.002s	sys 0.000s
I20260812 06:37:41.489866  4688 ts_tablet_manager.cc:1434] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933: Time spent starting tablet: real 0.001s	user 0.001s	sys 0.000s
I20260812 06:37:41.490031  4520 heartbeater.cc:499] Master 127.3.28.254:37251 was elected leader, sending a full tablet report...
I20260812 06:37:41.490216  4695 raft_consensus.cc:359] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f9350752f44cc3947f0853eceb9933" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 34069 } } peers { permanent_uuid: "c2c451feba984198a5bff0dd8325536c" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 45153 } } peers { permanent_uuid: "b110da3f2aa14447a08587fe94967dde" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40241 } }
I20260812 06:37:41.490355  4695 raft_consensus.cc:385] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:41.490444  4695 raft_consensus.cc:740] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b110da3f2aa14447a08587fe94967dde, State: Initialized, Role: FOLLOWER
I20260812 06:37:41.490602  4695 consensus_queue.cc:260] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f9350752f44cc3947f0853eceb9933" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 34069 } } peers { permanent_uuid: "c2c451feba984198a5bff0dd8325536c" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 45153 } } peers { permanent_uuid: "b110da3f2aa14447a08587fe94967dde" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40241 } }
I20260812 06:37:41.491057  4695 ts_tablet_manager.cc:1434] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde: Time spent starting tablet: real 0.001s	user 0.001s	sys 0.000s
I20260812 06:37:41.491225  4396 heartbeater.cc:499] Master 127.3.28.254:37251 was elected leader, sending a full tablet report...
I20260812 06:37:41.519668  4701 raft_consensus.cc:493] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:37:41.519833  4701 raft_consensus.cc:515] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f9350752f44cc3947f0853eceb9933" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 34069 } } peers { permanent_uuid: "c2c451feba984198a5bff0dd8325536c" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 45153 } } peers { permanent_uuid: "b110da3f2aa14447a08587fe94967dde" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40241 } }
I20260812 06:37:41.520414  4701 leader_election.cc:290] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c2c451feba984198a5bff0dd8325536c (127.3.28.195:45153), b110da3f2aa14447a08587fe94967dde (127.3.28.193:40241)
I20260812 06:37:41.523996  4598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40088c3774b040fcade8002ce521e52c" candidate_uuid: "53f9350752f44cc3947f0853eceb9933" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2c451feba984198a5bff0dd8325536c" is_pre_election: true
I20260812 06:37:41.524158  4598 raft_consensus.cc:2468] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53f9350752f44cc3947f0853eceb9933 in term 0.
I20260812 06:37:41.524201  4351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40088c3774b040fcade8002ce521e52c" candidate_uuid: "53f9350752f44cc3947f0853eceb9933" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b110da3f2aa14447a08587fe94967dde" is_pre_election: true
I20260812 06:37:41.524418  4351 raft_consensus.cc:2468] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 53f9350752f44cc3947f0853eceb9933 in term 0.
I20260812 06:37:41.524649  4421 leader_election.cc:304] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53f9350752f44cc3947f0853eceb9933, c2c451feba984198a5bff0dd8325536c; no voters: 
I20260812 06:37:41.524864  4701 raft_consensus.cc:2804] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:37:41.524928  4701 raft_consensus.cc:493] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:37:41.524957  4701 raft_consensus.cc:3060] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:41.525782  4701 raft_consensus.cc:515] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f9350752f44cc3947f0853eceb9933" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 34069 } } peers { permanent_uuid: "c2c451feba984198a5bff0dd8325536c" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 45153 } } peers { permanent_uuid: "b110da3f2aa14447a08587fe94967dde" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40241 } }
I20260812 06:37:41.526116  4701 leader_election.cc:290] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [CANDIDATE]: Term 1 election: Requested vote from peers c2c451feba984198a5bff0dd8325536c (127.3.28.195:45153), b110da3f2aa14447a08587fe94967dde (127.3.28.193:40241)
I20260812 06:37:41.526461  4598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40088c3774b040fcade8002ce521e52c" candidate_uuid: "53f9350752f44cc3947f0853eceb9933" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c2c451feba984198a5bff0dd8325536c"
I20260812 06:37:41.526501  4351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40088c3774b040fcade8002ce521e52c" candidate_uuid: "53f9350752f44cc3947f0853eceb9933" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b110da3f2aa14447a08587fe94967dde"
I20260812 06:37:41.526575  4598 raft_consensus.cc:3060] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:41.526612  4351 raft_consensus.cc:3060] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:41.527623  4598 raft_consensus.cc:2468] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53f9350752f44cc3947f0853eceb9933 in term 1.
I20260812 06:37:41.527627  4351 raft_consensus.cc:2468] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53f9350752f44cc3947f0853eceb9933 in term 1.
I20260812 06:37:41.527977  4420 leader_election.cc:304] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 53f9350752f44cc3947f0853eceb9933, b110da3f2aa14447a08587fe94967dde; no voters: 
I20260812 06:37:41.528180  4701 raft_consensus.cc:2804] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:37:41.528383  4701 raft_consensus.cc:697] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 1 LEADER]: Becoming Leader. State: Replica: 53f9350752f44cc3947f0853eceb9933, State: Running, Role: LEADER
I20260812 06:37:41.528566  4701 consensus_queue.cc:237] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f9350752f44cc3947f0853eceb9933" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 34069 } } peers { permanent_uuid: "c2c451feba984198a5bff0dd8325536c" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 45153 } } peers { permanent_uuid: "b110da3f2aa14447a08587fe94967dde" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40241 } }
I20260812 06:37:41.530067  4182 catalog_manager.cc:5719] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 reported cstate change: term changed from 0 to 1, leader changed from <none> to 53f9350752f44cc3947f0853eceb9933 (127.3.28.194). New cstate: current_term: 1 leader_uuid: "53f9350752f44cc3947f0853eceb9933" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f9350752f44cc3947f0853eceb9933" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 34069 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c2c451feba984198a5bff0dd8325536c" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 45153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b110da3f2aa14447a08587fe94967dde" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40241 } health_report { overall_health: UNKNOWN } } }
I20260812 06:37:41.549170  4351 raft_consensus.cc:1275] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [term 1 FOLLOWER]: Refusing update from remote peer 53f9350752f44cc3947f0853eceb9933: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:37:41.549170  4598 raft_consensus.cc:1275] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [term 1 FOLLOWER]: Refusing update from remote peer 53f9350752f44cc3947f0853eceb9933: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:37:41.549706  4701 consensus_queue.cc:1048] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b110da3f2aa14447a08587fe94967dde" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:37:41.549868  4705 consensus_queue.cc:1048] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2c451feba984198a5bff0dd8325536c" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 45153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:37:41.553391  4719 mvcc.cc:204] Tried to move back new op lower bound from 7317572245701734400 to 7317572245622571008. Current Snapshot: MvccSnapshot[applied={T|T < 7317572245701734400}]
I20260812 06:37:41.803562  4702 raft_consensus.cc:493] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [term 1 FOLLOWER]: Starting leader election (detected failure of leader 53f9350752f44cc3947f0853eceb9933)
I20260812 06:37:41.803722  4702 raft_consensus.cc:3060] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [term 1 FOLLOWER]: Advancing to term 2
I20260812 06:37:41.804832  4702 raft_consensus.cc:515] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f9350752f44cc3947f0853eceb9933" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 34069 } } peers { permanent_uuid: "c2c451feba984198a5bff0dd8325536c" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 45153 } } peers { permanent_uuid: "b110da3f2aa14447a08587fe94967dde" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40241 } }
I20260812 06:37:41.805205  4351 raft_consensus.cc:1240] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [term 2 FOLLOWER]: Rejecting Update request from peer 53f9350752f44cc3947f0853eceb9933 for earlier term 1. Current term is 2. Ops: []
I20260812 06:37:41.805522  4702 leader_election.cc:290] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [CANDIDATE]: Term 2 election: Requested vote from peers 53f9350752f44cc3947f0853eceb9933 (127.3.28.194:34069), c2c451feba984198a5bff0dd8325536c (127.3.28.195:45153)
I20260812 06:37:41.806085  4742 consensus_queue.cc:1059] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b110da3f2aa14447a08587fe94967dde" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40241 }, Status: INVALID_TERM, Last received: 1.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260812 06:37:41.808435  4742 raft_consensus.cc:3055] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 06:37:41.808518  4742 raft_consensus.cc:740] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 53f9350752f44cc3947f0853eceb9933, State: Running, Role: LEADER
I20260812 06:37:41.808691  4742 consensus_queue.cc:260] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 1.16, Last appended by leader: 16, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f9350752f44cc3947f0853eceb9933" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 34069 } } peers { permanent_uuid: "c2c451feba984198a5bff0dd8325536c" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 45153 } } peers { permanent_uuid: "b110da3f2aa14447a08587fe94967dde" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40241 } }
I20260812 06:37:41.808902  4742 raft_consensus.cc:3060] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 1 FOLLOWER]: Advancing to term 2
I20260812 06:37:41.809378  4475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40088c3774b040fcade8002ce521e52c" candidate_uuid: "b110da3f2aa14447a08587fe94967dde" candidate_term: 2 candidate_status { last_received { term: 1 index: 16 } } ignore_live_leader: false dest_uuid: "53f9350752f44cc3947f0853eceb9933"
I20260812 06:37:41.809662  4598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40088c3774b040fcade8002ce521e52c" candidate_uuid: "b110da3f2aa14447a08587fe94967dde" candidate_term: 2 candidate_status { last_received { term: 1 index: 16 } } ignore_live_leader: false dest_uuid: "c2c451feba984198a5bff0dd8325536c"
I20260812 06:37:41.811221  4475 raft_consensus.cc:2468] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b110da3f2aa14447a08587fe94967dde in term 2.
I20260812 06:37:41.811636  4298 leader_election.cc:304] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53f9350752f44cc3947f0853eceb9933, b110da3f2aa14447a08587fe94967dde; no voters: c2c451feba984198a5bff0dd8325536c
I20260812 06:37:41.811856  4702 raft_consensus.cc:2804] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [term 2 FOLLOWER]: Leader election won for term 2
I20260812 06:37:41.812115  4702 raft_consensus.cc:697] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [term 2 LEADER]: Becoming Leader. State: Replica: b110da3f2aa14447a08587fe94967dde, State: Running, Role: LEADER
I20260812 06:37:41.812326  4702 consensus_queue.cc:237] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 1.16, Last appended by leader: 16, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f9350752f44cc3947f0853eceb9933" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 34069 } } peers { permanent_uuid: "c2c451feba984198a5bff0dd8325536c" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 45153 } } peers { permanent_uuid: "b110da3f2aa14447a08587fe94967dde" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40241 } }
I20260812 06:37:41.813848  4180 catalog_manager.cc:5719] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde reported cstate change: term changed from 1 to 2, leader changed from 53f9350752f44cc3947f0853eceb9933 (127.3.28.194) to b110da3f2aa14447a08587fe94967dde (127.3.28.193). New cstate: current_term: 2 leader_uuid: "b110da3f2aa14447a08587fe94967dde" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f9350752f44cc3947f0853eceb9933" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 34069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2c451feba984198a5bff0dd8325536c" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 45153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b110da3f2aa14447a08587fe94967dde" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40241 } health_report { overall_health: HEALTHY } } }
I20260812 06:37:41.851931  4699 raft_consensus.cc:493] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 53f9350752f44cc3947f0853eceb9933)
I20260812 06:37:41.852090  4699 raft_consensus.cc:3060] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [term 1 FOLLOWER]: Advancing to term 2
I20260812 06:37:41.853173  4699 raft_consensus.cc:515] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f9350752f44cc3947f0853eceb9933" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 34069 } } peers { permanent_uuid: "c2c451feba984198a5bff0dd8325536c" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 45153 } } peers { permanent_uuid: "b110da3f2aa14447a08587fe94967dde" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40241 } }
I20260812 06:37:41.853796  4699 leader_election.cc:290] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [CANDIDATE]: Term 2 election: Requested vote from peers 53f9350752f44cc3947f0853eceb9933 (127.3.28.194:34069), b110da3f2aa14447a08587fe94967dde (127.3.28.193:40241)
I20260812 06:37:41.857708  4475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40088c3774b040fcade8002ce521e52c" candidate_uuid: "c2c451feba984198a5bff0dd8325536c" candidate_term: 2 candidate_status { last_received { term: 1 index: 16 } } ignore_live_leader: false dest_uuid: "53f9350752f44cc3947f0853eceb9933"
I20260812 06:37:41.857882  4475 raft_consensus.cc:2393] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c2c451feba984198a5bff0dd8325536c in current term 2: Already voted for candidate b110da3f2aa14447a08587fe94967dde in this term.
I20260812 06:37:41.857944  4351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40088c3774b040fcade8002ce521e52c" candidate_uuid: "c2c451feba984198a5bff0dd8325536c" candidate_term: 2 candidate_status { last_received { term: 1 index: 16 } } ignore_live_leader: false dest_uuid: "b110da3f2aa14447a08587fe94967dde"
I20260812 06:37:41.858304  4547 leader_election.cc:304] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2c451feba984198a5bff0dd8325536c; no voters: 53f9350752f44cc3947f0853eceb9933, b110da3f2aa14447a08587fe94967dde
I20260812 06:37:41.858526  4699 raft_consensus.cc:2749] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260812 06:37:41.919373  4475 raft_consensus.cc:1275] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 2 FOLLOWER]: Refusing update from remote peer b110da3f2aa14447a08587fe94967dde: Log matching property violated. Preceding OpId in replica: term: 1 index: 16. Preceding OpId from leader: term: 2 index: 17. (index mismatch)
I20260812 06:37:41.919981  4702 consensus_queue.cc:1048] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [LEADER]: Connected to new peer: Peer: permanent_uuid: "53f9350752f44cc3947f0853eceb9933" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 34069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260812 06:37:41.921350  4598 raft_consensus.cc:1275] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [term 2 FOLLOWER]: Refusing update from remote peer b110da3f2aa14447a08587fe94967dde: Log matching property violated. Preceding OpId in replica: term: 1 index: 16. Preceding OpId from leader: term: 2 index: 17. (index mismatch)
I20260812 06:37:41.921785  4702 consensus_queue.cc:1048] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2c451feba984198a5bff0dd8325536c" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 45153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260812 06:37:42.023517  4699 raft_consensus.cc:493] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [term 2 FOLLOWER]: Starting leader election (detected failure of leader b110da3f2aa14447a08587fe94967dde)
I20260812 06:37:42.023720  4699 raft_consensus.cc:3060] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [term 2 FOLLOWER]: Advancing to term 3
I20260812 06:37:42.024819  4699 raft_consensus.cc:515] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f9350752f44cc3947f0853eceb9933" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 34069 } } peers { permanent_uuid: "c2c451feba984198a5bff0dd8325536c" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 45153 } } peers { permanent_uuid: "b110da3f2aa14447a08587fe94967dde" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40241 } }
I20260812 06:37:42.025280  4699 leader_election.cc:290] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [CANDIDATE]: Term 3 election: Requested vote from peers 53f9350752f44cc3947f0853eceb9933 (127.3.28.194:34069), b110da3f2aa14447a08587fe94967dde (127.3.28.193:40241)
I20260812 06:37:42.025803  4475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40088c3774b040fcade8002ce521e52c" candidate_uuid: "c2c451feba984198a5bff0dd8325536c" candidate_term: 3 candidate_status { last_received { term: 2 index: 17 } } ignore_live_leader: false dest_uuid: "53f9350752f44cc3947f0853eceb9933"
I20260812 06:37:42.025998  4351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40088c3774b040fcade8002ce521e52c" candidate_uuid: "c2c451feba984198a5bff0dd8325536c" candidate_term: 3 candidate_status { last_received { term: 2 index: 17 } } ignore_live_leader: false dest_uuid: "b110da3f2aa14447a08587fe94967dde"
I20260812 06:37:42.026491  4547 leader_election.cc:304] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2c451feba984198a5bff0dd8325536c; no voters: 53f9350752f44cc3947f0853eceb9933, b110da3f2aa14447a08587fe94967dde
I20260812 06:37:42.026700  4699 raft_consensus.cc:2749] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260812 06:37:42.042666  4598 raft_consensus.cc:1240] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [term 3 FOLLOWER]: Rejecting Update request from peer b110da3f2aa14447a08587fe94967dde for earlier term 2. Current term is 3. Ops: []
I20260812 06:37:42.043278  4747 consensus_queue.cc:1059] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c2c451feba984198a5bff0dd8325536c" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 45153 }, Status: INVALID_TERM, Last received: 2.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260812 06:37:42.107406  4702 raft_consensus.cc:3055] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [term 2 LEADER]: Stepping down as leader of term 2
I20260812 06:37:42.107547  4702 raft_consensus.cc:740] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b110da3f2aa14447a08587fe94967dde, State: Running, Role: LEADER
I20260812 06:37:42.107800  4702 consensus_queue.cc:260] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 2.17, Last appended by leader: 17, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f9350752f44cc3947f0853eceb9933" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 34069 } } peers { permanent_uuid: "c2c451feba984198a5bff0dd8325536c" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 45153 } } peers { permanent_uuid: "b110da3f2aa14447a08587fe94967dde" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40241 } }
I20260812 06:37:42.108031  4702 raft_consensus.cc:3060] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [term 2 FOLLOWER]: Advancing to term 3
I20260812 06:37:42.125049  4742 raft_consensus.cc:493] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b110da3f2aa14447a08587fe94967dde)
I20260812 06:37:42.125252  4742 raft_consensus.cc:3060] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 2 FOLLOWER]: Advancing to term 3
I20260812 06:37:42.126334  4742 raft_consensus.cc:515] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f9350752f44cc3947f0853eceb9933" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 34069 } } peers { permanent_uuid: "c2c451feba984198a5bff0dd8325536c" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 45153 } } peers { permanent_uuid: "b110da3f2aa14447a08587fe94967dde" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40241 } }
I20260812 06:37:42.126919  4742 leader_election.cc:290] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [CANDIDATE]: Term 3 election: Requested vote from peers c2c451feba984198a5bff0dd8325536c (127.3.28.195:45153), b110da3f2aa14447a08587fe94967dde (127.3.28.193:40241)
I20260812 06:37:42.127631  4351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40088c3774b040fcade8002ce521e52c" candidate_uuid: "53f9350752f44cc3947f0853eceb9933" candidate_term: 3 candidate_status { last_received { term: 2 index: 17 } } ignore_live_leader: false dest_uuid: "b110da3f2aa14447a08587fe94967dde"
I20260812 06:37:42.127637  4598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40088c3774b040fcade8002ce521e52c" candidate_uuid: "53f9350752f44cc3947f0853eceb9933" candidate_term: 3 candidate_status { last_received { term: 2 index: 17 } } ignore_live_leader: false dest_uuid: "c2c451feba984198a5bff0dd8325536c"
I20260812 06:37:42.127862  4598 raft_consensus.cc:2393] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 53f9350752f44cc3947f0853eceb9933 in current term 3: Already voted for candidate c2c451feba984198a5bff0dd8325536c in this term.
I20260812 06:37:42.129123  4351 raft_consensus.cc:2468] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53f9350752f44cc3947f0853eceb9933 in term 3.
I20260812 06:37:42.129544  4420 leader_election.cc:304] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53f9350752f44cc3947f0853eceb9933, b110da3f2aa14447a08587fe94967dde; no voters: c2c451feba984198a5bff0dd8325536c
I20260812 06:37:42.129791  4742 raft_consensus.cc:2804] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 06:37:42.129925  4742 raft_consensus.cc:697] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 3 LEADER]: Becoming Leader. State: Replica: 53f9350752f44cc3947f0853eceb9933, State: Running, Role: LEADER
I20260812 06:37:42.130132  4742 consensus_queue.cc:237] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 2.17, Last appended by leader: 17, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f9350752f44cc3947f0853eceb9933" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 34069 } } peers { permanent_uuid: "c2c451feba984198a5bff0dd8325536c" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 45153 } } peers { permanent_uuid: "b110da3f2aa14447a08587fe94967dde" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40241 } }
I20260812 06:37:42.131868  4182 catalog_manager.cc:5719] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 reported cstate change: term changed from 2 to 3, leader changed from b110da3f2aa14447a08587fe94967dde (127.3.28.193) to 53f9350752f44cc3947f0853eceb9933 (127.3.28.194). New cstate: current_term: 3 leader_uuid: "53f9350752f44cc3947f0853eceb9933" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f9350752f44cc3947f0853eceb9933" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 34069 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c2c451feba984198a5bff0dd8325536c" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 45153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b110da3f2aa14447a08587fe94967dde" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40241 } health_report { overall_health: UNKNOWN } } }
I20260812 06:37:42.164525  4699 raft_consensus.cc:493] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:37:42.164700  4699 raft_consensus.cc:3060] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [term 3 FOLLOWER]: Advancing to term 4
I20260812 06:37:42.165730  4699 raft_consensus.cc:515] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f9350752f44cc3947f0853eceb9933" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 34069 } } peers { permanent_uuid: "c2c451feba984198a5bff0dd8325536c" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 45153 } } peers { permanent_uuid: "b110da3f2aa14447a08587fe94967dde" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40241 } }
I20260812 06:37:42.166301  4699 leader_election.cc:290] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [CANDIDATE]: Term 4 election: Requested vote from peers 53f9350752f44cc3947f0853eceb9933 (127.3.28.194:34069), b110da3f2aa14447a08587fe94967dde (127.3.28.193:40241)
I20260812 06:37:42.166890  4475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40088c3774b040fcade8002ce521e52c" candidate_uuid: "c2c451feba984198a5bff0dd8325536c" candidate_term: 4 candidate_status { last_received { term: 2 index: 17 } } ignore_live_leader: false dest_uuid: "53f9350752f44cc3947f0853eceb9933"
I20260812 06:37:42.166939  4351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40088c3774b040fcade8002ce521e52c" candidate_uuid: "c2c451feba984198a5bff0dd8325536c" candidate_term: 4 candidate_status { last_received { term: 2 index: 17 } } ignore_live_leader: false dest_uuid: "b110da3f2aa14447a08587fe94967dde"
I20260812 06:37:42.167121  4351 raft_consensus.cc:3060] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [term 3 FOLLOWER]: Advancing to term 4
I20260812 06:37:42.168035  4351 raft_consensus.cc:2468] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2c451feba984198a5bff0dd8325536c in term 4.
I20260812 06:37:42.168431  4547 leader_election.cc:304] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b110da3f2aa14447a08587fe94967dde, c2c451feba984198a5bff0dd8325536c; no voters: 53f9350752f44cc3947f0853eceb9933
I20260812 06:37:42.168648  4699 raft_consensus.cc:2804] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [term 4 FOLLOWER]: Leader election won for term 4
I20260812 06:37:42.168836  4699 raft_consensus.cc:697] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [term 4 LEADER]: Becoming Leader. State: Replica: c2c451feba984198a5bff0dd8325536c, State: Running, Role: LEADER
I20260812 06:37:42.169028  4699 consensus_queue.cc:237] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 2.17, Last appended by leader: 17, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f9350752f44cc3947f0853eceb9933" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 34069 } } peers { permanent_uuid: "c2c451feba984198a5bff0dd8325536c" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 45153 } } peers { permanent_uuid: "b110da3f2aa14447a08587fe94967dde" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40241 } }
I20260812 06:37:42.172154  4180 catalog_manager.cc:5719] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c reported cstate change: term changed from 3 to 4, leader changed from 53f9350752f44cc3947f0853eceb9933 (127.3.28.194) to c2c451feba984198a5bff0dd8325536c (127.3.28.195). New cstate: current_term: 4 leader_uuid: "c2c451feba984198a5bff0dd8325536c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f9350752f44cc3947f0853eceb9933" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 34069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2c451feba984198a5bff0dd8325536c" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 45153 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b110da3f2aa14447a08587fe94967dde" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40241 } health_report { overall_health: UNKNOWN } } }
I20260812 06:37:42.241825  4598 raft_consensus.cc:1240] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [term 4 LEADER]: Rejecting Update request from peer 53f9350752f44cc3947f0853eceb9933 for earlier term 3. Current term is 4. Ops: []
I20260812 06:37:42.242499  4742 consensus_queue.cc:1059] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c2c451feba984198a5bff0dd8325536c" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 45153 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260812 06:37:42.242710  4742 consensus_queue.cc:1243] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [LEADER]: Peer c2c451feba984198a5bff0dd8325536c log is divergent from this leader: its last log entry 4.18 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 17
I20260812 06:37:42.253088  4351 raft_consensus.cc:1240] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [term 4 FOLLOWER]: Rejecting Update request from peer 53f9350752f44cc3947f0853eceb9933 for earlier term 3. Current term is 4. Ops: []
I20260812 06:37:42.253733  4742 consensus_queue.cc:1059] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b110da3f2aa14447a08587fe94967dde" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40241 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260812 06:37:42.270113  4351 raft_consensus.cc:1275] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [term 4 FOLLOWER]: Refusing update from remote peer c2c451feba984198a5bff0dd8325536c: Log matching property violated. Preceding OpId in replica: term: 2 index: 17. Preceding OpId from leader: term: 4 index: 18. (index mismatch)
I20260812 06:37:42.270684  4699 consensus_queue.cc:1048] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [LEADER]: Connected to new peer: Peer: permanent_uuid: "b110da3f2aa14447a08587fe94967dde" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260812 06:37:42.288964  4721 raft_consensus.cc:3055] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 3 LEADER]: Stepping down as leader of term 3
I20260812 06:37:42.289096  4721 raft_consensus.cc:740] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 53f9350752f44cc3947f0853eceb9933, State: Running, Role: LEADER
I20260812 06:37:42.289340  4721 consensus_queue.cc:260] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 3.18, Last appended by leader: 18, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f9350752f44cc3947f0853eceb9933" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 34069 } } peers { permanent_uuid: "c2c451feba984198a5bff0dd8325536c" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 45153 } } peers { permanent_uuid: "b110da3f2aa14447a08587fe94967dde" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40241 } }
I20260812 06:37:42.289628  4721 raft_consensus.cc:3060] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 3 FOLLOWER]: Advancing to term 4
I20260812 06:37:42.291131  4475 raft_consensus.cc:1275] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 4 FOLLOWER]: Refusing update from remote peer c2c451feba984198a5bff0dd8325536c: Log matching property violated. Preceding OpId in replica: term: 3 index: 18. Preceding OpId from leader: term: 4 index: 18. (term mismatch)
I20260812 06:37:42.291204  4475 pending_rounds.cc:85] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933: Aborting all ops after (but not including) 17
I20260812 06:37:42.291224  4475 pending_rounds.cc:107] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933: Aborting uncommitted NO_OP operation due to leader change: 3.18
I20260812 06:37:42.291244  4475 raft_consensus.cc:2889] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 06:37:42.291878  4699 consensus_queue.cc:1048] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [LEADER]: Connected to new peer: Peer: permanent_uuid: "53f9350752f44cc3947f0853eceb9933" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 34069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260812 06:37:42.373719  4702 raft_consensus.cc:493] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [term 4 FOLLOWER]: Starting leader election (detected failure of leader c2c451feba984198a5bff0dd8325536c)
I20260812 06:37:42.373930  4702 raft_consensus.cc:3060] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [term 4 FOLLOWER]: Advancing to term 5
I20260812 06:37:42.375109  4702 raft_consensus.cc:515] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f9350752f44cc3947f0853eceb9933" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 34069 } } peers { permanent_uuid: "c2c451feba984198a5bff0dd8325536c" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 45153 } } peers { permanent_uuid: "b110da3f2aa14447a08587fe94967dde" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40241 } }
I20260812 06:37:42.375685  4702 leader_election.cc:290] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [CANDIDATE]: Term 5 election: Requested vote from peers 53f9350752f44cc3947f0853eceb9933 (127.3.28.194:34069), c2c451feba984198a5bff0dd8325536c (127.3.28.195:45153)
I20260812 06:37:42.376333  4598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40088c3774b040fcade8002ce521e52c" candidate_uuid: "b110da3f2aa14447a08587fe94967dde" candidate_term: 5 candidate_status { last_received { term: 4 index: 18 } } ignore_live_leader: false dest_uuid: "c2c451feba984198a5bff0dd8325536c"
I20260812 06:37:42.376372  4475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40088c3774b040fcade8002ce521e52c" candidate_uuid: "b110da3f2aa14447a08587fe94967dde" candidate_term: 5 candidate_status { last_received { term: 4 index: 18 } } ignore_live_leader: false dest_uuid: "53f9350752f44cc3947f0853eceb9933"
I20260812 06:37:42.376909  4298 leader_election.cc:304] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b110da3f2aa14447a08587fe94967dde; no voters: 53f9350752f44cc3947f0853eceb9933, c2c451feba984198a5bff0dd8325536c
I20260812 06:37:42.377275  4702 raft_consensus.cc:2749] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260812 06:37:42.380849  4351 raft_consensus.cc:1240] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [term 5 FOLLOWER]: Rejecting Update request from peer c2c451feba984198a5bff0dd8325536c for earlier term 4. Current term is 5. Ops: []
I20260812 06:37:42.381340  4750 consensus_queue.cc:1059] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b110da3f2aa14447a08587fe94967dde" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40241 }, Status: INVALID_TERM, Last received: 4.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260812 06:37:42.462538  4351 raft_consensus.cc:1240] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [term 5 FOLLOWER]: Rejecting Update request from peer c2c451feba984198a5bff0dd8325536c for earlier term 4. Current term is 5. Ops: []
I20260812 06:37:42.463109  4750 consensus_queue.cc:1059] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b110da3f2aa14447a08587fe94967dde" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40241 }, Status: INVALID_TERM, Last received: 4.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260812 06:37:42.519008  4752 raft_consensus.cc:3055] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [term 4 LEADER]: Stepping down as leader of term 4
I20260812 06:37:42.519137  4752 raft_consensus.cc:740] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c2c451feba984198a5bff0dd8325536c, State: Running, Role: LEADER
I20260812 06:37:42.519428  4752 consensus_queue.cc:260] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 4.18, Last appended by leader: 18, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f9350752f44cc3947f0853eceb9933" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 34069 } } peers { permanent_uuid: "c2c451feba984198a5bff0dd8325536c" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 45153 } } peers { permanent_uuid: "b110da3f2aa14447a08587fe94967dde" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40241 } }
I20260812 06:37:42.519699  4752 raft_consensus.cc:3060] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [term 4 FOLLOWER]: Advancing to term 5
I20260812 06:37:42.522889  4702 raft_consensus.cc:493] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:37:42.523020  4702 raft_consensus.cc:3060] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [term 5 FOLLOWER]: Advancing to term 6
I20260812 06:37:42.523940  4702 raft_consensus.cc:515] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f9350752f44cc3947f0853eceb9933" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 34069 } } peers { permanent_uuid: "c2c451feba984198a5bff0dd8325536c" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 45153 } } peers { permanent_uuid: "b110da3f2aa14447a08587fe94967dde" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40241 } }
I20260812 06:37:42.524427  4702 leader_election.cc:290] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [CANDIDATE]: Term 6 election: Requested vote from peers 53f9350752f44cc3947f0853eceb9933 (127.3.28.194:34069), c2c451feba984198a5bff0dd8325536c (127.3.28.195:45153)
I20260812 06:37:42.524947  4598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40088c3774b040fcade8002ce521e52c" candidate_uuid: "b110da3f2aa14447a08587fe94967dde" candidate_term: 6 candidate_status { last_received { term: 4 index: 18 } } ignore_live_leader: false dest_uuid: "c2c451feba984198a5bff0dd8325536c"
I20260812 06:37:42.524945  4475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40088c3774b040fcade8002ce521e52c" candidate_uuid: "b110da3f2aa14447a08587fe94967dde" candidate_term: 6 candidate_status { last_received { term: 4 index: 18 } } ignore_live_leader: false dest_uuid: "53f9350752f44cc3947f0853eceb9933"
I20260812 06:37:42.525123  4598 raft_consensus.cc:3060] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [term 5 FOLLOWER]: Advancing to term 6
I20260812 06:37:42.526054  4598 raft_consensus.cc:2468] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b110da3f2aa14447a08587fe94967dde in term 6.
I20260812 06:37:42.526475  4299 leader_election.cc:304] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b110da3f2aa14447a08587fe94967dde, c2c451feba984198a5bff0dd8325536c; no voters: 53f9350752f44cc3947f0853eceb9933
I20260812 06:37:42.526682  4702 raft_consensus.cc:2804] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [term 6 FOLLOWER]: Leader election won for term 6
I20260812 06:37:42.526803  4702 raft_consensus.cc:697] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [term 6 LEADER]: Becoming Leader. State: Replica: b110da3f2aa14447a08587fe94967dde, State: Running, Role: LEADER
I20260812 06:37:42.526971  4702 consensus_queue.cc:237] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 4.18, Last appended by leader: 18, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f9350752f44cc3947f0853eceb9933" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 34069 } } peers { permanent_uuid: "c2c451feba984198a5bff0dd8325536c" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 45153 } } peers { permanent_uuid: "b110da3f2aa14447a08587fe94967dde" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40241 } }
I20260812 06:37:42.528543  4180 catalog_manager.cc:5719] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde reported cstate change: term changed from 4 to 6, leader changed from c2c451feba984198a5bff0dd8325536c (127.3.28.195) to b110da3f2aa14447a08587fe94967dde (127.3.28.193). New cstate: current_term: 6 leader_uuid: "b110da3f2aa14447a08587fe94967dde" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f9350752f44cc3947f0853eceb9933" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 34069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2c451feba984198a5bff0dd8325536c" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 45153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b110da3f2aa14447a08587fe94967dde" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40241 } health_report { overall_health: HEALTHY } } }
I20260812 06:37:42.593998  4721 raft_consensus.cc:493] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c2c451feba984198a5bff0dd8325536c)
I20260812 06:37:42.594202  4721 raft_consensus.cc:3060] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 4 FOLLOWER]: Advancing to term 5
I20260812 06:37:42.595309  4721 raft_consensus.cc:515] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f9350752f44cc3947f0853eceb9933" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 34069 } } peers { permanent_uuid: "c2c451feba984198a5bff0dd8325536c" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 45153 } } peers { permanent_uuid: "b110da3f2aa14447a08587fe94967dde" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40241 } }
I20260812 06:37:42.595798  4721 leader_election.cc:290] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [CANDIDATE]: Term 5 election: Requested vote from peers c2c451feba984198a5bff0dd8325536c (127.3.28.195:45153), b110da3f2aa14447a08587fe94967dde (127.3.28.193:40241)
I20260812 06:37:42.596377  4598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40088c3774b040fcade8002ce521e52c" candidate_uuid: "53f9350752f44cc3947f0853eceb9933" candidate_term: 5 candidate_status { last_received { term: 4 index: 18 } } ignore_live_leader: false dest_uuid: "c2c451feba984198a5bff0dd8325536c"
I20260812 06:37:42.596405  4351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40088c3774b040fcade8002ce521e52c" candidate_uuid: "53f9350752f44cc3947f0853eceb9933" candidate_term: 5 candidate_status { last_received { term: 4 index: 18 } } ignore_live_leader: false dest_uuid: "b110da3f2aa14447a08587fe94967dde"
I20260812 06:37:42.596547  4598 raft_consensus.cc:2368] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 53f9350752f44cc3947f0853eceb9933 for earlier term 5. Current term is 6.
I20260812 06:37:42.596941  4421 leader_election.cc:400] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [CANDIDATE]: Term 5 election: Vote denied by peer c2c451feba984198a5bff0dd8325536c (127.3.28.195:45153) with higher term. Message: Invalid argument: T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 53f9350752f44cc3947f0853eceb9933 for earlier term 5. Current term is 6.
I20260812 06:37:42.596988  4421 leader_election.cc:403] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260812 06:37:42.597124  4721 raft_consensus.cc:3060] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 5 FOLLOWER]: Advancing to term 6
I20260812 06:37:42.597919  4721 raft_consensus.cc:2749] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer c2c451feba984198a5bff0dd8325536c (127.3.28.195:45153) with higher term. Message: Invalid argument: T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 53f9350752f44cc3947f0853eceb9933 for earlier term 5. Current term is 6.
I20260812 06:37:42.621803  4598 raft_consensus.cc:1275] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [term 6 FOLLOWER]: Refusing update from remote peer b110da3f2aa14447a08587fe94967dde: Log matching property violated. Preceding OpId in replica: term: 4 index: 18. Preceding OpId from leader: term: 6 index: 19. (index mismatch)
I20260812 06:37:42.622426  4702 consensus_queue.cc:1048] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2c451feba984198a5bff0dd8325536c" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 45153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260812 06:37:42.639976  4475 raft_consensus.cc:1275] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 6 FOLLOWER]: Refusing update from remote peer b110da3f2aa14447a08587fe94967dde: Log matching property violated. Preceding OpId in replica: term: 4 index: 18. Preceding OpId from leader: term: 6 index: 19. (index mismatch)
I20260812 06:37:42.640475  4702 consensus_queue.cc:1048] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [LEADER]: Connected to new peer: Peer: permanent_uuid: "53f9350752f44cc3947f0853eceb9933" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 34069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260812 06:37:42.741796  4721 raft_consensus.cc:493] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b110da3f2aa14447a08587fe94967dde)
I20260812 06:37:42.741974  4721 raft_consensus.cc:3060] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 6 FOLLOWER]: Advancing to term 7
I20260812 06:37:42.743016  4721 raft_consensus.cc:515] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f9350752f44cc3947f0853eceb9933" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 34069 } } peers { permanent_uuid: "c2c451feba984198a5bff0dd8325536c" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 45153 } } peers { permanent_uuid: "b110da3f2aa14447a08587fe94967dde" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40241 } }
I20260812 06:37:42.743541  4721 leader_election.cc:290] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [CANDIDATE]: Term 7 election: Requested vote from peers c2c451feba984198a5bff0dd8325536c (127.3.28.195:45153), b110da3f2aa14447a08587fe94967dde (127.3.28.193:40241)
I20260812 06:37:42.744004  4351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40088c3774b040fcade8002ce521e52c" candidate_uuid: "53f9350752f44cc3947f0853eceb9933" candidate_term: 7 candidate_status { last_received { term: 6 index: 19 } } ignore_live_leader: false dest_uuid: "b110da3f2aa14447a08587fe94967dde"
I20260812 06:37:42.743975  4598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40088c3774b040fcade8002ce521e52c" candidate_uuid: "53f9350752f44cc3947f0853eceb9933" candidate_term: 7 candidate_status { last_received { term: 6 index: 19 } } ignore_live_leader: false dest_uuid: "c2c451feba984198a5bff0dd8325536c"
I20260812 06:37:42.744482  4420 leader_election.cc:304] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53f9350752f44cc3947f0853eceb9933; no voters: b110da3f2aa14447a08587fe94967dde, c2c451feba984198a5bff0dd8325536c
I20260812 06:37:42.744663  4721 raft_consensus.cc:2749] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260812 06:37:42.752592  4475 raft_consensus.cc:1240] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 7 FOLLOWER]: Rejecting Update request from peer b110da3f2aa14447a08587fe94967dde for earlier term 6. Current term is 7. Ops: []
I20260812 06:37:42.753142  4753 consensus_queue.cc:1059] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "53f9350752f44cc3947f0853eceb9933" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 34069 }, Status: INVALID_TERM, Last received: 6.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260812 06:37:42.853477  4721 raft_consensus.cc:493] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:37:42.853673  4721 raft_consensus.cc:3060] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 7 FOLLOWER]: Advancing to term 8
I20260812 06:37:42.854784  4721 raft_consensus.cc:515] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f9350752f44cc3947f0853eceb9933" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 34069 } } peers { permanent_uuid: "c2c451feba984198a5bff0dd8325536c" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 45153 } } peers { permanent_uuid: "b110da3f2aa14447a08587fe94967dde" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40241 } }
I20260812 06:37:42.855348  4721 leader_election.cc:290] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [CANDIDATE]: Term 8 election: Requested vote from peers c2c451feba984198a5bff0dd8325536c (127.3.28.195:45153), b110da3f2aa14447a08587fe94967dde (127.3.28.193:40241)
I20260812 06:37:42.855810  4598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40088c3774b040fcade8002ce521e52c" candidate_uuid: "53f9350752f44cc3947f0853eceb9933" candidate_term: 8 candidate_status { last_received { term: 6 index: 19 } } ignore_live_leader: false dest_uuid: "c2c451feba984198a5bff0dd8325536c"
I20260812 06:37:42.855870  4351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40088c3774b040fcade8002ce521e52c" candidate_uuid: "53f9350752f44cc3947f0853eceb9933" candidate_term: 8 candidate_status { last_received { term: 6 index: 19 } } ignore_live_leader: false dest_uuid: "b110da3f2aa14447a08587fe94967dde"
I20260812 06:37:42.856364  4420 leader_election.cc:304] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53f9350752f44cc3947f0853eceb9933; no voters: b110da3f2aa14447a08587fe94967dde, c2c451feba984198a5bff0dd8325536c
I20260812 06:37:42.856594  4721 raft_consensus.cc:2749] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260812 06:37:42.870754  4475 raft_consensus.cc:1240] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 8 FOLLOWER]: Rejecting Update request from peer b110da3f2aa14447a08587fe94967dde for earlier term 6. Current term is 8. Ops: []
I20260812 06:37:42.871323  4753 consensus_queue.cc:1059] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "53f9350752f44cc3947f0853eceb9933" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 34069 }, Status: INVALID_TERM, Last received: 6.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260812 06:37:42.904829  4752 raft_consensus.cc:493] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [term 6 FOLLOWER]: Starting leader election (detected failure of leader b110da3f2aa14447a08587fe94967dde)
I20260812 06:37:42.905002  4752 raft_consensus.cc:3060] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [term 6 FOLLOWER]: Advancing to term 7
I20260812 06:37:42.906054  4752 raft_consensus.cc:515] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f9350752f44cc3947f0853eceb9933" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 34069 } } peers { permanent_uuid: "c2c451feba984198a5bff0dd8325536c" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 45153 } } peers { permanent_uuid: "b110da3f2aa14447a08587fe94967dde" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40241 } }
I20260812 06:37:42.906540  4752 leader_election.cc:290] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [CANDIDATE]: Term 7 election: Requested vote from peers 53f9350752f44cc3947f0853eceb9933 (127.3.28.194:34069), b110da3f2aa14447a08587fe94967dde (127.3.28.193:40241)
I20260812 06:37:42.906984  4475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40088c3774b040fcade8002ce521e52c" candidate_uuid: "c2c451feba984198a5bff0dd8325536c" candidate_term: 7 candidate_status { last_received { term: 6 index: 19 } } ignore_live_leader: false dest_uuid: "53f9350752f44cc3947f0853eceb9933"
I20260812 06:37:42.907163  4475 raft_consensus.cc:2368] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c2c451feba984198a5bff0dd8325536c for earlier term 7. Current term is 8.
I20260812 06:37:42.907166  4351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40088c3774b040fcade8002ce521e52c" candidate_uuid: "c2c451feba984198a5bff0dd8325536c" candidate_term: 7 candidate_status { last_received { term: 6 index: 19 } } ignore_live_leader: false dest_uuid: "b110da3f2aa14447a08587fe94967dde"
I20260812 06:37:42.907615  4547 leader_election.cc:400] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [CANDIDATE]: Term 7 election: Vote denied by peer 53f9350752f44cc3947f0853eceb9933 (127.3.28.194:34069) with higher term. Message: Invalid argument: T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c2c451feba984198a5bff0dd8325536c for earlier term 7. Current term is 8.
I20260812 06:37:42.907696  4547 leader_election.cc:403] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260812 06:37:42.907822  4752 raft_consensus.cc:3060] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [term 7 FOLLOWER]: Advancing to term 8
I20260812 06:37:42.908658  4752 raft_consensus.cc:2749] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 53f9350752f44cc3947f0853eceb9933 (127.3.28.194:34069) with higher term. Message: Invalid argument: T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c2c451feba984198a5bff0dd8325536c for earlier term 7. Current term is 8.
I20260812 06:37:42.929626  4702 raft_consensus.cc:3055] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [term 6 LEADER]: Stepping down as leader of term 6
I20260812 06:37:42.929756  4702 raft_consensus.cc:740] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b110da3f2aa14447a08587fe94967dde, State: Running, Role: LEADER
I20260812 06:37:42.929998  4702 consensus_queue.cc:260] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 6.19, Last appended by leader: 19, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f9350752f44cc3947f0853eceb9933" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 34069 } } peers { permanent_uuid: "c2c451feba984198a5bff0dd8325536c" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 45153 } } peers { permanent_uuid: "b110da3f2aa14447a08587fe94967dde" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40241 } }
I20260812 06:37:42.930266  4702 raft_consensus.cc:3060] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [term 6 FOLLOWER]: Advancing to term 7
I20260812 06:37:42.995595  4721 raft_consensus.cc:493] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:37:42.995762  4721 raft_consensus.cc:3060] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 8 FOLLOWER]: Advancing to term 9
I20260812 06:37:42.997025  4721 raft_consensus.cc:515] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f9350752f44cc3947f0853eceb9933" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 34069 } } peers { permanent_uuid: "c2c451feba984198a5bff0dd8325536c" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 45153 } } peers { permanent_uuid: "b110da3f2aa14447a08587fe94967dde" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40241 } }
I20260812 06:37:42.997613  4721 leader_election.cc:290] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [CANDIDATE]: Term 9 election: Requested vote from peers c2c451feba984198a5bff0dd8325536c (127.3.28.195:45153), b110da3f2aa14447a08587fe94967dde (127.3.28.193:40241)
I20260812 06:37:42.998051  4598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40088c3774b040fcade8002ce521e52c" candidate_uuid: "53f9350752f44cc3947f0853eceb9933" candidate_term: 9 candidate_status { last_received { term: 6 index: 19 } } ignore_live_leader: false dest_uuid: "c2c451feba984198a5bff0dd8325536c"
I20260812 06:37:42.998059  4351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40088c3774b040fcade8002ce521e52c" candidate_uuid: "53f9350752f44cc3947f0853eceb9933" candidate_term: 9 candidate_status { last_received { term: 6 index: 19 } } ignore_live_leader: false dest_uuid: "b110da3f2aa14447a08587fe94967dde"
I20260812 06:37:42.998262  4351 raft_consensus.cc:3060] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [term 7 FOLLOWER]: Advancing to term 9
I20260812 06:37:42.999315  4351 raft_consensus.cc:2468] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53f9350752f44cc3947f0853eceb9933 in term 9.
I20260812 06:37:42.999666  4420 leader_election.cc:304] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53f9350752f44cc3947f0853eceb9933, b110da3f2aa14447a08587fe94967dde; no voters: c2c451feba984198a5bff0dd8325536c
I20260812 06:37:42.999887  4721 raft_consensus.cc:2804] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 9 FOLLOWER]: Leader election won for term 9
I20260812 06:37:43.000110  4721 raft_consensus.cc:697] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 9 LEADER]: Becoming Leader. State: Replica: 53f9350752f44cc3947f0853eceb9933, State: Running, Role: LEADER
I20260812 06:37:43.000473  4721 consensus_queue.cc:237] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 6.19, Last appended by leader: 19, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f9350752f44cc3947f0853eceb9933" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 34069 } } peers { permanent_uuid: "c2c451feba984198a5bff0dd8325536c" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 45153 } } peers { permanent_uuid: "b110da3f2aa14447a08587fe94967dde" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40241 } }
I20260812 06:37:43.002213  4180 catalog_manager.cc:5719] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 reported cstate change: term changed from 6 to 9, leader changed from b110da3f2aa14447a08587fe94967dde (127.3.28.193) to 53f9350752f44cc3947f0853eceb9933 (127.3.28.194). New cstate: current_term: 9 leader_uuid: "53f9350752f44cc3947f0853eceb9933" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f9350752f44cc3947f0853eceb9933" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 34069 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c2c451feba984198a5bff0dd8325536c" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 45153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b110da3f2aa14447a08587fe94967dde" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40241 } health_report { overall_health: UNKNOWN } } }
I20260812 06:37:43.042591  4752 raft_consensus.cc:493] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:37:43.042740  4752 raft_consensus.cc:3060] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [term 8 FOLLOWER]: Advancing to term 9
I20260812 06:37:43.043773  4752 raft_consensus.cc:515] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f9350752f44cc3947f0853eceb9933" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 34069 } } peers { permanent_uuid: "c2c451feba984198a5bff0dd8325536c" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 45153 } } peers { permanent_uuid: "b110da3f2aa14447a08587fe94967dde" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40241 } }
I20260812 06:37:43.044258  4752 leader_election.cc:290] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [CANDIDATE]: Term 9 election: Requested vote from peers 53f9350752f44cc3947f0853eceb9933 (127.3.28.194:34069), b110da3f2aa14447a08587fe94967dde (127.3.28.193:40241)
I20260812 06:37:43.044966  4475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40088c3774b040fcade8002ce521e52c" candidate_uuid: "c2c451feba984198a5bff0dd8325536c" candidate_term: 9 candidate_status { last_received { term: 6 index: 19 } } ignore_live_leader: false dest_uuid: "53f9350752f44cc3947f0853eceb9933"
I20260812 06:37:43.045019  4351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40088c3774b040fcade8002ce521e52c" candidate_uuid: "c2c451feba984198a5bff0dd8325536c" candidate_term: 9 candidate_status { last_received { term: 6 index: 19 } } ignore_live_leader: false dest_uuid: "b110da3f2aa14447a08587fe94967dde"
I20260812 06:37:43.045181  4351 raft_consensus.cc:2393] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c2c451feba984198a5bff0dd8325536c in current term 9: Already voted for candidate 53f9350752f44cc3947f0853eceb9933 in this term.
I20260812 06:37:43.045455  4547 leader_election.cc:304] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2c451feba984198a5bff0dd8325536c; no voters: 53f9350752f44cc3947f0853eceb9933, b110da3f2aa14447a08587fe94967dde
I20260812 06:37:43.045640  4752 raft_consensus.cc:2749] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260812 06:37:43.088477  4598 raft_consensus.cc:1275] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [term 9 FOLLOWER]: Refusing update from remote peer 53f9350752f44cc3947f0853eceb9933: Log matching property violated. Preceding OpId in replica: term: 6 index: 19. Preceding OpId from leader: term: 9 index: 20. (index mismatch)
I20260812 06:37:43.089051  4721 consensus_queue.cc:1048] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2c451feba984198a5bff0dd8325536c" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 45153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260812 06:37:43.119894  4351 raft_consensus.cc:1275] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [term 9 FOLLOWER]: Refusing update from remote peer 53f9350752f44cc3947f0853eceb9933: Log matching property violated. Preceding OpId in replica: term: 6 index: 19. Preceding OpId from leader: term: 9 index: 20. (index mismatch)
I20260812 06:37:43.120482  4721 consensus_queue.cc:1048] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b110da3f2aa14447a08587fe94967dde" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260812 06:37:43.222303  4702 raft_consensus.cc:493] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [term 9 FOLLOWER]: Starting leader election (detected failure of leader 53f9350752f44cc3947f0853eceb9933)
I20260812 06:37:43.222596  4702 raft_consensus.cc:3060] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [term 9 FOLLOWER]: Advancing to term 10
I20260812 06:37:43.223719  4702 raft_consensus.cc:515] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f9350752f44cc3947f0853eceb9933" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 34069 } } peers { permanent_uuid: "c2c451feba984198a5bff0dd8325536c" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 45153 } } peers { permanent_uuid: "b110da3f2aa14447a08587fe94967dde" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40241 } }
I20260812 06:37:43.224256  4702 leader_election.cc:290] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [CANDIDATE]: Term 10 election: Requested vote from peers 53f9350752f44cc3947f0853eceb9933 (127.3.28.194:34069), c2c451feba984198a5bff0dd8325536c (127.3.28.195:45153)
I20260812 06:37:43.224725  4475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40088c3774b040fcade8002ce521e52c" candidate_uuid: "b110da3f2aa14447a08587fe94967dde" candidate_term: 10 candidate_status { last_received { term: 9 index: 20 } } ignore_live_leader: false dest_uuid: "53f9350752f44cc3947f0853eceb9933"
I20260812 06:37:43.224886  4598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40088c3774b040fcade8002ce521e52c" candidate_uuid: "b110da3f2aa14447a08587fe94967dde" candidate_term: 10 candidate_status { last_received { term: 9 index: 20 } } ignore_live_leader: false dest_uuid: "c2c451feba984198a5bff0dd8325536c"
I20260812 06:37:43.225283  4299 leader_election.cc:304] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b110da3f2aa14447a08587fe94967dde; no voters: 53f9350752f44cc3947f0853eceb9933, c2c451feba984198a5bff0dd8325536c
I20260812 06:37:43.225514  4702 raft_consensus.cc:2749] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260812 06:37:43.226449  4351 raft_consensus.cc:1240] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [term 10 FOLLOWER]: Rejecting Update request from peer 53f9350752f44cc3947f0853eceb9933 for earlier term 9. Current term is 10. Ops: []
I20260812 06:37:43.226912  4721 consensus_queue.cc:1059] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b110da3f2aa14447a08587fe94967dde" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40241 }, Status: INVALID_TERM, Last received: 9.20, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20260812 06:37:43.286657  4721 raft_consensus.cc:3055] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 9 LEADER]: Stepping down as leader of term 9
I20260812 06:37:43.286795  4721 raft_consensus.cc:740] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 53f9350752f44cc3947f0853eceb9933, State: Running, Role: LEADER
I20260812 06:37:43.287062  4721 consensus_queue.cc:260] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 9.20, Last appended by leader: 20, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f9350752f44cc3947f0853eceb9933" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 34069 } } peers { permanent_uuid: "c2c451feba984198a5bff0dd8325536c" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 45153 } } peers { permanent_uuid: "b110da3f2aa14447a08587fe94967dde" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40241 } }
I20260812 06:37:43.287289  4721 raft_consensus.cc:3060] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 9 FOLLOWER]: Advancing to term 10
I20260812 06:37:43.299669  4752 raft_consensus.cc:493] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 53f9350752f44cc3947f0853eceb9933)
I20260812 06:37:43.299865  4752 raft_consensus.cc:3060] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [term 9 FOLLOWER]: Advancing to term 10
I20260812 06:37:43.300947  4752 raft_consensus.cc:515] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f9350752f44cc3947f0853eceb9933" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 34069 } } peers { permanent_uuid: "c2c451feba984198a5bff0dd8325536c" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 45153 } } peers { permanent_uuid: "b110da3f2aa14447a08587fe94967dde" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40241 } }
I20260812 06:37:43.301523  4752 leader_election.cc:290] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [CANDIDATE]: Term 10 election: Requested vote from peers 53f9350752f44cc3947f0853eceb9933 (127.3.28.194:34069), b110da3f2aa14447a08587fe94967dde (127.3.28.193:40241)
I20260812 06:37:43.302089  4351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40088c3774b040fcade8002ce521e52c" candidate_uuid: "c2c451feba984198a5bff0dd8325536c" candidate_term: 10 candidate_status { last_received { term: 9 index: 20 } } ignore_live_leader: false dest_uuid: "b110da3f2aa14447a08587fe94967dde"
I20260812 06:37:43.302112  4475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40088c3774b040fcade8002ce521e52c" candidate_uuid: "c2c451feba984198a5bff0dd8325536c" candidate_term: 10 candidate_status { last_received { term: 9 index: 20 } } ignore_live_leader: false dest_uuid: "53f9350752f44cc3947f0853eceb9933"
I20260812 06:37:43.302225  4351 raft_consensus.cc:2393] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c2c451feba984198a5bff0dd8325536c in current term 10: Already voted for candidate b110da3f2aa14447a08587fe94967dde in this term.
I20260812 06:37:43.303272  4475 raft_consensus.cc:2468] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c2c451feba984198a5bff0dd8325536c in term 10.
I20260812 06:37:43.303691  4547 leader_election.cc:304] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53f9350752f44cc3947f0853eceb9933, c2c451feba984198a5bff0dd8325536c; no voters: b110da3f2aa14447a08587fe94967dde
I20260812 06:37:43.303902  4752 raft_consensus.cc:2804] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [term 10 FOLLOWER]: Leader election won for term 10
I20260812 06:37:43.304113  4752 raft_consensus.cc:697] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [term 10 LEADER]: Becoming Leader. State: Replica: c2c451feba984198a5bff0dd8325536c, State: Running, Role: LEADER
I20260812 06:37:43.304293  4752 consensus_queue.cc:237] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 9.20, Last appended by leader: 20, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f9350752f44cc3947f0853eceb9933" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 34069 } } peers { permanent_uuid: "c2c451feba984198a5bff0dd8325536c" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 45153 } } peers { permanent_uuid: "b110da3f2aa14447a08587fe94967dde" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40241 } }
I20260812 06:37:43.305967  4182 catalog_manager.cc:5719] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c reported cstate change: term changed from 9 to 10, leader changed from 53f9350752f44cc3947f0853eceb9933 (127.3.28.194) to c2c451feba984198a5bff0dd8325536c (127.3.28.195). New cstate: current_term: 10 leader_uuid: "c2c451feba984198a5bff0dd8325536c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f9350752f44cc3947f0853eceb9933" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 34069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2c451feba984198a5bff0dd8325536c" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 45153 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b110da3f2aa14447a08587fe94967dde" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40241 } health_report { overall_health: UNKNOWN } } }
I20260812 06:37:43.336266  4702 raft_consensus.cc:493] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:37:43.336433  4702 raft_consensus.cc:3060] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [term 10 FOLLOWER]: Advancing to term 11
I20260812 06:37:43.337502  4702 raft_consensus.cc:515] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f9350752f44cc3947f0853eceb9933" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 34069 } } peers { permanent_uuid: "c2c451feba984198a5bff0dd8325536c" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 45153 } } peers { permanent_uuid: "b110da3f2aa14447a08587fe94967dde" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40241 } }
I20260812 06:37:43.338047  4702 leader_election.cc:290] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [CANDIDATE]: Term 11 election: Requested vote from peers 53f9350752f44cc3947f0853eceb9933 (127.3.28.194:34069), c2c451feba984198a5bff0dd8325536c (127.3.28.195:45153)
I20260812 06:37:43.338588  4475 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40088c3774b040fcade8002ce521e52c" candidate_uuid: "b110da3f2aa14447a08587fe94967dde" candidate_term: 11 candidate_status { last_received { term: 9 index: 20 } } ignore_live_leader: false dest_uuid: "53f9350752f44cc3947f0853eceb9933"
I20260812 06:37:43.338634  4598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40088c3774b040fcade8002ce521e52c" candidate_uuid: "b110da3f2aa14447a08587fe94967dde" candidate_term: 11 candidate_status { last_received { term: 9 index: 20 } } ignore_live_leader: false dest_uuid: "c2c451feba984198a5bff0dd8325536c"
I20260812 06:37:43.338745  4475 raft_consensus.cc:3060] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 10 FOLLOWER]: Advancing to term 11
I20260812 06:37:43.339704  4475 raft_consensus.cc:2468] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b110da3f2aa14447a08587fe94967dde in term 11.
I20260812 06:37:43.340070  4298 leader_election.cc:304] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53f9350752f44cc3947f0853eceb9933, b110da3f2aa14447a08587fe94967dde; no voters: c2c451feba984198a5bff0dd8325536c
I20260812 06:37:43.340272  4702 raft_consensus.cc:2804] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [term 11 FOLLOWER]: Leader election won for term 11
I20260812 06:37:43.340378  4702 raft_consensus.cc:697] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [term 11 LEADER]: Becoming Leader. State: Replica: b110da3f2aa14447a08587fe94967dde, State: Running, Role: LEADER
I20260812 06:37:43.340581  4702 consensus_queue.cc:237] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 9.20, Last appended by leader: 20, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f9350752f44cc3947f0853eceb9933" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 34069 } } peers { permanent_uuid: "c2c451feba984198a5bff0dd8325536c" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 45153 } } peers { permanent_uuid: "b110da3f2aa14447a08587fe94967dde" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40241 } }
I20260812 06:37:43.341698  3187 timestamp_advancement-itest.cc:267] GCing logs...
I20260812 06:37:43.342999  3187 timestamp_advancement-itest.cc:267] GCing logs...
I20260812 06:37:43.345238  3187 timestamp_advancement-itest.cc:267] GCing logs...
I20260812 06:37:43.349520  3187 timestamp_advancement-itest.cc:267] GCing logs...
I20260812 06:37:43.357816  3187 timestamp_advancement-itest.cc:267] GCing logs...
I20260812 06:37:43.374130  3187 timestamp_advancement-itest.cc:267] GCing logs...
I20260812 06:37:43.402601  4180 catalog_manager.cc:5719] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde reported cstate change: term changed from 10 to 11, leader changed from c2c451feba984198a5bff0dd8325536c (127.3.28.195) to b110da3f2aa14447a08587fe94967dde (127.3.28.193). New cstate: current_term: 11 leader_uuid: "b110da3f2aa14447a08587fe94967dde" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f9350752f44cc3947f0853eceb9933" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 34069 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c2c451feba984198a5bff0dd8325536c" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 45153 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b110da3f2aa14447a08587fe94967dde" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40241 } health_report { overall_health: HEALTHY } } }
I20260812 06:37:43.405046  4351 raft_consensus.cc:1240] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [term 11 LEADER]: Rejecting Update request from peer c2c451feba984198a5bff0dd8325536c for earlier term 10. Current term is 11. Ops: []
I20260812 06:37:43.405651  4752 consensus_queue.cc:1059] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b110da3f2aa14447a08587fe94967dde" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40241 }, Status: INVALID_TERM, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20260812 06:37:43.405824  4752 consensus_queue.cc:1243] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [LEADER]: Peer b110da3f2aa14447a08587fe94967dde log is divergent from this leader: its last log entry 11.21 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 20
I20260812 06:37:43.405884  4757 raft_consensus.cc:3055] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [term 10 LEADER]: Stepping down as leader of term 10
I20260812 06:37:43.405947  4757 raft_consensus.cc:740] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c2c451feba984198a5bff0dd8325536c, State: Running, Role: LEADER
I20260812 06:37:43.406086  4757 consensus_queue.cc:260] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 10.21, Last appended by leader: 21, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f9350752f44cc3947f0853eceb9933" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 34069 } } peers { permanent_uuid: "c2c451feba984198a5bff0dd8325536c" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 45153 } } peers { permanent_uuid: "b110da3f2aa14447a08587fe94967dde" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40241 } }
I20260812 06:37:43.406219  4757 raft_consensus.cc:3060] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [term 10 FOLLOWER]: Advancing to term 11
I20260812 06:37:43.406534  3187 timestamp_advancement-itest.cc:267] GCing logs...
I20260812 06:37:43.442698  4475 raft_consensus.cc:1275] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 11 FOLLOWER]: Refusing update from remote peer b110da3f2aa14447a08587fe94967dde: Log matching property violated. Preceding OpId in replica: term: 9 index: 20. Preceding OpId from leader: term: 11 index: 21. (index mismatch)
I20260812 06:37:43.443388  4702 consensus_queue.cc:1048] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [LEADER]: Connected to new peer: Peer: permanent_uuid: "53f9350752f44cc3947f0853eceb9933" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 34069 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20260812 06:37:43.446326  4598 raft_consensus.cc:1275] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [term 11 FOLLOWER]: Refusing update from remote peer b110da3f2aa14447a08587fe94967dde: Log matching property violated. Preceding OpId in replica: term: 10 index: 21. Preceding OpId from leader: term: 11 index: 21. (term mismatch)
I20260812 06:37:43.446455  4598 pending_rounds.cc:85] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c: Aborting all ops after (but not including) 20
I20260812 06:37:43.446488  4598 pending_rounds.cc:107] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c: Aborting uncommitted NO_OP operation due to leader change: 10.21
I20260812 06:37:43.446517  4598 raft_consensus.cc:2889] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260812 06:37:43.446956  4702 consensus_queue.cc:1048] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [LEADER]: Connected to new peer: Peer: permanent_uuid: "c2c451feba984198a5bff0dd8325536c" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 45153 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20260812 06:37:43.470906  3187 timestamp_advancement-itest.cc:267] GCing logs...
I20260812 06:37:43.471174  3187 log_reader.cc:385] T 40088c3774b040fcade8002ce521e52c: removed 1 log segments from log reader
I20260812 06:37:43.471232  3187 log.cc:1079] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde: Deleting log segment in path: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1786516657398854-3187-0/minicluster-data/ts-0-root/wals/40088c3774b040fcade8002ce521e52c/wal-000000001 (ops 1-16)
I20260812 06:37:43.472146  3187 timestamp_advancement-itest.cc:274] Shutting down cluster...
I20260812 06:37:43.472303  3187 master.cc:562] Master@127.3.28.254:37251 shutting down...
I20260812 06:37:43.547386  4721 raft_consensus.cc:493] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b110da3f2aa14447a08587fe94967dde)
I20260812 06:37:43.547560  4721 raft_consensus.cc:3060] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 11 FOLLOWER]: Advancing to term 12
I20260812 06:37:43.548424  3187 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 726d86b4a3be4654b6d80bb8ac492087 [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:37:43.548589  3187 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 726d86b4a3be4654b6d80bb8ac492087 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:37:43.548671  3187 tablet_replica.cc:333] T 00000000000000000000000000000000 P 726d86b4a3be4654b6d80bb8ac492087: stopping tablet replica
I20260812 06:37:43.548921  4721 raft_consensus.cc:515] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f9350752f44cc3947f0853eceb9933" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 34069 } } peers { permanent_uuid: "c2c451feba984198a5bff0dd8325536c" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 45153 } } peers { permanent_uuid: "b110da3f2aa14447a08587fe94967dde" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40241 } }
I20260812 06:37:43.549373  4721 leader_election.cc:290] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [CANDIDATE]: Term 12 election: Requested vote from peers c2c451feba984198a5bff0dd8325536c (127.3.28.195:45153), b110da3f2aa14447a08587fe94967dde (127.3.28.193:40241)
I20260812 06:37:43.549713  4598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40088c3774b040fcade8002ce521e52c" candidate_uuid: "53f9350752f44cc3947f0853eceb9933" candidate_term: 12 candidate_status { last_received { term: 11 index: 21 } } ignore_live_leader: false dest_uuid: "c2c451feba984198a5bff0dd8325536c"
I20260812 06:37:43.549762  4351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40088c3774b040fcade8002ce521e52c" candidate_uuid: "53f9350752f44cc3947f0853eceb9933" candidate_term: 12 candidate_status { last_received { term: 11 index: 21 } } ignore_live_leader: false dest_uuid: "b110da3f2aa14447a08587fe94967dde"
I20260812 06:37:43.550189  4421 leader_election.cc:304] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 53f9350752f44cc3947f0853eceb9933; no voters: b110da3f2aa14447a08587fe94967dde, c2c451feba984198a5bff0dd8325536c
I20260812 06:37:43.550451  4721 raft_consensus.cc:2749] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260812 06:37:43.552796  4475 raft_consensus.cc:1240] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 12 FOLLOWER]: Rejecting Update request from peer b110da3f2aa14447a08587fe94967dde for earlier term 11. Current term is 12. Ops: []
I20260812 06:37:43.553258  4759 consensus_queue.cc:1059] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "53f9350752f44cc3947f0853eceb9933" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 34069 }, Status: INVALID_TERM, Last received: 11.21, Next index: 22, Last known committed idx: 21, Time since last communication: 0.000s
I20260812 06:37:43.553500  4702 raft_consensus.cc:3055] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [term 11 LEADER]: Stepping down as leader of term 11
I20260812 06:37:43.553562  4702 raft_consensus.cc:740] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b110da3f2aa14447a08587fe94967dde, State: Running, Role: LEADER
I20260812 06:37:43.553686  4702 consensus_queue.cc:260] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 11.21, Last appended by leader: 21, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f9350752f44cc3947f0853eceb9933" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 34069 } } peers { permanent_uuid: "c2c451feba984198a5bff0dd8325536c" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 45153 } } peers { permanent_uuid: "b110da3f2aa14447a08587fe94967dde" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40241 } }
I20260812 06:37:43.553808  4702 raft_consensus.cc:3060] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [term 11 FOLLOWER]: Advancing to term 12
I20260812 06:37:43.562661  3187 master.cc:584] Master@127.3.28.254:37251 shutdown complete.
I20260812 06:37:43.566057  3187 tablet_server.cc:179] TabletServer@127.3.28.193:0 shutting down...
I20260812 06:37:43.623281  3187 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260812 06:37:43.623560  3187 tablet_replica.cc:333] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde: stopping tablet replica
I20260812 06:37:43.623690  3187 raft_consensus.cc:2243] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [term 12 FOLLOWER]: Raft consensus shutting down.
I20260812 06:37:43.623814  3187 raft_consensus.cc:2272] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [term 12 FOLLOWER]: Raft consensus is shut down!
I20260812 06:37:43.637923  3187 tablet_server.cc:196] TabletServer@127.3.28.193:0 shutdown complete.
I20260812 06:37:43.640447  3187 tablet_server.cc:179] TabletServer@127.3.28.194:0 shutting down...
I20260812 06:37:43.649152  4757 raft_consensus.cc:493] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [term 11 FOLLOWER]: Starting leader election (detected failure of leader b110da3f2aa14447a08587fe94967dde)
I20260812 06:37:43.649312  4757 raft_consensus.cc:3060] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [term 11 FOLLOWER]: Advancing to term 12
I20260812 06:37:43.650334  4757 raft_consensus.cc:515] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f9350752f44cc3947f0853eceb9933" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 34069 } } peers { permanent_uuid: "c2c451feba984198a5bff0dd8325536c" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 45153 } } peers { permanent_uuid: "b110da3f2aa14447a08587fe94967dde" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40241 } }
I20260812 06:37:43.650869  4757 leader_election.cc:290] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [CANDIDATE]: Term 12 election: Requested vote from peers 53f9350752f44cc3947f0853eceb9933 (127.3.28.194:34069), b110da3f2aa14447a08587fe94967dde (127.3.28.193:40241)
W20260812 06:37:43.652559  4547 leader_election.cc:336] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer b110da3f2aa14447a08587fe94967dde (127.3.28.193:40241): Network error: Client connection negotiation failed: client connection to 127.3.28.193:40241: connect: Connection refused (error 111)
W20260812 06:37:43.652765  4547 leader_election.cc:336] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 53f9350752f44cc3947f0853eceb9933 (127.3.28.194:34069): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260812 06:37:43.652837  4547 leader_election.cc:304] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c2c451feba984198a5bff0dd8325536c; no voters: 53f9350752f44cc3947f0853eceb9933, b110da3f2aa14447a08587fe94967dde
I20260812 06:37:43.653064  4757 raft_consensus.cc:2749] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260812 06:37:43.661103  4721 raft_consensus.cc:493] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:37:43.661239  4721 raft_consensus.cc:3060] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 12 FOLLOWER]: Advancing to term 13
I20260812 06:37:43.662221  4721 raft_consensus.cc:515] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f9350752f44cc3947f0853eceb9933" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 34069 } } peers { permanent_uuid: "c2c451feba984198a5bff0dd8325536c" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 45153 } } peers { permanent_uuid: "b110da3f2aa14447a08587fe94967dde" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40241 } }
I20260812 06:37:43.662813  4721 leader_election.cc:290] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [CANDIDATE]: Term 13 election: Requested vote from peers c2c451feba984198a5bff0dd8325536c (127.3.28.195:45153), b110da3f2aa14447a08587fe94967dde (127.3.28.193:40241)
I20260812 06:37:43.663341  4598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40088c3774b040fcade8002ce521e52c" candidate_uuid: "53f9350752f44cc3947f0853eceb9933" candidate_term: 13 candidate_status { last_received { term: 11 index: 21 } } ignore_live_leader: false dest_uuid: "c2c451feba984198a5bff0dd8325536c"
I20260812 06:37:43.663451  4598 raft_consensus.cc:3060] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [term 12 FOLLOWER]: Advancing to term 13
W20260812 06:37:43.664338  4420 leader_election.cc:336] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer b110da3f2aa14447a08587fe94967dde (127.3.28.193:40241): Network error: Client connection negotiation failed: client connection to 127.3.28.193:40241: connect: Connection refused (error 111)
I20260812 06:37:43.664438  4598 raft_consensus.cc:2468] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 53f9350752f44cc3947f0853eceb9933 in term 13.
I20260812 06:37:43.664845  4421 leader_election.cc:304] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 53f9350752f44cc3947f0853eceb9933, c2c451feba984198a5bff0dd8325536c; no voters: b110da3f2aa14447a08587fe94967dde
I20260812 06:37:43.665104  4721 raft_consensus.cc:2804] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 13 FOLLOWER]: Leader election won for term 13
I20260812 06:37:43.665226  4721 raft_consensus.cc:697] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 13 LEADER]: Becoming Leader. State: Replica: 53f9350752f44cc3947f0853eceb9933, State: Running, Role: LEADER
I20260812 06:37:43.665422  4721 consensus_queue.cc:237] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 11.21, Last appended by leader: 21, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f9350752f44cc3947f0853eceb9933" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 34069 } } peers { permanent_uuid: "c2c451feba984198a5bff0dd8325536c" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 45153 } } peers { permanent_uuid: "b110da3f2aa14447a08587fe94967dde" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40241 } }
I20260812 06:37:43.672335  3187 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260812 06:37:43.672641  3187 tablet_replica.cc:333] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933: stopping tablet replica
I20260812 06:37:43.672791  3187 raft_consensus.cc:2243] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 13 LEADER]: Raft consensus shutting down.
I20260812 06:37:43.672978  3187 pending_rounds.cc:70] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933: Trying to abort 1 pending ops.
I20260812 06:37:43.673031  3187 pending_rounds.cc:77] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933: Aborting op as it isn't in flight: id { term: 13 index: 22 } timestamp: 7317572254375174144 op_type: NO_OP noop_request { }
I20260812 06:37:43.673141  3187 raft_consensus.cc:2889] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 13 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260812 06:37:43.673208  3187 raft_consensus.cc:2272] T 40088c3774b040fcade8002ce521e52c P 53f9350752f44cc3947f0853eceb9933 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260812 06:37:43.686668  3187 tablet_server.cc:196] TabletServer@127.3.28.194:0 shutdown complete.
I20260812 06:37:43.688869  3187 tablet_server.cc:179] TabletServer@127.3.28.195:0 shutting down...
I20260812 06:37:43.695844  3187 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260812 06:37:43.696146  3187 tablet_replica.cc:333] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c: stopping tablet replica
I20260812 06:37:43.696288  3187 raft_consensus.cc:2243] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [term 13 FOLLOWER]: Raft consensus shutting down.
I20260812 06:37:43.696456  3187 raft_consensus.cc:2272] T 40088c3774b040fcade8002ce521e52c P c2c451feba984198a5bff0dd8325536c [term 13 FOLLOWER]: Raft consensus is shut down!
I20260812 06:37:43.699522  3187 tablet_server.cc:196] TabletServer@127.3.28.195:0 shutdown complete.
I20260812 06:37:43.701299  3187 timestamp_advancement-itest.cc:282] Restarting single tablet server...
I20260812 06:37:43.701599  3187 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 06:37:43.702001  3187 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 50
W20260812 06:37:43.703609  4771 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:43.703603  4768 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:43.703616  4767 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:43.704087  3187 server_base.cc:1061] running on GCE node
I20260812 06:37:43.704205  3187 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 06:37:43.704237  3187 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 06:37:43.704267  3187 hybrid_clock.cc:648] HybridClock initialized: now 1786516663704266 us; error 0 us; skew 500 ppm
I20260812 06:37:43.705075  3187 webserver.cc:533] Webserver started at http://127.3.28.193:33197/ using document root <none> and password file <none>
I20260812 06:37:43.705262  3187 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:43.705327  3187 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260812 06:37:43.706640  3187 fs_manager.cc:714] Time spent opening directory manager: real 0.001s	user 0.000s	sys 0.001s
I20260812 06:37:43.709434  4782 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:43.709734  3187 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.001s
I20260812 06:37:43.709805  3187 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1786516657398854-3187-0/minicluster-data/ts-0-root
uuid: "b110da3f2aa14447a08587fe94967dde"
format_stamp: "Formatted at 2026-08-12 06:37:41 on dist-test-slave-tk9z"
I20260812 06:37:43.709911  3187 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1786516657398854-3187-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1786516657398854-3187-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap.1786516657398854-3187-0/minicluster-data/ts-0-root/data
Total live blocks: 5
Total live bytes: 5297
Total live bytes (after alignment): 24576
Total number of LBM containers: 6 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:43.727305  3187 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:43.727738  3187 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:43.728065  3187 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:37:43.728762  4804 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260812 06:37:43.729959  3187 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 06:37:43.730046  3187 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s	user 0.000s	sys 0.000s
I20260812 06:37:43.730121  3187 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260812 06:37:43.730921  3187 ts_tablet_manager.cc:616] Registered 1 tablets
I20260812 06:37:43.730988  3187 ts_tablet_manager.cc:595] Time spent register tablets: real 0.001s	user 0.000s	sys 0.000s
I20260812 06:37:43.731127  4804 tablet_bootstrap.cc:492] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde: Bootstrap starting.
I20260812 06:37:43.735540  4804 tablet_bootstrap.cc:492] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:37:43.735901  4804 tablet_bootstrap.cc:492] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde: Bootstrap complete.
I20260812 06:37:43.736112  4804 ts_tablet_manager.cc:1403] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde: Time spent bootstrapping tablet: real 0.005s	user 0.003s	sys 0.000s
I20260812 06:37:43.736578  4804 raft_consensus.cc:359] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [term 12 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f9350752f44cc3947f0853eceb9933" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 34069 } } peers { permanent_uuid: "c2c451feba984198a5bff0dd8325536c" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 45153 } } peers { permanent_uuid: "b110da3f2aa14447a08587fe94967dde" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40241 } }
I20260812 06:37:43.736713  4804 raft_consensus.cc:740] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [term 12 FOLLOWER]: Becoming Follower/Learner. State: Replica: b110da3f2aa14447a08587fe94967dde, State: Initialized, Role: FOLLOWER
I20260812 06:37:43.736873  3187 rpc_server.cc:307] RPC server started. Bound to: 127.3.28.193:40241
I20260812 06:37:43.736922  4804 consensus_queue.cc:260] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 21, Last appended: 11.21, Last appended by leader: 21, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f9350752f44cc3947f0853eceb9933" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 34069 } } peers { permanent_uuid: "c2c451feba984198a5bff0dd8325536c" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 45153 } } peers { permanent_uuid: "b110da3f2aa14447a08587fe94967dde" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40241 } }
I20260812 06:37:43.737591  4804 ts_tablet_manager.cc:1434] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde: Time spent starting tablet: real 0.001s	user 0.003s	sys 0.000s
I20260812 06:37:43.740274  4904 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.28.193:40241 every 8 connection(s)
W20260812 06:37:43.742190  4906 heartbeater.cc:412] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260812 06:37:43.752539  3187 tablet_server.cc:179] TabletServer@127.3.28.193:40241 shutting down...
I20260812 06:37:43.815812  4905 raft_consensus.cc:493] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:37:43.815966  4905 raft_consensus.cc:3060] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [term 12 FOLLOWER]: Advancing to term 13
I20260812 06:37:43.817099  4905 raft_consensus.cc:515] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f9350752f44cc3947f0853eceb9933" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 34069 } } peers { permanent_uuid: "c2c451feba984198a5bff0dd8325536c" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 45153 } } peers { permanent_uuid: "b110da3f2aa14447a08587fe94967dde" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40241 } }
I20260812 06:37:43.817782  4905 leader_election.cc:290] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [CANDIDATE]: Term 13 election: Requested vote from peers 53f9350752f44cc3947f0853eceb9933 (127.3.28.194:34069), c2c451feba984198a5bff0dd8325536c (127.3.28.195:45153)
W20260812 06:37:43.819139  4788 leader_election.cc:336] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 53f9350752f44cc3947f0853eceb9933 (127.3.28.194:34069): Network error: Client connection negotiation failed: client connection to 127.3.28.194:34069: connect: Connection refused (error 111)
W20260812 06:37:43.819265  4794 leader_election.cc:336] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer c2c451feba984198a5bff0dd8325536c (127.3.28.195:45153): Network error: Client connection negotiation failed: client connection to 127.3.28.195:45153: connect: Connection refused (error 111)
I20260812 06:37:43.819387  4794 leader_election.cc:304] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b110da3f2aa14447a08587fe94967dde; no voters: 53f9350752f44cc3947f0853eceb9933, c2c451feba984198a5bff0dd8325536c
I20260812 06:37:43.819578  4905 raft_consensus.cc:2749] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260812 06:37:43.960479  4905 raft_consensus.cc:493] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:37:43.960629  4905 raft_consensus.cc:3060] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [term 13 FOLLOWER]: Advancing to term 14
I20260812 06:37:43.961584  4905 raft_consensus.cc:515] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "53f9350752f44cc3947f0853eceb9933" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 34069 } } peers { permanent_uuid: "c2c451feba984198a5bff0dd8325536c" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 45153 } } peers { permanent_uuid: "b110da3f2aa14447a08587fe94967dde" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40241 } }
I20260812 06:37:43.962052  4905 leader_election.cc:290] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [CANDIDATE]: Term 14 election: Requested vote from peers 53f9350752f44cc3947f0853eceb9933 (127.3.28.194:34069), c2c451feba984198a5bff0dd8325536c (127.3.28.195:45153)
W20260812 06:37:43.963281  4788 leader_election.cc:336] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer 53f9350752f44cc3947f0853eceb9933 (127.3.28.194:34069): Network error: Client connection negotiation failed: client connection to 127.3.28.194:34069: connect: Connection refused (error 111)
W20260812 06:37:43.963435  4794 leader_election.cc:336] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer c2c451feba984198a5bff0dd8325536c (127.3.28.195:45153): Network error: Client connection negotiation failed: client connection to 127.3.28.195:45153: connect: Connection refused (error 111)
I20260812 06:37:43.963521  4794 leader_election.cc:304] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b110da3f2aa14447a08587fe94967dde; no voters: 53f9350752f44cc3947f0853eceb9933, c2c451feba984198a5bff0dd8325536c
I20260812 06:37:43.963696  4905 raft_consensus.cc:2749] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260812 06:37:43.991007  3187 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260812 06:37:43.991334  3187 tablet_replica.cc:333] stopping tablet replica
I20260812 06:37:43.991493  3187 raft_consensus.cc:2243] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [term 14 FOLLOWER]: Raft consensus shutting down.
I20260812 06:37:43.991672  3187 raft_consensus.cc:2272] T 40088c3774b040fcade8002ce521e52c P b110da3f2aa14447a08587fe94967dde [term 14 FOLLOWER]: Raft consensus is shut down!
I20260812 06:37:44.004896  3187 tablet_server.cc:196] TabletServer@127.3.28.193:40241 shutdown complete.
[       OK ] TimestampAdvancementITest.TestNoOpAdvancesMvccSafeTimeOnBootstrap (2730 ms)
[ RUN      ] TimestampAdvancementITest.Kudu2463Test
I20260812 06:37:44.012019  3187 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.28.254:45527
I20260812 06:37:44.012434  3187 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:37:44.014150  4916 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:44.014150  4915 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:44.014276  4919 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:44.014469  3187 server_base.cc:1061] running on GCE node
I20260812 06:37:44.014638  3187 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 06:37:44.014710  3187 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 06:37:44.014743  3187 hybrid_clock.cc:648] HybridClock initialized: now 1786516664014742 us; error 0 us; skew 500 ppm
I20260812 06:37:44.015601  3187 webserver.cc:533] Webserver started at http://127.3.28.254:32903/ using document root <none> and password file <none>
I20260812 06:37:44.015798  3187 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:44.015877  3187 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:44.015959  3187 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:37:44.016371  3187 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1786516657398854-3187-0/minicluster-data/master-0-root/instance:
uuid: "7a73c8c9e775410fb15ec51e9fd42b68"
format_stamp: "Formatted at 2026-08-12 06:37:44 on dist-test-slave-tk9z"
I20260812 06:37:44.017946  3187 fs_manager.cc:696] Time spent creating directory manager: real 0.001s	user 0.002s	sys 0.000s
I20260812 06:37:44.019073  4924 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:44.019352  3187 fs_manager.cc:730] Time spent opening block manager: real 0.001s	user 0.000s	sys 0.001s
I20260812 06:37:44.019445  3187 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1786516657398854-3187-0/minicluster-data/master-0-root
uuid: "7a73c8c9e775410fb15ec51e9fd42b68"
format_stamp: "Formatted at 2026-08-12 06:37:44 on dist-test-slave-tk9z"
I20260812 06:37:44.019542  3187 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1786516657398854-3187-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1786516657398854-3187-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1786516657398854-3187-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:44.032820  3187 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:44.033229  3187 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:44.037774  3187 rpc_server.cc:307] RPC server started. Bound to: 127.3.28.254:45527
I20260812 06:37:44.038440  4998 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.28.254:45527 every 8 connection(s)
I20260812 06:37:44.039047  5000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:44.040860  5000 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7a73c8c9e775410fb15ec51e9fd42b68: Bootstrap starting.
I20260812 06:37:44.041647  5000 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7a73c8c9e775410fb15ec51e9fd42b68: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:44.042686  5000 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7a73c8c9e775410fb15ec51e9fd42b68: No bootstrap required, opened a new log
I20260812 06:37:44.043087  5000 raft_consensus.cc:359] T 00000000000000000000000000000000 P 7a73c8c9e775410fb15ec51e9fd42b68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a73c8c9e775410fb15ec51e9fd42b68" member_type: VOTER }
I20260812 06:37:44.043206  5000 raft_consensus.cc:385] T 00000000000000000000000000000000 P 7a73c8c9e775410fb15ec51e9fd42b68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:44.043258  5000 raft_consensus.cc:740] T 00000000000000000000000000000000 P 7a73c8c9e775410fb15ec51e9fd42b68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a73c8c9e775410fb15ec51e9fd42b68, State: Initialized, Role: FOLLOWER
I20260812 06:37:44.043407  5000 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7a73c8c9e775410fb15ec51e9fd42b68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a73c8c9e775410fb15ec51e9fd42b68" member_type: VOTER }
I20260812 06:37:44.043512  5000 raft_consensus.cc:399] T 00000000000000000000000000000000 P 7a73c8c9e775410fb15ec51e9fd42b68 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:37:44.043566  5000 raft_consensus.cc:493] T 00000000000000000000000000000000 P 7a73c8c9e775410fb15ec51e9fd42b68 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:37:44.043622  5000 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7a73c8c9e775410fb15ec51e9fd42b68 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:44.044349  5000 raft_consensus.cc:515] T 00000000000000000000000000000000 P 7a73c8c9e775410fb15ec51e9fd42b68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a73c8c9e775410fb15ec51e9fd42b68" member_type: VOTER }
I20260812 06:37:44.044528  5000 leader_election.cc:304] T 00000000000000000000000000000000 P 7a73c8c9e775410fb15ec51e9fd42b68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7a73c8c9e775410fb15ec51e9fd42b68; no voters: 
I20260812 06:37:44.044744  5000 leader_election.cc:290] T 00000000000000000000000000000000 P 7a73c8c9e775410fb15ec51e9fd42b68 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 06:37:44.044898  5008 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 7a73c8c9e775410fb15ec51e9fd42b68 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:37:44.045141  5008 raft_consensus.cc:697] T 00000000000000000000000000000000 P 7a73c8c9e775410fb15ec51e9fd42b68 [term 1 LEADER]: Becoming Leader. State: Replica: 7a73c8c9e775410fb15ec51e9fd42b68, State: Running, Role: LEADER
I20260812 06:37:44.045226  5000 sys_catalog.cc:565] T 00000000000000000000000000000000 P 7a73c8c9e775410fb15ec51e9fd42b68 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:37:44.045315  5008 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7a73c8c9e775410fb15ec51e9fd42b68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a73c8c9e775410fb15ec51e9fd42b68" member_type: VOTER }
I20260812 06:37:44.045801  5009 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7a73c8c9e775410fb15ec51e9fd42b68 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7a73c8c9e775410fb15ec51e9fd42b68" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a73c8c9e775410fb15ec51e9fd42b68" member_type: VOTER } }
I20260812 06:37:44.045859  5011 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7a73c8c9e775410fb15ec51e9fd42b68 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7a73c8c9e775410fb15ec51e9fd42b68. Latest consensus state: current_term: 1 leader_uuid: "7a73c8c9e775410fb15ec51e9fd42b68" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7a73c8c9e775410fb15ec51e9fd42b68" member_type: VOTER } }
I20260812 06:37:44.045917  5009 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7a73c8c9e775410fb15ec51e9fd42b68 [sys.catalog]: This master's current role is: LEADER
I20260812 06:37:44.045951  5011 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7a73c8c9e775410fb15ec51e9fd42b68 [sys.catalog]: This master's current role is: LEADER
I20260812 06:37:44.046213  5021 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 06:37:44.047034  5021 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 06:37:44.047406  3187 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260812 06:37:44.048827  5021 catalog_manager.cc:1383] Generated new cluster ID: 60d35ddfd5334f80be89a02a7cfb4386
I20260812 06:37:44.048887  5021 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 06:37:44.057546  5021 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 06:37:44.058125  5021 catalog_manager.cc:1540] Loading token signing keys...
I20260812 06:37:44.067118  5021 catalog_manager.cc:6092] T 00000000000000000000000000000000 P 7a73c8c9e775410fb15ec51e9fd42b68: Generated new TSK 0
I20260812 06:37:44.067299  5021 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 06:37:44.079782  3187 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260812 06:37:44.081948  3187 server_base.cc:1061] running on GCE node
W20260812 06:37:44.081871  5043 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:44.081934  5040 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:44.082108  5041 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:44.082334  3187 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 06:37:44.082437  3187 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 06:37:44.082468  3187 hybrid_clock.cc:648] HybridClock initialized: now 1786516664082467 us; error 0 us; skew 500 ppm
I20260812 06:37:44.083357  3187 webserver.cc:533] Webserver started at http://127.3.28.193:45053/ using document root <none> and password file <none>
I20260812 06:37:44.083559  3187 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:44.083639  3187 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:44.083720  3187 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:37:44.084151  3187 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1786516657398854-3187-0/minicluster-data/ts-0-root/instance:
uuid: "155b3bf9ca74442fbb15f5a42e60f088"
format_stamp: "Formatted at 2026-08-12 06:37:44 on dist-test-slave-tk9z"
I20260812 06:37:44.085866  3187 fs_manager.cc:696] Time spent creating directory manager: real 0.001s	user 0.000s	sys 0.002s
I20260812 06:37:44.087132  5054 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:44.087483  3187 fs_manager.cc:730] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20260812 06:37:44.087584  3187 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1786516657398854-3187-0/minicluster-data/ts-0-root
uuid: "155b3bf9ca74442fbb15f5a42e60f088"
format_stamp: "Formatted at 2026-08-12 06:37:44 on dist-test-slave-tk9z"
I20260812 06:37:44.087690  3187 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1786516657398854-3187-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1786516657398854-3187-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1786516657398854-3187-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:44.100804  3187 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:44.101289  3187 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:44.101612  3187 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:37:44.102113  3187 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:37:44.102178  3187 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:44.102239  3187 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:37:44.102275  3187 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:44.106596  3187 rpc_server.cc:307] RPC server started. Bound to: 127.3.28.193:33041
I20260812 06:37:44.106640  5162 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.28.193:33041 every 8 connection(s)
I20260812 06:37:44.107527  3187 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:37:44.109565  5168 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:44.109602  5167 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:44.109618  5173 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:44.110142  3187 server_base.cc:1061] running on GCE node
I20260812 06:37:44.110404  3187 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 06:37:44.110457  3187 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 06:37:44.110507  3187 hybrid_clock.cc:648] HybridClock initialized: now 1786516664110505 us; error 0 us; skew 500 ppm
I20260812 06:37:44.111506  3187 webserver.cc:533] Webserver started at http://127.3.28.194:46587/ using document root <none> and password file <none>
I20260812 06:37:44.111686  3187 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:44.111752  3187 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:44.111832  3187 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:37:44.112310  3187 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1786516657398854-3187-0/minicluster-data/ts-1-root/instance:
uuid: "6edcc833ff8a4f36848c7674dd357e40"
format_stamp: "Formatted at 2026-08-12 06:37:44 on dist-test-slave-tk9z"
I20260812 06:37:44.112516  5163 heartbeater.cc:344] Connected to a master server at 127.3.28.254:45527
I20260812 06:37:44.112612  5163 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:44.112840  5163 heartbeater.cc:507] Master 127.3.28.254:45527 requested a full tablet report, sending...
I20260812 06:37:44.113503  4944 ts_manager.cc:194] Registered new tserver with Master: 155b3bf9ca74442fbb15f5a42e60f088 (127.3.28.193:33041)
I20260812 06:37:44.114217  3187 fs_manager.cc:696] Time spent creating directory manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:37:44.114513  4944 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46418
I20260812 06:37:44.115392  5180 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:44.115684  3187 fs_manager.cc:730] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20260812 06:37:44.115772  3187 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1786516657398854-3187-0/minicluster-data/ts-1-root
uuid: "6edcc833ff8a4f36848c7674dd357e40"
format_stamp: "Formatted at 2026-08-12 06:37:44 on dist-test-slave-tk9z"
I20260812 06:37:44.115877  3187 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1786516657398854-3187-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1786516657398854-3187-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1786516657398854-3187-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:44.121244  3187 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:44.121594  3187 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:44.121876  3187 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:37:44.122320  3187 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:37:44.122385  3187 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:44.122462  3187 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:37:44.122498  3187 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:44.126796  3187 rpc_server.cc:307] RPC server started. Bound to: 127.3.28.194:37903
I20260812 06:37:44.126834  5290 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.28.194:37903 every 8 connection(s)
I20260812 06:37:44.127645  3187 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:37:44.129640  5303 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:44.129657  5301 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:44.129966  5307 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:44.130110  3187 server_base.cc:1061] running on GCE node
I20260812 06:37:44.130321  3187 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 06:37:44.130360  3187 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 06:37:44.130437  3187 hybrid_clock.cc:648] HybridClock initialized: now 1786516664130437 us; error 0 us; skew 500 ppm
I20260812 06:37:44.131376  3187 webserver.cc:533] Webserver started at http://127.3.28.195:46045/ using document root <none> and password file <none>
I20260812 06:37:44.131551  3187 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:44.131620  3187 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:44.131695  3187 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:37:44.132181  3187 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1786516657398854-3187-0/minicluster-data/ts-2-root/instance:
uuid: "a748b9e4d38f4359bf0e3733995423d5"
format_stamp: "Formatted at 2026-08-12 06:37:44 on dist-test-slave-tk9z"
I20260812 06:37:44.132408  5295 heartbeater.cc:344] Connected to a master server at 127.3.28.254:45527
I20260812 06:37:44.132532  5295 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:44.132740  5295 heartbeater.cc:507] Master 127.3.28.254:45527 requested a full tablet report, sending...
I20260812 06:37:44.133409  4944 ts_manager.cc:194] Registered new tserver with Master: 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194:37903)
I20260812 06:37:44.133980  4944 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46430
I20260812 06:37:44.134065  3187 fs_manager.cc:696] Time spent creating directory manager: real 0.002s	user 0.000s	sys 0.002s
I20260812 06:37:44.135226  5312 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:44.135514  3187 fs_manager.cc:730] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20260812 06:37:44.135603  3187 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1786516657398854-3187-0/minicluster-data/ts-2-root
uuid: "a748b9e4d38f4359bf0e3733995423d5"
format_stamp: "Formatted at 2026-08-12 06:37:44 on dist-test-slave-tk9z"
I20260812 06:37:44.135695  3187 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1786516657398854-3187-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1786516657398854-3187-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1786516657398854-3187-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:44.148959  3187 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:44.149461  3187 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:44.149816  3187 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:37:44.150341  3187 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:37:44.150467  3187 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:44.150552  3187 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:37:44.150584  3187 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:44.155625  3187 rpc_server.cc:307] RPC server started. Bound to: 127.3.28.195:38333
I20260812 06:37:44.155668  5413 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.28.195:38333 every 8 connection(s)
I20260812 06:37:44.160491  5416 heartbeater.cc:344] Connected to a master server at 127.3.28.254:45527
I20260812 06:37:44.160614  5416 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:44.160823  5416 heartbeater.cc:507] Master 127.3.28.254:45527 requested a full tablet report, sending...
I20260812 06:37:44.161437  4944 ts_manager.cc:194] Registered new tserver with Master: a748b9e4d38f4359bf0e3733995423d5 (127.3.28.195:38333)
I20260812 06:37:44.161801  3187 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.005672896s
I20260812 06:37:44.162112  4944 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46440
I20260812 06:37:44.180104  4944 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46462:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260812 06:37:44.180611  4944 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:37:44.190028  5356 tablet_service.cc:1511] Processing CreateTablet for tablet 13d248a66d9a4c68a4cca28349ace304 (DEFAULT_TABLE table=test-workload [id=a39848a875eb4995b8122638aa16d268]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:37:44.190407  5356 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13d248a66d9a4c68a4cca28349ace304. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:44.190791  5225 tablet_service.cc:1511] Processing CreateTablet for tablet 13d248a66d9a4c68a4cca28349ace304 (DEFAULT_TABLE table=test-workload [id=a39848a875eb4995b8122638aa16d268]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:37:44.191061  5225 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13d248a66d9a4c68a4cca28349ace304. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:44.192557  5455 tablet_bootstrap.cc:492] T 13d248a66d9a4c68a4cca28349ace304 P a748b9e4d38f4359bf0e3733995423d5: Bootstrap starting.
I20260812 06:37:44.190760  5100 tablet_service.cc:1511] Processing CreateTablet for tablet 13d248a66d9a4c68a4cca28349ace304 (DEFAULT_TABLE table=test-workload [id=a39848a875eb4995b8122638aa16d268]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:37:44.193120  5100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13d248a66d9a4c68a4cca28349ace304. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:44.193681  5455 tablet_bootstrap.cc:654] T 13d248a66d9a4c68a4cca28349ace304 P a748b9e4d38f4359bf0e3733995423d5: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:44.194649  5462 tablet_bootstrap.cc:492] T 13d248a66d9a4c68a4cca28349ace304 P 6edcc833ff8a4f36848c7674dd357e40: Bootstrap starting.
I20260812 06:37:44.194965  5455 tablet_bootstrap.cc:492] T 13d248a66d9a4c68a4cca28349ace304 P a748b9e4d38f4359bf0e3733995423d5: No bootstrap required, opened a new log
I20260812 06:37:44.195076  5455 ts_tablet_manager.cc:1403] T 13d248a66d9a4c68a4cca28349ace304 P a748b9e4d38f4359bf0e3733995423d5: Time spent bootstrapping tablet: real 0.003s	user 0.002s	sys 0.000s
I20260812 06:37:44.195473  5464 tablet_bootstrap.cc:492] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088: Bootstrap starting.
I20260812 06:37:44.195608  5455 raft_consensus.cc:359] T 13d248a66d9a4c68a4cca28349ace304 P a748b9e4d38f4359bf0e3733995423d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } }
I20260812 06:37:44.195722  5455 raft_consensus.cc:385] T 13d248a66d9a4c68a4cca28349ace304 P a748b9e4d38f4359bf0e3733995423d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:44.195789  5462 tablet_bootstrap.cc:654] T 13d248a66d9a4c68a4cca28349ace304 P 6edcc833ff8a4f36848c7674dd357e40: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:44.195895  5455 raft_consensus.cc:740] T 13d248a66d9a4c68a4cca28349ace304 P a748b9e4d38f4359bf0e3733995423d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a748b9e4d38f4359bf0e3733995423d5, State: Initialized, Role: FOLLOWER
I20260812 06:37:44.196089  5455 consensus_queue.cc:260] T 13d248a66d9a4c68a4cca28349ace304 P a748b9e4d38f4359bf0e3733995423d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } }
I20260812 06:37:44.196475  5455 ts_tablet_manager.cc:1434] T 13d248a66d9a4c68a4cca28349ace304 P a748b9e4d38f4359bf0e3733995423d5: Time spent starting tablet: real 0.001s	user 0.002s	sys 0.000s
I20260812 06:37:44.196616  5464 tablet_bootstrap.cc:654] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:44.196647  5416 heartbeater.cc:499] Master 127.3.28.254:45527 was elected leader, sending a full tablet report...
I20260812 06:37:44.197021  5462 tablet_bootstrap.cc:492] T 13d248a66d9a4c68a4cca28349ace304 P 6edcc833ff8a4f36848c7674dd357e40: No bootstrap required, opened a new log
I20260812 06:37:44.197109  5462 ts_tablet_manager.cc:1403] T 13d248a66d9a4c68a4cca28349ace304 P 6edcc833ff8a4f36848c7674dd357e40: Time spent bootstrapping tablet: real 0.003s	user 0.000s	sys 0.002s
I20260812 06:37:44.197549  5462 raft_consensus.cc:359] T 13d248a66d9a4c68a4cca28349ace304 P 6edcc833ff8a4f36848c7674dd357e40 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } }
I20260812 06:37:44.197638  5462 raft_consensus.cc:385] T 13d248a66d9a4c68a4cca28349ace304 P 6edcc833ff8a4f36848c7674dd357e40 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:44.197702  5462 raft_consensus.cc:740] T 13d248a66d9a4c68a4cca28349ace304 P 6edcc833ff8a4f36848c7674dd357e40 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6edcc833ff8a4f36848c7674dd357e40, State: Initialized, Role: FOLLOWER
I20260812 06:37:44.197877  5464 tablet_bootstrap.cc:492] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088: No bootstrap required, opened a new log
I20260812 06:37:44.197846  5462 consensus_queue.cc:260] T 13d248a66d9a4c68a4cca28349ace304 P 6edcc833ff8a4f36848c7674dd357e40 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } }
I20260812 06:37:44.198037  5464 ts_tablet_manager.cc:1403] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088: Time spent bootstrapping tablet: real 0.003s	user 0.002s	sys 0.000s
I20260812 06:37:44.198263  5462 ts_tablet_manager.cc:1434] T 13d248a66d9a4c68a4cca28349ace304 P 6edcc833ff8a4f36848c7674dd357e40: Time spent starting tablet: real 0.001s	user 0.000s	sys 0.001s
I20260812 06:37:44.198287  5295 heartbeater.cc:499] Master 127.3.28.254:45527 was elected leader, sending a full tablet report...
I20260812 06:37:44.198666  5464 raft_consensus.cc:359] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } }
I20260812 06:37:44.198774  5464 raft_consensus.cc:385] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:44.198822  5464 raft_consensus.cc:740] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 155b3bf9ca74442fbb15f5a42e60f088, State: Initialized, Role: FOLLOWER
I20260812 06:37:44.198939  5464 consensus_queue.cc:260] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } }
I20260812 06:37:44.199334  5163 heartbeater.cc:499] Master 127.3.28.254:45527 was elected leader, sending a full tablet report...
I20260812 06:37:44.199800  5464 ts_tablet_manager.cc:1434] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088: Time spent starting tablet: real 0.002s	user 0.001s	sys 0.000s
I20260812 06:37:44.302476  5473 raft_consensus.cc:493] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:37:44.302642  5473 raft_consensus.cc:515] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } }
I20260812 06:37:44.303282  5473 leader_election.cc:290] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194:37903), a748b9e4d38f4359bf0e3733995423d5 (127.3.28.195:38333)
I20260812 06:37:44.307266  5240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d248a66d9a4c68a4cca28349ace304" candidate_uuid: "155b3bf9ca74442fbb15f5a42e60f088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6edcc833ff8a4f36848c7674dd357e40" is_pre_election: true
I20260812 06:37:44.307435  5240 raft_consensus.cc:2468] T 13d248a66d9a4c68a4cca28349ace304 P 6edcc833ff8a4f36848c7674dd357e40 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b3bf9ca74442fbb15f5a42e60f088 in term 0.
I20260812 06:37:44.307477  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d248a66d9a4c68a4cca28349ace304" candidate_uuid: "155b3bf9ca74442fbb15f5a42e60f088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a748b9e4d38f4359bf0e3733995423d5" is_pre_election: true
I20260812 06:37:44.307668  5370 raft_consensus.cc:2468] T 13d248a66d9a4c68a4cca28349ace304 P a748b9e4d38f4359bf0e3733995423d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b3bf9ca74442fbb15f5a42e60f088 in term 0.
I20260812 06:37:44.307832  5055 leader_election.cc:304] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b3bf9ca74442fbb15f5a42e60f088, 6edcc833ff8a4f36848c7674dd357e40; no voters: 
I20260812 06:37:44.308019  5473 raft_consensus.cc:2804] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:37:44.308084  5473 raft_consensus.cc:493] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:37:44.308127  5473 raft_consensus.cc:3060] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:44.308988  5473 raft_consensus.cc:515] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } }
I20260812 06:37:44.309415  5473 leader_election.cc:290] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [CANDIDATE]: Term 1 election: Requested vote from peers 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194:37903), a748b9e4d38f4359bf0e3733995423d5 (127.3.28.195:38333)
I20260812 06:37:44.309777  5240 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d248a66d9a4c68a4cca28349ace304" candidate_uuid: "155b3bf9ca74442fbb15f5a42e60f088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6edcc833ff8a4f36848c7674dd357e40"
I20260812 06:37:44.309898  5240 raft_consensus.cc:3060] T 13d248a66d9a4c68a4cca28349ace304 P 6edcc833ff8a4f36848c7674dd357e40 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:44.310794  5240 raft_consensus.cc:2468] T 13d248a66d9a4c68a4cca28349ace304 P 6edcc833ff8a4f36848c7674dd357e40 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b3bf9ca74442fbb15f5a42e60f088 in term 1.
I20260812 06:37:44.311084  5370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13d248a66d9a4c68a4cca28349ace304" candidate_uuid: "155b3bf9ca74442fbb15f5a42e60f088" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a748b9e4d38f4359bf0e3733995423d5"
I20260812 06:37:44.311141  5055 leader_election.cc:304] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b3bf9ca74442fbb15f5a42e60f088, 6edcc833ff8a4f36848c7674dd357e40; no voters: 
I20260812 06:37:44.311192  5370 raft_consensus.cc:3060] T 13d248a66d9a4c68a4cca28349ace304 P a748b9e4d38f4359bf0e3733995423d5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:44.311306  5473 raft_consensus.cc:2804] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:37:44.311542  5473 raft_consensus.cc:697] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [term 1 LEADER]: Becoming Leader. State: Replica: 155b3bf9ca74442fbb15f5a42e60f088, State: Running, Role: LEADER
I20260812 06:37:44.311702  5473 consensus_queue.cc:237] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } }
I20260812 06:37:44.312218  5370 raft_consensus.cc:2468] T 13d248a66d9a4c68a4cca28349ace304 P a748b9e4d38f4359bf0e3733995423d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b3bf9ca74442fbb15f5a42e60f088 in term 1.
I20260812 06:37:44.313416  4942 catalog_manager.cc:5719] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 reported cstate change: term changed from 0 to 1, leader changed from <none> to 155b3bf9ca74442fbb15f5a42e60f088 (127.3.28.193). New cstate: current_term: 1 leader_uuid: "155b3bf9ca74442fbb15f5a42e60f088" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } health_report { overall_health: HEALTHY } } }
I20260812 06:37:44.349639  5240 raft_consensus.cc:1275] T 13d248a66d9a4c68a4cca28349ace304 P 6edcc833ff8a4f36848c7674dd357e40 [term 1 FOLLOWER]: Refusing update from remote peer 155b3bf9ca74442fbb15f5a42e60f088: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:37:44.349639  5370 raft_consensus.cc:1275] T 13d248a66d9a4c68a4cca28349ace304 P a748b9e4d38f4359bf0e3733995423d5 [term 1 FOLLOWER]: Refusing update from remote peer 155b3bf9ca74442fbb15f5a42e60f088: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:37:44.350198  5477 consensus_queue.cc:1048] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:37:44.350442  5473 consensus_queue.cc:1048] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:37:44.402033  5117 consensus_queue.cc:237] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 1.16, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: NON_VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } }
I20260812 06:37:44.403419  5240 raft_consensus.cc:1275] T 13d248a66d9a4c68a4cca28349ace304 P 6edcc833ff8a4f36848c7674dd357e40 [term 1 FOLLOWER]: Refusing update from remote peer 155b3bf9ca74442fbb15f5a42e60f088: Log matching property violated. Preceding OpId in replica: term: 1 index: 16. Preceding OpId from leader: term: 1 index: 17. (index mismatch)
I20260812 06:37:44.403435  5369 raft_consensus.cc:1275] T 13d248a66d9a4c68a4cca28349ace304 P a748b9e4d38f4359bf0e3733995423d5 [term 1 FOLLOWER]: Refusing update from remote peer 155b3bf9ca74442fbb15f5a42e60f088: Log matching property violated. Preceding OpId in replica: term: 1 index: 16. Preceding OpId from leader: term: 1 index: 17. (index mismatch)
I20260812 06:37:44.403841  5473 consensus_queue.cc:1048] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260812 06:37:44.404074  5477 consensus_queue.cc:1048] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: NON_VOTER last_known_addr { host: "127.3.28.194" port: 37903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260812 06:37:44.405834  5473 raft_consensus.cc:2955] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [term 1 LEADER]: Committing config change with OpId 1.17: config changed from index -1 to 17, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from VOTER to NON_VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: NON_VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
I20260812 06:37:44.406306  5369 raft_consensus.cc:2955] T 13d248a66d9a4c68a4cca28349ace304 P a748b9e4d38f4359bf0e3733995423d5 [term 1 FOLLOWER]: Committing config change with OpId 1.17: config changed from index -1 to 17, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from VOTER to NON_VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: NON_VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
I20260812 06:37:44.408332  5117 consensus_queue.cc:237] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 1.17, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } }
I20260812 06:37:44.408794  4944 catalog_manager.cc:5719] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 reported cstate change: config changed from index -1 to 17, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "155b3bf9ca74442fbb15f5a42e60f088" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: NON_VOTER last_known_addr { host: "127.3.28.194" port: 37903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } health_report { overall_health: HEALTHY } } }
I20260812 06:37:44.409433  5369 raft_consensus.cc:1275] T 13d248a66d9a4c68a4cca28349ace304 P a748b9e4d38f4359bf0e3733995423d5 [term 1 FOLLOWER]: Refusing update from remote peer 155b3bf9ca74442fbb15f5a42e60f088: Log matching property violated. Preceding OpId in replica: term: 1 index: 17. Preceding OpId from leader: term: 1 index: 18. (index mismatch)
I20260812 06:37:44.409490  5238 raft_consensus.cc:1275] T 13d248a66d9a4c68a4cca28349ace304 P 6edcc833ff8a4f36848c7674dd357e40 [term 1 LEARNER]: Refusing update from remote peer 155b3bf9ca74442fbb15f5a42e60f088: Log matching property violated. Preceding OpId in replica: term: 1 index: 17. Preceding OpId from leader: term: 1 index: 18. (index mismatch)
I20260812 06:37:44.409963  5514 consensus_queue.cc:1048] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260812 06:37:44.410091  5477 consensus_queue.cc:1048] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.000s
I20260812 06:37:44.410492  5240 raft_consensus.cc:2955] T 13d248a66d9a4c68a4cca28349ace304 P 6edcc833ff8a4f36848c7674dd357e40 [term 1 LEARNER]: Committing config change with OpId 1.17: config changed from index -1 to 17, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from VOTER to NON_VOTER. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: NON_VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
W20260812 06:37:44.411681  4944 catalog_manager.cc:5397] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 13d248a66d9a4c68a4cca28349ace304 with cas_config_opid_index 17: no extra replica candidate found for tablet 13d248a66d9a4c68a4cca28349ace304 (table test-workload [id=a39848a875eb4995b8122638aa16d268]): Not found: could not select location for extra replica: not enough tablet servers to satisfy replica placement policy: the total number of registered tablet servers (3) does not allow for adding an extra replica; consider bringing up more to have at least 4 tablet servers up and running
I20260812 06:37:44.411813  5477 raft_consensus.cc:2955] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [term 1 LEADER]: Committing config change with OpId 1.18: config changed from index 17 to 18, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
I20260812 06:37:44.412209  5369 raft_consensus.cc:2955] T 13d248a66d9a4c68a4cca28349ace304 P a748b9e4d38f4359bf0e3733995423d5 [term 1 FOLLOWER]: Committing config change with OpId 1.18: config changed from index 17 to 18, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
I20260812 06:37:44.414781  4941 catalog_manager.cc:5719] T 13d248a66d9a4c68a4cca28349ace304 P a748b9e4d38f4359bf0e3733995423d5 reported cstate change: config changed from index 17 to 18, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "155b3bf9ca74442fbb15f5a42e60f088" committed_config { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
I20260812 06:37:44.415385  5238 raft_consensus.cc:2955] T 13d248a66d9a4c68a4cca28349ace304 P 6edcc833ff8a4f36848c7674dd357e40 [term 1 FOLLOWER]: Committing config change with OpId 1.18: config changed from index 17 to 18, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from NON_VOTER to VOTER. New config: { opid_index: 18 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
I20260812 06:37:44.415874  5117 consensus_queue.cc:237] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 1.18, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: NON_VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } }
I20260812 06:37:44.417007  5369 raft_consensus.cc:1275] T 13d248a66d9a4c68a4cca28349ace304 P a748b9e4d38f4359bf0e3733995423d5 [term 1 FOLLOWER]: Refusing update from remote peer 155b3bf9ca74442fbb15f5a42e60f088: Log matching property violated. Preceding OpId in replica: term: 1 index: 18. Preceding OpId from leader: term: 1 index: 19. (index mismatch)
I20260812 06:37:44.417172  5238 raft_consensus.cc:1275] T 13d248a66d9a4c68a4cca28349ace304 P 6edcc833ff8a4f36848c7674dd357e40 [term 1 FOLLOWER]: Refusing update from remote peer 155b3bf9ca74442fbb15f5a42e60f088: Log matching property violated. Preceding OpId in replica: term: 1 index: 18. Preceding OpId from leader: term: 1 index: 19. (index mismatch)
I20260812 06:37:44.417984  5473 consensus_queue.cc:1048] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260812 06:37:44.418184  5514 consensus_queue.cc:1048] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: NON_VOTER last_known_addr { host: "127.3.28.194" port: 37903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260812 06:37:44.419565  5477 raft_consensus.cc:2955] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [term 1 LEADER]: Committing config change with OpId 1.19: config changed from index 18 to 19, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from VOTER to NON_VOTER. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: NON_VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
I20260812 06:37:44.420085  5369 raft_consensus.cc:2955] T 13d248a66d9a4c68a4cca28349ace304 P a748b9e4d38f4359bf0e3733995423d5 [term 1 FOLLOWER]: Committing config change with OpId 1.19: config changed from index 18 to 19, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from VOTER to NON_VOTER. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: NON_VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
I20260812 06:37:44.420224  5238 raft_consensus.cc:2955] T 13d248a66d9a4c68a4cca28349ace304 P 6edcc833ff8a4f36848c7674dd357e40 [term 1 LEARNER]: Committing config change with OpId 1.19: config changed from index 18 to 19, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from VOTER to NON_VOTER. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: NON_VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
I20260812 06:37:44.421854  5117 consensus_queue.cc:237] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 1.19, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } }
I20260812 06:37:44.421862  4942 catalog_manager.cc:5719] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 reported cstate change: config changed from index 18 to 19, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "155b3bf9ca74442fbb15f5a42e60f088" committed_config { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: NON_VOTER last_known_addr { host: "127.3.28.194" port: 37903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } health_report { overall_health: HEALTHY } } }
I20260812 06:37:44.423091  5238 raft_consensus.cc:1275] T 13d248a66d9a4c68a4cca28349ace304 P 6edcc833ff8a4f36848c7674dd357e40 [term 1 LEARNER]: Refusing update from remote peer 155b3bf9ca74442fbb15f5a42e60f088: Log matching property violated. Preceding OpId in replica: term: 1 index: 19. Preceding OpId from leader: term: 1 index: 20. (index mismatch)
I20260812 06:37:44.423092  5369 raft_consensus.cc:1275] T 13d248a66d9a4c68a4cca28349ace304 P a748b9e4d38f4359bf0e3733995423d5 [term 1 FOLLOWER]: Refusing update from remote peer 155b3bf9ca74442fbb15f5a42e60f088: Log matching property violated. Preceding OpId in replica: term: 1 index: 19. Preceding OpId from leader: term: 1 index: 20. (index mismatch)
I20260812 06:37:44.423439  5514 consensus_queue.cc:1048] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260812 06:37:44.423616  5473 consensus_queue.cc:1048] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260812 06:37:44.424964  5473 raft_consensus.cc:2955] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [term 1 LEADER]: Committing config change with OpId 1.20: config changed from index 19 to 20, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from NON_VOTER to VOTER. New config: { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
I20260812 06:37:44.426517  5238 raft_consensus.cc:2955] T 13d248a66d9a4c68a4cca28349ace304 P 6edcc833ff8a4f36848c7674dd357e40 [term 1 FOLLOWER]: Committing config change with OpId 1.20: config changed from index 19 to 20, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from NON_VOTER to VOTER. New config: { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
I20260812 06:37:44.427006  5369 raft_consensus.cc:2955] T 13d248a66d9a4c68a4cca28349ace304 P a748b9e4d38f4359bf0e3733995423d5 [term 1 FOLLOWER]: Committing config change with OpId 1.20: config changed from index 19 to 20, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from NON_VOTER to VOTER. New config: { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
I20260812 06:37:44.427218  5117 consensus_queue.cc:237] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 1.20, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 21 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: NON_VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } }
I20260812 06:37:44.427268  4941 catalog_manager.cc:5719] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 reported cstate change: config changed from index 19 to 20, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "155b3bf9ca74442fbb15f5a42e60f088" committed_config { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } health_report { overall_health: HEALTHY } } }
I20260812 06:37:44.429757  5369 raft_consensus.cc:1275] T 13d248a66d9a4c68a4cca28349ace304 P a748b9e4d38f4359bf0e3733995423d5 [term 1 FOLLOWER]: Refusing update from remote peer 155b3bf9ca74442fbb15f5a42e60f088: Log matching property violated. Preceding OpId in replica: term: 1 index: 20. Preceding OpId from leader: term: 1 index: 21. (index mismatch)
I20260812 06:37:44.430418  5238 raft_consensus.cc:1275] T 13d248a66d9a4c68a4cca28349ace304 P 6edcc833ff8a4f36848c7674dd357e40 [term 1 FOLLOWER]: Refusing update from remote peer 155b3bf9ca74442fbb15f5a42e60f088: Log matching property violated. Preceding OpId in replica: term: 1 index: 20. Preceding OpId from leader: term: 1 index: 21. (index mismatch)
I20260812 06:37:44.430603  5514 consensus_queue.cc:1048] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20260812 06:37:44.430799  5477 consensus_queue.cc:1048] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: NON_VOTER last_known_addr { host: "127.3.28.194" port: 37903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20260812 06:37:44.432081  5514 raft_consensus.cc:2955] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [term 1 LEADER]: Committing config change with OpId 1.21: config changed from index 20 to 21, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from VOTER to NON_VOTER. New config: { opid_index: 21 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: NON_VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
I20260812 06:37:44.432440  5369 raft_consensus.cc:2955] T 13d248a66d9a4c68a4cca28349ace304 P a748b9e4d38f4359bf0e3733995423d5 [term 1 FOLLOWER]: Committing config change with OpId 1.21: config changed from index 20 to 21, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from VOTER to NON_VOTER. New config: { opid_index: 21 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: NON_VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
I20260812 06:37:44.432727  5238 raft_consensus.cc:2955] T 13d248a66d9a4c68a4cca28349ace304 P 6edcc833ff8a4f36848c7674dd357e40 [term 1 LEARNER]: Committing config change with OpId 1.21: config changed from index 20 to 21, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from VOTER to NON_VOTER. New config: { opid_index: 21 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: NON_VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
I20260812 06:37:44.434168  5117 consensus_queue.cc:237] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 1.21, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 22 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } }
I20260812 06:37:44.434134  4942 catalog_manager.cc:5719] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 reported cstate change: config changed from index 20 to 21, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "155b3bf9ca74442fbb15f5a42e60f088" committed_config { opid_index: 21 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: NON_VOTER last_known_addr { host: "127.3.28.194" port: 37903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } health_report { overall_health: HEALTHY } } }
I20260812 06:37:44.436095  5369 raft_consensus.cc:1275] T 13d248a66d9a4c68a4cca28349ace304 P a748b9e4d38f4359bf0e3733995423d5 [term 1 FOLLOWER]: Refusing update from remote peer 155b3bf9ca74442fbb15f5a42e60f088: Log matching property violated. Preceding OpId in replica: term: 1 index: 21. Preceding OpId from leader: term: 1 index: 22. (index mismatch)
I20260812 06:37:44.436437  5238 raft_consensus.cc:1275] T 13d248a66d9a4c68a4cca28349ace304 P 6edcc833ff8a4f36848c7674dd357e40 [term 1 LEARNER]: Refusing update from remote peer 155b3bf9ca74442fbb15f5a42e60f088: Log matching property violated. Preceding OpId in replica: term: 1 index: 21. Preceding OpId from leader: term: 1 index: 22. (index mismatch)
I20260812 06:37:44.437002  5514 consensus_queue.cc:1048] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.000s
I20260812 06:37:44.437203  5477 consensus_queue.cc:1048] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.000s
I20260812 06:37:44.438782  5514 raft_consensus.cc:2955] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [term 1 LEADER]: Committing config change with OpId 1.22: config changed from index 21 to 22, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from NON_VOTER to VOTER. New config: { opid_index: 22 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
I20260812 06:37:44.439234  5369 raft_consensus.cc:2955] T 13d248a66d9a4c68a4cca28349ace304 P a748b9e4d38f4359bf0e3733995423d5 [term 1 FOLLOWER]: Committing config change with OpId 1.22: config changed from index 21 to 22, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from NON_VOTER to VOTER. New config: { opid_index: 22 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
I20260812 06:37:44.439231  5238 raft_consensus.cc:2955] T 13d248a66d9a4c68a4cca28349ace304 P 6edcc833ff8a4f36848c7674dd357e40 [term 1 FOLLOWER]: Committing config change with OpId 1.22: config changed from index 21 to 22, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from NON_VOTER to VOTER. New config: { opid_index: 22 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
W20260812 06:37:44.440753  5473 consensus_queue.cc:1175] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a748b9e4d38f4359bf0e3733995423d5" responder_term: 1 status { last_received { term: 1 index: 22 } last_committed_idx: 22 last_received_current_leader { term: 1 index: 22 } }
I20260812 06:37:44.440925  5117 consensus_queue.cc:237] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 22, Committed index: 22, Last appended: 1.22, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 23 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: NON_VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } }
I20260812 06:37:44.441102  4942 catalog_manager.cc:5719] T 13d248a66d9a4c68a4cca28349ace304 P a748b9e4d38f4359bf0e3733995423d5 reported cstate change: config changed from index 21 to 22, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "155b3bf9ca74442fbb15f5a42e60f088" committed_config { opid_index: 22 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
I20260812 06:37:44.442633  5369 raft_consensus.cc:1275] T 13d248a66d9a4c68a4cca28349ace304 P a748b9e4d38f4359bf0e3733995423d5 [term 1 FOLLOWER]: Refusing update from remote peer 155b3bf9ca74442fbb15f5a42e60f088: Log matching property violated. Preceding OpId in replica: term: 1 index: 22. Preceding OpId from leader: term: 1 index: 23. (index mismatch)
I20260812 06:37:44.442989  5514 consensus_queue.cc:1048] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 22, Time since last communication: 0.000s
I20260812 06:37:44.443396  5238 raft_consensus.cc:1275] T 13d248a66d9a4c68a4cca28349ace304 P 6edcc833ff8a4f36848c7674dd357e40 [term 1 FOLLOWER]: Refusing update from remote peer 155b3bf9ca74442fbb15f5a42e60f088: Log matching property violated. Preceding OpId in replica: term: 1 index: 22. Preceding OpId from leader: term: 1 index: 23. (index mismatch)
I20260812 06:37:44.443878  5514 consensus_queue.cc:1048] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: NON_VOTER last_known_addr { host: "127.3.28.194" port: 37903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 22, Time since last communication: 0.000s
I20260812 06:37:44.444767  5473 raft_consensus.cc:2955] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [term 1 LEADER]: Committing config change with OpId 1.23: config changed from index 22 to 23, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from VOTER to NON_VOTER. New config: { opid_index: 23 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: NON_VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
I20260812 06:37:44.445196  5369 raft_consensus.cc:2955] T 13d248a66d9a4c68a4cca28349ace304 P a748b9e4d38f4359bf0e3733995423d5 [term 1 FOLLOWER]: Committing config change with OpId 1.23: config changed from index 22 to 23, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from VOTER to NON_VOTER. New config: { opid_index: 23 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: NON_VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
I20260812 06:37:44.445796  5238 raft_consensus.cc:2955] T 13d248a66d9a4c68a4cca28349ace304 P 6edcc833ff8a4f36848c7674dd357e40 [term 1 LEARNER]: Committing config change with OpId 1.23: config changed from index 22 to 23, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from VOTER to NON_VOTER. New config: { opid_index: 23 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: NON_VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
I20260812 06:37:44.447530  5117 consensus_queue.cc:237] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 23, Committed index: 23, Last appended: 1.23, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 24 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } }
I20260812 06:37:44.447571  4944 catalog_manager.cc:5719] T 13d248a66d9a4c68a4cca28349ace304 P a748b9e4d38f4359bf0e3733995423d5 reported cstate change: config changed from index 22 to 23, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "155b3bf9ca74442fbb15f5a42e60f088" committed_config { opid_index: 23 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: NON_VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
I20260812 06:37:44.448652  5369 raft_consensus.cc:1275] T 13d248a66d9a4c68a4cca28349ace304 P a748b9e4d38f4359bf0e3733995423d5 [term 1 FOLLOWER]: Refusing update from remote peer 155b3bf9ca74442fbb15f5a42e60f088: Log matching property violated. Preceding OpId in replica: term: 1 index: 23. Preceding OpId from leader: term: 1 index: 24. (index mismatch)
I20260812 06:37:44.448719  5238 raft_consensus.cc:1275] T 13d248a66d9a4c68a4cca28349ace304 P 6edcc833ff8a4f36848c7674dd357e40 [term 1 LEARNER]: Refusing update from remote peer 155b3bf9ca74442fbb15f5a42e60f088: Log matching property violated. Preceding OpId in replica: term: 1 index: 23. Preceding OpId from leader: term: 1 index: 24. (index mismatch)
I20260812 06:37:44.449005  5514 consensus_queue.cc:1048] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 24, Last known committed idx: 23, Time since last communication: 0.000s
I20260812 06:37:44.449285  5473 consensus_queue.cc:1048] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 24, Last known committed idx: 23, Time since last communication: 0.000s
I20260812 06:37:44.451049  5477 raft_consensus.cc:2955] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [term 1 LEADER]: Committing config change with OpId 1.24: config changed from index 23 to 24, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from NON_VOTER to VOTER. New config: { opid_index: 24 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
I20260812 06:37:44.452701  5369 raft_consensus.cc:2955] T 13d248a66d9a4c68a4cca28349ace304 P a748b9e4d38f4359bf0e3733995423d5 [term 1 FOLLOWER]: Committing config change with OpId 1.24: config changed from index 23 to 24, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from NON_VOTER to VOTER. New config: { opid_index: 24 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
I20260812 06:37:44.452822  5238 raft_consensus.cc:2955] T 13d248a66d9a4c68a4cca28349ace304 P 6edcc833ff8a4f36848c7674dd357e40 [term 1 FOLLOWER]: Committing config change with OpId 1.24: config changed from index 23 to 24, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from NON_VOTER to VOTER. New config: { opid_index: 24 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
I20260812 06:37:44.453073  5117 consensus_queue.cc:237] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 24, Committed index: 24, Last appended: 1.24, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: NON_VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } }
I20260812 06:37:44.454514  4942 catalog_manager.cc:5719] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 reported cstate change: config changed from index 23 to 24, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "155b3bf9ca74442fbb15f5a42e60f088" committed_config { opid_index: 24 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } health_report { overall_health: HEALTHY } } }
I20260812 06:37:44.454783  5240 raft_consensus.cc:1275] T 13d248a66d9a4c68a4cca28349ace304 P 6edcc833ff8a4f36848c7674dd357e40 [term 1 FOLLOWER]: Refusing update from remote peer 155b3bf9ca74442fbb15f5a42e60f088: Log matching property violated. Preceding OpId in replica: term: 1 index: 24. Preceding OpId from leader: term: 1 index: 25. (index mismatch)
I20260812 06:37:44.455158  5514 consensus_queue.cc:1048] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: NON_VOTER last_known_addr { host: "127.3.28.194" port: 37903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 25, Last known committed idx: 24, Time since last communication: 0.000s
I20260812 06:37:44.455657  5370 raft_consensus.cc:1275] T 13d248a66d9a4c68a4cca28349ace304 P a748b9e4d38f4359bf0e3733995423d5 [term 1 FOLLOWER]: Refusing update from remote peer 155b3bf9ca74442fbb15f5a42e60f088: Log matching property violated. Preceding OpId in replica: term: 1 index: 24. Preceding OpId from leader: term: 1 index: 25. (index mismatch)
I20260812 06:37:44.456629  5514 consensus_queue.cc:1048] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 25, Last known committed idx: 24, Time since last communication: 0.000s
I20260812 06:37:44.458033  5517 raft_consensus.cc:2955] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [term 1 LEADER]: Committing config change with OpId 1.25: config changed from index 24 to 25, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from VOTER to NON_VOTER. New config: { opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: NON_VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
I20260812 06:37:44.458472  5369 raft_consensus.cc:2955] T 13d248a66d9a4c68a4cca28349ace304 P a748b9e4d38f4359bf0e3733995423d5 [term 1 FOLLOWER]: Committing config change with OpId 1.25: config changed from index 24 to 25, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from VOTER to NON_VOTER. New config: { opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: NON_VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
I20260812 06:37:44.460282  5240 raft_consensus.cc:2955] T 13d248a66d9a4c68a4cca28349ace304 P 6edcc833ff8a4f36848c7674dd357e40 [term 1 LEARNER]: Committing config change with OpId 1.25: config changed from index 24 to 25, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from VOTER to NON_VOTER. New config: { opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: NON_VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
I20260812 06:37:44.460656  4942 catalog_manager.cc:5719] T 13d248a66d9a4c68a4cca28349ace304 P a748b9e4d38f4359bf0e3733995423d5 reported cstate change: config changed from index 24 to 25, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "155b3bf9ca74442fbb15f5a42e60f088" committed_config { opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: NON_VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
W20260812 06:37:44.461968  5473 consensus_queue.cc:1175] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6edcc833ff8a4f36848c7674dd357e40" responder_term: 1 status { last_received { term: 1 index: 25 } last_committed_idx: 25 last_received_current_leader { term: 1 index: 25 } }
I20260812 06:37:44.462941  5117 consensus_queue.cc:237] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 25, Committed index: 25, Last appended: 1.25, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } }
I20260812 06:37:44.464005  5369 raft_consensus.cc:1275] T 13d248a66d9a4c68a4cca28349ace304 P a748b9e4d38f4359bf0e3733995423d5 [term 1 FOLLOWER]: Refusing update from remote peer 155b3bf9ca74442fbb15f5a42e60f088: Log matching property violated. Preceding OpId in replica: term: 1 index: 25. Preceding OpId from leader: term: 1 index: 26. (index mismatch)
I20260812 06:37:44.464007  5240 raft_consensus.cc:1275] T 13d248a66d9a4c68a4cca28349ace304 P 6edcc833ff8a4f36848c7674dd357e40 [term 1 LEARNER]: Refusing update from remote peer 155b3bf9ca74442fbb15f5a42e60f088: Log matching property violated. Preceding OpId in replica: term: 1 index: 25. Preceding OpId from leader: term: 1 index: 26. (index mismatch)
I20260812 06:37:44.464448  5517 consensus_queue.cc:1048] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 26, Last known committed idx: 25, Time since last communication: 0.000s
I20260812 06:37:44.464608  5473 consensus_queue.cc:1048] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 26, Last known committed idx: 25, Time since last communication: 0.000s
I20260812 06:37:44.466292  5514 raft_consensus.cc:2955] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [term 1 LEADER]: Committing config change with OpId 1.26: config changed from index 25 to 26, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from NON_VOTER to VOTER. New config: { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
I20260812 06:37:44.466691  5240 raft_consensus.cc:2955] T 13d248a66d9a4c68a4cca28349ace304 P 6edcc833ff8a4f36848c7674dd357e40 [term 1 FOLLOWER]: Committing config change with OpId 1.26: config changed from index 25 to 26, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from NON_VOTER to VOTER. New config: { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
I20260812 06:37:44.466809  5369 raft_consensus.cc:2955] T 13d248a66d9a4c68a4cca28349ace304 P a748b9e4d38f4359bf0e3733995423d5 [term 1 FOLLOWER]: Committing config change with OpId 1.26: config changed from index 25 to 26, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from NON_VOTER to VOTER. New config: { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
I20260812 06:37:44.468530  5117 consensus_queue.cc:237] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 26, Committed index: 26, Last appended: 1.26, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: NON_VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } }
I20260812 06:37:44.468664  4944 catalog_manager.cc:5719] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 reported cstate change: config changed from index 25 to 26, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "155b3bf9ca74442fbb15f5a42e60f088" committed_config { opid_index: 26 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } health_report { overall_health: HEALTHY } } }
I20260812 06:37:44.469789  5369 raft_consensus.cc:1275] T 13d248a66d9a4c68a4cca28349ace304 P a748b9e4d38f4359bf0e3733995423d5 [term 1 FOLLOWER]: Refusing update from remote peer 155b3bf9ca74442fbb15f5a42e60f088: Log matching property violated. Preceding OpId in replica: term: 1 index: 26. Preceding OpId from leader: term: 1 index: 27. (index mismatch)
I20260812 06:37:44.469867  5240 raft_consensus.cc:1275] T 13d248a66d9a4c68a4cca28349ace304 P 6edcc833ff8a4f36848c7674dd357e40 [term 1 FOLLOWER]: Refusing update from remote peer 155b3bf9ca74442fbb15f5a42e60f088: Log matching property violated. Preceding OpId in replica: term: 1 index: 26. Preceding OpId from leader: term: 1 index: 27. (index mismatch)
I20260812 06:37:44.470126  5473 consensus_queue.cc:1048] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 27, Last known committed idx: 26, Time since last communication: 0.000s
I20260812 06:37:44.470245  5477 consensus_queue.cc:1048] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: NON_VOTER last_known_addr { host: "127.3.28.194" port: 37903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 27, Last known committed idx: 26, Time since last communication: 0.000s
I20260812 06:37:44.470467  4925 catalog_manager.cc:5266] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 13d248a66d9a4c68a4cca28349ace304 with cas_config_opid_index 19: aborting the task: latest config opid_index 25; task opid_index 19
I20260812 06:37:44.472366  5514 raft_consensus.cc:2955] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [term 1 LEADER]: Committing config change with OpId 1.27: config changed from index 26 to 27, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from VOTER to NON_VOTER. New config: { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: NON_VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
I20260812 06:37:44.473750  4928 catalog_manager.cc:5266] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 13d248a66d9a4c68a4cca28349ace304 with cas_config_opid_index 17: aborting the task: latest config opid_index 26; task opid_index 17
I20260812 06:37:44.474062  5240 raft_consensus.cc:2955] T 13d248a66d9a4c68a4cca28349ace304 P 6edcc833ff8a4f36848c7674dd357e40 [term 1 LEARNER]: Committing config change with OpId 1.27: config changed from index 26 to 27, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from VOTER to NON_VOTER. New config: { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: NON_VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
I20260812 06:37:44.474330  5369 raft_consensus.cc:2955] T 13d248a66d9a4c68a4cca28349ace304 P a748b9e4d38f4359bf0e3733995423d5 [term 1 FOLLOWER]: Committing config change with OpId 1.27: config changed from index 26 to 27, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from VOTER to NON_VOTER. New config: { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: NON_VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
I20260812 06:37:44.474435  5117 consensus_queue.cc:237] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 27, Committed index: 27, Last appended: 1.27, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } }
I20260812 06:37:44.475950  4944 catalog_manager.cc:5719] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 reported cstate change: config changed from index 26 to 27, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "155b3bf9ca74442fbb15f5a42e60f088" committed_config { opid_index: 27 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: NON_VOTER last_known_addr { host: "127.3.28.194" port: 37903 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } health_report { overall_health: HEALTHY } } }
I20260812 06:37:44.476132  5370 raft_consensus.cc:1275] T 13d248a66d9a4c68a4cca28349ace304 P a748b9e4d38f4359bf0e3733995423d5 [term 1 FOLLOWER]: Refusing update from remote peer 155b3bf9ca74442fbb15f5a42e60f088: Log matching property violated. Preceding OpId in replica: term: 1 index: 27. Preceding OpId from leader: term: 1 index: 28. (index mismatch)
I20260812 06:37:44.476562  5473 consensus_queue.cc:1048] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 28, Last known committed idx: 27, Time since last communication: 0.000s
I20260812 06:37:44.476660  5240 raft_consensus.cc:1275] T 13d248a66d9a4c68a4cca28349ace304 P 6edcc833ff8a4f36848c7674dd357e40 [term 1 LEARNER]: Refusing update from remote peer 155b3bf9ca74442fbb15f5a42e60f088: Log matching property violated. Preceding OpId in replica: term: 1 index: 27. Preceding OpId from leader: term: 1 index: 28. (index mismatch)
I20260812 06:37:44.477237  5473 consensus_queue.cc:1048] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 28, Last known committed idx: 27, Time since last communication: 0.000s
I20260812 06:37:44.479144  5477 raft_consensus.cc:2955] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [term 1 LEADER]: Committing config change with OpId 1.28: config changed from index 27 to 28, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from NON_VOTER to VOTER. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
I20260812 06:37:44.479944  5369 raft_consensus.cc:2955] T 13d248a66d9a4c68a4cca28349ace304 P a748b9e4d38f4359bf0e3733995423d5 [term 1 FOLLOWER]: Committing config change with OpId 1.28: config changed from index 27 to 28, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from NON_VOTER to VOTER. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
I20260812 06:37:44.480881  5240 raft_consensus.cc:2955] T 13d248a66d9a4c68a4cca28349ace304 P 6edcc833ff8a4f36848c7674dd357e40 [term 1 FOLLOWER]: Committing config change with OpId 1.28: config changed from index 27 to 28, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from NON_VOTER to VOTER. New config: { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
I20260812 06:37:44.481890  5117 consensus_queue.cc:237] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 28, Committed index: 28, Last appended: 1.28, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: NON_VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } }
I20260812 06:37:44.482771  4941 catalog_manager.cc:5719] T 13d248a66d9a4c68a4cca28349ace304 P a748b9e4d38f4359bf0e3733995423d5 reported cstate change: config changed from index 27 to 28, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "155b3bf9ca74442fbb15f5a42e60f088" committed_config { opid_index: 28 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
I20260812 06:37:44.483080  5369 raft_consensus.cc:1275] T 13d248a66d9a4c68a4cca28349ace304 P a748b9e4d38f4359bf0e3733995423d5 [term 1 FOLLOWER]: Refusing update from remote peer 155b3bf9ca74442fbb15f5a42e60f088: Log matching property violated. Preceding OpId in replica: term: 1 index: 28. Preceding OpId from leader: term: 1 index: 29. (index mismatch)
I20260812 06:37:44.483228  5240 raft_consensus.cc:1275] T 13d248a66d9a4c68a4cca28349ace304 P 6edcc833ff8a4f36848c7674dd357e40 [term 1 FOLLOWER]: Refusing update from remote peer 155b3bf9ca74442fbb15f5a42e60f088: Log matching property violated. Preceding OpId in replica: term: 1 index: 28. Preceding OpId from leader: term: 1 index: 29. (index mismatch)
I20260812 06:37:44.483554  5473 consensus_queue.cc:1048] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 29, Last known committed idx: 28, Time since last communication: 0.000s
I20260812 06:37:44.483700  5517 consensus_queue.cc:1048] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: NON_VOTER last_known_addr { host: "127.3.28.194" port: 37903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 29, Last known committed idx: 28, Time since last communication: 0.000s
I20260812 06:37:44.485947  5473 raft_consensus.cc:2955] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [term 1 LEADER]: Committing config change with OpId 1.29: config changed from index 28 to 29, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from VOTER to NON_VOTER. New config: { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: NON_VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
I20260812 06:37:44.486512  5369 raft_consensus.cc:2955] T 13d248a66d9a4c68a4cca28349ace304 P a748b9e4d38f4359bf0e3733995423d5 [term 1 FOLLOWER]: Committing config change with OpId 1.29: config changed from index 28 to 29, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from VOTER to NON_VOTER. New config: { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: NON_VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
I20260812 06:37:44.487987  5117 consensus_queue.cc:237] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 29, Committed index: 29, Last appended: 1.29, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } }
I20260812 06:37:44.488716  4942 catalog_manager.cc:5719] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 reported cstate change: config changed from index 28 to 29, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "155b3bf9ca74442fbb15f5a42e60f088" committed_config { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: NON_VOTER last_known_addr { host: "127.3.28.194" port: 37903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } health_report { overall_health: HEALTHY } } }
I20260812 06:37:44.489431  5238 raft_consensus.cc:1275] T 13d248a66d9a4c68a4cca28349ace304 P 6edcc833ff8a4f36848c7674dd357e40 [term 1 LEARNER]: Refusing update from remote peer 155b3bf9ca74442fbb15f5a42e60f088: Log matching property violated. Preceding OpId in replica: term: 1 index: 29. Preceding OpId from leader: term: 1 index: 30. (index mismatch)
I20260812 06:37:44.489674  5369 raft_consensus.cc:1275] T 13d248a66d9a4c68a4cca28349ace304 P a748b9e4d38f4359bf0e3733995423d5 [term 1 FOLLOWER]: Refusing update from remote peer 155b3bf9ca74442fbb15f5a42e60f088: Log matching property violated. Preceding OpId in replica: term: 1 index: 29. Preceding OpId from leader: term: 1 index: 30. (index mismatch)
I20260812 06:37:44.489605  5240 raft_consensus.cc:2955] T 13d248a66d9a4c68a4cca28349ace304 P 6edcc833ff8a4f36848c7674dd357e40 [term 1 LEARNER]: Committing config change with OpId 1.29: config changed from index 28 to 29, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from VOTER to NON_VOTER. New config: { opid_index: 29 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: NON_VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
I20260812 06:37:44.490010  5517 consensus_queue.cc:1048] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 30, Last known committed idx: 29, Time since last communication: 0.000s
I20260812 06:37:44.490325  5517 consensus_queue.cc:1048] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 30, Last known committed idx: 28, Time since last communication: 0.000s
I20260812 06:37:44.491340  5514 raft_consensus.cc:2955] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [term 1 LEADER]: Committing config change with OpId 1.30: config changed from index 29 to 30, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from NON_VOTER to VOTER. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
I20260812 06:37:44.491767  5369 raft_consensus.cc:2955] T 13d248a66d9a4c68a4cca28349ace304 P a748b9e4d38f4359bf0e3733995423d5 [term 1 FOLLOWER]: Committing config change with OpId 1.30: config changed from index 29 to 30, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from NON_VOTER to VOTER. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
I20260812 06:37:44.493481  5117 consensus_queue.cc:237] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 30, Committed index: 30, Last appended: 1.30, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: NON_VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } }
I20260812 06:37:44.493818  4942 catalog_manager.cc:5719] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 reported cstate change: config changed from index 29 to 30, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "155b3bf9ca74442fbb15f5a42e60f088" committed_config { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } health_report { overall_health: HEALTHY } } }
I20260812 06:37:44.494899  5240 raft_consensus.cc:1275] T 13d248a66d9a4c68a4cca28349ace304 P 6edcc833ff8a4f36848c7674dd357e40 [term 1 FOLLOWER]: Refusing update from remote peer 155b3bf9ca74442fbb15f5a42e60f088: Log matching property violated. Preceding OpId in replica: term: 1 index: 30. Preceding OpId from leader: term: 1 index: 31. (index mismatch)
I20260812 06:37:44.494920  5369 raft_consensus.cc:1275] T 13d248a66d9a4c68a4cca28349ace304 P a748b9e4d38f4359bf0e3733995423d5 [term 1 FOLLOWER]: Refusing update from remote peer 155b3bf9ca74442fbb15f5a42e60f088: Log matching property violated. Preceding OpId in replica: term: 1 index: 30. Preceding OpId from leader: term: 1 index: 31. (index mismatch)
I20260812 06:37:44.495451  5473 consensus_queue.cc:1048] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 31, Last known committed idx: 30, Time since last communication: 0.000s
I20260812 06:37:44.495733  5473 consensus_queue.cc:1048] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: NON_VOTER last_known_addr { host: "127.3.28.194" port: 37903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 31, Last known committed idx: 29, Time since last communication: 0.000s
I20260812 06:37:44.496830  5240 raft_consensus.cc:2955] T 13d248a66d9a4c68a4cca28349ace304 P 6edcc833ff8a4f36848c7674dd357e40 [term 1 FOLLOWER]: Committing config change with OpId 1.30: config changed from index 29 to 30, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from NON_VOTER to VOTER. New config: { opid_index: 30 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
I20260812 06:37:44.497360  5473 raft_consensus.cc:2955] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [term 1 LEADER]: Committing config change with OpId 1.31: config changed from index 30 to 31, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from VOTER to NON_VOTER. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: NON_VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
I20260812 06:37:44.497787  4926 catalog_manager.cc:5266] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 13d248a66d9a4c68a4cca28349ace304 with cas_config_opid_index 21: aborting the task: latest config opid_index 30; task opid_index 21
I20260812 06:37:44.497702  5369 raft_consensus.cc:2955] T 13d248a66d9a4c68a4cca28349ace304 P a748b9e4d38f4359bf0e3733995423d5 [term 1 FOLLOWER]: Committing config change with OpId 1.31: config changed from index 30 to 31, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from VOTER to NON_VOTER. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: NON_VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
I20260812 06:37:44.499655  5117 consensus_queue.cc:237] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 31, Committed index: 31, Last appended: 1.31, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } }
I20260812 06:37:44.499606  4944 catalog_manager.cc:5719] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 reported cstate change: config changed from index 30 to 31, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "155b3bf9ca74442fbb15f5a42e60f088" committed_config { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: NON_VOTER last_known_addr { host: "127.3.28.194" port: 37903 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } health_report { overall_health: HEALTHY } } }
I20260812 06:37:44.500869  5370 raft_consensus.cc:1275] T 13d248a66d9a4c68a4cca28349ace304 P a748b9e4d38f4359bf0e3733995423d5 [term 1 FOLLOWER]: Refusing update from remote peer 155b3bf9ca74442fbb15f5a42e60f088: Log matching property violated. Preceding OpId in replica: term: 1 index: 31. Preceding OpId from leader: term: 1 index: 32. (index mismatch)
I20260812 06:37:44.501036  5240 raft_consensus.cc:1275] T 13d248a66d9a4c68a4cca28349ace304 P 6edcc833ff8a4f36848c7674dd357e40 [term 1 LEARNER]: Refusing update from remote peer 155b3bf9ca74442fbb15f5a42e60f088: Log matching property violated. Preceding OpId in replica: term: 1 index: 31. Preceding OpId from leader: term: 1 index: 32. (index mismatch)
I20260812 06:37:44.501199  5514 consensus_queue.cc:1048] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 32, Last known committed idx: 31, Time since last communication: 0.000s
I20260812 06:37:44.501398  5473 consensus_queue.cc:1048] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 32, Last known committed idx: 30, Time since last communication: 0.000s
I20260812 06:37:44.502097  5240 raft_consensus.cc:2955] T 13d248a66d9a4c68a4cca28349ace304 P 6edcc833ff8a4f36848c7674dd357e40 [term 1 LEARNER]: Committing config change with OpId 1.31: config changed from index 30 to 31, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from VOTER to NON_VOTER. New config: { opid_index: 31 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: NON_VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
I20260812 06:37:44.503523  5473 raft_consensus.cc:2955] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [term 1 LEADER]: Committing config change with OpId 1.32: config changed from index 31 to 32, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from NON_VOTER to VOTER. New config: { opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
I20260812 06:37:44.505146  5370 raft_consensus.cc:2955] T 13d248a66d9a4c68a4cca28349ace304 P a748b9e4d38f4359bf0e3733995423d5 [term 1 FOLLOWER]: Committing config change with OpId 1.32: config changed from index 31 to 32, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from NON_VOTER to VOTER. New config: { opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
I20260812 06:37:44.505460  5117 consensus_queue.cc:237] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 32, Committed index: 32, Last appended: 1.32, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: NON_VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } }
I20260812 06:37:44.506927  5240 raft_consensus.cc:1275] T 13d248a66d9a4c68a4cca28349ace304 P 6edcc833ff8a4f36848c7674dd357e40 [term 1 FOLLOWER]: Refusing update from remote peer 155b3bf9ca74442fbb15f5a42e60f088: Log matching property violated. Preceding OpId in replica: term: 1 index: 32. Preceding OpId from leader: term: 1 index: 33. (index mismatch)
I20260812 06:37:44.506927  5370 raft_consensus.cc:1275] T 13d248a66d9a4c68a4cca28349ace304 P a748b9e4d38f4359bf0e3733995423d5 [term 1 FOLLOWER]: Refusing update from remote peer 155b3bf9ca74442fbb15f5a42e60f088: Log matching property violated. Preceding OpId in replica: term: 1 index: 32. Preceding OpId from leader: term: 1 index: 33. (index mismatch)
I20260812 06:37:44.507268  4942 catalog_manager.cc:5719] T 13d248a66d9a4c68a4cca28349ace304 P a748b9e4d38f4359bf0e3733995423d5 reported cstate change: config changed from index 31 to 32, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "155b3bf9ca74442fbb15f5a42e60f088" committed_config { opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
I20260812 06:37:44.507414  5514 consensus_queue.cc:1048] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 33, Last known committed idx: 32, Time since last communication: 0.000s
I20260812 06:37:44.508531  5514 consensus_queue.cc:1048] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: NON_VOTER last_known_addr { host: "127.3.28.194" port: 37903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 33, Last known committed idx: 31, Time since last communication: 0.000s
I20260812 06:37:44.509254  5240 raft_consensus.cc:2955] T 13d248a66d9a4c68a4cca28349ace304 P 6edcc833ff8a4f36848c7674dd357e40 [term 1 FOLLOWER]: Committing config change with OpId 1.32: config changed from index 31 to 32, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from NON_VOTER to VOTER. New config: { opid_index: 32 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
I20260812 06:37:44.510007  5517 raft_consensus.cc:2955] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [term 1 LEADER]: Committing config change with OpId 1.33: config changed from index 32 to 33, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from VOTER to NON_VOTER. New config: { opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: NON_VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
I20260812 06:37:44.511030  5370 raft_consensus.cc:2955] T 13d248a66d9a4c68a4cca28349ace304 P a748b9e4d38f4359bf0e3733995423d5 [term 1 FOLLOWER]: Committing config change with OpId 1.33: config changed from index 32 to 33, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from VOTER to NON_VOTER. New config: { opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: NON_VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
I20260812 06:37:44.512681  5117 consensus_queue.cc:237] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 33, Committed index: 33, Last appended: 1.33, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 34 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } }
I20260812 06:37:44.513931  5370 raft_consensus.cc:1275] T 13d248a66d9a4c68a4cca28349ace304 P a748b9e4d38f4359bf0e3733995423d5 [term 1 FOLLOWER]: Refusing update from remote peer 155b3bf9ca74442fbb15f5a42e60f088: Log matching property violated. Preceding OpId in replica: term: 1 index: 33. Preceding OpId from leader: term: 1 index: 34. (index mismatch)
I20260812 06:37:44.514165  5240 raft_consensus.cc:1275] T 13d248a66d9a4c68a4cca28349ace304 P 6edcc833ff8a4f36848c7674dd357e40 [term 1 LEARNER]: Refusing update from remote peer 155b3bf9ca74442fbb15f5a42e60f088: Log matching property violated. Preceding OpId in replica: term: 1 index: 33. Preceding OpId from leader: term: 1 index: 34. (index mismatch)
I20260812 06:37:44.514166  4941 catalog_manager.cc:5719] T 13d248a66d9a4c68a4cca28349ace304 P a748b9e4d38f4359bf0e3733995423d5 reported cstate change: config changed from index 32 to 33, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "155b3bf9ca74442fbb15f5a42e60f088" committed_config { opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: NON_VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
I20260812 06:37:44.514321  5517 consensus_queue.cc:1048] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 34, Last known committed idx: 33, Time since last communication: 0.000s
I20260812 06:37:44.514550  4925 catalog_manager.cc:5266] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 13d248a66d9a4c68a4cca28349ace304 with cas_config_opid_index 23: aborting the task: latest config opid_index 32; task opid_index 23
I20260812 06:37:44.514798  5514 consensus_queue.cc:1048] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 34, Last known committed idx: 32, Time since last communication: 0.000s
I20260812 06:37:44.515854  5240 raft_consensus.cc:2955] T 13d248a66d9a4c68a4cca28349ace304 P 6edcc833ff8a4f36848c7674dd357e40 [term 1 LEARNER]: Committing config change with OpId 1.33: config changed from index 32 to 33, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from VOTER to NON_VOTER. New config: { opid_index: 33 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: NON_VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
I20260812 06:37:44.516492  5517 raft_consensus.cc:2955] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [term 1 LEADER]: Committing config change with OpId 1.34: config changed from index 33 to 34, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from NON_VOTER to VOTER. New config: { opid_index: 34 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
I20260812 06:37:44.517421  5370 raft_consensus.cc:2955] T 13d248a66d9a4c68a4cca28349ace304 P a748b9e4d38f4359bf0e3733995423d5 [term 1 FOLLOWER]: Committing config change with OpId 1.34: config changed from index 33 to 34, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from NON_VOTER to VOTER. New config: { opid_index: 34 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
I20260812 06:37:44.518810  4927 catalog_manager.cc:5266] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 13d248a66d9a4c68a4cca28349ace304 with cas_config_opid_index 25: aborting the task: latest config opid_index 33; task opid_index 25
I20260812 06:37:44.519384  4944 catalog_manager.cc:5719] T 13d248a66d9a4c68a4cca28349ace304 P a748b9e4d38f4359bf0e3733995423d5 reported cstate change: config changed from index 33 to 34, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "155b3bf9ca74442fbb15f5a42e60f088" committed_config { opid_index: 34 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
I20260812 06:37:44.520113  5240 raft_consensus.cc:2955] T 13d248a66d9a4c68a4cca28349ace304 P 6edcc833ff8a4f36848c7674dd357e40 [term 1 FOLLOWER]: Committing config change with OpId 1.34: config changed from index 33 to 34, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from NON_VOTER to VOTER. New config: { opid_index: 34 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
I20260812 06:37:44.521206  5117 consensus_queue.cc:237] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 34, Committed index: 34, Last appended: 1.34, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 35 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: NON_VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } }
I20260812 06:37:44.522990  5370 raft_consensus.cc:1275] T 13d248a66d9a4c68a4cca28349ace304 P a748b9e4d38f4359bf0e3733995423d5 [term 1 FOLLOWER]: Refusing update from remote peer 155b3bf9ca74442fbb15f5a42e60f088: Log matching property violated. Preceding OpId in replica: term: 1 index: 34. Preceding OpId from leader: term: 1 index: 35. (index mismatch)
I20260812 06:37:44.523056  5240 raft_consensus.cc:1275] T 13d248a66d9a4c68a4cca28349ace304 P 6edcc833ff8a4f36848c7674dd357e40 [term 1 FOLLOWER]: Refusing update from remote peer 155b3bf9ca74442fbb15f5a42e60f088: Log matching property violated. Preceding OpId in replica: term: 1 index: 34. Preceding OpId from leader: term: 1 index: 35. (index mismatch)
I20260812 06:37:44.523360  5517 consensus_queue.cc:1048] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 35, Last known committed idx: 34, Time since last communication: 0.000s
I20260812 06:37:44.523480  5514 consensus_queue.cc:1048] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: NON_VOTER last_known_addr { host: "127.3.28.194" port: 37903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 35, Last known committed idx: 34, Time since last communication: 0.000s
I20260812 06:37:44.525039  5514 raft_consensus.cc:2955] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [term 1 LEADER]: Committing config change with OpId 1.35: config changed from index 34 to 35, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from VOTER to NON_VOTER. New config: { opid_index: 35 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: NON_VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
I20260812 06:37:44.525555  5370 raft_consensus.cc:2955] T 13d248a66d9a4c68a4cca28349ace304 P a748b9e4d38f4359bf0e3733995423d5 [term 1 FOLLOWER]: Committing config change with OpId 1.35: config changed from index 34 to 35, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from VOTER to NON_VOTER. New config: { opid_index: 35 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: NON_VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
I20260812 06:37:44.527068  5117 consensus_queue.cc:237] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 35, Committed index: 35, Last appended: 1.35, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 36 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } }
I20260812 06:37:44.527236  5240 raft_consensus.cc:2955] T 13d248a66d9a4c68a4cca28349ace304 P 6edcc833ff8a4f36848c7674dd357e40 [term 1 LEARNER]: Committing config change with OpId 1.35: config changed from index 34 to 35, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from VOTER to NON_VOTER. New config: { opid_index: 35 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: NON_VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
I20260812 06:37:44.527899  4941 catalog_manager.cc:5719] T 13d248a66d9a4c68a4cca28349ace304 P a748b9e4d38f4359bf0e3733995423d5 reported cstate change: config changed from index 34 to 35, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from VOTER to NON_VOTER. New cstate: current_term: 1 leader_uuid: "155b3bf9ca74442fbb15f5a42e60f088" committed_config { opid_index: 35 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: NON_VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
I20260812 06:37:44.528402  5370 raft_consensus.cc:1275] T 13d248a66d9a4c68a4cca28349ace304 P a748b9e4d38f4359bf0e3733995423d5 [term 1 FOLLOWER]: Refusing update from remote peer 155b3bf9ca74442fbb15f5a42e60f088: Log matching property violated. Preceding OpId in replica: term: 1 index: 35. Preceding OpId from leader: term: 1 index: 36. (index mismatch)
I20260812 06:37:44.528837  5517 consensus_queue.cc:1048] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 36, Last known committed idx: 35, Time since last communication: 0.000s
I20260812 06:37:44.528878  5238 raft_consensus.cc:1275] T 13d248a66d9a4c68a4cca28349ace304 P 6edcc833ff8a4f36848c7674dd357e40 [term 1 LEARNER]: Refusing update from remote peer 155b3bf9ca74442fbb15f5a42e60f088: Log matching property violated. Preceding OpId in replica: term: 1 index: 35. Preceding OpId from leader: term: 1 index: 36. (index mismatch)
I20260812 06:37:44.530009  5517 consensus_queue.cc:1048] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 36, Last known committed idx: 35, Time since last communication: 0.000s
I20260812 06:37:44.531414  5477 raft_consensus.cc:2955] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [term 1 LEADER]: Committing config change with OpId 1.36: config changed from index 35 to 36, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from NON_VOTER to VOTER. New config: { opid_index: 36 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
I20260812 06:37:44.531991  5370 raft_consensus.cc:2955] T 13d248a66d9a4c68a4cca28349ace304 P a748b9e4d38f4359bf0e3733995423d5 [term 1 FOLLOWER]: Committing config change with OpId 1.36: config changed from index 35 to 36, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from NON_VOTER to VOTER. New config: { opid_index: 36 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
I20260812 06:37:44.532588  5240 raft_consensus.cc:2955] T 13d248a66d9a4c68a4cca28349ace304 P 6edcc833ff8a4f36848c7674dd357e40 [term 1 FOLLOWER]: Committing config change with OpId 1.36: config changed from index 35 to 36, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from NON_VOTER to VOTER. New config: { opid_index: 36 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
I20260812 06:37:44.532971  3187 timestamp_advancement-itest.cc:267] GCing logs...
I20260812 06:37:44.533180  3187 log_reader.cc:385] T 13d248a66d9a4c68a4cca28349ace304: removed 1 log segments from log reader
I20260812 06:37:44.533237  3187 log.cc:1079] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088: Deleting log segment in path: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1786516657398854-3187-0/minicluster-data/ts-0-root/wals/13d248a66d9a4c68a4cca28349ace304/wal-000000001 (ops 1-16)
I20260812 06:37:44.535054  4944 catalog_manager.cc:5719] T 13d248a66d9a4c68a4cca28349ace304 P a748b9e4d38f4359bf0e3733995423d5 reported cstate change: config changed from index 35 to 36, 6edcc833ff8a4f36848c7674dd357e40 (127.3.28.194) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "155b3bf9ca74442fbb15f5a42e60f088" committed_config { opid_index: 36 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } } }
I20260812 06:37:44.536818  4926 catalog_manager.cc:5266] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 13d248a66d9a4c68a4cca28349ace304 with cas_config_opid_index 31: aborting the task: latest config opid_index 36; task opid_index 31
I20260812 06:37:44.537201  3187 timestamp_advancement-itest.cc:274] Shutting down cluster...
I20260812 06:37:44.537339  3187 master.cc:562] Master@127.3.28.254:45527 shutting down...
I20260812 06:37:44.538208  4926 catalog_manager.cc:5266] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 13d248a66d9a4c68a4cca28349ace304 with cas_config_opid_index 27: aborting the task: latest config opid_index 36; task opid_index 27
I20260812 06:37:44.548221  4928 catalog_manager.cc:5266] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 13d248a66d9a4c68a4cca28349ace304 with cas_config_opid_index 29: aborting the task: latest config opid_index 36; task opid_index 29
I20260812 06:37:44.573580  4926 catalog_manager.cc:5266] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 13d248a66d9a4c68a4cca28349ace304 with cas_config_opid_index 35: aborting the task: latest config opid_index 36; task opid_index 35
I20260812 06:37:44.579133  4927 catalog_manager.cc:5266] ChangeConfig:ADD_PEER:NON_VOTER RPC for tablet 13d248a66d9a4c68a4cca28349ace304 with cas_config_opid_index 33: aborting the task: latest config opid_index 36; task opid_index 33
I20260812 06:37:44.785225  3187 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 7a73c8c9e775410fb15ec51e9fd42b68 [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:37:44.785488  3187 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 7a73c8c9e775410fb15ec51e9fd42b68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:37:44.785583  3187 tablet_replica.cc:333] T 00000000000000000000000000000000 P 7a73c8c9e775410fb15ec51e9fd42b68: stopping tablet replica
I20260812 06:37:44.799436  3187 master.cc:584] Master@127.3.28.254:45527 shutdown complete.
I20260812 06:37:44.802582  3187 tablet_server.cc:179] TabletServer@127.3.28.193:0 shutting down...
I20260812 06:37:44.858930  3187 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260812 06:37:44.859249  3187 tablet_replica.cc:333] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088: stopping tablet replica
I20260812 06:37:44.859438  3187 raft_consensus.cc:2243] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:37:44.859724  3187 raft_consensus.cc:2272] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:37:44.873853  3187 tablet_server.cc:196] TabletServer@127.3.28.193:0 shutdown complete.
I20260812 06:37:44.876732  3187 tablet_server.cc:179] TabletServer@127.3.28.194:0 shutting down...
I20260812 06:37:45.128491  3187 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260812 06:37:45.128810  3187 tablet_replica.cc:333] T 13d248a66d9a4c68a4cca28349ace304 P 6edcc833ff8a4f36848c7674dd357e40: stopping tablet replica
I20260812 06:37:45.128957  3187 raft_consensus.cc:2243] T 13d248a66d9a4c68a4cca28349ace304 P 6edcc833ff8a4f36848c7674dd357e40 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:37:45.129142  3187 raft_consensus.cc:2272] T 13d248a66d9a4c68a4cca28349ace304 P 6edcc833ff8a4f36848c7674dd357e40 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:37:45.142153  3187 tablet_server.cc:196] TabletServer@127.3.28.194:0 shutdown complete.
I20260812 06:37:45.144443  3187 tablet_server.cc:179] TabletServer@127.3.28.195:0 shutting down...
I20260812 06:37:45.157086  3187 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260812 06:37:45.157404  3187 tablet_replica.cc:333] T 13d248a66d9a4c68a4cca28349ace304 P a748b9e4d38f4359bf0e3733995423d5: stopping tablet replica
I20260812 06:37:45.157555  3187 raft_consensus.cc:2243] T 13d248a66d9a4c68a4cca28349ace304 P a748b9e4d38f4359bf0e3733995423d5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:37:45.157770  3187 raft_consensus.cc:2272] T 13d248a66d9a4c68a4cca28349ace304 P a748b9e4d38f4359bf0e3733995423d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:37:45.170768  3187 tablet_server.cc:196] TabletServer@127.3.28.195:0 shutdown complete.
I20260812 06:37:45.172892  3187 timestamp_advancement-itest.cc:282] Restarting single tablet server...
I20260812 06:37:45.173197  3187 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:37:45.174954  5518 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:45.174991  5525 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:45.174975  5521 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:45.175209  3187 server_base.cc:1061] running on GCE node
I20260812 06:37:45.175390  3187 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 06:37:45.175441  3187 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 06:37:45.175457  3187 hybrid_clock.cc:648] HybridClock initialized: now 1786516665175457 us; error 0 us; skew 500 ppm
I20260812 06:37:45.176308  3187 webserver.cc:533] Webserver started at http://127.3.28.193:45053/ using document root <none> and password file <none>
I20260812 06:37:45.176486  3187 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:45.176535  3187 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260812 06:37:45.177693  3187 fs_manager.cc:714] Time spent opening directory manager: real 0.001s	user 0.001s	sys 0.000s
I20260812 06:37:45.180409  5537 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:45.180696  3187 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260812 06:37:45.180759  3187 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1786516657398854-3187-0/minicluster-data/ts-0-root
uuid: "155b3bf9ca74442fbb15f5a42e60f088"
format_stamp: "Formatted at 2026-08-12 06:37:44 on dist-test-slave-tk9z"
I20260812 06:37:45.180856  3187 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1786516657398854-3187-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1786516657398854-3187-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.Kudu2463Test.1786516657398854-3187-0/minicluster-data/ts-0-root/data
Total live blocks: 5
Total live bytes: 5298
Total live bytes (after alignment): 24576
Total number of LBM containers: 6 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:45.199834  3187 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:45.200279  3187 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:45.200619  3187 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:37:45.201272  5550 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260812 06:37:45.202430  3187 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 06:37:45.202515  3187 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s	user 0.000s	sys 0.000s
I20260812 06:37:45.202580  3187 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260812 06:37:45.203328  3187 ts_tablet_manager.cc:616] Registered 1 tablets
I20260812 06:37:45.203389  3187 ts_tablet_manager.cc:595] Time spent register tablets: real 0.001s	user 0.000s	sys 0.000s
I20260812 06:37:45.203472  5550 tablet_bootstrap.cc:492] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088: Bootstrap starting.
I20260812 06:37:45.208858  3187 rpc_server.cc:307] RPC server started. Bound to: 127.3.28.193:33041
I20260812 06:37:45.209903  5660 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.28.193:33041 every 8 connection(s)
I20260812 06:37:45.211848  5550 tablet_bootstrap.cc:492] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088: Bootstrap replayed 1/1 log segments. Stats: ops{read=20 overwritten=0 applied=20 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:37:45.212321  5550 tablet_bootstrap.cc:492] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088: Bootstrap complete.
I20260812 06:37:45.212517  5550 ts_tablet_manager.cc:1403] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088: Time spent bootstrapping tablet: real 0.009s	user 0.004s	sys 0.003s
I20260812 06:37:45.212988  5550 raft_consensus.cc:359] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 36 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } }
I20260812 06:37:45.213122  5550 raft_consensus.cc:740] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 155b3bf9ca74442fbb15f5a42e60f088, State: Initialized, Role: FOLLOWER
I20260812 06:37:45.213281  5550 consensus_queue.cc:260] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 36, Last appended: 1.36, Last appended by leader: 36, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 36 OBSOLETE_local: false peers { permanent_uuid: "6edcc833ff8a4f36848c7674dd357e40" member_type: VOTER last_known_addr { host: "127.3.28.194" port: 37903 } } peers { permanent_uuid: "a748b9e4d38f4359bf0e3733995423d5" member_type: VOTER last_known_addr { host: "127.3.28.195" port: 38333 } } peers { permanent_uuid: "155b3bf9ca74442fbb15f5a42e60f088" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 33041 } }
I20260812 06:37:45.213678  5550 ts_tablet_manager.cc:1434] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088: Time spent starting tablet: real 0.001s	user 0.002s	sys 0.002s
W20260812 06:37:45.213950  5661 heartbeater.cc:412] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260812 06:37:45.220518  5576 tablet_service.cc:3018] Rejecting scan request for tablet 13d248a66d9a4c68a4cca28349ace304: Uninitialized: clean time has not yet been initialized
I20260812 06:37:45.220959  3187 timestamp_advancement-itest.cc:447] Got response: error { code: TABLET_NOT_RUNNING status { code: UNINITIALIZED message: "clean time has not yet been initialized" } }
I20260812 06:37:45.221392  3187 tablet_server.cc:179] TabletServer@127.3.28.193:33041 shutting down...
I20260812 06:37:45.461030  3187 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260812 06:37:45.461490  3187 tablet_replica.cc:333] stopping tablet replica
I20260812 06:37:45.461663  3187 raft_consensus.cc:2243] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260812 06:37:45.461831  3187 raft_consensus.cc:2272] T 13d248a66d9a4c68a4cca28349ace304 P 155b3bf9ca74442fbb15f5a42e60f088 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:37:45.475039  3187 tablet_server.cc:196] TabletServer@127.3.28.193:33041 shutdown complete.
[       OK ] TimestampAdvancementITest.Kudu2463Test (1469 ms)
[ RUN      ] TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp
I20260812 06:37:45.481958  3187 timestamp_advancement-itest.cc:460] Running with 1 replicas
I20260812 06:37:45.482228  3187 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.28.254:42593
I20260812 06:37:45.482661  3187 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:37:45.484323  5669 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:45.484392  5673 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:45.484465  5668 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:45.484575  3187 server_base.cc:1061] running on GCE node
I20260812 06:37:45.484751  3187 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 06:37:45.484802  3187 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 06:37:45.484838  3187 hybrid_clock.cc:648] HybridClock initialized: now 1786516665484817 us; error 0 us; skew 500 ppm
I20260812 06:37:45.485684  3187 webserver.cc:533] Webserver started at http://127.3.28.254:46069/ using document root <none> and password file <none>
I20260812 06:37:45.485864  3187 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:45.485924  3187 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:45.486033  3187 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:37:45.486516  3187 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1786516657398854-3187-0/minicluster-data/master-0-root/instance:
uuid: "21ed679f1b95439d89736bdd51732779"
format_stamp: "Formatted at 2026-08-12 06:37:45 on dist-test-slave-tk9z"
I20260812 06:37:45.488067  3187 fs_manager.cc:696] Time spent creating directory manager: real 0.001s	user 0.000s	sys 0.001s
I20260812 06:37:45.489053  5681 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:45.489356  3187 fs_manager.cc:730] Time spent opening block manager: real 0.001s	user 0.000s	sys 0.001s
I20260812 06:37:45.489439  3187 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1786516657398854-3187-0/minicluster-data/master-0-root
uuid: "21ed679f1b95439d89736bdd51732779"
format_stamp: "Formatted at 2026-08-12 06:37:45 on dist-test-slave-tk9z"
I20260812 06:37:45.489502  3187 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1786516657398854-3187-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1786516657398854-3187-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1786516657398854-3187-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:45.503289  3187 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:45.503656  3187 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:45.507957  3187 rpc_server.cc:307] RPC server started. Bound to: 127.3.28.254:42593
I20260812 06:37:45.508507  5766 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.28.254:42593 every 8 connection(s)
I20260812 06:37:45.509105  5767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:45.510926  5767 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 21ed679f1b95439d89736bdd51732779: Bootstrap starting.
I20260812 06:37:45.511686  5767 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 21ed679f1b95439d89736bdd51732779: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:45.513039  5767 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 21ed679f1b95439d89736bdd51732779: No bootstrap required, opened a new log
I20260812 06:37:45.513561  5767 raft_consensus.cc:359] T 00000000000000000000000000000000 P 21ed679f1b95439d89736bdd51732779 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21ed679f1b95439d89736bdd51732779" member_type: VOTER }
I20260812 06:37:45.513681  5767 raft_consensus.cc:385] T 00000000000000000000000000000000 P 21ed679f1b95439d89736bdd51732779 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:45.513724  5767 raft_consensus.cc:740] T 00000000000000000000000000000000 P 21ed679f1b95439d89736bdd51732779 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21ed679f1b95439d89736bdd51732779, State: Initialized, Role: FOLLOWER
I20260812 06:37:45.513867  5767 consensus_queue.cc:260] T 00000000000000000000000000000000 P 21ed679f1b95439d89736bdd51732779 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21ed679f1b95439d89736bdd51732779" member_type: VOTER }
I20260812 06:37:45.513983  5767 raft_consensus.cc:399] T 00000000000000000000000000000000 P 21ed679f1b95439d89736bdd51732779 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:37:45.514029  5767 raft_consensus.cc:493] T 00000000000000000000000000000000 P 21ed679f1b95439d89736bdd51732779 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:37:45.514074  5767 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 21ed679f1b95439d89736bdd51732779 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:45.514919  5767 raft_consensus.cc:515] T 00000000000000000000000000000000 P 21ed679f1b95439d89736bdd51732779 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21ed679f1b95439d89736bdd51732779" member_type: VOTER }
I20260812 06:37:45.515086  5767 leader_election.cc:304] T 00000000000000000000000000000000 P 21ed679f1b95439d89736bdd51732779 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 21ed679f1b95439d89736bdd51732779; no voters: 
I20260812 06:37:45.515297  5767 leader_election.cc:290] T 00000000000000000000000000000000 P 21ed679f1b95439d89736bdd51732779 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 06:37:45.515432  5771 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 21ed679f1b95439d89736bdd51732779 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:37:45.515641  5771 raft_consensus.cc:697] T 00000000000000000000000000000000 P 21ed679f1b95439d89736bdd51732779 [term 1 LEADER]: Becoming Leader. State: Replica: 21ed679f1b95439d89736bdd51732779, State: Running, Role: LEADER
I20260812 06:37:45.515764  5767 sys_catalog.cc:565] T 00000000000000000000000000000000 P 21ed679f1b95439d89736bdd51732779 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:37:45.515798  5771 consensus_queue.cc:237] T 00000000000000000000000000000000 P 21ed679f1b95439d89736bdd51732779 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21ed679f1b95439d89736bdd51732779" member_type: VOTER }
I20260812 06:37:45.516193  5774 sys_catalog.cc:455] T 00000000000000000000000000000000 P 21ed679f1b95439d89736bdd51732779 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 21ed679f1b95439d89736bdd51732779. Latest consensus state: current_term: 1 leader_uuid: "21ed679f1b95439d89736bdd51732779" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21ed679f1b95439d89736bdd51732779" member_type: VOTER } }
I20260812 06:37:45.516286  5774 sys_catalog.cc:458] T 00000000000000000000000000000000 P 21ed679f1b95439d89736bdd51732779 [sys.catalog]: This master's current role is: LEADER
I20260812 06:37:45.516248  5772 sys_catalog.cc:455] T 00000000000000000000000000000000 P 21ed679f1b95439d89736bdd51732779 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "21ed679f1b95439d89736bdd51732779" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21ed679f1b95439d89736bdd51732779" member_type: VOTER } }
I20260812 06:37:45.516397  5772 sys_catalog.cc:458] T 00000000000000000000000000000000 P 21ed679f1b95439d89736bdd51732779 [sys.catalog]: This master's current role is: LEADER
I20260812 06:37:45.516590  5777 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 06:37:45.517493  5777 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 06:37:45.518057  3187 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260812 06:37:45.519556  5777 catalog_manager.cc:1383] Generated new cluster ID: f09f8d2ea03546c2ae439836d03360d2
I20260812 06:37:45.519646  5777 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 06:37:45.527372  5777 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 06:37:45.527946  5777 catalog_manager.cc:1540] Loading token signing keys...
I20260812 06:37:45.541426  5777 catalog_manager.cc:6092] T 00000000000000000000000000000000 P 21ed679f1b95439d89736bdd51732779: Generated new TSK 0
I20260812 06:37:45.541668  5777 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 06:37:45.550581  3187 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:37:45.552889  5802 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:45.552907  5800 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:45.553067  5804 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:45.553568  3187 server_base.cc:1061] running on GCE node
I20260812 06:37:45.553777  3187 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 06:37:45.553836  3187 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 06:37:45.553853  3187 hybrid_clock.cc:648] HybridClock initialized: now 1786516665553853 us; error 0 us; skew 500 ppm
I20260812 06:37:45.554864  3187 webserver.cc:533] Webserver started at http://127.3.28.193:37511/ using document root <none> and password file <none>
I20260812 06:37:45.555078  3187 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:45.555132  3187 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:45.555219  3187 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:37:45.555660  3187 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1786516657398854-3187-0/minicluster-data/ts-0-root/instance:
uuid: "9f0346a2ee014f578f67e729928d135a"
format_stamp: "Formatted at 2026-08-12 06:37:45 on dist-test-slave-tk9z"
I20260812 06:37:45.557657  3187 fs_manager.cc:696] Time spent creating directory manager: real 0.002s	user 0.002s	sys 0.001s
I20260812 06:37:45.558843  5814 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:45.559209  3187 fs_manager.cc:730] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20260812 06:37:45.559315  3187 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1786516657398854-3187-0/minicluster-data/ts-0-root
uuid: "9f0346a2ee014f578f67e729928d135a"
format_stamp: "Formatted at 2026-08-12 06:37:45 on dist-test-slave-tk9z"
I20260812 06:37:45.559451  3187 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1786516657398854-3187-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1786516657398854-3187-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1786516657398854-3187-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:45.568265  3187 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:45.568706  3187 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:45.569070  3187 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:37:45.569610  3187 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:37:45.569680  3187 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:45.569751  3187 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:37:45.569790  3187 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:45.574679  3187 rpc_server.cc:307] RPC server started. Bound to: 127.3.28.193:40123
I20260812 06:37:45.574717  5919 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.28.193:40123 every 8 connection(s)
I20260812 06:37:45.580207  5920 heartbeater.cc:344] Connected to a master server at 127.3.28.254:42593
I20260812 06:37:45.580338  5920 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:45.580566  5920 heartbeater.cc:507] Master 127.3.28.254:42593 requested a full tablet report, sending...
I20260812 06:37:45.581316  5710 ts_manager.cc:194] Registered new tserver with Master: 9f0346a2ee014f578f67e729928d135a (127.3.28.193:40123)
I20260812 06:37:45.582115  3187 internal_mini_cluster.cc:371] 1 TS(s) registered with all masters after 0.00688554s
I20260812 06:37:45.582170  5710 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36288
I20260812 06:37:45.602353  5710 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36316:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 1
split_rows_range_bounds {
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260812 06:37:45.611390  5870 tablet_service.cc:1511] Processing CreateTablet for tablet 93a5457c65234c9984065c030ca502b9 (DEFAULT_TABLE table=test-workload [id=9a919290f64b408a99ec151257cc2c77]), partition=RANGE (key) PARTITION UNBOUNDED
I20260812 06:37:45.611739  5870 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93a5457c65234c9984065c030ca502b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:45.614116  5956 tablet_bootstrap.cc:492] T 93a5457c65234c9984065c030ca502b9 P 9f0346a2ee014f578f67e729928d135a: Bootstrap starting.
I20260812 06:37:45.614991  5956 tablet_bootstrap.cc:654] T 93a5457c65234c9984065c030ca502b9 P 9f0346a2ee014f578f67e729928d135a: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:45.616102  5956 tablet_bootstrap.cc:492] T 93a5457c65234c9984065c030ca502b9 P 9f0346a2ee014f578f67e729928d135a: No bootstrap required, opened a new log
I20260812 06:37:45.616178  5956 ts_tablet_manager.cc:1403] T 93a5457c65234c9984065c030ca502b9 P 9f0346a2ee014f578f67e729928d135a: Time spent bootstrapping tablet: real 0.002s	user 0.001s	sys 0.000s
I20260812 06:37:45.616694  5956 raft_consensus.cc:359] T 93a5457c65234c9984065c030ca502b9 P 9f0346a2ee014f578f67e729928d135a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f0346a2ee014f578f67e729928d135a" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40123 } }
I20260812 06:37:45.616816  5956 raft_consensus.cc:385] T 93a5457c65234c9984065c030ca502b9 P 9f0346a2ee014f578f67e729928d135a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:45.616851  5956 raft_consensus.cc:740] T 93a5457c65234c9984065c030ca502b9 P 9f0346a2ee014f578f67e729928d135a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f0346a2ee014f578f67e729928d135a, State: Initialized, Role: FOLLOWER
I20260812 06:37:45.616998  5956 consensus_queue.cc:260] T 93a5457c65234c9984065c030ca502b9 P 9f0346a2ee014f578f67e729928d135a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f0346a2ee014f578f67e729928d135a" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40123 } }
I20260812 06:37:45.617112  5956 raft_consensus.cc:399] T 93a5457c65234c9984065c030ca502b9 P 9f0346a2ee014f578f67e729928d135a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:37:45.617159  5956 raft_consensus.cc:493] T 93a5457c65234c9984065c030ca502b9 P 9f0346a2ee014f578f67e729928d135a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:37:45.617214  5956 raft_consensus.cc:3060] T 93a5457c65234c9984065c030ca502b9 P 9f0346a2ee014f578f67e729928d135a [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:45.618140  5956 raft_consensus.cc:515] T 93a5457c65234c9984065c030ca502b9 P 9f0346a2ee014f578f67e729928d135a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f0346a2ee014f578f67e729928d135a" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40123 } }
I20260812 06:37:45.618283  5956 leader_election.cc:304] T 93a5457c65234c9984065c030ca502b9 P 9f0346a2ee014f578f67e729928d135a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9f0346a2ee014f578f67e729928d135a; no voters: 
I20260812 06:37:45.618551  5956 leader_election.cc:290] T 93a5457c65234c9984065c030ca502b9 P 9f0346a2ee014f578f67e729928d135a [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 06:37:45.618678  5958 raft_consensus.cc:2804] T 93a5457c65234c9984065c030ca502b9 P 9f0346a2ee014f578f67e729928d135a [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:37:45.618937  5956 ts_tablet_manager.cc:1434] T 93a5457c65234c9984065c030ca502b9 P 9f0346a2ee014f578f67e729928d135a: Time spent starting tablet: real 0.003s	user 0.003s	sys 0.000s
I20260812 06:37:45.618968  5958 raft_consensus.cc:697] T 93a5457c65234c9984065c030ca502b9 P 9f0346a2ee014f578f67e729928d135a [term 1 LEADER]: Becoming Leader. State: Replica: 9f0346a2ee014f578f67e729928d135a, State: Running, Role: LEADER
I20260812 06:37:45.618947  5920 heartbeater.cc:499] Master 127.3.28.254:42593 was elected leader, sending a full tablet report...
I20260812 06:37:45.619156  5958 consensus_queue.cc:237] T 93a5457c65234c9984065c030ca502b9 P 9f0346a2ee014f578f67e729928d135a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f0346a2ee014f578f67e729928d135a" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40123 } }
I20260812 06:37:45.620632  5710 catalog_manager.cc:5719] T 93a5457c65234c9984065c030ca502b9 P 9f0346a2ee014f578f67e729928d135a reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f0346a2ee014f578f67e729928d135a (127.3.28.193). New cstate: current_term: 1 leader_uuid: "9f0346a2ee014f578f67e729928d135a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f0346a2ee014f578f67e729928d135a" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40123 } health_report { overall_health: HEALTHY } } }
I20260812 06:37:45.627030  3187 tablet_server.cc:179] TabletServer@127.3.28.193:0 shutting down...
I20260812 06:37:45.631138  3187 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260812 06:37:45.631438  3187 tablet_replica.cc:333] T 93a5457c65234c9984065c030ca502b9 P 9f0346a2ee014f578f67e729928d135a: stopping tablet replica
I20260812 06:37:45.631577  3187 raft_consensus.cc:2243] T 93a5457c65234c9984065c030ca502b9 P 9f0346a2ee014f578f67e729928d135a [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:37:45.631687  3187 raft_consensus.cc:2272] T 93a5457c65234c9984065c030ca502b9 P 9f0346a2ee014f578f67e729928d135a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:37:45.645102  3187 tablet_server.cc:196] TabletServer@127.3.28.193:0 shutdown complete.
I20260812 06:37:45.648034  3187 master.cc:562] Master@127.3.28.254:42593 shutting down...
I20260812 06:37:45.652410  3187 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 21ed679f1b95439d89736bdd51732779 [term 1 LEADER]: Raft consensus shutting down.
I20260812 06:37:45.652659  3187 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 21ed679f1b95439d89736bdd51732779 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260812 06:37:45.652793  3187 tablet_replica.cc:333] T 00000000000000000000000000000000 P 21ed679f1b95439d89736bdd51732779: stopping tablet replica
I20260812 06:37:45.666664  3187 master.cc:584] Master@127.3.28.254:42593 shutdown complete.
I20260812 06:37:45.670578  3187 timestamp_advancement-itest.cc:460] Running with 3 replicas
I20260812 06:37:45.670895  3187 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.3.28.254:40933
I20260812 06:37:45.671239  3187 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260812 06:37:45.673103  3187 server_base.cc:1061] running on GCE node
W20260812 06:37:45.673126  5966 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:45.673230  5969 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:45.673144  5967 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:45.673554  3187 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 06:37:45.673600  3187 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 06:37:45.673616  3187 hybrid_clock.cc:648] HybridClock initialized: now 1786516665673616 us; error 0 us; skew 500 ppm
I20260812 06:37:45.674578  3187 webserver.cc:533] Webserver started at http://127.3.28.254:38825/ using document root <none> and password file <none>
I20260812 06:37:45.674774  3187 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:45.674816  3187 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260812 06:37:45.675930  3187 fs_manager.cc:714] Time spent opening directory manager: real 0.001s	user 0.001s	sys 0.000s
I20260812 06:37:45.676942  5978 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:45.677238  3187 fs_manager.cc:730] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20260812 06:37:45.677322  3187 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1786516657398854-3187-0/minicluster-data/master-0-root
uuid: "21ed679f1b95439d89736bdd51732779"
format_stamp: "Formatted at 2026-08-12 06:37:45 on dist-test-slave-tk9z"
I20260812 06:37:45.677428  3187 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1786516657398854-3187-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1786516657398854-3187-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1786516657398854-3187-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:45.688237  3187 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:45.688643  3187 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:45.693257  3187 rpc_server.cc:307] RPC server started. Bound to: 127.3.28.254:40933
I20260812 06:37:45.694597  6067 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.28.254:40933 every 8 connection(s)
I20260812 06:37:45.695845  6068 sys_catalog.cc:263] Verifying existing consensus state
I20260812 06:37:45.696703  6068 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 21ed679f1b95439d89736bdd51732779: Bootstrap starting.
I20260812 06:37:45.702797  6068 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 21ed679f1b95439d89736bdd51732779: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=5 ignored=0} mutations{seen=2 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:37:45.703161  6068 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 21ed679f1b95439d89736bdd51732779: Bootstrap complete.
I20260812 06:37:45.703676  6068 raft_consensus.cc:359] T 00000000000000000000000000000000 P 21ed679f1b95439d89736bdd51732779 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21ed679f1b95439d89736bdd51732779" member_type: VOTER }
I20260812 06:37:45.703780  6068 raft_consensus.cc:740] T 00000000000000000000000000000000 P 21ed679f1b95439d89736bdd51732779 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21ed679f1b95439d89736bdd51732779, State: Initialized, Role: FOLLOWER
I20260812 06:37:45.703975  6068 consensus_queue.cc:260] T 00000000000000000000000000000000 P 21ed679f1b95439d89736bdd51732779 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21ed679f1b95439d89736bdd51732779" member_type: VOTER }
I20260812 06:37:45.704054  6068 raft_consensus.cc:399] T 00000000000000000000000000000000 P 21ed679f1b95439d89736bdd51732779 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:37:45.704111  6068 raft_consensus.cc:493] T 00000000000000000000000000000000 P 21ed679f1b95439d89736bdd51732779 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:37:45.704185  6068 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 21ed679f1b95439d89736bdd51732779 [term 1 FOLLOWER]: Advancing to term 2
I20260812 06:37:45.705004  6068 raft_consensus.cc:515] T 00000000000000000000000000000000 P 21ed679f1b95439d89736bdd51732779 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21ed679f1b95439d89736bdd51732779" member_type: VOTER }
I20260812 06:37:45.705152  6068 leader_election.cc:304] T 00000000000000000000000000000000 P 21ed679f1b95439d89736bdd51732779 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 21ed679f1b95439d89736bdd51732779; no voters: 
I20260812 06:37:45.705386  6068 leader_election.cc:290] T 00000000000000000000000000000000 P 21ed679f1b95439d89736bdd51732779 [CANDIDATE]: Term 2 election: Requested vote from peers 
I20260812 06:37:45.705580  6074 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 21ed679f1b95439d89736bdd51732779 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 06:37:45.705829  6074 raft_consensus.cc:697] T 00000000000000000000000000000000 P 21ed679f1b95439d89736bdd51732779 [term 2 LEADER]: Becoming Leader. State: Replica: 21ed679f1b95439d89736bdd51732779, State: Running, Role: LEADER
I20260812 06:37:45.705976  6074 consensus_queue.cc:237] T 00000000000000000000000000000000 P 21ed679f1b95439d89736bdd51732779 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21ed679f1b95439d89736bdd51732779" member_type: VOTER }
I20260812 06:37:45.706017  6068 sys_catalog.cc:565] T 00000000000000000000000000000000 P 21ed679f1b95439d89736bdd51732779 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:37:45.706456  6081 sys_catalog.cc:455] T 00000000000000000000000000000000 P 21ed679f1b95439d89736bdd51732779 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "21ed679f1b95439d89736bdd51732779" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21ed679f1b95439d89736bdd51732779" member_type: VOTER } }
I20260812 06:37:45.706573  6081 sys_catalog.cc:458] T 00000000000000000000000000000000 P 21ed679f1b95439d89736bdd51732779 [sys.catalog]: This master's current role is: LEADER
I20260812 06:37:45.707074  6085 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 06:37:45.707114  6083 sys_catalog.cc:455] T 00000000000000000000000000000000 P 21ed679f1b95439d89736bdd51732779 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 21ed679f1b95439d89736bdd51732779. Latest consensus state: current_term: 2 leader_uuid: "21ed679f1b95439d89736bdd51732779" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "21ed679f1b95439d89736bdd51732779" member_type: VOTER } }
I20260812 06:37:45.707209  6083 sys_catalog.cc:458] T 00000000000000000000000000000000 P 21ed679f1b95439d89736bdd51732779 [sys.catalog]: This master's current role is: LEADER
I20260812 06:37:45.708560  6085 catalog_manager.cc:679] Loaded metadata for table test-workload [id=9a919290f64b408a99ec151257cc2c77]
I20260812 06:37:45.709494  6085 tablet_loader.cc:96] loaded metadata for tablet 93a5457c65234c9984065c030ca502b9 (table test-workload [id=9a919290f64b408a99ec151257cc2c77])
I20260812 06:37:45.709623  6085 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 06:37:45.709856  3187 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260812 06:37:45.710207  6085 catalog_manager.cc:1295] Loaded cluster ID: f09f8d2ea03546c2ae439836d03360d2
I20260812 06:37:45.710270  6085 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 06:37:45.711704  6085 catalog_manager.cc:1540] Loading token signing keys...
I20260812 06:37:45.712227  6085 catalog_manager.cc:6103] T 00000000000000000000000000000000 P 21ed679f1b95439d89736bdd51732779: Loaded TSK: 0
I20260812 06:37:45.712677  6085 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 06:37:45.713615  3187 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260812 06:37:45.715559  3187 server_base.cc:1061] running on GCE node
W20260812 06:37:45.715495  6114 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:45.715495  6110 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:45.715571  6109 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:45.715902  3187 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 06:37:45.715965  3187 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 06:37:45.715989  3187 hybrid_clock.cc:648] HybridClock initialized: now 1786516665715988 us; error 0 us; skew 500 ppm
I20260812 06:37:45.717073  3187 webserver.cc:533] Webserver started at http://127.3.28.193:35893/ using document root <none> and password file <none>
I20260812 06:37:45.717262  3187 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:45.717322  3187 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260812 06:37:45.718402  3187 fs_manager.cc:714] Time spent opening directory manager: real 0.001s	user 0.000s	sys 0.001s
I20260812 06:37:45.719322  6122 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:45.719580  3187 fs_manager.cc:730] Time spent opening block manager: real 0.001s	user 0.000s	sys 0.001s
I20260812 06:37:45.719674  3187 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1786516657398854-3187-0/minicluster-data/ts-0-root
uuid: "9f0346a2ee014f578f67e729928d135a"
format_stamp: "Formatted at 2026-08-12 06:37:45 on dist-test-slave-tk9z"
I20260812 06:37:45.719771  3187 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1786516657398854-3187-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1786516657398854-3187-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1786516657398854-3187-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:45.759105  3187 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:45.759613  3187 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:45.759986  3187 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:37:45.761642  3187 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 06:37:45.761737  3187 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s	user 0.000s	sys 0.000s
I20260812 06:37:45.762728  3187 ts_tablet_manager.cc:616] Registered 1 tablets
I20260812 06:37:45.762806  3187 ts_tablet_manager.cc:595] Time spent register tablets: real 0.001s	user 0.001s	sys 0.000s
I20260812 06:37:45.762904  6136 tablet_bootstrap.cc:492] T 93a5457c65234c9984065c030ca502b9 P 9f0346a2ee014f578f67e729928d135a: Bootstrap starting.
I20260812 06:37:45.765688  6136 tablet_bootstrap.cc:492] T 93a5457c65234c9984065c030ca502b9 P 9f0346a2ee014f578f67e729928d135a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:37:45.766057  6136 tablet_bootstrap.cc:492] T 93a5457c65234c9984065c030ca502b9 P 9f0346a2ee014f578f67e729928d135a: Bootstrap complete.
I20260812 06:37:45.766253  6136 ts_tablet_manager.cc:1403] T 93a5457c65234c9984065c030ca502b9 P 9f0346a2ee014f578f67e729928d135a: Time spent bootstrapping tablet: real 0.003s	user 0.003s	sys 0.000s
I20260812 06:37:45.766680  6136 raft_consensus.cc:359] T 93a5457c65234c9984065c030ca502b9 P 9f0346a2ee014f578f67e729928d135a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f0346a2ee014f578f67e729928d135a" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40123 } }
I20260812 06:37:45.766798  6136 raft_consensus.cc:740] T 93a5457c65234c9984065c030ca502b9 P 9f0346a2ee014f578f67e729928d135a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f0346a2ee014f578f67e729928d135a, State: Initialized, Role: FOLLOWER
I20260812 06:37:45.766997  6136 consensus_queue.cc:260] T 93a5457c65234c9984065c030ca502b9 P 9f0346a2ee014f578f67e729928d135a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f0346a2ee014f578f67e729928d135a" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40123 } }
I20260812 06:37:45.767115  6136 raft_consensus.cc:399] T 93a5457c65234c9984065c030ca502b9 P 9f0346a2ee014f578f67e729928d135a [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:37:45.767170  6136 raft_consensus.cc:493] T 93a5457c65234c9984065c030ca502b9 P 9f0346a2ee014f578f67e729928d135a [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:37:45.767235  6136 raft_consensus.cc:3060] T 93a5457c65234c9984065c030ca502b9 P 9f0346a2ee014f578f67e729928d135a [term 1 FOLLOWER]: Advancing to term 2
I20260812 06:37:45.768173  6136 raft_consensus.cc:515] T 93a5457c65234c9984065c030ca502b9 P 9f0346a2ee014f578f67e729928d135a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f0346a2ee014f578f67e729928d135a" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40123 } }
I20260812 06:37:45.768335  6136 leader_election.cc:304] T 93a5457c65234c9984065c030ca502b9 P 9f0346a2ee014f578f67e729928d135a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9f0346a2ee014f578f67e729928d135a; no voters: 
I20260812 06:37:45.768568  6136 leader_election.cc:290] T 93a5457c65234c9984065c030ca502b9 P 9f0346a2ee014f578f67e729928d135a [CANDIDATE]: Term 2 election: Requested vote from peers 
I20260812 06:37:45.768654  6230 raft_consensus.cc:2804] T 93a5457c65234c9984065c030ca502b9 P 9f0346a2ee014f578f67e729928d135a [term 2 FOLLOWER]: Leader election won for term 2
I20260812 06:37:45.768857  6230 raft_consensus.cc:697] T 93a5457c65234c9984065c030ca502b9 P 9f0346a2ee014f578f67e729928d135a [term 2 LEADER]: Becoming Leader. State: Replica: 9f0346a2ee014f578f67e729928d135a, State: Running, Role: LEADER
I20260812 06:37:45.768929  6136 ts_tablet_manager.cc:1434] T 93a5457c65234c9984065c030ca502b9 P 9f0346a2ee014f578f67e729928d135a: Time spent starting tablet: real 0.003s	user 0.003s	sys 0.000s
I20260812 06:37:45.769008  6230 consensus_queue.cc:237] T 93a5457c65234c9984065c030ca502b9 P 9f0346a2ee014f578f67e729928d135a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f0346a2ee014f578f67e729928d135a" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40123 } }
I20260812 06:37:45.769351  3187 rpc_server.cc:307] RPC server started. Bound to: 127.3.28.193:40165
I20260812 06:37:45.769361  6241 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.28.193:40165 every 8 connection(s)
I20260812 06:37:45.770336  3187 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:37:45.772660  6251 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:45.772754  6253 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:45.773118  6258 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:45.773306  3187 server_base.cc:1061] running on GCE node
I20260812 06:37:45.773514  3187 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 06:37:45.773577  3187 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 06:37:45.773602  3187 hybrid_clock.cc:648] HybridClock initialized: now 1786516665773602 us; error 0 us; skew 500 ppm
I20260812 06:37:45.774724  3187 webserver.cc:533] Webserver started at http://127.3.28.194:46669/ using document root <none> and password file <none>
I20260812 06:37:45.774883  3187 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:45.774928  3187 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:45.774982  3187 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:37:45.775341  3187 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1786516657398854-3187-0/minicluster-data/ts-1-root/instance:
uuid: "42961daa5dc14bddb44a51caddad6474"
format_stamp: "Formatted at 2026-08-12 06:37:45 on dist-test-slave-tk9z"
I20260812 06:37:45.777016  3187 fs_manager.cc:696] Time spent creating directory manager: real 0.001s	user 0.001s	sys 0.001s
I20260812 06:37:45.778127  6268 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:45.778518  3187 fs_manager.cc:730] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20260812 06:37:45.778616  3187 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1786516657398854-3187-0/minicluster-data/ts-1-root
uuid: "42961daa5dc14bddb44a51caddad6474"
format_stamp: "Formatted at 2026-08-12 06:37:45 on dist-test-slave-tk9z"
I20260812 06:37:45.778700  3187 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1786516657398854-3187-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1786516657398854-3187-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1786516657398854-3187-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:45.779592  6243 heartbeater.cc:344] Connected to a master server at 127.3.28.254:40933
I20260812 06:37:45.779699  6243 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:45.779956  6243 heartbeater.cc:507] Master 127.3.28.254:40933 requested a full tablet report, sending...
I20260812 06:37:45.780932  6013 ts_manager.cc:194] Registered new tserver with Master: 9f0346a2ee014f578f67e729928d135a (127.3.28.193:40165)
I20260812 06:37:45.781260  6013 catalog_manager.cc:5719] T 93a5457c65234c9984065c030ca502b9 P 9f0346a2ee014f578f67e729928d135a reported cstate change: term changed from 1 to 2. New cstate: current_term: 2 leader_uuid: "9f0346a2ee014f578f67e729928d135a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9f0346a2ee014f578f67e729928d135a" member_type: VOTER last_known_addr { host: "127.3.28.193" port: 40123 } health_report { overall_health: HEALTHY } } }
I20260812 06:37:45.784241  6013 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37204
I20260812 06:37:45.785110  6243 heartbeater.cc:499] Master 127.3.28.254:40933 was elected leader, sending a full tablet report...
I20260812 06:37:45.788002  3187 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:45.788383  3187 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:45.788654  3187 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:37:45.789143  3187 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:37:45.789181  3187 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:45.789244  3187 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:37:45.789288  3187 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:45.794040  3187 rpc_server.cc:307] RPC server started. Bound to: 127.3.28.194:37145
I20260812 06:37:45.794140  6379 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.28.194:37145 every 8 connection(s)
I20260812 06:37:45.794978  3187 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:37:45.796957  6385 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:45.797165  3187 server_base.cc:1061] running on GCE node
W20260812 06:37:45.797178  6391 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:45.796999  6386 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:45.797516  3187 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260812 06:37:45.797583  3187 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260812 06:37:45.797618  3187 hybrid_clock.cc:648] HybridClock initialized: now 1786516665797617 us; error 0 us; skew 500 ppm
I20260812 06:37:45.798691  3187 webserver.cc:533] Webserver started at http://127.3.28.195:45015/ using document root <none> and password file <none>
I20260812 06:37:45.798889  3187 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:45.798952  3187 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:45.799041  3187 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:37:45.799546  3187 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1786516657398854-3187-0/minicluster-data/ts-2-root/instance:
uuid: "43244ac349e842e0ad6d753c91fb2e82"
format_stamp: "Formatted at 2026-08-12 06:37:45 on dist-test-slave-tk9z"
I20260812 06:37:45.799610  6380 heartbeater.cc:344] Connected to a master server at 127.3.28.254:40933
I20260812 06:37:45.799691  6380 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:45.799937  6380 heartbeater.cc:507] Master 127.3.28.254:40933 requested a full tablet report, sending...
I20260812 06:37:45.800657  6013 ts_manager.cc:194] Registered new tserver with Master: 42961daa5dc14bddb44a51caddad6474 (127.3.28.194:37145)
I20260812 06:37:45.801316  6013 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37220
I20260812 06:37:45.801540  3187 fs_manager.cc:696] Time spent creating directory manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:37:45.802667  6399 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:45.802922  3187 fs_manager.cc:730] Time spent opening block manager: real 0.001s	user 0.001s	sys 0.000s
I20260812 06:37:45.803022  3187 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1786516657398854-3187-0/minicluster-data/ts-2-root
uuid: "43244ac349e842e0ad6d753c91fb2e82"
format_stamp: "Formatted at 2026-08-12 06:37:45 on dist-test-slave-tk9z"
I20260812 06:37:45.803124  3187 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1786516657398854-3187-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1786516657398854-3187-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskRkxwyt/test-tmp/timestamp_advancement-itest.0.TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp.1786516657398854-3187-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:45.826650  3187 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:45.827210  3187 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:45.827596  3187 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260812 06:37:45.828167  3187 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:37:45.828236  3187 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:45.828308  3187 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:37:45.828356  3187 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:45.834067  3187 rpc_server.cc:307] RPC server started. Bound to: 127.3.28.195:41303
I20260812 06:37:45.834158  6534 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.28.195:41303 every 8 connection(s)
I20260812 06:37:45.839183  6536 heartbeater.cc:344] Connected to a master server at 127.3.28.254:40933
I20260812 06:37:45.839305  6536 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:45.839497  6536 heartbeater.cc:507] Master 127.3.28.254:40933 requested a full tablet report, sending...
I20260812 06:37:45.840101  6013 ts_manager.cc:194] Registered new tserver with Master: 43244ac349e842e0ad6d753c91fb2e82 (127.3.28.195:41303)
I20260812 06:37:45.840337  3187 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.005670953s
I20260812 06:37:45.840723  6013 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37236
I20260812 06:37:45.861500  3187 test_workload.cc:405] TestWorkload: Skipping table creation because table test-workload already exists
I20260812 06:37:45.861706  3187 tablet_server.cc:179] TabletServer@127.3.28.193:0 shutting down...
I20260812 06:37:45.866750  3187 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260812 06:37:45.867120  3187 tablet_replica.cc:333] stopping tablet replica
I20260812 06:37:45.867254  3187 raft_consensus.cc:2243] T 93a5457c65234c9984065c030ca502b9 P 9f0346a2ee014f578f67e729928d135a [term 2 LEADER]: Raft consensus shutting down.
I20260812 06:37:45.867372  3187 raft_consensus.cc:2272] T 93a5457c65234c9984065c030ca502b9 P 9f0346a2ee014f578f67e729928d135a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 06:37:45.880537  3187 tablet_server.cc:196] TabletServer@127.3.28.193:0 shutdown complete.
I20260812 06:37:45.882979  3187 tablet_server.cc:179] TabletServer@127.3.28.194:0 shutting down...
I20260812 06:37:45.887085  3187 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260812 06:37:45.899232  3187 tablet_server.cc:196] TabletServer@127.3.28.194:0 shutdown complete.
I20260812 06:37:45.901415  3187 tablet_server.cc:179] TabletServer@127.3.28.195:0 shutting down...
I20260812 06:37:45.905890  3187 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260812 06:37:45.917986  3187 tablet_server.cc:196] TabletServer@127.3.28.195:0 shutdown complete.
I20260812 06:37:45.920013  3187 master.cc:562] Master@127.3.28.254:40933 shutting down...
I20260812 06:37:45.923486  3187 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 21ed679f1b95439d89736bdd51732779 [term 2 LEADER]: Raft consensus shutting down.
I20260812 06:37:45.923671  3187 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 21ed679f1b95439d89736bdd51732779 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260812 06:37:45.923804  3187 tablet_replica.cc:333] stopping tablet replica
I20260812 06:37:45.937459  3187 master.cc:584] Master@127.3.28.254:40933 shutdown complete.
[       OK ] TimestampAdvancementITest.TestTimestampsAdvancedFromRaftNoOp (461 ms)
[----------] 4 tests from TimestampAdvancementITest (8534 ms total)

[----------] Global test environment tear-down
[==========] 4 tests from 1 test suite ran. (8534 ms total)
[  PASSED  ] 4 tests.
I20260812 06:37:45.943892  3187 logging.cc:436] LogThrottler /workspace/apache/dev/local/kudu/src/kudu/master/catalog_manager.cc:5397: suppressed but not reported on 9 messages since previous log ~1 seconds ago
I20260812 06:37:45.943928  3187 logging.cc:436] LogThrottler /workspace/apache/dev/local/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 1 messages since previous log ~0 seconds ago
I20260812 06:37:45.943949  3187 logging.cc:436] LogThrottler /workspace/apache/dev/local/kudu/src/kudu/tserver/ts_tablet_manager.cc:542: suppressed but not reported on 1 messages since previous log ~0 seconds ago
I20260812 06:37:45.943966  3187 logging.cc:436] LogThrottler /workspace/apache/dev/local/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 13 messages since previous log ~5 seconds ago
I20260812 06:37:45.943987  3187 logging.cc:436] LogThrottler /workspace/apache/dev/local/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 20 messages since previous log ~5 seconds ago
I20260812 06:37:45.944037  3187 logging.cc:436] LogThrottler /workspace/apache/dev/local/kudu/src/kudu/util/maintenance_manager.cc:346: suppressed but not reported on 101 messages since previous log ~8 seconds ago
