[==========] Running 4 tests from 1 test suite.
[----------] Global test environment set-up.
[----------] 4 tests from TxnStatusManagerITest
[ RUN      ] TxnStatusManagerITest.StaleTransactionsCleanup
2026-08-12T06:36:55Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:36:55Z Disabled control of system clock
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260812 06:36:55.875195  6956 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu
/tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786516615841258-6956-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786516615841258-6956-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786516615841258-6956-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786516615841258-6956-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.203.62:46287
--webserver_interface=127.6.203.62
--webserver_port=0
--builtin_ntp_servers=127.6.203.20:38327
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.203.62:46287
--txn_manager_enabled=true
--txn_manager_lazily_initialized=false with env {}
W20260812 06:36:56.023801  6969 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:56.024191  6969 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:56.024324  6969 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:56.028127  6969 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:36:56.028231  6969 flags.cc:432] Enabled experimental flag: --txn_manager_enabled=true
W20260812 06:36:56.028256  6969 flags.cc:432] Enabled experimental flag: --txn_manager_lazily_initialized=false
W20260812 06:36:56.028273  6969 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:56.028293  6969 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:36:56.028311  6969 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:36:56.032879  6969 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786516615841258-6956-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.203.20:38327
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786516615841258-6956-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786516615841258-6956-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.6.203.62:46287
--txn_manager_enabled=true
--txn_manager_lazily_initialized=false
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.203.62:46287
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786516615841258-6956-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.203.62
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.6969
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:56.034786  6969 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:56.036177  6969 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:36:56.044364  6984 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:56.044384  6977 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:56.044646  6969 server_base.cc:1061] running on GCE node
W20260812 06:36:56.044364  6978 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:56.045514  6969 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:56.046691  6969 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:56.047930  6969 hybrid_clock.cc:648] HybridClock initialized: now 1786516616047887 us; error 128 us; skew 500 ppm
I20260812 06:36:56.050556  6969 webserver.cc:533] Webserver started at http://127.6.203.62:33291/ using document root <none> and password file <none>
I20260812 06:36:56.051266  6969 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:56.051369  6969 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:56.051644  6969 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:56.053687  6969 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786516615841258-6956-0/minicluster-data/master-0/data/instance:
uuid: "b6152ad4ab7041fb8599eb8459993dcf"
format_stamp: "Formatted at 2026-08-12 06:36:56 on dist-test-slave-z8x9"
I20260812 06:36:56.054308  6969 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786516615841258-6956-0/minicluster-data/master-0/wal/instance:
uuid: "b6152ad4ab7041fb8599eb8459993dcf"
format_stamp: "Formatted at 2026-08-12 06:36:56 on dist-test-slave-z8x9"
I20260812 06:36:56.058722  6969 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260812 06:36:56.062649  6998 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:56.064241  6969 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260812 06:36:56.064514  6969 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786516615841258-6956-0/minicluster-data/master-0/data,/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786516615841258-6956-0/minicluster-data/master-0/wal
uuid: "b6152ad4ab7041fb8599eb8459993dcf"
format_stamp: "Formatted at 2026-08-12 06:36:56 on dist-test-slave-z8x9"
I20260812 06:36:56.064672  6969 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786516615841258-6956-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786516615841258-6956-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786516615841258-6956-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:56.090924  6969 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:56.091823  6969 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:56.092064  6969 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:56.107954  6969 rpc_server.cc:307] RPC server started. Bound to: 127.6.203.62:46287
I20260812 06:36:56.107951  7108 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.203.62:46287 every 8 connection(s)
I20260812 06:36:56.109350  6969 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786516615841258-6956-0/minicluster-data/master-0/data/info.pb
I20260812 06:36:56.112950  7109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:56.116926  6956 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu as pid 6969
I20260812 06:36:56.117110  6956 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786516615841258-6956-0/minicluster-data/master-0/wal/instance
I20260812 06:36:56.120388  7109 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b6152ad4ab7041fb8599eb8459993dcf: Bootstrap starting.
I20260812 06:36:56.123270  7109 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b6152ad4ab7041fb8599eb8459993dcf: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:56.124086  7109 log.cc:826] T 00000000000000000000000000000000 P b6152ad4ab7041fb8599eb8459993dcf: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:56.126386  7109 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b6152ad4ab7041fb8599eb8459993dcf: No bootstrap required, opened a new log
I20260812 06:36:56.129736  7109 raft_consensus.cc:359] T 00000000000000000000000000000000 P b6152ad4ab7041fb8599eb8459993dcf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6152ad4ab7041fb8599eb8459993dcf" member_type: VOTER last_known_addr { host: "127.6.203.62" port: 46287 } }
I20260812 06:36:56.130026  7109 raft_consensus.cc:385] T 00000000000000000000000000000000 P b6152ad4ab7041fb8599eb8459993dcf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:36:56.130115  7109 raft_consensus.cc:740] T 00000000000000000000000000000000 P b6152ad4ab7041fb8599eb8459993dcf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6152ad4ab7041fb8599eb8459993dcf, State: Initialized, Role: FOLLOWER
I20260812 06:36:56.130663  7109 consensus_queue.cc:260] T 00000000000000000000000000000000 P b6152ad4ab7041fb8599eb8459993dcf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6152ad4ab7041fb8599eb8459993dcf" member_type: VOTER last_known_addr { host: "127.6.203.62" port: 46287 } }
I20260812 06:36:56.130842  7109 raft_consensus.cc:399] T 00000000000000000000000000000000 P b6152ad4ab7041fb8599eb8459993dcf [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:36:56.130914  7109 raft_consensus.cc:493] T 00000000000000000000000000000000 P b6152ad4ab7041fb8599eb8459993dcf [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:36:56.131047  7109 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b6152ad4ab7041fb8599eb8459993dcf [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:56.132078  7109 raft_consensus.cc:515] T 00000000000000000000000000000000 P b6152ad4ab7041fb8599eb8459993dcf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6152ad4ab7041fb8599eb8459993dcf" member_type: VOTER last_known_addr { host: "127.6.203.62" port: 46287 } }
I20260812 06:36:56.132524  7109 leader_election.cc:304] T 00000000000000000000000000000000 P b6152ad4ab7041fb8599eb8459993dcf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b6152ad4ab7041fb8599eb8459993dcf; no voters: 
I20260812 06:36:56.132894  7109 leader_election.cc:290] T 00000000000000000000000000000000 P b6152ad4ab7041fb8599eb8459993dcf [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 06:36:56.132982  7124 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b6152ad4ab7041fb8599eb8459993dcf [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:36:56.133255  7124 raft_consensus.cc:697] T 00000000000000000000000000000000 P b6152ad4ab7041fb8599eb8459993dcf [term 1 LEADER]: Becoming Leader. State: Replica: b6152ad4ab7041fb8599eb8459993dcf, State: Running, Role: LEADER
I20260812 06:36:56.133627  7124 consensus_queue.cc:237] T 00000000000000000000000000000000 P b6152ad4ab7041fb8599eb8459993dcf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6152ad4ab7041fb8599eb8459993dcf" member_type: VOTER last_known_addr { host: "127.6.203.62" port: 46287 } }
I20260812 06:36:56.134174  7109 sys_catalog.cc:565] T 00000000000000000000000000000000 P b6152ad4ab7041fb8599eb8459993dcf [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:36:56.135913  7125 sys_catalog.cc:455] T 00000000000000000000000000000000 P b6152ad4ab7041fb8599eb8459993dcf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b6152ad4ab7041fb8599eb8459993dcf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6152ad4ab7041fb8599eb8459993dcf" member_type: VOTER last_known_addr { host: "127.6.203.62" port: 46287 } } }
I20260812 06:36:56.136081  7125 sys_catalog.cc:458] T 00000000000000000000000000000000 P b6152ad4ab7041fb8599eb8459993dcf [sys.catalog]: This master's current role is: LEADER
I20260812 06:36:56.136390  7126 sys_catalog.cc:455] T 00000000000000000000000000000000 P b6152ad4ab7041fb8599eb8459993dcf [sys.catalog]: SysCatalogTable state changed. Reason: New leader b6152ad4ab7041fb8599eb8459993dcf. Latest consensus state: current_term: 1 leader_uuid: "b6152ad4ab7041fb8599eb8459993dcf" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6152ad4ab7041fb8599eb8459993dcf" member_type: VOTER last_known_addr { host: "127.6.203.62" port: 46287 } } }
I20260812 06:36:56.136556  7126 sys_catalog.cc:458] T 00000000000000000000000000000000 P b6152ad4ab7041fb8599eb8459993dcf [sys.catalog]: This master's current role is: LEADER
I20260812 06:36:56.136835  7139 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 06:36:56.140589  7139 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 06:36:56.147051  7139 catalog_manager.cc:1383] Generated new cluster ID: e064787b1a794802a48b6e94390c4d97
I20260812 06:36:56.147226  7139 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 06:36:56.169600  7139 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 06:36:56.170801  7139 catalog_manager.cc:1540] Loading token signing keys...
I20260812 06:36:56.182898  7139 catalog_manager.cc:6092] T 00000000000000000000000000000000 P b6152ad4ab7041fb8599eb8459993dcf: Generated new TSK 0
I20260812 06:36:56.183810  7139 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 06:36:56.191519  7030 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59034:
name: "kudu_system.kudu_transactions"
schema {
  columns {
    name: "txn_id"
    type: INT64
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "entry_type"
    type: INT8
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "identifier"
    type: STRING
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "metadata"
    type: STRING
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
  indirect_data: "<redacted>"""
}
partition_schema {
  range_schema {
    columns {
      name: "txn_id"
    }
  }
}
table_type: TXN_STATUS_TABLE
W20260812 06:36:56.196547  7109 master.cc:465] Invalid argument: unable to initialize TxnManager: Error creating table kudu_system.kudu_transactions on the master: not enough live tablet servers to create a table with the requested replication factor 3; 0 tablet servers are alive: unable to init TxnManager, will retry in 1.000s
I20260812 06:36:56.198858  6956 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu
/tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786516615841258-6956-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786516615841258-6956-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786516615841258-6956-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786516615841258-6956-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.203.1:0
--local_ip_for_outbound_sockets=127.6.203.1
--webserver_interface=127.6.203.1
--webserver_port=0
--tserver_master_addrs=127.6.203.62:46287
--builtin_ntp_servers=127.6.203.20:38327
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--txn_keepalive_interval_ms=500
--txn_staleness_tracker_interval_ms=100
--txn_staleness_tracker_disabled_interval_ms=100
--raft_heartbeat_interval_ms=50
--leader_failure_max_missed_heartbeat_periods=1.25
--enable_txn_system_client_init=true
--txn_schedule_background_tasks=false with env {}
W20260812 06:36:56.314770  7166 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:56.315011  7166 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:56.315058  7166 flags.cc:432] Enabled unsafe flag: --txn_schedule_background_tasks=false
W20260812 06:36:56.315148  7166 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:56.319075  7166 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:56.319190  7166 flags.cc:432] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 06:36:56.319211  7166 flags.cc:432] Enabled experimental flag: --txn_staleness_tracker_interval_ms=100
W20260812 06:36:56.319228  7166 flags.cc:432] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 06:36:56.319365  7166 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.203.1
I20260812 06:36:56.323488  7166 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786516615841258-6956-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.203.20:38327
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1.25
--raft_heartbeat_interval_ms=50
--fs_data_dirs=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786516615841258-6956-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786516615841258-6956-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.203.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786516615841258-6956-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.6.203.1
--webserver_port=0
--txn_keepalive_interval_ms=500
--txn_schedule_background_tasks=false
--txn_staleness_tracker_interval_ms=100
--enable_txn_system_client_init=true
--tserver_master_addrs=127.6.203.62:46287
--txn_staleness_tracker_disabled_interval_ms=100
--never_fsync=true
--heap_profile_path=/tmp/kudu.7166
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.203.1

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:56.324659  7166 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:56.325856  7166 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 06:36:56.328572  7166 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 06:36:56.332476  7175 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:56.332489  7179 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:56.332490  7176 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:56.332753  7166 server_base.cc:1061] running on GCE node
I20260812 06:36:56.333069  7166 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:56.333674  7166 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:56.334888  7166 hybrid_clock.cc:648] HybridClock initialized: now 1786516616334867 us; error 31 us; skew 500 ppm
I20260812 06:36:56.336963  7166 webserver.cc:533] Webserver started at http://127.6.203.1:46043/ using document root <none> and password file <none>
I20260812 06:36:56.337620  7166 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:56.337680  7166 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:56.337843  7166 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:56.339445  7166 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786516615841258-6956-0/minicluster-data/ts-0/data/instance:
uuid: "206661efc252414c9caef3cf7ae72c9e"
format_stamp: "Formatted at 2026-08-12 06:36:56 on dist-test-slave-z8x9"
I20260812 06:36:56.339924  7166 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786516615841258-6956-0/minicluster-data/ts-0/wal/instance:
uuid: "206661efc252414c9caef3cf7ae72c9e"
format_stamp: "Formatted at 2026-08-12 06:36:56 on dist-test-slave-z8x9"
I20260812 06:36:56.344101  7166 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260812 06:36:56.347075  7192 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:56.348662  7166 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260812 06:36:56.348780  7166 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786516615841258-6956-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786516615841258-6956-0/minicluster-data/ts-0/wal
uuid: "206661efc252414c9caef3cf7ae72c9e"
format_stamp: "Formatted at 2026-08-12 06:36:56 on dist-test-slave-z8x9"
I20260812 06:36:56.348871  7166 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786516615841258-6956-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786516615841258-6956-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786516615841258-6956-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:56.364493  7166 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:56.365119  7166 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:56.365345  7166 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:56.367096  7166 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:36:56.367147  7166 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:56.367195  7166 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:36:56.367298  7166 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:56.386437  7166 rpc_server.cc:307] RPC server started. Bound to: 127.6.203.1:37055
I20260812 06:36:56.386459  7426 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.203.1:37055 every 8 connection(s)
I20260812 06:36:56.387359  7166 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786516615841258-6956-0/minicluster-data/ts-0/data/info.pb
I20260812 06:36:56.388448  6956 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu as pid 7166
I20260812 06:36:56.388567  6956 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786516615841258-6956-0/minicluster-data/ts-0/wal/instance
I20260812 06:36:56.389008  7427 heartbeater.cc:344] Connected to a master server at 127.6.203.62:46287
I20260812 06:36:56.389231  7427 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:56.389798  7427 heartbeater.cc:507] Master 127.6.203.62:46287 requested a full tablet report, sending...
I20260812 06:36:56.391041  6956 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu
/tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786516615841258-6956-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786516615841258-6956-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786516615841258-6956-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786516615841258-6956-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.203.2:0
--local_ip_for_outbound_sockets=127.6.203.2
--webserver_interface=127.6.203.2
--webserver_port=0
--tserver_master_addrs=127.6.203.62:46287
--builtin_ntp_servers=127.6.203.20:38327
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--txn_keepalive_interval_ms=500
--txn_staleness_tracker_interval_ms=100
--txn_staleness_tracker_disabled_interval_ms=100
--raft_heartbeat_interval_ms=50
--leader_failure_max_missed_heartbeat_periods=1.25
--enable_txn_system_client_init=true
--txn_schedule_background_tasks=false with env {}
I20260812 06:36:56.391434  7026 ts_manager.cc:194] Registered new tserver with Master: 206661efc252414c9caef3cf7ae72c9e (127.6.203.1:37055)
I20260812 06:36:56.392747  7026 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.6.203.1:58141
W20260812 06:36:56.499466  7430 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:56.499753  7430 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:56.499825  7430 flags.cc:432] Enabled unsafe flag: --txn_schedule_background_tasks=false
W20260812 06:36:56.499907  7430 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:56.503404  7430 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:56.503547  7430 flags.cc:432] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 06:36:56.503614  7430 flags.cc:432] Enabled experimental flag: --txn_staleness_tracker_interval_ms=100
W20260812 06:36:56.503655  7430 flags.cc:432] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 06:36:56.503741  7430 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.203.2
I20260812 06:36:56.507700  7430 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786516615841258-6956-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.203.20:38327
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1.25
--raft_heartbeat_interval_ms=50
--fs_data_dirs=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786516615841258-6956-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786516615841258-6956-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.203.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786516615841258-6956-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.6.203.2
--webserver_port=0
--txn_keepalive_interval_ms=500
--txn_schedule_background_tasks=false
--txn_staleness_tracker_interval_ms=100
--enable_txn_system_client_init=true
--tserver_master_addrs=127.6.203.62:46287
--txn_staleness_tracker_disabled_interval_ms=100
--never_fsync=true
--heap_profile_path=/tmp/kudu.7430
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.203.2

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:56.508919  7430 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:56.510181  7430 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 06:36:56.513078  7430 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 06:36:56.517472  7449 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:56.517491  7443 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:56.517515  7441 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:56.517858  7430 server_base.cc:1061] running on GCE node
I20260812 06:36:56.518290  7430 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:56.518860  7430 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:56.520025  7430 hybrid_clock.cc:648] HybridClock initialized: now 1786516616519974 us; error 63 us; skew 500 ppm
I20260812 06:36:56.522010  7430 webserver.cc:533] Webserver started at http://127.6.203.2:34351/ using document root <none> and password file <none>
I20260812 06:36:56.522593  7430 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:56.522651  7430 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:56.522866  7430 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:56.524446  7430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786516615841258-6956-0/minicluster-data/ts-1/data/instance:
uuid: "bb8cc6cb37b74113bc8208e9c6e3543b"
format_stamp: "Formatted at 2026-08-12 06:36:56 on dist-test-slave-z8x9"
I20260812 06:36:56.524948  7430 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786516615841258-6956-0/minicluster-data/ts-1/wal/instance:
uuid: "bb8cc6cb37b74113bc8208e9c6e3543b"
format_stamp: "Formatted at 2026-08-12 06:36:56 on dist-test-slave-z8x9"
I20260812 06:36:56.528407  7430 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.001s
I20260812 06:36:56.530771  7459 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:56.531852  7430 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260812 06:36:56.531970  7430 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786516615841258-6956-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786516615841258-6956-0/minicluster-data/ts-1/wal
uuid: "bb8cc6cb37b74113bc8208e9c6e3543b"
format_stamp: "Formatted at 2026-08-12 06:36:56 on dist-test-slave-z8x9"
I20260812 06:36:56.532073  7430 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786516615841258-6956-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786516615841258-6956-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786516615841258-6956-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:56.561357  7430 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:56.562130  7430 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:56.562350  7430 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:56.563949  7430 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:36:56.564000  7430 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:56.564080  7430 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:36:56.564116  7430 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:56.578795  7430 rpc_server.cc:307] RPC server started. Bound to: 127.6.203.2:34457
I20260812 06:36:56.578871  7691 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.203.2:34457 every 8 connection(s)
I20260812 06:36:56.580025  7430 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786516615841258-6956-0/minicluster-data/ts-1/data/info.pb
I20260812 06:36:56.581408  7692 heartbeater.cc:344] Connected to a master server at 127.6.203.62:46287
I20260812 06:36:56.581616  7692 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:56.582084  7692 heartbeater.cc:507] Master 127.6.203.62:46287 requested a full tablet report, sending...
I20260812 06:36:56.583035  7026 ts_manager.cc:194] Registered new tserver with Master: bb8cc6cb37b74113bc8208e9c6e3543b (127.6.203.2:34457)
I20260812 06:36:56.583539  7026 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.6.203.2:52645
I20260812 06:36:56.589524  6956 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu as pid 7430
I20260812 06:36:56.589632  6956 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786516615841258-6956-0/minicluster-data/ts-1/wal/instance
I20260812 06:36:56.591876  6956 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu
/tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786516615841258-6956-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786516615841258-6956-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786516615841258-6956-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786516615841258-6956-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.203.3:0
--local_ip_for_outbound_sockets=127.6.203.3
--webserver_interface=127.6.203.3
--webserver_port=0
--tserver_master_addrs=127.6.203.62:46287
--builtin_ntp_servers=127.6.203.20:38327
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--txn_keepalive_interval_ms=500
--txn_staleness_tracker_interval_ms=100
--txn_staleness_tracker_disabled_interval_ms=100
--raft_heartbeat_interval_ms=50
--leader_failure_max_missed_heartbeat_periods=1.25
--enable_txn_system_client_init=true
--txn_schedule_background_tasks=false with env {}
W20260812 06:36:56.706954  7694 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:36:56.707216  7694 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:36:56.707264  7694 flags.cc:432] Enabled unsafe flag: --txn_schedule_background_tasks=false
W20260812 06:36:56.707297  7694 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:36:56.711059  7694 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:36:56.711184  7694 flags.cc:432] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 06:36:56.711207  7694 flags.cc:432] Enabled experimental flag: --txn_staleness_tracker_interval_ms=100
W20260812 06:36:56.711231  7694 flags.cc:432] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 06:36:56.711279  7694 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.203.3
I20260812 06:36:56.715499  7694 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786516615841258-6956-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.203.20:38327
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1.25
--raft_heartbeat_interval_ms=50
--fs_data_dirs=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786516615841258-6956-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786516615841258-6956-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.203.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786516615841258-6956-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.6.203.3
--webserver_port=0
--txn_keepalive_interval_ms=500
--txn_schedule_background_tasks=false
--txn_staleness_tracker_interval_ms=100
--enable_txn_system_client_init=true
--tserver_master_addrs=127.6.203.62:46287
--txn_staleness_tracker_disabled_interval_ms=100
--never_fsync=true
--heap_profile_path=/tmp/kudu.7694
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.203.3

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:36:56.716696  7694 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:36:56.717914  7694 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 06:36:56.720579  7694 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 06:36:56.724618  7707 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:56.724625  7709 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:36:56.724640  7713 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:36:56.725001  7694 server_base.cc:1061] running on GCE node
I20260812 06:36:56.725396  7694 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:36:56.725962  7694 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:36:56.727167  7694 hybrid_clock.cc:648] HybridClock initialized: now 1786516616727152 us; error 35 us; skew 500 ppm
I20260812 06:36:56.729005  7694 webserver.cc:533] Webserver started at http://127.6.203.3:45913/ using document root <none> and password file <none>
I20260812 06:36:56.729635  7694 fs_manager.cc:362] Metadata directory not provided
I20260812 06:36:56.729751  7694 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:36:56.729974  7694 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:36:56.731554  7694 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786516615841258-6956-0/minicluster-data/ts-2/data/instance:
uuid: "a2bb0b5d938f4886b5d65f1172d8bb4a"
format_stamp: "Formatted at 2026-08-12 06:36:56 on dist-test-slave-z8x9"
I20260812 06:36:56.732251  7694 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786516615841258-6956-0/minicluster-data/ts-2/wal/instance:
uuid: "a2bb0b5d938f4886b5d65f1172d8bb4a"
format_stamp: "Formatted at 2026-08-12 06:36:56 on dist-test-slave-z8x9"
I20260812 06:36:56.735622  7694 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.003s
I20260812 06:36:56.737897  7728 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:56.738941  7694 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:36:56.739087  7694 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786516615841258-6956-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786516615841258-6956-0/minicluster-data/ts-2/wal
uuid: "a2bb0b5d938f4886b5d65f1172d8bb4a"
format_stamp: "Formatted at 2026-08-12 06:36:56 on dist-test-slave-z8x9"
I20260812 06:36:56.739198  7694 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786516615841258-6956-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786516615841258-6956-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786516615841258-6956-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:36:56.762507  7694 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:36:56.763171  7694 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:36:56.763381  7694 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:36:56.765242  7694 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:36:56.765317  7694 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:56.765388  7694 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:36:56.765439  7694 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:36:56.781008  7694 rpc_server.cc:307] RPC server started. Bound to: 127.6.203.3:36401
I20260812 06:36:56.781044  7969 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.203.3:36401 every 8 connection(s)
I20260812 06:36:56.782286  7694 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786516615841258-6956-0/minicluster-data/ts-2/data/info.pb
I20260812 06:36:56.783859  7971 heartbeater.cc:344] Connected to a master server at 127.6.203.62:46287
I20260812 06:36:56.784006  7971 heartbeater.cc:461] Registering TS with master...
I20260812 06:36:56.784377  7971 heartbeater.cc:507] Master 127.6.203.62:46287 requested a full tablet report, sending...
I20260812 06:36:56.785315  7026 ts_manager.cc:194] Registered new tserver with Master: a2bb0b5d938f4886b5d65f1172d8bb4a (127.6.203.3:36401)
I20260812 06:36:56.785842  7026 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.6.203.3:47831
I20260812 06:36:56.791842  6956 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu as pid 7694
I20260812 06:36:56.791961  6956 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786516615841258-6956-0/minicluster-data/ts-2/wal/instance
I20260812 06:36:56.794654  6956 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260812 06:36:57.234607  7026 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59054:
name: "kudu_system.kudu_transactions"
schema {
  columns {
    name: "txn_id"
    type: INT64
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "entry_type"
    type: INT8
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "identifier"
    type: STRING
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "metadata"
    type: STRING
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
  indirect_data: "<redacted>"""
}
partition_schema {
  range_schema {
    columns {
      name: "txn_id"
    }
  }
}
table_type: TXN_STATUS_TABLE
W20260812 06:36:57.235206  7026 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:36:57.252600  7302 tablet_service.cc:1511] Processing CreateTablet for tablet abbacda00c104ee79de09477c6f7bf46 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=3d49c81e592240bb909eb6caec9e26d0]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 06:36:57.253450  7791 tablet_service.cc:1511] Processing CreateTablet for tablet abbacda00c104ee79de09477c6f7bf46 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=3d49c81e592240bb909eb6caec9e26d0]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 06:36:57.254247  7302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abbacda00c104ee79de09477c6f7bf46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:57.254612  7791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abbacda00c104ee79de09477c6f7bf46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:57.260159  7555 tablet_service.cc:1511] Processing CreateTablet for tablet abbacda00c104ee79de09477c6f7bf46 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=3d49c81e592240bb909eb6caec9e26d0]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 06:36:57.261914  7555 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abbacda00c104ee79de09477c6f7bf46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:36:57.261927  8016 tablet_bootstrap.cc:492] T abbacda00c104ee79de09477c6f7bf46 P a2bb0b5d938f4886b5d65f1172d8bb4a: Bootstrap starting.
I20260812 06:36:57.262264  8014 tablet_bootstrap.cc:492] T abbacda00c104ee79de09477c6f7bf46 P 206661efc252414c9caef3cf7ae72c9e: Bootstrap starting.
I20260812 06:36:57.263852  8016 tablet_bootstrap.cc:654] T abbacda00c104ee79de09477c6f7bf46 P a2bb0b5d938f4886b5d65f1172d8bb4a: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:57.264320  8014 tablet_bootstrap.cc:654] T abbacda00c104ee79de09477c6f7bf46 P 206661efc252414c9caef3cf7ae72c9e: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:57.264668  8016 log.cc:826] T abbacda00c104ee79de09477c6f7bf46 P a2bb0b5d938f4886b5d65f1172d8bb4a: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:57.265823  8014 log.cc:826] T abbacda00c104ee79de09477c6f7bf46 P 206661efc252414c9caef3cf7ae72c9e: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:57.267024  8016 tablet_bootstrap.cc:492] T abbacda00c104ee79de09477c6f7bf46 P a2bb0b5d938f4886b5d65f1172d8bb4a: No bootstrap required, opened a new log
I20260812 06:36:57.267218  8016 ts_tablet_manager.cc:1403] T abbacda00c104ee79de09477c6f7bf46 P a2bb0b5d938f4886b5d65f1172d8bb4a: Time spent bootstrapping tablet: real 0.006s	user 0.004s	sys 0.000s
I20260812 06:36:57.267987  8014 tablet_bootstrap.cc:492] T abbacda00c104ee79de09477c6f7bf46 P 206661efc252414c9caef3cf7ae72c9e: No bootstrap required, opened a new log
I20260812 06:36:57.268177  8014 ts_tablet_manager.cc:1403] T abbacda00c104ee79de09477c6f7bf46 P 206661efc252414c9caef3cf7ae72c9e: Time spent bootstrapping tablet: real 0.006s	user 0.005s	sys 0.000s
I20260812 06:36:57.269814  8021 tablet_bootstrap.cc:492] T abbacda00c104ee79de09477c6f7bf46 P bb8cc6cb37b74113bc8208e9c6e3543b: Bootstrap starting.
I20260812 06:36:57.271363  8016 raft_consensus.cc:359] T abbacda00c104ee79de09477c6f7bf46 P a2bb0b5d938f4886b5d65f1172d8bb4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "206661efc252414c9caef3cf7ae72c9e" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 37055 } } peers { permanent_uuid: "a2bb0b5d938f4886b5d65f1172d8bb4a" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 36401 } } peers { permanent_uuid: "bb8cc6cb37b74113bc8208e9c6e3543b" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 34457 } }
I20260812 06:36:57.271625  8016 raft_consensus.cc:385] T abbacda00c104ee79de09477c6f7bf46 P a2bb0b5d938f4886b5d65f1172d8bb4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:36:57.271687  8016 raft_consensus.cc:740] T abbacda00c104ee79de09477c6f7bf46 P a2bb0b5d938f4886b5d65f1172d8bb4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2bb0b5d938f4886b5d65f1172d8bb4a, State: Initialized, Role: FOLLOWER
I20260812 06:36:57.272132  8021 tablet_bootstrap.cc:654] T abbacda00c104ee79de09477c6f7bf46 P bb8cc6cb37b74113bc8208e9c6e3543b: Neither blocks nor log segments found. Creating new log.
I20260812 06:36:57.272122  8016 consensus_queue.cc:260] T abbacda00c104ee79de09477c6f7bf46 P a2bb0b5d938f4886b5d65f1172d8bb4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "206661efc252414c9caef3cf7ae72c9e" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 37055 } } peers { permanent_uuid: "a2bb0b5d938f4886b5d65f1172d8bb4a" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 36401 } } peers { permanent_uuid: "bb8cc6cb37b74113bc8208e9c6e3543b" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 34457 } }
I20260812 06:36:57.272394  8014 raft_consensus.cc:359] T abbacda00c104ee79de09477c6f7bf46 P 206661efc252414c9caef3cf7ae72c9e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "206661efc252414c9caef3cf7ae72c9e" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 37055 } } peers { permanent_uuid: "a2bb0b5d938f4886b5d65f1172d8bb4a" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 36401 } } peers { permanent_uuid: "bb8cc6cb37b74113bc8208e9c6e3543b" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 34457 } }
I20260812 06:36:57.272969  8014 raft_consensus.cc:385] T abbacda00c104ee79de09477c6f7bf46 P 206661efc252414c9caef3cf7ae72c9e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:36:57.273082  8014 raft_consensus.cc:740] T abbacda00c104ee79de09477c6f7bf46 P 206661efc252414c9caef3cf7ae72c9e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 206661efc252414c9caef3cf7ae72c9e, State: Initialized, Role: FOLLOWER
I20260812 06:36:57.273265  8016 ts_tablet_manager.cc:1434] T abbacda00c104ee79de09477c6f7bf46 P a2bb0b5d938f4886b5d65f1172d8bb4a: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260812 06:36:57.273259  8021 log.cc:826] T abbacda00c104ee79de09477c6f7bf46 P bb8cc6cb37b74113bc8208e9c6e3543b: Log is configured to *not* fsync() on all Append() calls
I20260812 06:36:57.273661  7971 heartbeater.cc:499] Master 127.6.203.62:46287 was elected leader, sending a full tablet report...
I20260812 06:36:57.273705  8014 consensus_queue.cc:260] T abbacda00c104ee79de09477c6f7bf46 P 206661efc252414c9caef3cf7ae72c9e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "206661efc252414c9caef3cf7ae72c9e" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 37055 } } peers { permanent_uuid: "a2bb0b5d938f4886b5d65f1172d8bb4a" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 36401 } } peers { permanent_uuid: "bb8cc6cb37b74113bc8208e9c6e3543b" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 34457 } }
I20260812 06:36:57.273882  8022 tablet_replica.cc:442] T abbacda00c104ee79de09477c6f7bf46 P a2bb0b5d938f4886b5d65f1172d8bb4a: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "206661efc252414c9caef3cf7ae72c9e" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 37055 } } peers { permanent_uuid: "a2bb0b5d938f4886b5d65f1172d8bb4a" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 36401 } } peers { permanent_uuid: "bb8cc6cb37b74113bc8208e9c6e3543b" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 34457 } } }
I20260812 06:36:57.274120  8022 tablet_replica.cc:445] T abbacda00c104ee79de09477c6f7bf46 P a2bb0b5d938f4886b5d65f1172d8bb4a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:36:57.274515  8028 tablet_replica.cc:442] T abbacda00c104ee79de09477c6f7bf46 P 206661efc252414c9caef3cf7ae72c9e: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "206661efc252414c9caef3cf7ae72c9e" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 37055 } } peers { permanent_uuid: "a2bb0b5d938f4886b5d65f1172d8bb4a" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 36401 } } peers { permanent_uuid: "bb8cc6cb37b74113bc8208e9c6e3543b" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 34457 } } }
I20260812 06:36:57.274555  7427 heartbeater.cc:499] Master 127.6.203.62:46287 was elected leader, sending a full tablet report...
I20260812 06:36:57.274706  8014 ts_tablet_manager.cc:1434] T abbacda00c104ee79de09477c6f7bf46 P 206661efc252414c9caef3cf7ae72c9e: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.005s
I20260812 06:36:57.274993  8028 tablet_replica.cc:445] T abbacda00c104ee79de09477c6f7bf46 P 206661efc252414c9caef3cf7ae72c9e: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:36:57.276636  8021 tablet_bootstrap.cc:492] T abbacda00c104ee79de09477c6f7bf46 P bb8cc6cb37b74113bc8208e9c6e3543b: No bootstrap required, opened a new log
I20260812 06:36:57.277454  8021 ts_tablet_manager.cc:1403] T abbacda00c104ee79de09477c6f7bf46 P bb8cc6cb37b74113bc8208e9c6e3543b: Time spent bootstrapping tablet: real 0.008s	user 0.005s	sys 0.000s
I20260812 06:36:57.281067  8021 raft_consensus.cc:359] T abbacda00c104ee79de09477c6f7bf46 P bb8cc6cb37b74113bc8208e9c6e3543b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "206661efc252414c9caef3cf7ae72c9e" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 37055 } } peers { permanent_uuid: "a2bb0b5d938f4886b5d65f1172d8bb4a" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 36401 } } peers { permanent_uuid: "bb8cc6cb37b74113bc8208e9c6e3543b" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 34457 } }
I20260812 06:36:57.281337  8021 raft_consensus.cc:385] T abbacda00c104ee79de09477c6f7bf46 P bb8cc6cb37b74113bc8208e9c6e3543b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:36:57.281545  8021 raft_consensus.cc:740] T abbacda00c104ee79de09477c6f7bf46 P bb8cc6cb37b74113bc8208e9c6e3543b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb8cc6cb37b74113bc8208e9c6e3543b, State: Initialized, Role: FOLLOWER
I20260812 06:36:57.282001  8021 consensus_queue.cc:260] T abbacda00c104ee79de09477c6f7bf46 P bb8cc6cb37b74113bc8208e9c6e3543b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "206661efc252414c9caef3cf7ae72c9e" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 37055 } } peers { permanent_uuid: "a2bb0b5d938f4886b5d65f1172d8bb4a" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 36401 } } peers { permanent_uuid: "bb8cc6cb37b74113bc8208e9c6e3543b" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 34457 } }
I20260812 06:36:57.282696  7692 heartbeater.cc:499] Master 127.6.203.62:46287 was elected leader, sending a full tablet report...
I20260812 06:36:57.282832  8033 raft_consensus.cc:493] T abbacda00c104ee79de09477c6f7bf46 P 206661efc252414c9caef3cf7ae72c9e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:36:57.283082  8033 raft_consensus.cc:515] T abbacda00c104ee79de09477c6f7bf46 P 206661efc252414c9caef3cf7ae72c9e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "206661efc252414c9caef3cf7ae72c9e" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 37055 } } peers { permanent_uuid: "a2bb0b5d938f4886b5d65f1172d8bb4a" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 36401 } } peers { permanent_uuid: "bb8cc6cb37b74113bc8208e9c6e3543b" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 34457 } }
I20260812 06:36:57.283138  8021 ts_tablet_manager.cc:1434] T abbacda00c104ee79de09477c6f7bf46 P bb8cc6cb37b74113bc8208e9c6e3543b: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
W20260812 06:36:57.283658  7974 tablet.cc:2406] T abbacda00c104ee79de09477c6f7bf46 P a2bb0b5d938f4886b5d65f1172d8bb4a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:36:57.284582  8029 tablet_replica.cc:442] T abbacda00c104ee79de09477c6f7bf46 P bb8cc6cb37b74113bc8208e9c6e3543b: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "206661efc252414c9caef3cf7ae72c9e" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 37055 } } peers { permanent_uuid: "a2bb0b5d938f4886b5d65f1172d8bb4a" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 36401 } } peers { permanent_uuid: "bb8cc6cb37b74113bc8208e9c6e3543b" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 34457 } } }
I20260812 06:36:57.284789  8029 tablet_replica.cc:445] T abbacda00c104ee79de09477c6f7bf46 P bb8cc6cb37b74113bc8208e9c6e3543b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:36:57.285532  8022 raft_consensus.cc:493] T abbacda00c104ee79de09477c6f7bf46 P a2bb0b5d938f4886b5d65f1172d8bb4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:36:57.285741  8022 raft_consensus.cc:515] T abbacda00c104ee79de09477c6f7bf46 P a2bb0b5d938f4886b5d65f1172d8bb4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "206661efc252414c9caef3cf7ae72c9e" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 37055 } } peers { permanent_uuid: "a2bb0b5d938f4886b5d65f1172d8bb4a" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 36401 } } peers { permanent_uuid: "bb8cc6cb37b74113bc8208e9c6e3543b" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 34457 } }
I20260812 06:36:57.287688  8033 leader_election.cc:290] T abbacda00c104ee79de09477c6f7bf46 P 206661efc252414c9caef3cf7ae72c9e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2bb0b5d938f4886b5d65f1172d8bb4a (127.6.203.3:36401), bb8cc6cb37b74113bc8208e9c6e3543b (127.6.203.2:34457)
I20260812 06:36:57.288769  8022 leader_election.cc:290] T abbacda00c104ee79de09477c6f7bf46 P a2bb0b5d938f4886b5d65f1172d8bb4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 206661efc252414c9caef3cf7ae72c9e (127.6.203.1:37055), bb8cc6cb37b74113bc8208e9c6e3543b (127.6.203.2:34457)
I20260812 06:36:57.289822  8029 raft_consensus.cc:493] T abbacda00c104ee79de09477c6f7bf46 P bb8cc6cb37b74113bc8208e9c6e3543b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:36:57.290055  8029 raft_consensus.cc:515] T abbacda00c104ee79de09477c6f7bf46 P bb8cc6cb37b74113bc8208e9c6e3543b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "206661efc252414c9caef3cf7ae72c9e" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 37055 } } peers { permanent_uuid: "a2bb0b5d938f4886b5d65f1172d8bb4a" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 36401 } } peers { permanent_uuid: "bb8cc6cb37b74113bc8208e9c6e3543b" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 34457 } }
I20260812 06:36:57.291337  8029 leader_election.cc:290] T abbacda00c104ee79de09477c6f7bf46 P bb8cc6cb37b74113bc8208e9c6e3543b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 206661efc252414c9caef3cf7ae72c9e (127.6.203.1:37055), a2bb0b5d938f4886b5d65f1172d8bb4a (127.6.203.3:36401)
I20260812 06:36:57.292713  7588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbacda00c104ee79de09477c6f7bf46" candidate_uuid: "206661efc252414c9caef3cf7ae72c9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8cc6cb37b74113bc8208e9c6e3543b" is_pre_election: true
I20260812 06:36:57.293252  7588 raft_consensus.cc:2468] T abbacda00c104ee79de09477c6f7bf46 P bb8cc6cb37b74113bc8208e9c6e3543b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 206661efc252414c9caef3cf7ae72c9e in term 0.
I20260812 06:36:57.293720  7342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbacda00c104ee79de09477c6f7bf46" candidate_uuid: "a2bb0b5d938f4886b5d65f1172d8bb4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "206661efc252414c9caef3cf7ae72c9e" is_pre_election: true
I20260812 06:36:57.293908  7342 raft_consensus.cc:2468] T abbacda00c104ee79de09477c6f7bf46 P 206661efc252414c9caef3cf7ae72c9e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2bb0b5d938f4886b5d65f1172d8bb4a in term 0.
I20260812 06:36:57.297425  7733 leader_election.cc:304] T abbacda00c104ee79de09477c6f7bf46 P a2bb0b5d938f4886b5d65f1172d8bb4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 206661efc252414c9caef3cf7ae72c9e, a2bb0b5d938f4886b5d65f1172d8bb4a; no voters: 
I20260812 06:36:57.298094  7855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbacda00c104ee79de09477c6f7bf46" candidate_uuid: "bb8cc6cb37b74113bc8208e9c6e3543b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2bb0b5d938f4886b5d65f1172d8bb4a" is_pre_election: true
I20260812 06:36:57.299371  7194 leader_election.cc:304] T abbacda00c104ee79de09477c6f7bf46 P 206661efc252414c9caef3cf7ae72c9e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 206661efc252414c9caef3cf7ae72c9e, bb8cc6cb37b74113bc8208e9c6e3543b; no voters: 
I20260812 06:36:57.300123  8033 raft_consensus.cc:2804] T abbacda00c104ee79de09477c6f7bf46 P 206661efc252414c9caef3cf7ae72c9e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:36:57.300313  8033 raft_consensus.cc:493] T abbacda00c104ee79de09477c6f7bf46 P 206661efc252414c9caef3cf7ae72c9e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:36:57.300369  8033 raft_consensus.cc:3060] T abbacda00c104ee79de09477c6f7bf46 P 206661efc252414c9caef3cf7ae72c9e [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:57.301200  7342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbacda00c104ee79de09477c6f7bf46" candidate_uuid: "bb8cc6cb37b74113bc8208e9c6e3543b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "206661efc252414c9caef3cf7ae72c9e" is_pre_election: true
I20260812 06:36:57.301324  8022 raft_consensus.cc:2804] T abbacda00c104ee79de09477c6f7bf46 P a2bb0b5d938f4886b5d65f1172d8bb4a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:36:57.301604  7855 raft_consensus.cc:2468] T abbacda00c104ee79de09477c6f7bf46 P a2bb0b5d938f4886b5d65f1172d8bb4a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate bb8cc6cb37b74113bc8208e9c6e3543b in term 0.
I20260812 06:36:57.301805  8033 raft_consensus.cc:515] T abbacda00c104ee79de09477c6f7bf46 P 206661efc252414c9caef3cf7ae72c9e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "206661efc252414c9caef3cf7ae72c9e" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 37055 } } peers { permanent_uuid: "a2bb0b5d938f4886b5d65f1172d8bb4a" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 36401 } } peers { permanent_uuid: "bb8cc6cb37b74113bc8208e9c6e3543b" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 34457 } }
I20260812 06:36:57.302255  7342 raft_consensus.cc:2393] T abbacda00c104ee79de09477c6f7bf46 P 206661efc252414c9caef3cf7ae72c9e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb8cc6cb37b74113bc8208e9c6e3543b in current term 1: Already voted for candidate 206661efc252414c9caef3cf7ae72c9e in this term.
I20260812 06:36:57.302829  7588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbacda00c104ee79de09477c6f7bf46" candidate_uuid: "206661efc252414c9caef3cf7ae72c9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8cc6cb37b74113bc8208e9c6e3543b"
I20260812 06:36:57.302984  7588 raft_consensus.cc:3060] T abbacda00c104ee79de09477c6f7bf46 P bb8cc6cb37b74113bc8208e9c6e3543b [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:57.304389  7588 raft_consensus.cc:2468] T abbacda00c104ee79de09477c6f7bf46 P bb8cc6cb37b74113bc8208e9c6e3543b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 206661efc252414c9caef3cf7ae72c9e in term 1.
I20260812 06:36:57.304546  7463 leader_election.cc:304] T abbacda00c104ee79de09477c6f7bf46 P bb8cc6cb37b74113bc8208e9c6e3543b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2bb0b5d938f4886b5d65f1172d8bb4a, bb8cc6cb37b74113bc8208e9c6e3543b; no voters: 206661efc252414c9caef3cf7ae72c9e
I20260812 06:36:57.304913  7194 leader_election.cc:304] T abbacda00c104ee79de09477c6f7bf46 P 206661efc252414c9caef3cf7ae72c9e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 206661efc252414c9caef3cf7ae72c9e, bb8cc6cb37b74113bc8208e9c6e3543b; no voters: 
I20260812 06:36:57.305100  8033 leader_election.cc:290] T abbacda00c104ee79de09477c6f7bf46 P 206661efc252414c9caef3cf7ae72c9e [CANDIDATE]: Term 1 election: Requested vote from peers a2bb0b5d938f4886b5d65f1172d8bb4a (127.6.203.3:36401), bb8cc6cb37b74113bc8208e9c6e3543b (127.6.203.2:34457)
I20260812 06:36:57.305106  8028 raft_consensus.cc:2804] T abbacda00c104ee79de09477c6f7bf46 P 206661efc252414c9caef3cf7ae72c9e [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:36:57.305238  8029 raft_consensus.cc:2764] T abbacda00c104ee79de09477c6f7bf46 P bb8cc6cb37b74113bc8208e9c6e3543b [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260812 06:36:57.305371  8028 raft_consensus.cc:697] T abbacda00c104ee79de09477c6f7bf46 P 206661efc252414c9caef3cf7ae72c9e [term 1 LEADER]: Becoming Leader. State: Replica: 206661efc252414c9caef3cf7ae72c9e, State: Running, Role: LEADER
I20260812 06:36:57.305475  8022 raft_consensus.cc:493] T abbacda00c104ee79de09477c6f7bf46 P a2bb0b5d938f4886b5d65f1172d8bb4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:36:57.305581  8022 raft_consensus.cc:3060] T abbacda00c104ee79de09477c6f7bf46 P a2bb0b5d938f4886b5d65f1172d8bb4a [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:36:57.305727  8028 consensus_queue.cc:237] T abbacda00c104ee79de09477c6f7bf46 P 206661efc252414c9caef3cf7ae72c9e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "206661efc252414c9caef3cf7ae72c9e" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 37055 } } peers { permanent_uuid: "a2bb0b5d938f4886b5d65f1172d8bb4a" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 36401 } } peers { permanent_uuid: "bb8cc6cb37b74113bc8208e9c6e3543b" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 34457 } }
I20260812 06:36:57.306685  8022 raft_consensus.cc:515] T abbacda00c104ee79de09477c6f7bf46 P a2bb0b5d938f4886b5d65f1172d8bb4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "206661efc252414c9caef3cf7ae72c9e" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 37055 } } peers { permanent_uuid: "a2bb0b5d938f4886b5d65f1172d8bb4a" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 36401 } } peers { permanent_uuid: "bb8cc6cb37b74113bc8208e9c6e3543b" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 34457 } }
I20260812 06:36:57.307382  8022 leader_election.cc:290] T abbacda00c104ee79de09477c6f7bf46 P a2bb0b5d938f4886b5d65f1172d8bb4a [CANDIDATE]: Term 1 election: Requested vote from peers 206661efc252414c9caef3cf7ae72c9e (127.6.203.1:37055), bb8cc6cb37b74113bc8208e9c6e3543b (127.6.203.2:34457)
I20260812 06:36:57.307672  7342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbacda00c104ee79de09477c6f7bf46" candidate_uuid: "a2bb0b5d938f4886b5d65f1172d8bb4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "206661efc252414c9caef3cf7ae72c9e"
I20260812 06:36:57.308589  7855 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbacda00c104ee79de09477c6f7bf46" candidate_uuid: "206661efc252414c9caef3cf7ae72c9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2bb0b5d938f4886b5d65f1172d8bb4a" is_pre_election: true
I20260812 06:36:57.308732  8033 tablet_replica.cc:442] T abbacda00c104ee79de09477c6f7bf46 P 206661efc252414c9caef3cf7ae72c9e: TxnStatusTablet state changed. Reason: New leader 206661efc252414c9caef3cf7ae72c9e. Latest consensus state: current_term: 1 leader_uuid: "206661efc252414c9caef3cf7ae72c9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "206661efc252414c9caef3cf7ae72c9e" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 37055 } } peers { permanent_uuid: "a2bb0b5d938f4886b5d65f1172d8bb4a" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 36401 } } peers { permanent_uuid: "bb8cc6cb37b74113bc8208e9c6e3543b" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 34457 } } }
I20260812 06:36:57.308792  7855 raft_consensus.cc:2393] T abbacda00c104ee79de09477c6f7bf46 P a2bb0b5d938f4886b5d65f1172d8bb4a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 206661efc252414c9caef3cf7ae72c9e in current term 1: Already voted for candidate a2bb0b5d938f4886b5d65f1172d8bb4a in this term.
I20260812 06:36:57.308825  8033 tablet_replica.cc:445] T abbacda00c104ee79de09477c6f7bf46 P 206661efc252414c9caef3cf7ae72c9e: This TxnStatusTablet replica's current role is: LEADER
I20260812 06:36:57.309139  7854 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbacda00c104ee79de09477c6f7bf46" candidate_uuid: "206661efc252414c9caef3cf7ae72c9e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2bb0b5d938f4886b5d65f1172d8bb4a"
I20260812 06:36:57.309333  7854 raft_consensus.cc:2393] T abbacda00c104ee79de09477c6f7bf46 P a2bb0b5d938f4886b5d65f1172d8bb4a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 206661efc252414c9caef3cf7ae72c9e in current term 1: Already voted for candidate a2bb0b5d938f4886b5d65f1172d8bb4a in this term.
I20260812 06:36:57.309381  7026 catalog_manager.cc:5719] T abbacda00c104ee79de09477c6f7bf46 P 206661efc252414c9caef3cf7ae72c9e reported cstate change: term changed from 0 to 1, leader changed from <none> to 206661efc252414c9caef3cf7ae72c9e (127.6.203.1). New cstate: current_term: 1 leader_uuid: "206661efc252414c9caef3cf7ae72c9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "206661efc252414c9caef3cf7ae72c9e" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 37055 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2bb0b5d938f4886b5d65f1172d8bb4a" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 36401 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "bb8cc6cb37b74113bc8208e9c6e3543b" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 34457 } health_report { overall_health: UNKNOWN } } }
I20260812 06:36:57.311062  8070 txn_status_manager.cc:874] Waiting until node catch up with all replicated operations in previous term...
I20260812 06:36:57.311271  8070 txn_status_manager.cc:930] Loading transaction status metadata into memory...
I20260812 06:36:57.312388  7588 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbacda00c104ee79de09477c6f7bf46" candidate_uuid: "a2bb0b5d938f4886b5d65f1172d8bb4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8cc6cb37b74113bc8208e9c6e3543b" is_pre_election: true
I20260812 06:36:57.312584  7588 raft_consensus.cc:2393] T abbacda00c104ee79de09477c6f7bf46 P bb8cc6cb37b74113bc8208e9c6e3543b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2bb0b5d938f4886b5d65f1172d8bb4a in current term 1: Already voted for candidate 206661efc252414c9caef3cf7ae72c9e in this term.
I20260812 06:36:57.312681  7587 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abbacda00c104ee79de09477c6f7bf46" candidate_uuid: "a2bb0b5d938f4886b5d65f1172d8bb4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb8cc6cb37b74113bc8208e9c6e3543b"
I20260812 06:36:57.312805  7587 raft_consensus.cc:2393] T abbacda00c104ee79de09477c6f7bf46 P bb8cc6cb37b74113bc8208e9c6e3543b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a2bb0b5d938f4886b5d65f1172d8bb4a in current term 1: Already voted for candidate 206661efc252414c9caef3cf7ae72c9e in this term.
I20260812 06:36:57.313447  7729 leader_election.cc:304] T abbacda00c104ee79de09477c6f7bf46 P a2bb0b5d938f4886b5d65f1172d8bb4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2bb0b5d938f4886b5d65f1172d8bb4a; no voters: 206661efc252414c9caef3cf7ae72c9e, bb8cc6cb37b74113bc8208e9c6e3543b
I20260812 06:36:57.313637  8022 raft_consensus.cc:2749] T abbacda00c104ee79de09477c6f7bf46 P a2bb0b5d938f4886b5d65f1172d8bb4a [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260812 06:36:57.331483  7693 tablet.cc:2406] T abbacda00c104ee79de09477c6f7bf46 P bb8cc6cb37b74113bc8208e9c6e3543b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:36:57.347177  7854 raft_consensus.cc:1275] T abbacda00c104ee79de09477c6f7bf46 P a2bb0b5d938f4886b5d65f1172d8bb4a [term 1 FOLLOWER]: Refusing update from remote peer 206661efc252414c9caef3cf7ae72c9e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:36:57.347390  7587 raft_consensus.cc:1275] T abbacda00c104ee79de09477c6f7bf46 P bb8cc6cb37b74113bc8208e9c6e3543b [term 1 FOLLOWER]: Refusing update from remote peer 206661efc252414c9caef3cf7ae72c9e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:36:57.347839  8033 consensus_queue.cc:1048] T abbacda00c104ee79de09477c6f7bf46 P 206661efc252414c9caef3cf7ae72c9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2bb0b5d938f4886b5d65f1172d8bb4a" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 36401 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:36:57.348008  8028 consensus_queue.cc:1048] T abbacda00c104ee79de09477c6f7bf46 P 206661efc252414c9caef3cf7ae72c9e [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb8cc6cb37b74113bc8208e9c6e3543b" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 34457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:36:57.353092  8029 tablet_replica.cc:442] T abbacda00c104ee79de09477c6f7bf46 P bb8cc6cb37b74113bc8208e9c6e3543b: TxnStatusTablet state changed. Reason: New leader 206661efc252414c9caef3cf7ae72c9e. Latest consensus state: current_term: 1 leader_uuid: "206661efc252414c9caef3cf7ae72c9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "206661efc252414c9caef3cf7ae72c9e" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 37055 } } peers { permanent_uuid: "a2bb0b5d938f4886b5d65f1172d8bb4a" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 36401 } } peers { permanent_uuid: "bb8cc6cb37b74113bc8208e9c6e3543b" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 34457 } } }
I20260812 06:36:57.353257  8029 tablet_replica.cc:445] T abbacda00c104ee79de09477c6f7bf46 P bb8cc6cb37b74113bc8208e9c6e3543b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:36:57.356211  8061 tablet_replica.cc:442] T abbacda00c104ee79de09477c6f7bf46 P 206661efc252414c9caef3cf7ae72c9e: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "206661efc252414c9caef3cf7ae72c9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "206661efc252414c9caef3cf7ae72c9e" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 37055 } } peers { permanent_uuid: "a2bb0b5d938f4886b5d65f1172d8bb4a" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 36401 } } peers { permanent_uuid: "bb8cc6cb37b74113bc8208e9c6e3543b" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 34457 } } }
I20260812 06:36:57.356350  8061 tablet_replica.cc:445] T abbacda00c104ee79de09477c6f7bf46 P 206661efc252414c9caef3cf7ae72c9e: This TxnStatusTablet replica's current role is: LEADER
I20260812 06:36:57.356462  8061 tablet_replica.cc:442] T abbacda00c104ee79de09477c6f7bf46 P 206661efc252414c9caef3cf7ae72c9e: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "206661efc252414c9caef3cf7ae72c9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "206661efc252414c9caef3cf7ae72c9e" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 37055 } } peers { permanent_uuid: "a2bb0b5d938f4886b5d65f1172d8bb4a" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 36401 } } peers { permanent_uuid: "bb8cc6cb37b74113bc8208e9c6e3543b" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 34457 } } }
I20260812 06:36:57.356518  8061 tablet_replica.cc:445] T abbacda00c104ee79de09477c6f7bf46 P 206661efc252414c9caef3cf7ae72c9e: This TxnStatusTablet replica's current role is: LEADER
I20260812 06:36:57.357957  8029 tablet_replica.cc:442] T abbacda00c104ee79de09477c6f7bf46 P bb8cc6cb37b74113bc8208e9c6e3543b: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "206661efc252414c9caef3cf7ae72c9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "206661efc252414c9caef3cf7ae72c9e" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 37055 } } peers { permanent_uuid: "a2bb0b5d938f4886b5d65f1172d8bb4a" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 36401 } } peers { permanent_uuid: "bb8cc6cb37b74113bc8208e9c6e3543b" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 34457 } } }
I20260812 06:36:57.358074  8029 tablet_replica.cc:445] T abbacda00c104ee79de09477c6f7bf46 P bb8cc6cb37b74113bc8208e9c6e3543b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:36:57.358160  8083 mvcc.cc:204] Tried to move back new op lower bound from 7317572064646537216 to 7317572064487432192. Current Snapshot: MvccSnapshot[applied={T|T < 7317572064646537216}]
I20260812 06:36:57.358671  8082 mvcc.cc:204] Tried to move back new op lower bound from 7317572064646537216 to 7317572064487432192. Current Snapshot: MvccSnapshot[applied={T|T < 7317572064646537216}]
I20260812 06:36:57.359623  8093 tablet_replica.cc:442] T abbacda00c104ee79de09477c6f7bf46 P a2bb0b5d938f4886b5d65f1172d8bb4a: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "206661efc252414c9caef3cf7ae72c9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "206661efc252414c9caef3cf7ae72c9e" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 37055 } } peers { permanent_uuid: "a2bb0b5d938f4886b5d65f1172d8bb4a" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 36401 } } peers { permanent_uuid: "bb8cc6cb37b74113bc8208e9c6e3543b" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 34457 } } }
I20260812 06:36:57.359745  8093 tablet_replica.cc:445] T abbacda00c104ee79de09477c6f7bf46 P a2bb0b5d938f4886b5d65f1172d8bb4a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:36:57.361346  8022 tablet_replica.cc:442] T abbacda00c104ee79de09477c6f7bf46 P a2bb0b5d938f4886b5d65f1172d8bb4a: TxnStatusTablet state changed. Reason: New leader 206661efc252414c9caef3cf7ae72c9e. Latest consensus state: current_term: 1 leader_uuid: "206661efc252414c9caef3cf7ae72c9e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "206661efc252414c9caef3cf7ae72c9e" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 37055 } } peers { permanent_uuid: "a2bb0b5d938f4886b5d65f1172d8bb4a" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 36401 } } peers { permanent_uuid: "bb8cc6cb37b74113bc8208e9c6e3543b" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 34457 } } }
I20260812 06:36:57.361476  8022 tablet_replica.cc:445] T abbacda00c104ee79de09477c6f7bf46 P a2bb0b5d938f4886b5d65f1172d8bb4a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:36:57.877506  7204 txn_status_manager.cc:1391] automatically aborted stale txn (ID 0) past 0.510s from last keepalive heartbeat (effective timeout is 0.500s)
I20260812 06:37:00.383375  6956 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu with pid 7166
I20260812 06:37:00.398669  6956 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu with pid 7430
I20260812 06:37:00.416013  6956 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu with pid 7694
I20260812 06:37:00.429581  6956 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu with pid 6969
2026-08-12T06:37:00Z chronyd exiting
[       OK ] TxnStatusManagerITest.StaleTransactionsCleanup (4614 ms)
[ RUN      ] TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime
2026-08-12T06:37:00Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:37:00Z Disabled control of system clock
I20260812 06:37:00.476354  6956 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu
/tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786516615841258-6956-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786516615841258-6956-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786516615841258-6956-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786516615841258-6956-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.203.62:38593
--webserver_interface=127.6.203.62
--webserver_port=0
--builtin_ntp_servers=127.6.203.20:39383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.203.62:38593
--txn_manager_enabled=true
--txn_manager_lazily_initialized=false with env {}
W20260812 06:37:00.593532  8150 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:00.593767  8150 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:00.593808  8150 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:00.597121  8150 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:37:00.597226  8150 flags.cc:432] Enabled experimental flag: --txn_manager_enabled=true
W20260812 06:37:00.597244  8150 flags.cc:432] Enabled experimental flag: --txn_manager_lazily_initialized=false
W20260812 06:37:00.597259  8150 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:00.597278  8150 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:37:00.597295  8150 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:37:00.601583  8150 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786516615841258-6956-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.203.20:39383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786516615841258-6956-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786516615841258-6956-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.6.203.62:38593
--txn_manager_enabled=true
--txn_manager_lazily_initialized=false
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.203.62:38593
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786516615841258-6956-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.203.62
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.8150
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:00.602742  8150 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:00.603868  8150 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:37:00.609722  8172 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:00.609843  8150 server_base.cc:1061] running on GCE node
W20260812 06:37:00.609711  8164 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:00.609711  8167 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:00.610606  8150 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:00.611511  8150 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:00.612730  8150 hybrid_clock.cc:648] HybridClock initialized: now 1786516620612701 us; error 50 us; skew 500 ppm
I20260812 06:37:00.614812  8150 webserver.cc:533] Webserver started at http://127.6.203.62:34595/ using document root <none> and password file <none>
I20260812 06:37:00.615415  8150 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:00.615502  8150 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:00.615726  8150 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:37:00.617434  8150 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786516615841258-6956-0/minicluster-data/master-0/data/instance:
uuid: "d1a27953b15f4a49a583c6913caabe96"
format_stamp: "Formatted at 2026-08-12 06:37:00 on dist-test-slave-z8x9"
I20260812 06:37:00.617941  8150 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786516615841258-6956-0/minicluster-data/master-0/wal/instance:
uuid: "d1a27953b15f4a49a583c6913caabe96"
format_stamp: "Formatted at 2026-08-12 06:37:00 on dist-test-slave-z8x9"
I20260812 06:37:00.621430  8150 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.001s
I20260812 06:37:00.623762  8182 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:00.624928  8150 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:37:00.625092  8150 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786516615841258-6956-0/minicluster-data/master-0/data,/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786516615841258-6956-0/minicluster-data/master-0/wal
uuid: "d1a27953b15f4a49a583c6913caabe96"
format_stamp: "Formatted at 2026-08-12 06:37:00 on dist-test-slave-z8x9"
I20260812 06:37:00.625259  8150 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786516615841258-6956-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786516615841258-6956-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786516615841258-6956-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:00.638196  8150 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:00.638908  8150 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:00.639112  8150 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:00.648134  8150 rpc_server.cc:307] RPC server started. Bound to: 127.6.203.62:38593
I20260812 06:37:00.648190  8300 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.203.62:38593 every 8 connection(s)
I20260812 06:37:00.649331  8150 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786516615841258-6956-0/minicluster-data/master-0/data/info.pb
I20260812 06:37:00.652294  8301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:00.652925  6956 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu as pid 8150
I20260812 06:37:00.653071  6956 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786516615841258-6956-0/minicluster-data/master-0/wal/instance
I20260812 06:37:00.657963  8301 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d1a27953b15f4a49a583c6913caabe96: Bootstrap starting.
I20260812 06:37:00.660573  8301 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d1a27953b15f4a49a583c6913caabe96: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:00.661541  8301 log.cc:826] T 00000000000000000000000000000000 P d1a27953b15f4a49a583c6913caabe96: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:00.664021  8301 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d1a27953b15f4a49a583c6913caabe96: No bootstrap required, opened a new log
I20260812 06:37:00.667451  8301 raft_consensus.cc:359] T 00000000000000000000000000000000 P d1a27953b15f4a49a583c6913caabe96 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1a27953b15f4a49a583c6913caabe96" member_type: VOTER last_known_addr { host: "127.6.203.62" port: 38593 } }
I20260812 06:37:00.667707  8301 raft_consensus.cc:385] T 00000000000000000000000000000000 P d1a27953b15f4a49a583c6913caabe96 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:00.667778  8301 raft_consensus.cc:740] T 00000000000000000000000000000000 P d1a27953b15f4a49a583c6913caabe96 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d1a27953b15f4a49a583c6913caabe96, State: Initialized, Role: FOLLOWER
I20260812 06:37:00.668277  8301 consensus_queue.cc:260] T 00000000000000000000000000000000 P d1a27953b15f4a49a583c6913caabe96 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1a27953b15f4a49a583c6913caabe96" member_type: VOTER last_known_addr { host: "127.6.203.62" port: 38593 } }
I20260812 06:37:00.668452  8301 raft_consensus.cc:399] T 00000000000000000000000000000000 P d1a27953b15f4a49a583c6913caabe96 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:37:00.668526  8301 raft_consensus.cc:493] T 00000000000000000000000000000000 P d1a27953b15f4a49a583c6913caabe96 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:37:00.668649  8301 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d1a27953b15f4a49a583c6913caabe96 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:00.669866  8301 raft_consensus.cc:515] T 00000000000000000000000000000000 P d1a27953b15f4a49a583c6913caabe96 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1a27953b15f4a49a583c6913caabe96" member_type: VOTER last_known_addr { host: "127.6.203.62" port: 38593 } }
I20260812 06:37:00.670280  8301 leader_election.cc:304] T 00000000000000000000000000000000 P d1a27953b15f4a49a583c6913caabe96 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d1a27953b15f4a49a583c6913caabe96; no voters: 
I20260812 06:37:00.670667  8301 leader_election.cc:290] T 00000000000000000000000000000000 P d1a27953b15f4a49a583c6913caabe96 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 06:37:00.670894  8311 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d1a27953b15f4a49a583c6913caabe96 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:37:00.671176  8311 raft_consensus.cc:697] T 00000000000000000000000000000000 P d1a27953b15f4a49a583c6913caabe96 [term 1 LEADER]: Becoming Leader. State: Replica: d1a27953b15f4a49a583c6913caabe96, State: Running, Role: LEADER
I20260812 06:37:00.671579  8311 consensus_queue.cc:237] T 00000000000000000000000000000000 P d1a27953b15f4a49a583c6913caabe96 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1a27953b15f4a49a583c6913caabe96" member_type: VOTER last_known_addr { host: "127.6.203.62" port: 38593 } }
I20260812 06:37:00.671921  8301 sys_catalog.cc:565] T 00000000000000000000000000000000 P d1a27953b15f4a49a583c6913caabe96 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:37:00.674573  8314 sys_catalog.cc:455] T 00000000000000000000000000000000 P d1a27953b15f4a49a583c6913caabe96 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d1a27953b15f4a49a583c6913caabe96. Latest consensus state: current_term: 1 leader_uuid: "d1a27953b15f4a49a583c6913caabe96" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1a27953b15f4a49a583c6913caabe96" member_type: VOTER last_known_addr { host: "127.6.203.62" port: 38593 } } }
I20260812 06:37:00.674782  8314 sys_catalog.cc:458] T 00000000000000000000000000000000 P d1a27953b15f4a49a583c6913caabe96 [sys.catalog]: This master's current role is: LEADER
I20260812 06:37:00.674785  8312 sys_catalog.cc:455] T 00000000000000000000000000000000 P d1a27953b15f4a49a583c6913caabe96 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d1a27953b15f4a49a583c6913caabe96" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d1a27953b15f4a49a583c6913caabe96" member_type: VOTER last_known_addr { host: "127.6.203.62" port: 38593 } } }
I20260812 06:37:00.674942  8312 sys_catalog.cc:458] T 00000000000000000000000000000000 P d1a27953b15f4a49a583c6913caabe96 [sys.catalog]: This master's current role is: LEADER
I20260812 06:37:00.675280  8326 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 06:37:00.678610  8326 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 06:37:00.690800  8326 catalog_manager.cc:1383] Generated new cluster ID: 46e9fc55b7bc4949918e803fa302cd20
I20260812 06:37:00.690897  8326 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 06:37:00.720142  8326 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 06:37:00.721064  8326 catalog_manager.cc:1540] Loading token signing keys...
I20260812 06:37:00.728618  8326 catalog_manager.cc:6092] T 00000000000000000000000000000000 P d1a27953b15f4a49a583c6913caabe96: Generated new TSK 0
I20260812 06:37:00.729377  8326 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 06:37:00.737643  8213 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33792:
name: "kudu_system.kudu_transactions"
schema {
  columns {
    name: "txn_id"
    type: INT64
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "entry_type"
    type: INT8
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "identifier"
    type: STRING
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "metadata"
    type: STRING
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
  indirect_data: "<redacted>"""
}
partition_schema {
  range_schema {
    columns {
      name: "txn_id"
    }
  }
}
table_type: TXN_STATUS_TABLE
W20260812 06:37:00.741508  8301 master.cc:465] Invalid argument: unable to initialize TxnManager: Error creating table kudu_system.kudu_transactions on the master: not enough live tablet servers to create a table with the requested replication factor 3; 0 tablet servers are alive: unable to init TxnManager, will retry in 1.000s
I20260812 06:37:00.741622  6956 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu
/tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786516615841258-6956-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786516615841258-6956-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786516615841258-6956-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786516615841258-6956-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.203.1:0
--local_ip_for_outbound_sockets=127.6.203.1
--webserver_interface=127.6.203.1
--webserver_port=0
--tserver_master_addrs=127.6.203.62:38593
--builtin_ntp_servers=127.6.203.20:39383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--txn_keepalive_interval_ms=500
--txn_staleness_tracker_interval_ms=100
--txn_staleness_tracker_disabled_interval_ms=100
--raft_heartbeat_interval_ms=50
--leader_failure_max_missed_heartbeat_periods=1.25
--enable_txn_system_client_init=true
--txn_schedule_background_tasks=false with env {}
W20260812 06:37:00.853401  8358 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:00.853680  8358 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:00.853755  8358 flags.cc:432] Enabled unsafe flag: --txn_schedule_background_tasks=false
W20260812 06:37:00.853845  8358 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:00.857297  8358 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:00.857453  8358 flags.cc:432] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 06:37:00.857498  8358 flags.cc:432] Enabled experimental flag: --txn_staleness_tracker_interval_ms=100
W20260812 06:37:00.857532  8358 flags.cc:432] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 06:37:00.857614  8358 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.203.1
I20260812 06:37:00.861910  8358 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786516615841258-6956-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.203.20:39383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1.25
--raft_heartbeat_interval_ms=50
--fs_data_dirs=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786516615841258-6956-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786516615841258-6956-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.203.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786516615841258-6956-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.6.203.1
--webserver_port=0
--txn_keepalive_interval_ms=500
--txn_schedule_background_tasks=false
--txn_staleness_tracker_interval_ms=100
--enable_txn_system_client_init=true
--tserver_master_addrs=127.6.203.62:38593
--txn_staleness_tracker_disabled_interval_ms=100
--never_fsync=true
--heap_profile_path=/tmp/kudu.8358
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.203.1

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:00.863152  8358 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:00.864336  8358 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 06:37:00.867110  8358 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 06:37:00.871311  8365 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:00.871280  8371 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:00.871424  8358 server_base.cc:1061] running on GCE node
W20260812 06:37:00.871534  8368 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:00.871932  8358 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:00.872550  8358 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:00.873749  8358 hybrid_clock.cc:648] HybridClock initialized: now 1786516620873721 us; error 42 us; skew 500 ppm
I20260812 06:37:00.875681  8358 webserver.cc:533] Webserver started at http://127.6.203.1:35411/ using document root <none> and password file <none>
I20260812 06:37:00.876325  8358 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:00.876412  8358 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:00.876616  8358 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:37:00.878347  8358 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786516615841258-6956-0/minicluster-data/ts-0/data/instance:
uuid: "2013d696feda4a38ae3b18dd371b43ca"
format_stamp: "Formatted at 2026-08-12 06:37:00 on dist-test-slave-z8x9"
I20260812 06:37:00.878836  8358 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786516615841258-6956-0/minicluster-data/ts-0/wal/instance:
uuid: "2013d696feda4a38ae3b18dd371b43ca"
format_stamp: "Formatted at 2026-08-12 06:37:00 on dist-test-slave-z8x9"
I20260812 06:37:00.882360  8358 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260812 06:37:00.884680  8386 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:00.885854  8358 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260812 06:37:00.886005  8358 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786516615841258-6956-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786516615841258-6956-0/minicluster-data/ts-0/wal
uuid: "2013d696feda4a38ae3b18dd371b43ca"
format_stamp: "Formatted at 2026-08-12 06:37:00 on dist-test-slave-z8x9"
I20260812 06:37:00.886118  8358 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786516615841258-6956-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786516615841258-6956-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786516615841258-6956-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:00.899364  8358 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:00.900159  8358 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:00.900370  8358 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:00.902350  8358 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:37:00.902420  8358 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:00.902479  8358 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:37:00.902506  8358 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:00.914976  8358 rpc_server.cc:307] RPC server started. Bound to: 127.6.203.1:39563
I20260812 06:37:00.915000  8616 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.203.1:39563 every 8 connection(s)
I20260812 06:37:00.916162  8358 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786516615841258-6956-0/minicluster-data/ts-0/data/info.pb
I20260812 06:37:00.918956  6956 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu as pid 8358
I20260812 06:37:00.918923  8618 heartbeater.cc:344] Connected to a master server at 127.6.203.62:38593
I20260812 06:37:00.919085  6956 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786516615841258-6956-0/minicluster-data/ts-0/wal/instance
I20260812 06:37:00.919265  8618 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:00.920017  8618 heartbeater.cc:507] Master 127.6.203.62:38593 requested a full tablet report, sending...
I20260812 06:37:00.921458  6956 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu
/tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786516615841258-6956-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786516615841258-6956-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786516615841258-6956-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786516615841258-6956-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.203.2:0
--local_ip_for_outbound_sockets=127.6.203.2
--webserver_interface=127.6.203.2
--webserver_port=0
--tserver_master_addrs=127.6.203.62:38593
--builtin_ntp_servers=127.6.203.20:39383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--txn_keepalive_interval_ms=500
--txn_staleness_tracker_interval_ms=100
--txn_staleness_tracker_disabled_interval_ms=100
--raft_heartbeat_interval_ms=50
--leader_failure_max_missed_heartbeat_periods=1.25
--enable_txn_system_client_init=true
--txn_schedule_background_tasks=false with env {}
I20260812 06:37:00.921722  8213 ts_manager.cc:194] Registered new tserver with Master: 2013d696feda4a38ae3b18dd371b43ca (127.6.203.1:39563)
I20260812 06:37:00.922910  8213 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.6.203.1:60557
W20260812 06:37:01.038885  8620 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:01.039168  8620 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:01.039250  8620 flags.cc:432] Enabled unsafe flag: --txn_schedule_background_tasks=false
W20260812 06:37:01.039345  8620 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:01.042876  8620 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:01.043037  8620 flags.cc:432] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 06:37:01.043105  8620 flags.cc:432] Enabled experimental flag: --txn_staleness_tracker_interval_ms=100
W20260812 06:37:01.043141  8620 flags.cc:432] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 06:37:01.043212  8620 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.203.2
I20260812 06:37:01.047403  8620 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786516615841258-6956-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.203.20:39383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1.25
--raft_heartbeat_interval_ms=50
--fs_data_dirs=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786516615841258-6956-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786516615841258-6956-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.203.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786516615841258-6956-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.6.203.2
--webserver_port=0
--txn_keepalive_interval_ms=500
--txn_schedule_background_tasks=false
--txn_staleness_tracker_interval_ms=100
--enable_txn_system_client_init=true
--tserver_master_addrs=127.6.203.62:38593
--txn_staleness_tracker_disabled_interval_ms=100
--never_fsync=true
--heap_profile_path=/tmp/kudu.8620
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.203.2

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:01.048595  8620 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:01.049798  8620 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 06:37:01.052855  8620 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 06:37:01.057106  8628 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:01.057111  8626 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:01.057440  8631 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:01.057610  8620 server_base.cc:1061] running on GCE node
I20260812 06:37:01.058022  8620 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:01.059020  8620 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:01.060227  8620 hybrid_clock.cc:648] HybridClock initialized: now 1786516621060214 us; error 57 us; skew 500 ppm
I20260812 06:37:01.062248  8620 webserver.cc:533] Webserver started at http://127.6.203.2:35065/ using document root <none> and password file <none>
I20260812 06:37:01.062860  8620 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:01.062919  8620 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:01.063129  8620 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:37:01.064739  8620 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786516615841258-6956-0/minicluster-data/ts-1/data/instance:
uuid: "f1afd50594e843e9b73ea0660340ce76"
format_stamp: "Formatted at 2026-08-12 06:37:01 on dist-test-slave-z8x9"
I20260812 06:37:01.065284  8620 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786516615841258-6956-0/minicluster-data/ts-1/wal/instance:
uuid: "f1afd50594e843e9b73ea0660340ce76"
format_stamp: "Formatted at 2026-08-12 06:37:01 on dist-test-slave-z8x9"
I20260812 06:37:01.069141  8620 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.000s
I20260812 06:37:01.071817  8643 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:01.073047  8620 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:37:01.073240  8620 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786516615841258-6956-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786516615841258-6956-0/minicluster-data/ts-1/wal
uuid: "f1afd50594e843e9b73ea0660340ce76"
format_stamp: "Formatted at 2026-08-12 06:37:01 on dist-test-slave-z8x9"
I20260812 06:37:01.073369  8620 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786516615841258-6956-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786516615841258-6956-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786516615841258-6956-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:01.101258  8620 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:01.102010  8620 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:01.102224  8620 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:01.104000  8620 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:37:01.104082  8620 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:01.104158  8620 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:37:01.104194  8620 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:01.116073  8620 rpc_server.cc:307] RPC server started. Bound to: 127.6.203.2:45201
I20260812 06:37:01.116144  8876 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.203.2:45201 every 8 connection(s)
I20260812 06:37:01.117028  8620 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786516615841258-6956-0/minicluster-data/ts-1/data/info.pb
I20260812 06:37:01.118539  8877 heartbeater.cc:344] Connected to a master server at 127.6.203.62:38593
I20260812 06:37:01.118742  8877 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:01.119339  8877 heartbeater.cc:507] Master 127.6.203.62:38593 requested a full tablet report, sending...
I20260812 06:37:01.120255  6956 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu as pid 8620
I20260812 06:37:01.120397  6956 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786516615841258-6956-0/minicluster-data/ts-1/wal/instance
I20260812 06:37:01.120447  8213 ts_manager.cc:194] Registered new tserver with Master: f1afd50594e843e9b73ea0660340ce76 (127.6.203.2:45201)
I20260812 06:37:01.121027  8213 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.6.203.2:45721
I20260812 06:37:01.122524  6956 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu
/tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786516615841258-6956-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786516615841258-6956-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786516615841258-6956-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786516615841258-6956-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.203.3:0
--local_ip_for_outbound_sockets=127.6.203.3
--webserver_interface=127.6.203.3
--webserver_port=0
--tserver_master_addrs=127.6.203.62:38593
--builtin_ntp_servers=127.6.203.20:39383
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--txn_keepalive_interval_ms=500
--txn_staleness_tracker_interval_ms=100
--txn_staleness_tracker_disabled_interval_ms=100
--raft_heartbeat_interval_ms=50
--leader_failure_max_missed_heartbeat_periods=1.25
--enable_txn_system_client_init=true
--txn_schedule_background_tasks=false with env {}
W20260812 06:37:01.242707  8880 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:01.242954  8880 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:01.243000  8880 flags.cc:432] Enabled unsafe flag: --txn_schedule_background_tasks=false
W20260812 06:37:01.243031  8880 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:01.246374  8880 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:01.246457  8880 flags.cc:432] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 06:37:01.246477  8880 flags.cc:432] Enabled experimental flag: --txn_staleness_tracker_interval_ms=100
W20260812 06:37:01.246493  8880 flags.cc:432] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 06:37:01.246536  8880 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.203.3
I20260812 06:37:01.250595  8880 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786516615841258-6956-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.203.20:39383
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1.25
--raft_heartbeat_interval_ms=50
--fs_data_dirs=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786516615841258-6956-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786516615841258-6956-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.203.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786516615841258-6956-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.6.203.3
--webserver_port=0
--txn_keepalive_interval_ms=500
--txn_schedule_background_tasks=false
--txn_staleness_tracker_interval_ms=100
--enable_txn_system_client_init=true
--tserver_master_addrs=127.6.203.62:38593
--txn_staleness_tracker_disabled_interval_ms=100
--never_fsync=true
--heap_profile_path=/tmp/kudu.8880
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.203.3

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:01.251663  8880 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:01.252735  8880 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 06:37:01.255517  8880 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 06:37:01.259385  8889 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:01.259399  8887 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:01.259451  8894 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:01.259639  8880 server_base.cc:1061] running on GCE node
I20260812 06:37:01.260061  8880 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:01.260632  8880 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:01.261818  8880 hybrid_clock.cc:648] HybridClock initialized: now 1786516621261807 us; error 27 us; skew 500 ppm
I20260812 06:37:01.263630  8880 webserver.cc:533] Webserver started at http://127.6.203.3:39011/ using document root <none> and password file <none>
I20260812 06:37:01.264225  8880 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:01.264315  8880 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:01.264539  8880 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:37:01.266319  8880 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786516615841258-6956-0/minicluster-data/ts-2/data/instance:
uuid: "fb10f48826554039b1ea6917ac672731"
format_stamp: "Formatted at 2026-08-12 06:37:01 on dist-test-slave-z8x9"
I20260812 06:37:01.266861  8880 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786516615841258-6956-0/minicluster-data/ts-2/wal/instance:
uuid: "fb10f48826554039b1ea6917ac672731"
format_stamp: "Formatted at 2026-08-12 06:37:01 on dist-test-slave-z8x9"
I20260812 06:37:01.270449  8880 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260812 06:37:01.272780  8907 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:01.273994  8880 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 06:37:01.274142  8880 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786516615841258-6956-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786516615841258-6956-0/minicluster-data/ts-2/wal
uuid: "fb10f48826554039b1ea6917ac672731"
format_stamp: "Formatted at 2026-08-12 06:37:01 on dist-test-slave-z8x9"
I20260812 06:37:01.274354  8880 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786516615841258-6956-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786516615841258-6956-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786516615841258-6956-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:01.299630  8880 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:01.300387  8880 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:01.300607  8880 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:01.302512  8880 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:37:01.302598  8880 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:01.302670  8880 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:37:01.302723  8880 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:01.315622  8880 rpc_server.cc:307] RPC server started. Bound to: 127.6.203.3:41269
I20260812 06:37:01.315649  9124 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.203.3:41269 every 8 connection(s)
I20260812 06:37:01.316681  8880 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786516615841258-6956-0/minicluster-data/ts-2/data/info.pb
I20260812 06:37:01.318835  9126 heartbeater.cc:344] Connected to a master server at 127.6.203.62:38593
I20260812 06:37:01.319041  9126 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:01.319542  9126 heartbeater.cc:507] Master 127.6.203.62:38593 requested a full tablet report, sending...
I20260812 06:37:01.320550  6956 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu as pid 8880
I20260812 06:37:01.320684  6956 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786516615841258-6956-0/minicluster-data/ts-2/wal/instance
I20260812 06:37:01.320672  8213 ts_manager.cc:194] Registered new tserver with Master: fb10f48826554039b1ea6917ac672731 (127.6.203.3:41269)
I20260812 06:37:01.321363  8213 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.6.203.3:53959
I20260812 06:37:01.323012  6956 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260812 06:37:01.765539  8213 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33808:
name: "kudu_system.kudu_transactions"
schema {
  columns {
    name: "txn_id"
    type: INT64
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "entry_type"
    type: INT8
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "identifier"
    type: STRING
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "metadata"
    type: STRING
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
  indirect_data: "<redacted>"""
}
partition_schema {
  range_schema {
    columns {
      name: "txn_id"
    }
  }
}
table_type: TXN_STATUS_TABLE
W20260812 06:37:01.766103  8213 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:37:01.781814  8990 tablet_service.cc:1511] Processing CreateTablet for tablet c2c0b0a683e6475a909ae7620a0c00bb (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=391da5b96de24928b95cb718c8c08d93]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 06:37:01.781806  8748 tablet_service.cc:1511] Processing CreateTablet for tablet c2c0b0a683e6475a909ae7620a0c00bb (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=391da5b96de24928b95cb718c8c08d93]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 06:37:01.782280  8484 tablet_service.cc:1511] Processing CreateTablet for tablet c2c0b0a683e6475a909ae7620a0c00bb (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=391da5b96de24928b95cb718c8c08d93]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 06:37:01.783051  8990 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2c0b0a683e6475a909ae7620a0c00bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:01.783061  8748 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2c0b0a683e6475a909ae7620a0c00bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:01.783227  8484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2c0b0a683e6475a909ae7620a0c00bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:01.788560  9167 tablet_bootstrap.cc:492] T c2c0b0a683e6475a909ae7620a0c00bb P fb10f48826554039b1ea6917ac672731: Bootstrap starting.
I20260812 06:37:01.789563  9170 tablet_bootstrap.cc:492] T c2c0b0a683e6475a909ae7620a0c00bb P f1afd50594e843e9b73ea0660340ce76: Bootstrap starting.
I20260812 06:37:01.791123  9167 tablet_bootstrap.cc:654] T c2c0b0a683e6475a909ae7620a0c00bb P fb10f48826554039b1ea6917ac672731: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:01.791776  9170 tablet_bootstrap.cc:654] T c2c0b0a683e6475a909ae7620a0c00bb P f1afd50594e843e9b73ea0660340ce76: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:01.791983  9167 log.cc:826] T c2c0b0a683e6475a909ae7620a0c00bb P fb10f48826554039b1ea6917ac672731: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:01.792564  9170 log.cc:826] T c2c0b0a683e6475a909ae7620a0c00bb P f1afd50594e843e9b73ea0660340ce76: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:01.792754  9169 tablet_bootstrap.cc:492] T c2c0b0a683e6475a909ae7620a0c00bb P 2013d696feda4a38ae3b18dd371b43ca: Bootstrap starting.
I20260812 06:37:01.794342  9170 tablet_bootstrap.cc:492] T c2c0b0a683e6475a909ae7620a0c00bb P f1afd50594e843e9b73ea0660340ce76: No bootstrap required, opened a new log
I20260812 06:37:01.794541  9170 ts_tablet_manager.cc:1403] T c2c0b0a683e6475a909ae7620a0c00bb P f1afd50594e843e9b73ea0660340ce76: Time spent bootstrapping tablet: real 0.005s	user 0.004s	sys 0.000s
I20260812 06:37:01.794948  9169 tablet_bootstrap.cc:654] T c2c0b0a683e6475a909ae7620a0c00bb P 2013d696feda4a38ae3b18dd371b43ca: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:01.795672  9169 log.cc:826] T c2c0b0a683e6475a909ae7620a0c00bb P 2013d696feda4a38ae3b18dd371b43ca: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:01.797552  9167 tablet_bootstrap.cc:492] T c2c0b0a683e6475a909ae7620a0c00bb P fb10f48826554039b1ea6917ac672731: No bootstrap required, opened a new log
I20260812 06:37:01.797587  9169 tablet_bootstrap.cc:492] T c2c0b0a683e6475a909ae7620a0c00bb P 2013d696feda4a38ae3b18dd371b43ca: No bootstrap required, opened a new log
I20260812 06:37:01.797789  9169 ts_tablet_manager.cc:1403] T c2c0b0a683e6475a909ae7620a0c00bb P 2013d696feda4a38ae3b18dd371b43ca: Time spent bootstrapping tablet: real 0.005s	user 0.004s	sys 0.000s
I20260812 06:37:01.797786  9167 ts_tablet_manager.cc:1403] T c2c0b0a683e6475a909ae7620a0c00bb P fb10f48826554039b1ea6917ac672731: Time spent bootstrapping tablet: real 0.009s	user 0.004s	sys 0.001s
I20260812 06:37:01.798318  9170 raft_consensus.cc:359] T c2c0b0a683e6475a909ae7620a0c00bb P f1afd50594e843e9b73ea0660340ce76 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb10f48826554039b1ea6917ac672731" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 41269 } } peers { permanent_uuid: "f1afd50594e843e9b73ea0660340ce76" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45201 } } peers { permanent_uuid: "2013d696feda4a38ae3b18dd371b43ca" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 39563 } }
I20260812 06:37:01.798553  9170 raft_consensus.cc:385] T c2c0b0a683e6475a909ae7620a0c00bb P f1afd50594e843e9b73ea0660340ce76 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:01.798622  9170 raft_consensus.cc:740] T c2c0b0a683e6475a909ae7620a0c00bb P f1afd50594e843e9b73ea0660340ce76 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1afd50594e843e9b73ea0660340ce76, State: Initialized, Role: FOLLOWER
I20260812 06:37:01.799101  9170 consensus_queue.cc:260] T c2c0b0a683e6475a909ae7620a0c00bb P f1afd50594e843e9b73ea0660340ce76 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb10f48826554039b1ea6917ac672731" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 41269 } } peers { permanent_uuid: "f1afd50594e843e9b73ea0660340ce76" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45201 } } peers { permanent_uuid: "2013d696feda4a38ae3b18dd371b43ca" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 39563 } }
I20260812 06:37:01.800060  9170 ts_tablet_manager.cc:1434] T c2c0b0a683e6475a909ae7620a0c00bb P f1afd50594e843e9b73ea0660340ce76: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260812 06:37:01.800539  8877 heartbeater.cc:499] Master 127.6.203.62:38593 was elected leader, sending a full tablet report...
I20260812 06:37:01.800698  9176 tablet_replica.cc:442] T c2c0b0a683e6475a909ae7620a0c00bb P f1afd50594e843e9b73ea0660340ce76: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb10f48826554039b1ea6917ac672731" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 41269 } } peers { permanent_uuid: "f1afd50594e843e9b73ea0660340ce76" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45201 } } peers { permanent_uuid: "2013d696feda4a38ae3b18dd371b43ca" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 39563 } } }
I20260812 06:37:01.800900  9176 tablet_replica.cc:445] T c2c0b0a683e6475a909ae7620a0c00bb P f1afd50594e843e9b73ea0660340ce76: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:37:01.800951  9169 raft_consensus.cc:359] T c2c0b0a683e6475a909ae7620a0c00bb P 2013d696feda4a38ae3b18dd371b43ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb10f48826554039b1ea6917ac672731" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 41269 } } peers { permanent_uuid: "f1afd50594e843e9b73ea0660340ce76" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45201 } } peers { permanent_uuid: "2013d696feda4a38ae3b18dd371b43ca" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 39563 } }
I20260812 06:37:01.801132  9169 raft_consensus.cc:385] T c2c0b0a683e6475a909ae7620a0c00bb P 2013d696feda4a38ae3b18dd371b43ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:01.801239  9169 raft_consensus.cc:740] T c2c0b0a683e6475a909ae7620a0c00bb P 2013d696feda4a38ae3b18dd371b43ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2013d696feda4a38ae3b18dd371b43ca, State: Initialized, Role: FOLLOWER
I20260812 06:37:01.801647  9169 consensus_queue.cc:260] T c2c0b0a683e6475a909ae7620a0c00bb P 2013d696feda4a38ae3b18dd371b43ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb10f48826554039b1ea6917ac672731" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 41269 } } peers { permanent_uuid: "f1afd50594e843e9b73ea0660340ce76" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45201 } } peers { permanent_uuid: "2013d696feda4a38ae3b18dd371b43ca" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 39563 } }
I20260812 06:37:01.801920  9167 raft_consensus.cc:359] T c2c0b0a683e6475a909ae7620a0c00bb P fb10f48826554039b1ea6917ac672731 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb10f48826554039b1ea6917ac672731" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 41269 } } peers { permanent_uuid: "f1afd50594e843e9b73ea0660340ce76" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45201 } } peers { permanent_uuid: "2013d696feda4a38ae3b18dd371b43ca" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 39563 } }
I20260812 06:37:01.802114  9167 raft_consensus.cc:385] T c2c0b0a683e6475a909ae7620a0c00bb P fb10f48826554039b1ea6917ac672731 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:01.802167  9167 raft_consensus.cc:740] T c2c0b0a683e6475a909ae7620a0c00bb P fb10f48826554039b1ea6917ac672731 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fb10f48826554039b1ea6917ac672731, State: Initialized, Role: FOLLOWER
I20260812 06:37:01.802289  8618 heartbeater.cc:499] Master 127.6.203.62:38593 was elected leader, sending a full tablet report...
I20260812 06:37:01.802805  9167 consensus_queue.cc:260] T c2c0b0a683e6475a909ae7620a0c00bb P fb10f48826554039b1ea6917ac672731 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb10f48826554039b1ea6917ac672731" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 41269 } } peers { permanent_uuid: "f1afd50594e843e9b73ea0660340ce76" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45201 } } peers { permanent_uuid: "2013d696feda4a38ae3b18dd371b43ca" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 39563 } }
I20260812 06:37:01.802934  9169 ts_tablet_manager.cc:1434] T c2c0b0a683e6475a909ae7620a0c00bb P 2013d696feda4a38ae3b18dd371b43ca: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.003s
I20260812 06:37:01.803653  9167 ts_tablet_manager.cc:1434] T c2c0b0a683e6475a909ae7620a0c00bb P fb10f48826554039b1ea6917ac672731: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260812 06:37:01.804075  9184 tablet_replica.cc:442] T c2c0b0a683e6475a909ae7620a0c00bb P fb10f48826554039b1ea6917ac672731: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb10f48826554039b1ea6917ac672731" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 41269 } } peers { permanent_uuid: "f1afd50594e843e9b73ea0660340ce76" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45201 } } peers { permanent_uuid: "2013d696feda4a38ae3b18dd371b43ca" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 39563 } } }
I20260812 06:37:01.804176  9184 tablet_replica.cc:445] T c2c0b0a683e6475a909ae7620a0c00bb P fb10f48826554039b1ea6917ac672731: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:37:01.804397  9126 heartbeater.cc:499] Master 127.6.203.62:38593 was elected leader, sending a full tablet report...
I20260812 06:37:01.805388  9177 tablet_replica.cc:442] T c2c0b0a683e6475a909ae7620a0c00bb P 2013d696feda4a38ae3b18dd371b43ca: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb10f48826554039b1ea6917ac672731" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 41269 } } peers { permanent_uuid: "f1afd50594e843e9b73ea0660340ce76" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45201 } } peers { permanent_uuid: "2013d696feda4a38ae3b18dd371b43ca" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 39563 } } }
I20260812 06:37:01.805500  9177 tablet_replica.cc:445] T c2c0b0a683e6475a909ae7620a0c00bb P 2013d696feda4a38ae3b18dd371b43ca: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:37:01.807799  9184 raft_consensus.cc:493] T c2c0b0a683e6475a909ae7620a0c00bb P fb10f48826554039b1ea6917ac672731 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:37:01.807964  9184 raft_consensus.cc:515] T c2c0b0a683e6475a909ae7620a0c00bb P fb10f48826554039b1ea6917ac672731 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb10f48826554039b1ea6917ac672731" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 41269 } } peers { permanent_uuid: "f1afd50594e843e9b73ea0660340ce76" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45201 } } peers { permanent_uuid: "2013d696feda4a38ae3b18dd371b43ca" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 39563 } }
I20260812 06:37:01.809000  9184 leader_election.cc:290] T c2c0b0a683e6475a909ae7620a0c00bb P fb10f48826554039b1ea6917ac672731 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1afd50594e843e9b73ea0660340ce76 (127.6.203.2:45201), 2013d696feda4a38ae3b18dd371b43ca (127.6.203.1:39563)
I20260812 06:37:01.814246  8525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c0b0a683e6475a909ae7620a0c00bb" candidate_uuid: "fb10f48826554039b1ea6917ac672731" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2013d696feda4a38ae3b18dd371b43ca" is_pre_election: true
I20260812 06:37:01.814234  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c0b0a683e6475a909ae7620a0c00bb" candidate_uuid: "fb10f48826554039b1ea6917ac672731" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1afd50594e843e9b73ea0660340ce76" is_pre_election: true
I20260812 06:37:01.814514  8783 raft_consensus.cc:2468] T c2c0b0a683e6475a909ae7620a0c00bb P f1afd50594e843e9b73ea0660340ce76 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fb10f48826554039b1ea6917ac672731 in term 0.
I20260812 06:37:01.814510  8525 raft_consensus.cc:2468] T c2c0b0a683e6475a909ae7620a0c00bb P 2013d696feda4a38ae3b18dd371b43ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fb10f48826554039b1ea6917ac672731 in term 0.
I20260812 06:37:01.814973  8913 leader_election.cc:304] T c2c0b0a683e6475a909ae7620a0c00bb P fb10f48826554039b1ea6917ac672731 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2013d696feda4a38ae3b18dd371b43ca, fb10f48826554039b1ea6917ac672731; no voters: 
I20260812 06:37:01.815317  9184 raft_consensus.cc:2804] T c2c0b0a683e6475a909ae7620a0c00bb P fb10f48826554039b1ea6917ac672731 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:37:01.815436  9184 raft_consensus.cc:493] T c2c0b0a683e6475a909ae7620a0c00bb P fb10f48826554039b1ea6917ac672731 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:37:01.815512  9184 raft_consensus.cc:3060] T c2c0b0a683e6475a909ae7620a0c00bb P fb10f48826554039b1ea6917ac672731 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:01.816766  9184 raft_consensus.cc:515] T c2c0b0a683e6475a909ae7620a0c00bb P fb10f48826554039b1ea6917ac672731 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb10f48826554039b1ea6917ac672731" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 41269 } } peers { permanent_uuid: "f1afd50594e843e9b73ea0660340ce76" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45201 } } peers { permanent_uuid: "2013d696feda4a38ae3b18dd371b43ca" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 39563 } }
I20260812 06:37:01.817569  9184 leader_election.cc:290] T c2c0b0a683e6475a909ae7620a0c00bb P fb10f48826554039b1ea6917ac672731 [CANDIDATE]: Term 1 election: Requested vote from peers f1afd50594e843e9b73ea0660340ce76 (127.6.203.2:45201), 2013d696feda4a38ae3b18dd371b43ca (127.6.203.1:39563)
I20260812 06:37:01.818177  8783 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c0b0a683e6475a909ae7620a0c00bb" candidate_uuid: "fb10f48826554039b1ea6917ac672731" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1afd50594e843e9b73ea0660340ce76"
W20260812 06:37:01.818250  9127 tablet.cc:2406] T c2c0b0a683e6475a909ae7620a0c00bb P fb10f48826554039b1ea6917ac672731: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:37:01.818325  8783 raft_consensus.cc:3060] T c2c0b0a683e6475a909ae7620a0c00bb P f1afd50594e843e9b73ea0660340ce76 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:01.818652  8525 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2c0b0a683e6475a909ae7620a0c00bb" candidate_uuid: "fb10f48826554039b1ea6917ac672731" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2013d696feda4a38ae3b18dd371b43ca"
I20260812 06:37:01.818806  8525 raft_consensus.cc:3060] T c2c0b0a683e6475a909ae7620a0c00bb P 2013d696feda4a38ae3b18dd371b43ca [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:01.819571  8783 raft_consensus.cc:2468] T c2c0b0a683e6475a909ae7620a0c00bb P f1afd50594e843e9b73ea0660340ce76 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb10f48826554039b1ea6917ac672731 in term 1.
I20260812 06:37:01.819911  8914 leader_election.cc:304] T c2c0b0a683e6475a909ae7620a0c00bb P fb10f48826554039b1ea6917ac672731 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f1afd50594e843e9b73ea0660340ce76, fb10f48826554039b1ea6917ac672731; no voters: 
I20260812 06:37:01.819960  8525 raft_consensus.cc:2468] T c2c0b0a683e6475a909ae7620a0c00bb P 2013d696feda4a38ae3b18dd371b43ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fb10f48826554039b1ea6917ac672731 in term 1.
I20260812 06:37:01.820231  9184 raft_consensus.cc:2804] T c2c0b0a683e6475a909ae7620a0c00bb P fb10f48826554039b1ea6917ac672731 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:37:01.820374  8601 generic_service.cc:175] {username='slave'} at 127.0.0.1:33234 changed flags via RPC: txn_staleness_tracker_interval_ms from '100' to '0'
I20260812 06:37:01.820480  9184 raft_consensus.cc:697] T c2c0b0a683e6475a909ae7620a0c00bb P fb10f48826554039b1ea6917ac672731 [term 1 LEADER]: Becoming Leader. State: Replica: fb10f48826554039b1ea6917ac672731, State: Running, Role: LEADER
I20260812 06:37:01.820791  9184 consensus_queue.cc:237] T c2c0b0a683e6475a909ae7620a0c00bb P fb10f48826554039b1ea6917ac672731 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb10f48826554039b1ea6917ac672731" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 41269 } } peers { permanent_uuid: "f1afd50594e843e9b73ea0660340ce76" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45201 } } peers { permanent_uuid: "2013d696feda4a38ae3b18dd371b43ca" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 39563 } }
I20260812 06:37:01.821807  8867 generic_service.cc:175] {username='slave'} at 127.0.0.1:32846 changed flags via RPC: txn_staleness_tracker_interval_ms from '100' to '0'
I20260812 06:37:01.823035  9116 generic_service.cc:175] {username='slave'} at 127.0.0.1:57522 changed flags via RPC: txn_staleness_tracker_interval_ms from '100' to '0'
I20260812 06:37:01.823210  9196 tablet_replica.cc:442] T c2c0b0a683e6475a909ae7620a0c00bb P fb10f48826554039b1ea6917ac672731: TxnStatusTablet state changed. Reason: New leader fb10f48826554039b1ea6917ac672731. Latest consensus state: current_term: 1 leader_uuid: "fb10f48826554039b1ea6917ac672731" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb10f48826554039b1ea6917ac672731" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 41269 } } peers { permanent_uuid: "f1afd50594e843e9b73ea0660340ce76" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45201 } } peers { permanent_uuid: "2013d696feda4a38ae3b18dd371b43ca" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 39563 } } }
I20260812 06:37:01.823359  9196 tablet_replica.cc:445] T c2c0b0a683e6475a909ae7620a0c00bb P fb10f48826554039b1ea6917ac672731: This TxnStatusTablet replica's current role is: LEADER
I20260812 06:37:01.823758  9199 txn_status_manager.cc:874] Waiting until node catch up with all replicated operations in previous term...
I20260812 06:37:01.823932  9199 txn_status_manager.cc:930] Loading transaction status metadata into memory...
I20260812 06:37:01.824858  8214 catalog_manager.cc:5719] T c2c0b0a683e6475a909ae7620a0c00bb P fb10f48826554039b1ea6917ac672731 reported cstate change: term changed from 0 to 1, leader changed from <none> to fb10f48826554039b1ea6917ac672731 (127.6.203.3). New cstate: current_term: 1 leader_uuid: "fb10f48826554039b1ea6917ac672731" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb10f48826554039b1ea6917ac672731" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 41269 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f1afd50594e843e9b73ea0660340ce76" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2013d696feda4a38ae3b18dd371b43ca" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 39563 } health_report { overall_health: UNKNOWN } } }
I20260812 06:37:01.861078  8525 raft_consensus.cc:1275] T c2c0b0a683e6475a909ae7620a0c00bb P 2013d696feda4a38ae3b18dd371b43ca [term 1 FOLLOWER]: Refusing update from remote peer fb10f48826554039b1ea6917ac672731: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:37:01.861110  8783 raft_consensus.cc:1275] T c2c0b0a683e6475a909ae7620a0c00bb P f1afd50594e843e9b73ea0660340ce76 [term 1 FOLLOWER]: Refusing update from remote peer fb10f48826554039b1ea6917ac672731: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:37:01.861780  9184 consensus_queue.cc:1048] T c2c0b0a683e6475a909ae7620a0c00bb P fb10f48826554039b1ea6917ac672731 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2013d696feda4a38ae3b18dd371b43ca" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 39563 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:37:01.861977  9196 consensus_queue.cc:1048] T c2c0b0a683e6475a909ae7620a0c00bb P fb10f48826554039b1ea6917ac672731 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1afd50594e843e9b73ea0660340ce76" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:37:01.865617  9176 tablet_replica.cc:442] T c2c0b0a683e6475a909ae7620a0c00bb P f1afd50594e843e9b73ea0660340ce76: TxnStatusTablet state changed. Reason: New leader fb10f48826554039b1ea6917ac672731. Latest consensus state: current_term: 1 leader_uuid: "fb10f48826554039b1ea6917ac672731" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb10f48826554039b1ea6917ac672731" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 41269 } } peers { permanent_uuid: "f1afd50594e843e9b73ea0660340ce76" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45201 } } peers { permanent_uuid: "2013d696feda4a38ae3b18dd371b43ca" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 39563 } } }
I20260812 06:37:01.865653  9177 tablet_replica.cc:442] T c2c0b0a683e6475a909ae7620a0c00bb P 2013d696feda4a38ae3b18dd371b43ca: TxnStatusTablet state changed. Reason: New leader fb10f48826554039b1ea6917ac672731. Latest consensus state: current_term: 1 leader_uuid: "fb10f48826554039b1ea6917ac672731" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb10f48826554039b1ea6917ac672731" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 41269 } } peers { permanent_uuid: "f1afd50594e843e9b73ea0660340ce76" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45201 } } peers { permanent_uuid: "2013d696feda4a38ae3b18dd371b43ca" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 39563 } } }
I20260812 06:37:01.865741  9176 tablet_replica.cc:445] T c2c0b0a683e6475a909ae7620a0c00bb P f1afd50594e843e9b73ea0660340ce76: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:37:01.865763  9177 tablet_replica.cc:445] T c2c0b0a683e6475a909ae7620a0c00bb P 2013d696feda4a38ae3b18dd371b43ca: This TxnStatusTablet replica's current role is: FOLLOWER
W20260812 06:37:01.868343  8879 tablet.cc:2406] T c2c0b0a683e6475a909ae7620a0c00bb P f1afd50594e843e9b73ea0660340ce76: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:37:01.868702  9196 tablet_replica.cc:442] T c2c0b0a683e6475a909ae7620a0c00bb P fb10f48826554039b1ea6917ac672731: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "fb10f48826554039b1ea6917ac672731" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb10f48826554039b1ea6917ac672731" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 41269 } } peers { permanent_uuid: "f1afd50594e843e9b73ea0660340ce76" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45201 } } peers { permanent_uuid: "2013d696feda4a38ae3b18dd371b43ca" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 39563 } } }
I20260812 06:37:01.868817  9196 tablet_replica.cc:445] T c2c0b0a683e6475a909ae7620a0c00bb P fb10f48826554039b1ea6917ac672731: This TxnStatusTablet replica's current role is: LEADER
I20260812 06:37:01.868777  9204 mvcc.cc:204] Tried to move back new op lower bound from 7317572083136634880 to 7317572082981216256. Current Snapshot: MvccSnapshot[applied={T|T < 7317572083136634880}]
I20260812 06:37:01.869952  9184 tablet_replica.cc:442] T c2c0b0a683e6475a909ae7620a0c00bb P fb10f48826554039b1ea6917ac672731: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "fb10f48826554039b1ea6917ac672731" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb10f48826554039b1ea6917ac672731" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 41269 } } peers { permanent_uuid: "f1afd50594e843e9b73ea0660340ce76" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45201 } } peers { permanent_uuid: "2013d696feda4a38ae3b18dd371b43ca" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 39563 } } }
I20260812 06:37:01.870069  9184 tablet_replica.cc:445] T c2c0b0a683e6475a909ae7620a0c00bb P fb10f48826554039b1ea6917ac672731: This TxnStatusTablet replica's current role is: LEADER
I20260812 06:37:01.871081  9176 tablet_replica.cc:442] T c2c0b0a683e6475a909ae7620a0c00bb P f1afd50594e843e9b73ea0660340ce76: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fb10f48826554039b1ea6917ac672731" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb10f48826554039b1ea6917ac672731" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 41269 } } peers { permanent_uuid: "f1afd50594e843e9b73ea0660340ce76" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45201 } } peers { permanent_uuid: "2013d696feda4a38ae3b18dd371b43ca" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 39563 } } }
I20260812 06:37:01.871192  9176 tablet_replica.cc:445] T c2c0b0a683e6475a909ae7620a0c00bb P f1afd50594e843e9b73ea0660340ce76: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:37:01.872505  9205 mvcc.cc:204] Tried to move back new op lower bound from 7317572083136634880 to 7317572082981216256. Current Snapshot: MvccSnapshot[applied={T|T < 7317572083136634880}]
I20260812 06:37:01.872617  9177 tablet_replica.cc:442] T c2c0b0a683e6475a909ae7620a0c00bb P 2013d696feda4a38ae3b18dd371b43ca: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "fb10f48826554039b1ea6917ac672731" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fb10f48826554039b1ea6917ac672731" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 41269 } } peers { permanent_uuid: "f1afd50594e843e9b73ea0660340ce76" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45201 } } peers { permanent_uuid: "2013d696feda4a38ae3b18dd371b43ca" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 39563 } } }
I20260812 06:37:01.872718  9177 tablet_replica.cc:445] T c2c0b0a683e6475a909ae7620a0c00bb P 2013d696feda4a38ae3b18dd371b43ca: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:37:03.377266  8601 generic_service.cc:175] {username='slave'} at 127.0.0.1:33234 changed flags via RPC: txn_staleness_tracker_interval_ms from '0' to '100'
I20260812 06:37:03.378371  8867 generic_service.cc:175] {username='slave'} at 127.0.0.1:32846 changed flags via RPC: txn_staleness_tracker_interval_ms from '0' to '100'
I20260812 06:37:03.379302  9116 generic_service.cc:175] {username='slave'} at 127.0.0.1:57522 changed flags via RPC: txn_staleness_tracker_interval_ms from '0' to '100'
I20260812 06:37:03.510813  8921 txn_status_manager.cc:1391] automatically aborted stale txn (ID 0) past 1.635s from last keepalive heartbeat (effective timeout is 0.500s)
I20260812 06:37:04.882571  6956 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu with pid 8358
I20260812 06:37:04.901489  6956 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu with pid 8620
I20260812 06:37:04.916097  6956 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu with pid 8880
I20260812 06:37:04.932859  6956 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu with pid 8150
2026-08-12T06:37:04Z chronyd exiting
[       OK ] TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime (4500 ms)
[ RUN      ] TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances
2026-08-12T06:37:04Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:37:04Z Disabled control of system clock
I20260812 06:37:04.977659  6956 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu
/tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.203.62:39207
--webserver_interface=127.6.203.62
--webserver_port=0
--builtin_ntp_servers=127.6.203.20:46485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.203.62:39207
--txn_manager_enabled=true
--txn_manager_lazily_initialized=false with env {}
W20260812 06:37:05.092971  9254 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:05.093290  9254 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:05.093346  9254 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:05.097379  9254 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:37:05.097461  9254 flags.cc:432] Enabled experimental flag: --txn_manager_enabled=true
W20260812 06:37:05.097482  9254 flags.cc:432] Enabled experimental flag: --txn_manager_lazily_initialized=false
W20260812 06:37:05.097501  9254 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:05.097522  9254 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:37:05.097543  9254 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:37:05.102849  9254 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.203.20:46485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.6.203.62:39207
--txn_manager_enabled=true
--txn_manager_lazily_initialized=false
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.203.62:39207
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.203.62
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.9254
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:05.104137  9254 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:05.105404  9254 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:37:05.111306  9267 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:05.111307  9263 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:05.111547  9254 server_base.cc:1061] running on GCE node
W20260812 06:37:05.111554  9264 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:05.112190  9254 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:05.113122  9254 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:05.114383  9254 hybrid_clock.cc:648] HybridClock initialized: now 1786516625114351 us; error 58 us; skew 500 ppm
I20260812 06:37:05.116647  9254 webserver.cc:533] Webserver started at http://127.6.203.62:38303/ using document root <none> and password file <none>
I20260812 06:37:05.117370  9254 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:05.117533  9254 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:05.117810  9254 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:37:05.119411  9254 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/master-0/data/instance:
uuid: "adda9ce7e85949768e5f784768ab23f9"
format_stamp: "Formatted at 2026-08-12 06:37:05 on dist-test-slave-z8x9"
I20260812 06:37:05.119932  9254 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/master-0/wal/instance:
uuid: "adda9ce7e85949768e5f784768ab23f9"
format_stamp: "Formatted at 2026-08-12 06:37:05 on dist-test-slave-z8x9"
I20260812 06:37:05.124068  9254 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.001s
I20260812 06:37:05.126675  9285 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:05.127745  9254 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260812 06:37:05.127926  9254 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/master-0/data,/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/master-0/wal
uuid: "adda9ce7e85949768e5f784768ab23f9"
format_stamp: "Formatted at 2026-08-12 06:37:05 on dist-test-slave-z8x9"
I20260812 06:37:05.128049  9254 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:05.142846  9254 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:05.143644  9254 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:05.144011  9254 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:05.154754  9254 rpc_server.cc:307] RPC server started. Bound to: 127.6.203.62:39207
I20260812 06:37:05.154862  9410 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.203.62:39207 every 8 connection(s)
I20260812 06:37:05.156363  9254 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/master-0/data/info.pb
I20260812 06:37:05.160547  9411 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:05.164644  6956 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu as pid 9254
I20260812 06:37:05.164816  6956 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/master-0/wal/instance
I20260812 06:37:05.167680  9411 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P adda9ce7e85949768e5f784768ab23f9: Bootstrap starting.
I20260812 06:37:05.170099  9411 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P adda9ce7e85949768e5f784768ab23f9: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:05.170887  9411 log.cc:826] T 00000000000000000000000000000000 P adda9ce7e85949768e5f784768ab23f9: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:05.172703  9411 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P adda9ce7e85949768e5f784768ab23f9: No bootstrap required, opened a new log
I20260812 06:37:05.175804  9411 raft_consensus.cc:359] T 00000000000000000000000000000000 P adda9ce7e85949768e5f784768ab23f9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "adda9ce7e85949768e5f784768ab23f9" member_type: VOTER last_known_addr { host: "127.6.203.62" port: 39207 } }
I20260812 06:37:05.176029  9411 raft_consensus.cc:385] T 00000000000000000000000000000000 P adda9ce7e85949768e5f784768ab23f9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:05.176117  9411 raft_consensus.cc:740] T 00000000000000000000000000000000 P adda9ce7e85949768e5f784768ab23f9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: adda9ce7e85949768e5f784768ab23f9, State: Initialized, Role: FOLLOWER
I20260812 06:37:05.176595  9411 consensus_queue.cc:260] T 00000000000000000000000000000000 P adda9ce7e85949768e5f784768ab23f9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "adda9ce7e85949768e5f784768ab23f9" member_type: VOTER last_known_addr { host: "127.6.203.62" port: 39207 } }
I20260812 06:37:05.176750  9411 raft_consensus.cc:399] T 00000000000000000000000000000000 P adda9ce7e85949768e5f784768ab23f9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:37:05.176837  9411 raft_consensus.cc:493] T 00000000000000000000000000000000 P adda9ce7e85949768e5f784768ab23f9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:37:05.176955  9411 raft_consensus.cc:3060] T 00000000000000000000000000000000 P adda9ce7e85949768e5f784768ab23f9 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:05.178041  9411 raft_consensus.cc:515] T 00000000000000000000000000000000 P adda9ce7e85949768e5f784768ab23f9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "adda9ce7e85949768e5f784768ab23f9" member_type: VOTER last_known_addr { host: "127.6.203.62" port: 39207 } }
I20260812 06:37:05.178495  9411 leader_election.cc:304] T 00000000000000000000000000000000 P adda9ce7e85949768e5f784768ab23f9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: adda9ce7e85949768e5f784768ab23f9; no voters: 
I20260812 06:37:05.178814  9411 leader_election.cc:290] T 00000000000000000000000000000000 P adda9ce7e85949768e5f784768ab23f9 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 06:37:05.178983  9419 raft_consensus.cc:2804] T 00000000000000000000000000000000 P adda9ce7e85949768e5f784768ab23f9 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:37:05.179236  9419 raft_consensus.cc:697] T 00000000000000000000000000000000 P adda9ce7e85949768e5f784768ab23f9 [term 1 LEADER]: Becoming Leader. State: Replica: adda9ce7e85949768e5f784768ab23f9, State: Running, Role: LEADER
I20260812 06:37:05.179526  9419 consensus_queue.cc:237] T 00000000000000000000000000000000 P adda9ce7e85949768e5f784768ab23f9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "adda9ce7e85949768e5f784768ab23f9" member_type: VOTER last_known_addr { host: "127.6.203.62" port: 39207 } }
I20260812 06:37:05.180003  9411 sys_catalog.cc:565] T 00000000000000000000000000000000 P adda9ce7e85949768e5f784768ab23f9 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:37:05.181365  9421 sys_catalog.cc:455] T 00000000000000000000000000000000 P adda9ce7e85949768e5f784768ab23f9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader adda9ce7e85949768e5f784768ab23f9. Latest consensus state: current_term: 1 leader_uuid: "adda9ce7e85949768e5f784768ab23f9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "adda9ce7e85949768e5f784768ab23f9" member_type: VOTER last_known_addr { host: "127.6.203.62" port: 39207 } } }
I20260812 06:37:05.181536  9421 sys_catalog.cc:458] T 00000000000000000000000000000000 P adda9ce7e85949768e5f784768ab23f9 [sys.catalog]: This master's current role is: LEADER
I20260812 06:37:05.181723  9420 sys_catalog.cc:455] T 00000000000000000000000000000000 P adda9ce7e85949768e5f784768ab23f9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "adda9ce7e85949768e5f784768ab23f9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "adda9ce7e85949768e5f784768ab23f9" member_type: VOTER last_known_addr { host: "127.6.203.62" port: 39207 } } }
I20260812 06:37:05.181861  9420 sys_catalog.cc:458] T 00000000000000000000000000000000 P adda9ce7e85949768e5f784768ab23f9 [sys.catalog]: This master's current role is: LEADER
I20260812 06:37:05.182411  9434 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 06:37:05.185156  9434 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 06:37:05.190747  9434 catalog_manager.cc:1383] Generated new cluster ID: 57757f31634442c4b88de030c7d9f5bb
I20260812 06:37:05.190836  9434 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 06:37:05.223029  9434 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 06:37:05.224021  9434 catalog_manager.cc:1540] Loading token signing keys...
I20260812 06:37:05.231323  9434 catalog_manager.cc:6092] T 00000000000000000000000000000000 P adda9ce7e85949768e5f784768ab23f9: Generated new TSK 0
I20260812 06:37:05.232077  9434 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 06:37:05.239739  6956 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu
/tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.203.1:0
--local_ip_for_outbound_sockets=127.6.203.1
--webserver_interface=127.6.203.1
--webserver_port=0
--tserver_master_addrs=127.6.203.62:39207
--builtin_ntp_servers=127.6.203.20:46485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--txn_keepalive_interval_ms=500
--txn_staleness_tracker_interval_ms=100
--txn_staleness_tracker_disabled_interval_ms=100
--raft_heartbeat_interval_ms=50
--leader_failure_max_missed_heartbeat_periods=1.25
--enable_txn_system_client_init=true
--txn_schedule_background_tasks=false with env {}
I20260812 06:37:05.242673  9315 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48430:
name: "kudu_system.kudu_transactions"
schema {
  columns {
    name: "txn_id"
    type: INT64
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "entry_type"
    type: INT8
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "identifier"
    type: STRING
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "metadata"
    type: STRING
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
  indirect_data: "<redacted>"""
}
partition_schema {
  range_schema {
    columns {
      name: "txn_id"
    }
  }
}
table_type: TXN_STATUS_TABLE
W20260812 06:37:05.246260  9411 master.cc:465] Invalid argument: unable to initialize TxnManager: Error creating table kudu_system.kudu_transactions on the master: not enough live tablet servers to create a table with the requested replication factor 3; 0 tablet servers are alive: unable to init TxnManager, will retry in 1.000s
W20260812 06:37:05.367146  9465 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:05.367394  9465 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:05.367439  9465 flags.cc:432] Enabled unsafe flag: --txn_schedule_background_tasks=false
W20260812 06:37:05.367470  9465 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:05.371109  9465 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:05.371209  9465 flags.cc:432] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 06:37:05.371229  9465 flags.cc:432] Enabled experimental flag: --txn_staleness_tracker_interval_ms=100
W20260812 06:37:05.371273  9465 flags.cc:432] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 06:37:05.371379  9465 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.203.1
I20260812 06:37:05.375607  9465 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.203.20:46485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1.25
--raft_heartbeat_interval_ms=50
--fs_data_dirs=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.203.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.6.203.1
--webserver_port=0
--txn_keepalive_interval_ms=500
--txn_schedule_background_tasks=false
--txn_staleness_tracker_interval_ms=100
--enable_txn_system_client_init=true
--tserver_master_addrs=127.6.203.62:39207
--txn_staleness_tracker_disabled_interval_ms=100
--never_fsync=true
--heap_profile_path=/tmp/kudu.9465
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.203.1

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:05.376804  9465 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:05.378000  9465 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 06:37:05.380875  9465 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 06:37:05.385924  9472 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:05.386018  9480 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:05.386051  9477 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:05.386399  9465 server_base.cc:1061] running on GCE node
I20260812 06:37:05.386838  9465 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:05.387392  9465 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:05.388592  9465 hybrid_clock.cc:648] HybridClock initialized: now 1786516625388576 us; error 28 us; skew 500 ppm
I20260812 06:37:05.390717  9465 webserver.cc:533] Webserver started at http://127.6.203.1:35707/ using document root <none> and password file <none>
I20260812 06:37:05.391427  9465 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:05.391516  9465 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:05.391753  9465 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:37:05.393460  9465 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-0/data/instance:
uuid: "1bd1bd41aa7c45c19c4e750d8e81124f"
format_stamp: "Formatted at 2026-08-12 06:37:05 on dist-test-slave-z8x9"
I20260812 06:37:05.393976  9465 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-0/wal/instance:
uuid: "1bd1bd41aa7c45c19c4e750d8e81124f"
format_stamp: "Formatted at 2026-08-12 06:37:05 on dist-test-slave-z8x9"
I20260812 06:37:05.397797  9465 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260812 06:37:05.400672  9489 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:05.402571  9465 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260812 06:37:05.402750  9465 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-0/wal
uuid: "1bd1bd41aa7c45c19c4e750d8e81124f"
format_stamp: "Formatted at 2026-08-12 06:37:05 on dist-test-slave-z8x9"
I20260812 06:37:05.402882  9465 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:05.417234  9465 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:05.417981  9465 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:05.418203  9465 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:05.419996  9465 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:37:05.420090  9465 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:05.420223  9465 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:37:05.420281  9465 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:05.432691  9465 rpc_server.cc:307] RPC server started. Bound to: 127.6.203.1:42589
I20260812 06:37:05.432824  9738 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.203.1:42589 every 8 connection(s)
I20260812 06:37:05.433786  9465 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-0/data/info.pb
I20260812 06:37:05.436539  9739 heartbeater.cc:344] Connected to a master server at 127.6.203.62:39207
I20260812 06:37:05.436744  9739 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:05.437810  9739 heartbeater.cc:507] Master 127.6.203.62:39207 requested a full tablet report, sending...
I20260812 06:37:05.438498  6956 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu as pid 9465
I20260812 06:37:05.438632  6956 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-0/wal/instance
I20260812 06:37:05.440054  9315 ts_manager.cc:194] Registered new tserver with Master: 1bd1bd41aa7c45c19c4e750d8e81124f (127.6.203.1:42589)
I20260812 06:37:05.441284  6956 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu
/tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.203.2:0
--local_ip_for_outbound_sockets=127.6.203.2
--webserver_interface=127.6.203.2
--webserver_port=0
--tserver_master_addrs=127.6.203.62:39207
--builtin_ntp_servers=127.6.203.20:46485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--txn_keepalive_interval_ms=500
--txn_staleness_tracker_interval_ms=100
--txn_staleness_tracker_disabled_interval_ms=100
--raft_heartbeat_interval_ms=50
--leader_failure_max_missed_heartbeat_periods=1.25
--enable_txn_system_client_init=true
--txn_schedule_background_tasks=false with env {}
I20260812 06:37:05.441875  9315 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.6.203.1:44291
W20260812 06:37:05.558379  9745 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:05.558615  9745 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:05.558658  9745 flags.cc:432] Enabled unsafe flag: --txn_schedule_background_tasks=false
W20260812 06:37:05.558688  9745 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:05.562109  9745 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:05.562202  9745 flags.cc:432] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 06:37:05.562222  9745 flags.cc:432] Enabled experimental flag: --txn_staleness_tracker_interval_ms=100
W20260812 06:37:05.562242  9745 flags.cc:432] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 06:37:05.562283  9745 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.203.2
I20260812 06:37:05.566274  9745 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.203.20:46485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1.25
--raft_heartbeat_interval_ms=50
--fs_data_dirs=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.203.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.6.203.2
--webserver_port=0
--txn_keepalive_interval_ms=500
--txn_schedule_background_tasks=false
--txn_staleness_tracker_interval_ms=100
--enable_txn_system_client_init=true
--tserver_master_addrs=127.6.203.62:39207
--txn_staleness_tracker_disabled_interval_ms=100
--never_fsync=true
--heap_profile_path=/tmp/kudu.9745
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.203.2

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:05.567378  9745 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:05.568549  9745 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 06:37:05.571411  9745 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 06:37:05.576134  9767 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:05.576119  9760 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:05.576210  9745 server_base.cc:1061] running on GCE node
W20260812 06:37:05.576119  9756 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:05.577207  9745 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:05.577864  9745 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:05.579193  9745 hybrid_clock.cc:648] HybridClock initialized: now 1786516625579073 us; error 139 us; skew 500 ppm
I20260812 06:37:05.581389  9745 webserver.cc:533] Webserver started at http://127.6.203.2:33017/ using document root <none> and password file <none>
I20260812 06:37:05.582029  9745 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:05.582120  9745 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:05.582420  9745 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:37:05.584051  9745 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-1/data/instance:
uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5"
format_stamp: "Formatted at 2026-08-12 06:37:05 on dist-test-slave-z8x9"
I20260812 06:37:05.584555  9745 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-1/wal/instance:
uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5"
format_stamp: "Formatted at 2026-08-12 06:37:05 on dist-test-slave-z8x9"
I20260812 06:37:05.588070  9745 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.006s	sys 0.000s
I20260812 06:37:05.590525  9774 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:05.591614  9745 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260812 06:37:05.591763  9745 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-1/wal
uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5"
format_stamp: "Formatted at 2026-08-12 06:37:05 on dist-test-slave-z8x9"
I20260812 06:37:05.591879  9745 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:05.605383  9745 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:05.606256  9745 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:05.606487  9745 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:05.608269  9745 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:37:05.608345  9745 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:05.608419  9745 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:37:05.608464  9745 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:05.623862  9745 rpc_server.cc:307] RPC server started. Bound to: 127.6.203.2:45473
I20260812 06:37:05.623893 10023 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.203.2:45473 every 8 connection(s)
I20260812 06:37:05.625066  9745 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-1/data/info.pb
I20260812 06:37:05.627132 10024 heartbeater.cc:344] Connected to a master server at 127.6.203.62:39207
I20260812 06:37:05.627370 10024 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:05.627974 10024 heartbeater.cc:507] Master 127.6.203.62:39207 requested a full tablet report, sending...
I20260812 06:37:05.629168  9315 ts_manager.cc:194] Registered new tserver with Master: 9cd71e9bb1634fd4992bbc5a24f7a6f5 (127.6.203.2:45473)
I20260812 06:37:05.629695  6956 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu as pid 9745
I20260812 06:37:05.629842  6956 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-1/wal/instance
I20260812 06:37:05.629959  9315 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.6.203.2:44209
I20260812 06:37:05.632587  6956 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu
/tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.203.3:0
--local_ip_for_outbound_sockets=127.6.203.3
--webserver_interface=127.6.203.3
--webserver_port=0
--tserver_master_addrs=127.6.203.62:39207
--builtin_ntp_servers=127.6.203.20:46485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--txn_keepalive_interval_ms=500
--txn_staleness_tracker_interval_ms=100
--txn_staleness_tracker_disabled_interval_ms=100
--raft_heartbeat_interval_ms=50
--leader_failure_max_missed_heartbeat_periods=1.25
--enable_txn_system_client_init=true
--txn_schedule_background_tasks=false with env {}
W20260812 06:37:05.754302 10028 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:05.754555 10028 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:05.754599 10028 flags.cc:432] Enabled unsafe flag: --txn_schedule_background_tasks=false
W20260812 06:37:05.754690 10028 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:05.758446 10028 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:05.758556 10028 flags.cc:432] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 06:37:05.758576 10028 flags.cc:432] Enabled experimental flag: --txn_staleness_tracker_interval_ms=100
W20260812 06:37:05.758592 10028 flags.cc:432] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 06:37:05.758693 10028 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.203.3
I20260812 06:37:05.763134 10028 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.203.20:46485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1.25
--raft_heartbeat_interval_ms=50
--fs_data_dirs=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.203.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.6.203.3
--webserver_port=0
--txn_keepalive_interval_ms=500
--txn_schedule_background_tasks=false
--txn_staleness_tracker_interval_ms=100
--enable_txn_system_client_init=true
--tserver_master_addrs=127.6.203.62:39207
--txn_staleness_tracker_disabled_interval_ms=100
--never_fsync=true
--heap_profile_path=/tmp/kudu.10028
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.203.3

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:05.764395 10028 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:05.765882 10028 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 06:37:05.768857 10028 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 06:37:05.772650 10047 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:05.772670 10041 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:05.772660 10040 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:05.772984 10028 server_base.cc:1061] running on GCE node
I20260812 06:37:05.773428 10028 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:05.774058 10028 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:05.775238 10028 hybrid_clock.cc:648] HybridClock initialized: now 1786516625775218 us; error 33 us; skew 500 ppm
I20260812 06:37:05.777067 10028 webserver.cc:533] Webserver started at http://127.6.203.3:43995/ using document root <none> and password file <none>
I20260812 06:37:05.777714 10028 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:05.777818 10028 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:05.778048 10028 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:37:05.779655 10028 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-2/data/instance:
uuid: "abfe9e6137aa4ab5abe1df00f96278ae"
format_stamp: "Formatted at 2026-08-12 06:37:05 on dist-test-slave-z8x9"
I20260812 06:37:05.780172 10028 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-2/wal/instance:
uuid: "abfe9e6137aa4ab5abe1df00f96278ae"
format_stamp: "Formatted at 2026-08-12 06:37:05 on dist-test-slave-z8x9"
I20260812 06:37:05.783733 10028 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.006s	sys 0.000s
I20260812 06:37:05.786008 10058 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:05.787253 10028 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 06:37:05.787423 10028 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-2/wal
uuid: "abfe9e6137aa4ab5abe1df00f96278ae"
format_stamp: "Formatted at 2026-08-12 06:37:05 on dist-test-slave-z8x9"
I20260812 06:37:05.787534 10028 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:05.803848 10028 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:05.804605 10028 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:05.804822 10028 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:05.806532 10028 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:37:05.806617 10028 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:05.806687 10028 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:37:05.806728 10028 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:05.818845 10028 rpc_server.cc:307] RPC server started. Bound to: 127.6.203.3:46091
I20260812 06:37:05.818908 10307 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.203.3:46091 every 8 connection(s)
I20260812 06:37:05.820421 10028 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-2/data/info.pb
I20260812 06:37:05.822728 10311 heartbeater.cc:344] Connected to a master server at 127.6.203.62:39207
I20260812 06:37:05.823041 10311 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:05.823926 10311 heartbeater.cc:507] Master 127.6.203.62:39207 requested a full tablet report, sending...
I20260812 06:37:05.825438  9315 ts_manager.cc:194] Registered new tserver with Master: abfe9e6137aa4ab5abe1df00f96278ae (127.6.203.3:46091)
I20260812 06:37:05.826229  9315 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.6.203.3:42963
I20260812 06:37:05.830667  6956 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu as pid 10028
I20260812 06:37:05.830811  6956 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-2/wal/instance
I20260812 06:37:05.833452  6956 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260812 06:37:06.278551  9315 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48462:
name: "kudu_system.kudu_transactions"
schema {
  columns {
    name: "txn_id"
    type: INT64
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "entry_type"
    type: INT8
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "identifier"
    type: STRING
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "metadata"
    type: STRING
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
  indirect_data: "<redacted>"""
}
partition_schema {
  range_schema {
    columns {
      name: "txn_id"
    }
  }
}
table_type: TXN_STATUS_TABLE
W20260812 06:37:06.279138  9315 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:37:06.297289  9609 tablet_service.cc:1511] Processing CreateTablet for tablet b617582dd0f24339b52e664853e3bced (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=d41d881b16bb4d9296d6b3a06c1d9738]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 06:37:06.297681 10170 tablet_service.cc:1511] Processing CreateTablet for tablet b617582dd0f24339b52e664853e3bced (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=d41d881b16bb4d9296d6b3a06c1d9738]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 06:37:06.297678  9892 tablet_service.cc:1511] Processing CreateTablet for tablet b617582dd0f24339b52e664853e3bced (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=d41d881b16bb4d9296d6b3a06c1d9738]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 06:37:06.298498  9609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b617582dd0f24339b52e664853e3bced. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:06.298785 10170 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b617582dd0f24339b52e664853e3bced. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:06.298785  9892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b617582dd0f24339b52e664853e3bced. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:06.304600 10363 tablet_bootstrap.cc:492] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f: Bootstrap starting.
I20260812 06:37:06.305636 10365 tablet_bootstrap.cc:492] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5: Bootstrap starting.
I20260812 06:37:06.306305 10367 tablet_bootstrap.cc:492] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae: Bootstrap starting.
I20260812 06:37:06.307942 10363 tablet_bootstrap.cc:654] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:06.308444 10367 tablet_bootstrap.cc:654] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:06.308815 10363 log.cc:826] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:06.309219 10367 log.cc:826] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:06.311053 10367 tablet_bootstrap.cc:492] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae: No bootstrap required, opened a new log
I20260812 06:37:06.311269 10367 ts_tablet_manager.cc:1403] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae: Time spent bootstrapping tablet: real 0.005s	user 0.004s	sys 0.000s
I20260812 06:37:06.311380 10363 tablet_bootstrap.cc:492] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f: No bootstrap required, opened a new log
I20260812 06:37:06.311558 10363 ts_tablet_manager.cc:1403] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f: Time spent bootstrapping tablet: real 0.007s	user 0.002s	sys 0.002s
I20260812 06:37:06.314414 10365 tablet_bootstrap.cc:654] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:06.315085 10365 log.cc:826] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:06.315429 10363 raft_consensus.cc:359] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } }
I20260812 06:37:06.315429 10367 raft_consensus.cc:359] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } }
I20260812 06:37:06.315644 10367 raft_consensus.cc:385] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:06.315644 10363 raft_consensus.cc:385] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:06.315709 10367 raft_consensus.cc:740] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: abfe9e6137aa4ab5abe1df00f96278ae, State: Initialized, Role: FOLLOWER
I20260812 06:37:06.315719 10363 raft_consensus.cc:740] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bd1bd41aa7c45c19c4e750d8e81124f, State: Initialized, Role: FOLLOWER
I20260812 06:37:06.316196 10367 consensus_queue.cc:260] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } }
I20260812 06:37:06.316196 10363 consensus_queue.cc:260] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } }
I20260812 06:37:06.316869 10365 tablet_bootstrap.cc:492] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5: No bootstrap required, opened a new log
I20260812 06:37:06.317035 10367 ts_tablet_manager.cc:1434] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260812 06:37:06.317035 10363 ts_tablet_manager.cc:1434] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.001s
I20260812 06:37:06.317071 10365 ts_tablet_manager.cc:1403] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5: Time spent bootstrapping tablet: real 0.012s	user 0.004s	sys 0.000s
I20260812 06:37:06.317462  9739 heartbeater.cc:499] Master 127.6.203.62:39207 was elected leader, sending a full tablet report...
I20260812 06:37:06.317590 10382 tablet_replica.cc:442] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:06.317588 10377 tablet_replica.cc:442] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:06.317708 10377 tablet_replica.cc:445] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:37:06.317708 10382 tablet_replica.cc:445] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:37:06.317986 10311 heartbeater.cc:499] Master 127.6.203.62:39207 was elected leader, sending a full tablet report...
I20260812 06:37:06.320226 10365 raft_consensus.cc:359] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } }
I20260812 06:37:06.320449 10365 raft_consensus.cc:385] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:06.320508 10365 raft_consensus.cc:740] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cd71e9bb1634fd4992bbc5a24f7a6f5, State: Initialized, Role: FOLLOWER
I20260812 06:37:06.320959 10365 consensus_queue.cc:260] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } }
I20260812 06:37:06.321595 10024 heartbeater.cc:499] Master 127.6.203.62:39207 was elected leader, sending a full tablet report...
I20260812 06:37:06.321586 10383 tablet_replica.cc:442] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:06.321782 10383 tablet_replica.cc:445] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:37:06.321875 10365 ts_tablet_manager.cc:1434] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
W20260812 06:37:06.322239 10314 tablet.cc:2406] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:37:06.331384 10377 raft_consensus.cc:493] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:37:06.331614 10377 raft_consensus.cc:515] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } }
I20260812 06:37:06.332818 10377 leader_election.cc:290] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers abfe9e6137aa4ab5abe1df00f96278ae (127.6.203.3:46091), 9cd71e9bb1634fd4992bbc5a24f7a6f5 (127.6.203.2:45473)
I20260812 06:37:06.337821 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b617582dd0f24339b52e664853e3bced" candidate_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" is_pre_election: true
I20260812 06:37:06.338148 10197 raft_consensus.cc:2468] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1bd1bd41aa7c45c19c4e750d8e81124f in term 0.
I20260812 06:37:06.338584  9910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b617582dd0f24339b52e664853e3bced" candidate_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" is_pre_election: true
I20260812 06:37:06.338722  9493 leader_election.cc:304] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bd1bd41aa7c45c19c4e750d8e81124f, abfe9e6137aa4ab5abe1df00f96278ae; no voters: 
I20260812 06:37:06.338826  9910 raft_consensus.cc:2468] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1bd1bd41aa7c45c19c4e750d8e81124f in term 0.
I20260812 06:37:06.339015 10377 raft_consensus.cc:2804] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:37:06.339094 10377 raft_consensus.cc:493] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:37:06.339152 10377 raft_consensus.cc:3060] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:06.340416 10377 raft_consensus.cc:515] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } }
I20260812 06:37:06.340847 10377 leader_election.cc:290] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [CANDIDATE]: Term 1 election: Requested vote from peers abfe9e6137aa4ab5abe1df00f96278ae (127.6.203.3:46091), 9cd71e9bb1634fd4992bbc5a24f7a6f5 (127.6.203.2:45473)
I20260812 06:37:06.341259 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b617582dd0f24339b52e664853e3bced" candidate_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "abfe9e6137aa4ab5abe1df00f96278ae"
I20260812 06:37:06.341388 10197 raft_consensus.cc:3060] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:06.341456  9910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b617582dd0f24339b52e664853e3bced" candidate_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5"
I20260812 06:37:06.341598  9910 raft_consensus.cc:3060] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:06.342502 10197 raft_consensus.cc:2468] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bd1bd41aa7c45c19c4e750d8e81124f in term 1.
I20260812 06:37:06.342829  9910 raft_consensus.cc:2468] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bd1bd41aa7c45c19c4e750d8e81124f in term 1.
I20260812 06:37:06.343168  9493 leader_election.cc:304] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bd1bd41aa7c45c19c4e750d8e81124f, abfe9e6137aa4ab5abe1df00f96278ae; no voters: 
I20260812 06:37:06.343411 10377 raft_consensus.cc:2804] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:37:06.343641 10377 raft_consensus.cc:697] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 1 LEADER]: Becoming Leader. State: Replica: 1bd1bd41aa7c45c19c4e750d8e81124f, State: Running, Role: LEADER
I20260812 06:37:06.344038 10377 consensus_queue.cc:237] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } }
I20260812 06:37:06.346737 10405 tablet_replica.cc:442] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f: TxnStatusTablet state changed. Reason: New leader 1bd1bd41aa7c45c19c4e750d8e81124f. Latest consensus state: current_term: 1 leader_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:06.346861 10405 tablet_replica.cc:445] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f: This TxnStatusTablet replica's current role is: LEADER
I20260812 06:37:06.347127 10409 txn_status_manager.cc:874] Waiting until node catch up with all replicated operations in previous term...
I20260812 06:37:06.347349 10409 txn_status_manager.cc:930] Loading transaction status metadata into memory...
I20260812 06:37:06.347898  9314 catalog_manager.cc:5719] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f reported cstate change: term changed from 0 to 1, leader changed from <none> to 1bd1bd41aa7c45c19c4e750d8e81124f (127.6.203.1). New cstate: current_term: 1 leader_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } health_report { overall_health: UNKNOWN } } }
W20260812 06:37:06.376736 10026 tablet.cc:2406] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:37:06.377127 10197 raft_consensus.cc:1275] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 1 FOLLOWER]: Refusing update from remote peer 1bd1bd41aa7c45c19c4e750d8e81124f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:37:06.377206  9910 raft_consensus.cc:1275] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 1 FOLLOWER]: Refusing update from remote peer 1bd1bd41aa7c45c19c4e750d8e81124f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:37:06.377847 10377 consensus_queue.cc:1048] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [LEADER]: Connected to new peer: Peer: permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:37:06.378014 10405 consensus_queue.cc:1048] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:37:06.382539 10383 tablet_replica.cc:442] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5: TxnStatusTablet state changed. Reason: New leader 1bd1bd41aa7c45c19c4e750d8e81124f. Latest consensus state: current_term: 1 leader_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:06.382663 10383 tablet_replica.cc:445] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:37:06.382761 10382 tablet_replica.cc:442] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae: TxnStatusTablet state changed. Reason: New leader 1bd1bd41aa7c45c19c4e750d8e81124f. Latest consensus state: current_term: 1 leader_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:06.382875 10382 tablet_replica.cc:445] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:37:06.385397 10377 tablet_replica.cc:442] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:06.385525 10377 tablet_replica.cc:445] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f: This TxnStatusTablet replica's current role is: LEADER
I20260812 06:37:06.385644 10413 mvcc.cc:204] Tried to move back new op lower bound from 7317572101633765376 to 7317572101508583424. Current Snapshot: MvccSnapshot[applied={T|T < 7317572101633765376}]
I20260812 06:37:06.386130 10414 mvcc.cc:204] Tried to move back new op lower bound from 7317572101633765376 to 7317572101508583424. Current Snapshot: MvccSnapshot[applied={T|T < 7317572101633765376}]
I20260812 06:37:06.386245 10383 tablet_replica.cc:442] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:06.386329 10383 tablet_replica.cc:445] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:37:06.388490 10405 tablet_replica.cc:442] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:06.388604 10405 tablet_replica.cc:445] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f: This TxnStatusTablet replica's current role is: LEADER
I20260812 06:37:06.389704 10382 tablet_replica.cc:442] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:06.389809 10382 tablet_replica.cc:445] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:37:06.390903 10417 mvcc.cc:204] Tried to move back new op lower bound from 7317572101633765376 to 7317572101508583424. Current Snapshot: MvccSnapshot[applied={T|T < 7317572101633765376}]
I20260812 06:37:06.447825 10383 raft_consensus.cc:493] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1bd1bd41aa7c45c19c4e750d8e81124f)
W20260812 06:37:06.447978 10428 txn_status_manager-itest.cc:377] KeepTransactionAlive() returned non-OK status: Timed out: KeepTransactionAlive RPC to 127.6.203.62:39207 timed out after 0.050s (SENT)
I20260812 06:37:06.448040 10383 raft_consensus.cc:515] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } }
I20260812 06:37:06.449235 10383 leader_election.cc:290] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1bd1bd41aa7c45c19c4e750d8e81124f (127.6.203.1:42589), abfe9e6137aa4ab5abe1df00f96278ae (127.6.203.3:46091)
I20260812 06:37:06.451479 10382 raft_consensus.cc:493] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1bd1bd41aa7c45c19c4e750d8e81124f)
I20260812 06:37:06.451602 10382 raft_consensus.cc:515] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } }
I20260812 06:37:06.452694 10382 leader_election.cc:290] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1bd1bd41aa7c45c19c4e750d8e81124f (127.6.203.1:42589), 9cd71e9bb1634fd4992bbc5a24f7a6f5 (127.6.203.2:45473)
I20260812 06:37:06.453783 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b617582dd0f24339b52e664853e3bced" candidate_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" is_pre_election: true
I20260812 06:37:06.453974 10197 raft_consensus.cc:2468] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cd71e9bb1634fd4992bbc5a24f7a6f5 in term 1.
I20260812 06:37:06.454452  9777 leader_election.cc:304] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cd71e9bb1634fd4992bbc5a24f7a6f5, abfe9e6137aa4ab5abe1df00f96278ae; no voters: 
I20260812 06:37:06.454751 10383 raft_consensus.cc:2804] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 06:37:06.454833 10383 raft_consensus.cc:493] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1bd1bd41aa7c45c19c4e750d8e81124f)
I20260812 06:37:06.454878 10383 raft_consensus.cc:3060] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 1 FOLLOWER]: Advancing to term 2
W20260812 06:37:06.454804 10345 meta_cache.cc:302] tablet b617582dd0f24339b52e664853e3bced: replica 1bd1bd41aa7c45c19c4e750d8e81124f (127.6.203.1:42589) has failed: Timed out: CoordinateTransaction RPC to 127.6.203.1:42589 timed out after 0.050s (SENT)
W20260812 06:37:06.455174  9372 rpcz_store.cc:267] Call kudu.transactions.TxnManagerService.KeepTransactionAlive from 127.0.0.1:48476 (request call id 0) took 51 ms (client timeout 50 ms). Trace:
W20260812 06:37:06.455264  9372 rpcz_store.cc:269] 0812 06:37:06.403771 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 06:37:06.403839 (+    68us) service_pool.cc:224] Handling call
0812 06:37:06.455131 (+ 51292us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260812 06:37:06.456152 10383 raft_consensus.cc:515] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } }
I20260812 06:37:06.456595 10383 leader_election.cc:290] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [CANDIDATE]: Term 2 election: Requested vote from peers 1bd1bd41aa7c45c19c4e750d8e81124f (127.6.203.1:42589), abfe9e6137aa4ab5abe1df00f96278ae (127.6.203.3:46091)
I20260812 06:37:06.457027 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b617582dd0f24339b52e664853e3bced" candidate_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "abfe9e6137aa4ab5abe1df00f96278ae"
I20260812 06:37:06.457203 10197 raft_consensus.cc:3060] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 1 FOLLOWER]: Advancing to term 2
I20260812 06:37:06.457633  9910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b617582dd0f24339b52e664853e3bced" candidate_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" is_pre_election: true
I20260812 06:37:06.457809  9910 raft_consensus.cc:2393] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abfe9e6137aa4ab5abe1df00f96278ae in current term 2: Already voted for candidate 9cd71e9bb1634fd4992bbc5a24f7a6f5 in this term.
I20260812 06:37:06.458321 10197 raft_consensus.cc:2468] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cd71e9bb1634fd4992bbc5a24f7a6f5 in term 2.
I20260812 06:37:06.458631  9777 leader_election.cc:304] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cd71e9bb1634fd4992bbc5a24f7a6f5, abfe9e6137aa4ab5abe1df00f96278ae; no voters: 
I20260812 06:37:06.458809 10383 raft_consensus.cc:2804] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 06:37:06.459007 10383 raft_consensus.cc:697] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 2 LEADER]: Becoming Leader. State: Replica: 9cd71e9bb1634fd4992bbc5a24f7a6f5, State: Running, Role: LEADER
I20260812 06:37:06.459313 10383 consensus_queue.cc:237] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } }
I20260812 06:37:06.460363 10452 tablet_replica.cc:442] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5: TxnStatusTablet state changed. Reason: New leader 9cd71e9bb1634fd4992bbc5a24f7a6f5. Latest consensus state: current_term: 2 leader_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:06.460467 10452 tablet_replica.cc:445] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5: This TxnStatusTablet replica's current role is: LEADER
I20260812 06:37:06.460732 10454 txn_status_manager.cc:874] Waiting until node catch up with all replicated operations in previous term...
I20260812 06:37:06.460937 10454 txn_status_manager.cc:930] Loading transaction status metadata into memory...
I20260812 06:37:06.461647  9315 catalog_manager.cc:5719] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 reported cstate change: term changed from 1 to 2, leader changed from 1bd1bd41aa7c45c19c4e750d8e81124f (127.6.203.1) to 9cd71e9bb1634fd4992bbc5a24f7a6f5 (127.6.203.2). New cstate: current_term: 2 leader_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } health_report { overall_health: HEALTHY } } }
I20260812 06:37:06.516788 10197 raft_consensus.cc:1275] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 2 FOLLOWER]: Refusing update from remote peer 9cd71e9bb1634fd4992bbc5a24f7a6f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260812 06:37:06.517510 10452 consensus_queue.cc:1048] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 06:37:06.518617 10382 tablet_replica.cc:442] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae: TxnStatusTablet state changed. Reason: New leader 9cd71e9bb1634fd4992bbc5a24f7a6f5. Latest consensus state: current_term: 2 leader_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:06.518740 10382 tablet_replica.cc:445] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:37:06.520226 10383 tablet_replica.cc:442] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:06.520340 10383 tablet_replica.cc:445] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5: This TxnStatusTablet replica's current role is: LEADER
I20260812 06:37:06.521239 10382 tablet_replica.cc:442] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:06.521368 10382 tablet_replica.cc:445] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae: This TxnStatusTablet replica's current role is: FOLLOWER
W20260812 06:37:06.524042 10067 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: connection negotiation to 127.6.203.1:42589 for RPC RequestConsensusVote timed out after 0.071s (ON_OUTBOUND_QUEUE)
W20260812 06:37:06.530639  9779 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: connection negotiation to 127.6.203.1:42589 for RPC RequestConsensusVote timed out after 0.081s (ON_OUTBOUND_QUEUE)
W20260812 06:37:06.596098 10067 leader_election.cc:336] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1bd1bd41aa7c45c19c4e750d8e81124f (127.6.203.1:42589): Timed out: connection negotiation to 127.6.203.1:42589 for RPC RequestConsensusVote timed out after 0.071s (ON_OUTBOUND_QUEUE)
I20260812 06:37:06.596297 10067 leader_election.cc:304] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abfe9e6137aa4ab5abe1df00f96278ae; no voters: 1bd1bd41aa7c45c19c4e750d8e81124f, 9cd71e9bb1634fd4992bbc5a24f7a6f5
I20260812 06:37:06.596618 10382 raft_consensus.cc:2749] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260812 06:37:06.612892  9779 leader_election.cc:336] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1bd1bd41aa7c45c19c4e750d8e81124f (127.6.203.1:42589): Timed out: connection negotiation to 127.6.203.1:42589 for RPC RequestConsensusVote timed out after 0.081s (ON_OUTBOUND_QUEUE)
W20260812 06:37:06.619475  9779 leader_election.cc:336] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 1bd1bd41aa7c45c19c4e750d8e81124f (127.6.203.1:42589): Timed out: connection negotiation to 127.6.203.1:42589 for RPC RequestConsensusVote timed out after 0.081s (ON_OUTBOUND_QUEUE)
I20260812 06:37:07.414611  9910 raft_consensus.cc:1240] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 2 LEADER]: Rejecting Update request from peer 1bd1bd41aa7c45c19c4e750d8e81124f for earlier term 1. Current term is 2. Ops: []
I20260812 06:37:07.415066 10405 consensus_queue.cc:1059] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 3, Time since last communication: 0.000s
I20260812 06:37:07.415232 10405 consensus_queue.cc:1243] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [LEADER]: Peer 9cd71e9bb1634fd4992bbc5a24f7a6f5 log is divergent from this leader: its last log entry 2.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260812 06:37:07.415307 10405 raft_consensus.cc:3055] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 1 LEADER]: Stepping down as leader of term 1
I20260812 06:37:07.415344 10405 raft_consensus.cc:740] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1bd1bd41aa7c45c19c4e750d8e81124f, State: Running, Role: LEADER
I20260812 06:37:07.415496 10405 consensus_queue.cc:260] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } }
I20260812 06:37:07.415740 10405 raft_consensus.cc:3060] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 1 FOLLOWER]: Advancing to term 2
I20260812 06:37:07.418788 10197 raft_consensus.cc:1240] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 2 FOLLOWER]: Rejecting Update request from peer 1bd1bd41aa7c45c19c4e750d8e81124f for earlier term 1. Current term is 2. Ops: []
I20260812 06:37:07.423347  9636 raft_consensus.cc:1275] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 2 FOLLOWER]: Refusing update from remote peer 9cd71e9bb1634fd4992bbc5a24f7a6f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 3. (term mismatch)
I20260812 06:37:07.423460  9636 pending_rounds.cc:85] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f: Aborting all ops after (but not including) 2
I20260812 06:37:07.423519  9636 pending_rounds.cc:107] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f: Aborting uncommitted WRITE_OP operation due to leader change: 1.3
W20260812 06:37:07.423887  9505 txn_status_manager.cc:1397] failed to abort stale txn (ID 0) past 1.020s from last keepalive heartbeat (effective timeout is 0.500s): Aborted: Op aborted by new leader
I20260812 06:37:07.424018  9505 txn_status_manager.cc:1407] skipping staleness check for the rest of in-flight txn records since this txn status tablet replica is no longer a leader or not running
I20260812 06:37:07.424432 10383 consensus_queue.cc:1048] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 06:37:07.425927 10405 tablet_replica.cc:442] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f: TxnStatusTablet state changed. Reason: New leader 9cd71e9bb1634fd4992bbc5a24f7a6f5. Latest consensus state: current_term: 2 leader_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:07.425997 10377 tablet_replica.cc:442] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:07.426025 10405 tablet_replica.cc:445] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:37:07.426111 10377 tablet_replica.cc:445] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:37:07.483711 10383 tablet_replica.cc:442] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:07.483984 10383 tablet_replica.cc:445] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5: This TxnStatusTablet replica's current role is: LEADER
I20260812 06:37:08.464237 10482 raft_consensus.cc:493] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9cd71e9bb1634fd4992bbc5a24f7a6f5)
I20260812 06:37:08.464390 10482 raft_consensus.cc:515] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } }
I20260812 06:37:08.464933 10482 leader_election.cc:290] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1bd1bd41aa7c45c19c4e750d8e81124f (127.6.203.1:42589), 9cd71e9bb1634fd4992bbc5a24f7a6f5 (127.6.203.2:45473)
I20260812 06:37:08.465590  9636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b617582dd0f24339b52e664853e3bced" candidate_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" is_pre_election: true
I20260812 06:37:08.474493 10483 raft_consensus.cc:493] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 9cd71e9bb1634fd4992bbc5a24f7a6f5)
I20260812 06:37:08.474649 10483 raft_consensus.cc:515] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } }
I20260812 06:37:08.475138 10483 leader_election.cc:290] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers abfe9e6137aa4ab5abe1df00f96278ae (127.6.203.3:46091), 9cd71e9bb1634fd4992bbc5a24f7a6f5 (127.6.203.2:45473)
I20260812 06:37:08.475680 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b617582dd0f24339b52e664853e3bced" candidate_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" is_pre_election: true
I20260812 06:37:08.475806 10197 raft_consensus.cc:2468] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1bd1bd41aa7c45c19c4e750d8e81124f in term 2.
I20260812 06:37:08.476152  9493 leader_election.cc:304] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bd1bd41aa7c45c19c4e750d8e81124f, abfe9e6137aa4ab5abe1df00f96278ae; no voters: 
I20260812 06:37:08.476436 10483 raft_consensus.cc:2804] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 06:37:08.476505 10483 raft_consensus.cc:493] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 9cd71e9bb1634fd4992bbc5a24f7a6f5)
I20260812 06:37:08.476735 10483 raft_consensus.cc:3060] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 2 FOLLOWER]: Advancing to term 3
I20260812 06:37:08.477824 10483 raft_consensus.cc:515] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } }
I20260812 06:37:08.478264 10483 leader_election.cc:290] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [CANDIDATE]: Term 3 election: Requested vote from peers abfe9e6137aa4ab5abe1df00f96278ae (127.6.203.3:46091), 9cd71e9bb1634fd4992bbc5a24f7a6f5 (127.6.203.2:45473)
I20260812 06:37:08.478919 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b617582dd0f24339b52e664853e3bced" candidate_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "abfe9e6137aa4ab5abe1df00f96278ae"
I20260812 06:37:08.479046 10197 raft_consensus.cc:3060] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 2 FOLLOWER]: Advancing to term 3
I20260812 06:37:08.479809 10197 raft_consensus.cc:2468] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bd1bd41aa7c45c19c4e750d8e81124f in term 3.
I20260812 06:37:08.480141  9493 leader_election.cc:304] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bd1bd41aa7c45c19c4e750d8e81124f, abfe9e6137aa4ab5abe1df00f96278ae; no voters: 
I20260812 06:37:08.480370 10483 raft_consensus.cc:2804] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 3 FOLLOWER]: Leader election won for term 3
I20260812 06:37:08.480525 10483 raft_consensus.cc:697] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 3 LEADER]: Becoming Leader. State: Replica: 1bd1bd41aa7c45c19c4e750d8e81124f, State: Running, Role: LEADER
I20260812 06:37:08.480787 10483 consensus_queue.cc:237] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } }
I20260812 06:37:08.481554 10484 tablet_replica.cc:442] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f: TxnStatusTablet state changed. Reason: New leader 1bd1bd41aa7c45c19c4e750d8e81124f. Latest consensus state: current_term: 3 leader_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:08.481673 10484 tablet_replica.cc:445] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f: This TxnStatusTablet replica's current role is: LEADER
I20260812 06:37:08.481871 10487 txn_status_manager.cc:874] Waiting until node catch up with all replicated operations in previous term...
I20260812 06:37:08.481976 10487 txn_status_manager.cc:930] Loading transaction status metadata into memory...
I20260812 06:37:08.482676  9315 catalog_manager.cc:5719] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f reported cstate change: term changed from 2 to 3, leader changed from 9cd71e9bb1634fd4992bbc5a24f7a6f5 (127.6.203.2) to 1bd1bd41aa7c45c19c4e750d8e81124f (127.6.203.1). New cstate: current_term: 3 leader_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260812 06:37:08.533525 10197 raft_consensus.cc:1275] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 3 FOLLOWER]: Refusing update from remote peer 1bd1bd41aa7c45c19c4e750d8e81124f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260812 06:37:08.534030 10484 consensus_queue.cc:1048] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [LEADER]: Connected to new peer: Peer: permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260812 06:37:08.535346 10482 tablet_replica.cc:442] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae: TxnStatusTablet state changed. Reason: New leader 1bd1bd41aa7c45c19c4e750d8e81124f. Latest consensus state: current_term: 3 leader_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:08.535472 10482 tablet_replica.cc:445] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:37:08.536898 10483 tablet_replica.cc:442] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:08.537039 10483 tablet_replica.cc:445] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f: This TxnStatusTablet replica's current role is: LEADER
I20260812 06:37:08.537395 10482 tablet_replica.cc:442] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:08.537499 10482 tablet_replica.cc:445] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae: This TxnStatusTablet replica's current role is: FOLLOWER
W20260812 06:37:08.553603  9490 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.203.2:45473 timed out after 0.078s (SENT)
W20260812 06:37:08.556847 10428 txn_status_manager-itest.cc:377] KeepTransactionAlive() returned non-OK status: Timed out: KeepTransactionAlive RPC to 127.6.203.62:39207 timed out after 0.050s (SENT)
W20260812 06:37:08.557704 10340 meta_cache.cc:302] tablet b617582dd0f24339b52e664853e3bced: replica 9cd71e9bb1634fd4992bbc5a24f7a6f5 (127.6.203.2:45473) has failed: Timed out: CoordinateTransaction RPC to 127.6.203.2:45473 timed out after 0.050s (SENT)
W20260812 06:37:08.558009  9372 rpcz_store.cc:267] Call kudu.transactions.TxnManagerService.KeepTransactionAlive from 127.0.0.1:48476 (request call id 20) took 51 ms (client timeout 50 ms). Trace:
W20260812 06:37:08.558068  9372 rpcz_store.cc:269] 0812 06:37:08.506750 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 06:37:08.506864 (+   114us) service_pool.cc:224] Handling call
0812 06:37:08.557981 (+ 51117us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260812 06:37:08.622327 10061 leader_election.cc:336] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9cd71e9bb1634fd4992bbc5a24f7a6f5 (127.6.203.2:45473): Timed out: RequestConsensusVote RPC to 127.6.203.2:45473 timed out after 0.078s (SENT)
I20260812 06:37:08.622457 10061 leader_election.cc:304] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abfe9e6137aa4ab5abe1df00f96278ae; no voters: 1bd1bd41aa7c45c19c4e750d8e81124f, 9cd71e9bb1634fd4992bbc5a24f7a6f5
I20260812 06:37:08.622670 10482 raft_consensus.cc:2749] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260812 06:37:08.632615  9490 leader_election.cc:336] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 9cd71e9bb1634fd4992bbc5a24f7a6f5 (127.6.203.2:45473): Timed out: RequestConsensusVote RPC to 127.6.203.2:45473 timed out after 0.078s (SENT)
W20260812 06:37:08.646082  9490 leader_election.cc:336] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 9cd71e9bb1634fd4992bbc5a24f7a6f5 (127.6.203.2:45473): Timed out: RequestConsensusVote RPC to 127.6.203.2:45473 timed out after 0.083s (SENT)
I20260812 06:37:09.430441  9928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b617582dd0f24339b52e664853e3bced" candidate_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" is_pre_election: true
I20260812 06:37:09.430830  9919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b617582dd0f24339b52e664853e3bced" candidate_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5"
I20260812 06:37:09.430946  9910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b617582dd0f24339b52e664853e3bced" candidate_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" is_pre_election: true
I20260812 06:37:09.431116  9924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b617582dd0f24339b52e664853e3bced" candidate_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5"
I20260812 06:37:09.431357  9926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b617582dd0f24339b52e664853e3bced" candidate_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" is_pre_election: true
I20260812 06:37:09.431586  9922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b617582dd0f24339b52e664853e3bced" candidate_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" is_pre_election: true
I20260812 06:37:09.431975  9923 raft_consensus.cc:3055] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 2 LEADER]: Stepping down as leader of term 2
I20260812 06:37:09.432036  9923 raft_consensus.cc:740] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9cd71e9bb1634fd4992bbc5a24f7a6f5, State: Running, Role: LEADER
I20260812 06:37:09.432202  9923 consensus_queue.cc:260] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } }
I20260812 06:37:09.432335  9923 raft_consensus.cc:3060] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 2 FOLLOWER]: Advancing to term 3
I20260812 06:37:09.432674 10197 raft_consensus.cc:1240] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 3 FOLLOWER]: Rejecting Update request from peer 9cd71e9bb1634fd4992bbc5a24f7a6f5 for earlier term 2. Current term is 3. Ops: []
W20260812 06:37:09.433588  9789 txn_status_manager.cc:1397] failed to abort stale txn (ID 0) past 1.025s from last keepalive heartbeat (effective timeout is 0.500s): Illegal state: Cannot assign timestamp to op. Tablet is not in leader mode. Last heard from a leader: 0.001s ago.
I20260812 06:37:09.433712  9636 raft_consensus.cc:1240] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 3 LEADER]: Rejecting Update request from peer 9cd71e9bb1634fd4992bbc5a24f7a6f5 for earlier term 2. Current term is 3. Ops: []
I20260812 06:37:09.433604  9923 raft_consensus.cc:1275] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 3 FOLLOWER]: Refusing update from remote peer 1bd1bd41aa7c45c19c4e750d8e81124f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260812 06:37:09.434363  9789 txn_status_manager.cc:1407] skipping staleness check for the rest of in-flight txn records since this txn status tablet replica is no longer a leader or not running
I20260812 06:37:09.434818 10484 consensus_queue.cc:1048] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260812 06:37:09.435940 10383 tablet_replica.cc:442] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5: TxnStatusTablet state changed. Reason: New leader 1bd1bd41aa7c45c19c4e750d8e81124f. Latest consensus state: current_term: 3 leader_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:09.435968 10480 tablet_replica.cc:442] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:09.436048 10383 tablet_replica.cc:445] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:37:09.436058 10480 tablet_replica.cc:445] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:37:09.482069 10484 tablet_replica.cc:442] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:09.482328 10484 tablet_replica.cc:445] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f: This TxnStatusTablet replica's current role is: LEADER
I20260812 06:37:10.490204 10521 raft_consensus.cc:493] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1bd1bd41aa7c45c19c4e750d8e81124f)
I20260812 06:37:10.490391 10521 raft_consensus.cc:515] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } }
I20260812 06:37:10.490875 10521 leader_election.cc:290] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1bd1bd41aa7c45c19c4e750d8e81124f (127.6.203.1:42589), 9cd71e9bb1634fd4992bbc5a24f7a6f5 (127.6.203.2:45473)
I20260812 06:37:10.491441  9924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b617582dd0f24339b52e664853e3bced" candidate_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" is_pre_election: true
I20260812 06:37:10.505574 10523 raft_consensus.cc:493] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1bd1bd41aa7c45c19c4e750d8e81124f)
I20260812 06:37:10.505728 10523 raft_consensus.cc:515] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } }
I20260812 06:37:10.506179 10523 leader_election.cc:290] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1bd1bd41aa7c45c19c4e750d8e81124f (127.6.203.1:42589), abfe9e6137aa4ab5abe1df00f96278ae (127.6.203.3:46091)
I20260812 06:37:10.506721 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b617582dd0f24339b52e664853e3bced" candidate_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" is_pre_election: true
I20260812 06:37:10.506876 10197 raft_consensus.cc:2468] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cd71e9bb1634fd4992bbc5a24f7a6f5 in term 3.
I20260812 06:37:10.507298  9777 leader_election.cc:304] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cd71e9bb1634fd4992bbc5a24f7a6f5, abfe9e6137aa4ab5abe1df00f96278ae; no voters: 
I20260812 06:37:10.507567 10523 raft_consensus.cc:2804] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 06:37:10.507633 10523 raft_consensus.cc:493] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 1bd1bd41aa7c45c19c4e750d8e81124f)
I20260812 06:37:10.507670 10523 raft_consensus.cc:3060] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 3 FOLLOWER]: Advancing to term 4
I20260812 06:37:10.508633 10523 raft_consensus.cc:515] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } }
I20260812 06:37:10.509028 10523 leader_election.cc:290] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [CANDIDATE]: Term 4 election: Requested vote from peers 1bd1bd41aa7c45c19c4e750d8e81124f (127.6.203.1:42589), abfe9e6137aa4ab5abe1df00f96278ae (127.6.203.3:46091)
I20260812 06:37:10.509495 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b617582dd0f24339b52e664853e3bced" candidate_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "abfe9e6137aa4ab5abe1df00f96278ae"
I20260812 06:37:10.509626 10197 raft_consensus.cc:3060] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 3 FOLLOWER]: Advancing to term 4
I20260812 06:37:10.510607 10197 raft_consensus.cc:2468] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cd71e9bb1634fd4992bbc5a24f7a6f5 in term 4.
I20260812 06:37:10.510949  9777 leader_election.cc:304] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cd71e9bb1634fd4992bbc5a24f7a6f5, abfe9e6137aa4ab5abe1df00f96278ae; no voters: 
I20260812 06:37:10.511132 10523 raft_consensus.cc:2804] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 4 FOLLOWER]: Leader election won for term 4
I20260812 06:37:10.511297 10523 raft_consensus.cc:697] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 4 LEADER]: Becoming Leader. State: Replica: 9cd71e9bb1634fd4992bbc5a24f7a6f5, State: Running, Role: LEADER
I20260812 06:37:10.511468 10523 consensus_queue.cc:237] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } }
I20260812 06:37:10.512188 10526 tablet_replica.cc:442] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5: TxnStatusTablet state changed. Reason: New leader 9cd71e9bb1634fd4992bbc5a24f7a6f5. Latest consensus state: current_term: 4 leader_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:10.512306 10526 tablet_replica.cc:445] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5: This TxnStatusTablet replica's current role is: LEADER
I20260812 06:37:10.512482 10532 txn_status_manager.cc:874] Waiting until node catch up with all replicated operations in previous term...
I20260812 06:37:10.512588 10532 txn_status_manager.cc:930] Loading transaction status metadata into memory...
I20260812 06:37:10.513365  9314 catalog_manager.cc:5719] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 reported cstate change: term changed from 3 to 4, leader changed from 1bd1bd41aa7c45c19c4e750d8e81124f (127.6.203.1) to 9cd71e9bb1634fd4992bbc5a24f7a6f5 (127.6.203.2). New cstate: current_term: 4 leader_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } health_report { overall_health: HEALTHY } } }
W20260812 06:37:10.560438 10428 txn_status_manager-itest.cc:377] KeepTransactionAlive() returned non-OK status: Timed out: KeepTransactionAlive RPC to 127.6.203.62:39207 timed out after 0.050s (SENT)
W20260812 06:37:10.560771 10345 meta_cache.cc:302] tablet b617582dd0f24339b52e664853e3bced: replica 1bd1bd41aa7c45c19c4e750d8e81124f (127.6.203.1:42589) has failed: Timed out: CoordinateTransaction RPC to 127.6.203.1:42589 timed out after 0.050s (SENT)
W20260812 06:37:10.561378  9372 rpcz_store.cc:267] Call kudu.transactions.TxnManagerService.KeepTransactionAlive from 127.0.0.1:48476 (request call id 39) took 51 ms (client timeout 50 ms). Trace:
W20260812 06:37:10.561486  9372 rpcz_store.cc:269] 0812 06:37:10.509984 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 06:37:10.510097 (+   113us) service_pool.cc:224] Handling call
0812 06:37:10.561352 (+ 51255us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260812 06:37:10.573340 10197 raft_consensus.cc:1275] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 4 FOLLOWER]: Refusing update from remote peer 9cd71e9bb1634fd4992bbc5a24f7a6f5: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260812 06:37:10.573920 10526 consensus_queue.cc:1048] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260812 06:37:10.575129 10521 tablet_replica.cc:442] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae: TxnStatusTablet state changed. Reason: New leader 9cd71e9bb1634fd4992bbc5a24f7a6f5. Latest consensus state: current_term: 4 leader_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:10.575246 10521 tablet_replica.cc:445] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:37:10.576206 10523 tablet_replica.cc:442] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:10.576327 10523 tablet_replica.cc:445] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5: This TxnStatusTablet replica's current role is: LEADER
I20260812 06:37:10.576697 10521 tablet_replica.cc:442] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:10.576809 10521 tablet_replica.cc:445] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae: This TxnStatusTablet replica's current role is: FOLLOWER
W20260812 06:37:10.656704 10067 leader_election.cc:336] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1bd1bd41aa7c45c19c4e750d8e81124f (127.6.203.1:42589): Timed out: RequestConsensusVote RPC to 127.6.203.1:42589 timed out after 0.082s (SENT)
I20260812 06:37:10.656862 10067 leader_election.cc:304] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abfe9e6137aa4ab5abe1df00f96278ae; no voters: 1bd1bd41aa7c45c19c4e750d8e81124f, 9cd71e9bb1634fd4992bbc5a24f7a6f5
I20260812 06:37:10.657116 10521 raft_consensus.cc:2749] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260812 06:37:10.666029  9779 leader_election.cc:336] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1bd1bd41aa7c45c19c4e750d8e81124f (127.6.203.1:42589): Timed out: RequestConsensusVote RPC to 127.6.203.1:42589 timed out after 0.079s (SENT)
W20260812 06:37:10.674450  9779 leader_election.cc:336] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 1bd1bd41aa7c45c19c4e750d8e81124f (127.6.203.1:42589): Timed out: RequestConsensusVote RPC to 127.6.203.1:42589 timed out after 0.082s (SENT)
W20260812 06:37:11.455536  9490 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.6.203.2:45473, user_credentials={real_user=slave}} blocked reactor thread for 1.01231e+06us
I20260812 06:37:11.455763  9637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b617582dd0f24339b52e664853e3bced" candidate_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f"
I20260812 06:37:11.456015  9633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b617582dd0f24339b52e664853e3bced" candidate_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" is_pre_election: true
I20260812 06:37:11.456192  9632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b617582dd0f24339b52e664853e3bced" candidate_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" is_pre_election: true
I20260812 06:37:11.455607  9643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b617582dd0f24339b52e664853e3bced" candidate_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" is_pre_election: true
I20260812 06:37:11.456391  9639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b617582dd0f24339b52e664853e3bced" candidate_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f"
I20260812 06:37:11.456616  9636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b617582dd0f24339b52e664853e3bced" candidate_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" is_pre_election: true
I20260812 06:37:11.457213  9640 raft_consensus.cc:3055] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 3 LEADER]: Stepping down as leader of term 3
I20260812 06:37:11.457300  9640 raft_consensus.cc:740] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1bd1bd41aa7c45c19c4e750d8e81124f, State: Running, Role: LEADER
I20260812 06:37:11.457456  9640 consensus_queue.cc:260] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } }
I20260812 06:37:11.457623  9640 raft_consensus.cc:3060] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 3 FOLLOWER]: Advancing to term 4
I20260812 06:37:11.458989  9640 raft_consensus.cc:1275] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 4 FOLLOWER]: Refusing update from remote peer 9cd71e9bb1634fd4992bbc5a24f7a6f5: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260812 06:37:11.460043 10523 consensus_queue.cc:1048] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260812 06:37:11.461391 10511 tablet_replica.cc:442] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f: TxnStatusTablet state changed. Reason: New leader 9cd71e9bb1634fd4992bbc5a24f7a6f5. Latest consensus state: current_term: 4 leader_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:11.461493 10511 tablet_replica.cc:445] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:37:11.461578 10511 tablet_replica.cc:442] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:11.461625 10511 tablet_replica.cc:445] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f: This TxnStatusTablet replica's current role is: FOLLOWER
W20260812 06:37:11.461814  9505 txn_status_manager.cc:1397] failed to abort stale txn (ID 0) past 1.047s from last keepalive heartbeat (effective timeout is 0.500s): Illegal state: Cannot assign timestamp to op. Tablet is not in leader mode. Last heard from a leader: 0.004s ago.
I20260812 06:37:11.461907  9505 txn_status_manager.cc:1407] skipping staleness check for the rest of in-flight txn records since this txn status tablet replica is no longer a leader or not running
I20260812 06:37:11.463245 10197 raft_consensus.cc:1240] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 4 FOLLOWER]: Rejecting Update request from peer 1bd1bd41aa7c45c19c4e750d8e81124f for earlier term 3. Current term is 4. Ops: []
I20260812 06:37:11.519433 10523 tablet_replica.cc:442] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:11.519623 10523 tablet_replica.cc:445] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5: This TxnStatusTablet replica's current role is: LEADER
I20260812 06:37:12.471500 10565 raft_consensus.cc:493] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9cd71e9bb1634fd4992bbc5a24f7a6f5)
I20260812 06:37:12.471634 10565 raft_consensus.cc:515] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } }
I20260812 06:37:12.472147 10565 leader_election.cc:290] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1bd1bd41aa7c45c19c4e750d8e81124f (127.6.203.1:42589), 9cd71e9bb1634fd4992bbc5a24f7a6f5 (127.6.203.2:45473)
I20260812 06:37:12.472615  9640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b617582dd0f24339b52e664853e3bced" candidate_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" is_pre_election: true
I20260812 06:37:12.478178 10566 raft_consensus.cc:493] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 9cd71e9bb1634fd4992bbc5a24f7a6f5)
I20260812 06:37:12.478317 10566 raft_consensus.cc:515] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } }
I20260812 06:37:12.478931 10566 leader_election.cc:290] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers abfe9e6137aa4ab5abe1df00f96278ae (127.6.203.3:46091), 9cd71e9bb1634fd4992bbc5a24f7a6f5 (127.6.203.2:45473)
I20260812 06:37:12.479367 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b617582dd0f24339b52e664853e3bced" candidate_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" is_pre_election: true
I20260812 06:37:12.479501 10197 raft_consensus.cc:2468] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1bd1bd41aa7c45c19c4e750d8e81124f in term 4.
I20260812 06:37:12.479914  9493 leader_election.cc:304] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bd1bd41aa7c45c19c4e750d8e81124f, abfe9e6137aa4ab5abe1df00f96278ae; no voters: 
I20260812 06:37:12.480129 10566 raft_consensus.cc:2804] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 06:37:12.480206 10566 raft_consensus.cc:493] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 9cd71e9bb1634fd4992bbc5a24f7a6f5)
I20260812 06:37:12.480261 10566 raft_consensus.cc:3060] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 4 FOLLOWER]: Advancing to term 5
I20260812 06:37:12.481490 10566 raft_consensus.cc:515] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } }
I20260812 06:37:12.481935 10566 leader_election.cc:290] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [CANDIDATE]: Term 5 election: Requested vote from peers abfe9e6137aa4ab5abe1df00f96278ae (127.6.203.3:46091), 9cd71e9bb1634fd4992bbc5a24f7a6f5 (127.6.203.2:45473)
I20260812 06:37:12.482467 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b617582dd0f24339b52e664853e3bced" candidate_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "abfe9e6137aa4ab5abe1df00f96278ae"
I20260812 06:37:12.482616 10197 raft_consensus.cc:3060] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 4 FOLLOWER]: Advancing to term 5
I20260812 06:37:12.483464 10197 raft_consensus.cc:2468] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bd1bd41aa7c45c19c4e750d8e81124f in term 5.
I20260812 06:37:12.483832  9493 leader_election.cc:304] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bd1bd41aa7c45c19c4e750d8e81124f, abfe9e6137aa4ab5abe1df00f96278ae; no voters: 
I20260812 06:37:12.484086 10566 raft_consensus.cc:2804] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 5 FOLLOWER]: Leader election won for term 5
I20260812 06:37:12.484330 10566 raft_consensus.cc:697] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 5 LEADER]: Becoming Leader. State: Replica: 1bd1bd41aa7c45c19c4e750d8e81124f, State: Running, Role: LEADER
I20260812 06:37:12.484524 10566 consensus_queue.cc:237] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } }
I20260812 06:37:12.485369 10568 tablet_replica.cc:442] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f: TxnStatusTablet state changed. Reason: New leader 1bd1bd41aa7c45c19c4e750d8e81124f. Latest consensus state: current_term: 5 leader_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:12.485487 10568 tablet_replica.cc:445] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f: This TxnStatusTablet replica's current role is: LEADER
I20260812 06:37:12.485842 10572 txn_status_manager.cc:874] Waiting until node catch up with all replicated operations in previous term...
I20260812 06:37:12.485963 10572 txn_status_manager.cc:930] Loading transaction status metadata into memory...
I20260812 06:37:12.486622  9314 catalog_manager.cc:5719] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f reported cstate change: term changed from 4 to 5, leader changed from 9cd71e9bb1634fd4992bbc5a24f7a6f5 (127.6.203.2) to 1bd1bd41aa7c45c19c4e750d8e81124f (127.6.203.1). New cstate: current_term: 5 leader_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260812 06:37:12.548135 10197 raft_consensus.cc:1275] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 5 FOLLOWER]: Refusing update from remote peer 1bd1bd41aa7c45c19c4e750d8e81124f: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260812 06:37:12.548851 10568 consensus_queue.cc:1048] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [LEADER]: Connected to new peer: Peer: permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260812 06:37:12.550138 10565 tablet_replica.cc:442] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae: TxnStatusTablet state changed. Reason: New leader 1bd1bd41aa7c45c19c4e750d8e81124f. Latest consensus state: current_term: 5 leader_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:12.550259 10565 tablet_replica.cc:445] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:37:12.551303 10566 tablet_replica.cc:442] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 5 leader_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:12.551424 10566 tablet_replica.cc:445] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f: This TxnStatusTablet replica's current role is: LEADER
I20260812 06:37:12.551987 10565 tablet_replica.cc:442] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 5 leader_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:12.552084 10565 tablet_replica.cc:445] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae: This TxnStatusTablet replica's current role is: FOLLOWER
W20260812 06:37:12.555034 10061 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.203.2:45473 timed out after 0.082s (SENT) [suppressed 2 similar messages]
W20260812 06:37:12.556949 10428 txn_status_manager-itest.cc:377] KeepTransactionAlive() returned non-OK status: Timed out: KeepTransactionAlive RPC to 127.6.203.62:39207 timed out after 0.050s (SENT)
W20260812 06:37:12.557804 10340 meta_cache.cc:302] tablet b617582dd0f24339b52e664853e3bced: replica 9cd71e9bb1634fd4992bbc5a24f7a6f5 (127.6.203.2:45473) has failed: Timed out: CoordinateTransaction RPC to 127.6.203.2:45473 timed out after 0.050s (SENT)
W20260812 06:37:12.558058  9372 rpcz_store.cc:267] Call kudu.transactions.TxnManagerService.KeepTransactionAlive from 127.0.0.1:48476 (request call id 58) took 51 ms (client timeout 50 ms). Trace:
W20260812 06:37:12.558123  9372 rpcz_store.cc:269] 0812 06:37:12.506966 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 06:37:12.507062 (+    96us) service_pool.cc:224] Handling call
0812 06:37:12.558040 (+ 50978us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260812 06:37:12.621738  9490 leader_election.cc:336] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 9cd71e9bb1634fd4992bbc5a24f7a6f5 (127.6.203.2:45473): Timed out: RequestConsensusVote RPC to 127.6.203.2:45473 timed out after 0.069s (SENT)
W20260812 06:37:12.638005 10061 leader_election.cc:336] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9cd71e9bb1634fd4992bbc5a24f7a6f5 (127.6.203.2:45473): Timed out: RequestConsensusVote RPC to 127.6.203.2:45473 timed out after 0.082s (SENT)
I20260812 06:37:12.638126 10061 leader_election.cc:304] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abfe9e6137aa4ab5abe1df00f96278ae; no voters: 1bd1bd41aa7c45c19c4e750d8e81124f, 9cd71e9bb1634fd4992bbc5a24f7a6f5
I20260812 06:37:12.638366 10565 raft_consensus.cc:2749] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260812 06:37:12.650424  9490 leader_election.cc:336] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 9cd71e9bb1634fd4992bbc5a24f7a6f5 (127.6.203.2:45473): Timed out: RequestConsensusVote RPC to 127.6.203.2:45473 timed out after 0.085s (SENT)
I20260812 06:37:13.473827  9923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b617582dd0f24339b52e664853e3bced" candidate_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5"
I20260812 06:37:13.473959  9922 raft_consensus.cc:3055] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 4 LEADER]: Stepping down as leader of term 4
I20260812 06:37:13.474059  9922 raft_consensus.cc:740] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 9cd71e9bb1634fd4992bbc5a24f7a6f5, State: Running, Role: LEADER
I20260812 06:37:13.474222  9922 consensus_queue.cc:260] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } }
I20260812 06:37:13.474408  9919 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b617582dd0f24339b52e664853e3bced" candidate_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" is_pre_election: true
I20260812 06:37:13.473826  9910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b617582dd0f24339b52e664853e3bced" candidate_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" is_pre_election: true
I20260812 06:37:13.474900  9640 raft_consensus.cc:1240] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 5 LEADER]: Rejecting Update request from peer 9cd71e9bb1634fd4992bbc5a24f7a6f5 for earlier term 4. Current term is 5. Ops: []
I20260812 06:37:13.474417  9922 raft_consensus.cc:3060] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 4 FOLLOWER]: Advancing to term 5
I20260812 06:37:13.476302  9924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b617582dd0f24339b52e664853e3bced" candidate_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" is_pre_election: true
I20260812 06:37:13.476377  9922 raft_consensus.cc:1275] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 5 FOLLOWER]: Refusing update from remote peer 1bd1bd41aa7c45c19c4e750d8e81124f: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260812 06:37:13.476496  9928 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b617582dd0f24339b52e664853e3bced" candidate_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" is_pre_election: true
I20260812 06:37:13.476600  9928 raft_consensus.cc:2468] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abfe9e6137aa4ab5abe1df00f96278ae in term 5.
I20260812 06:37:13.476842  9926 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b617582dd0f24339b52e664853e3bced" candidate_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5"
I20260812 06:37:13.477186 10566 consensus_queue.cc:1048] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260812 06:37:13.477327  9789 txn_status_manager.cc:1397] failed to abort stale txn (ID 0) past 1.068s from last keepalive heartbeat (effective timeout is 0.500s): Illegal state: Cannot assign timestamp to op. Tablet is not in leader mode. Last heard from a leader: 0.001s ago.
I20260812 06:37:13.477981  9926 raft_consensus.cc:2468] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bd1bd41aa7c45c19c4e750d8e81124f in term 5.
I20260812 06:37:13.478700  9789 txn_status_manager.cc:1407] skipping staleness check for the rest of in-flight txn records since this txn status tablet replica is no longer a leader or not running
I20260812 06:37:13.478618 10523 tablet_replica.cc:442] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 5 leader_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:13.478830 10523 tablet_replica.cc:445] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:37:13.479475 10599 tablet_replica.cc:442] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5: TxnStatusTablet state changed. Reason: New leader 1bd1bd41aa7c45c19c4e750d8e81124f. Latest consensus state: current_term: 5 leader_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:13.479609 10599 tablet_replica.cc:445] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:37:13.537204 10604 tablet_replica.cc:442] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 5 leader_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:13.537428 10604 tablet_replica.cc:445] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f: This TxnStatusTablet replica's current role is: LEADER
I20260812 06:37:14.496026 10607 raft_consensus.cc:493] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1bd1bd41aa7c45c19c4e750d8e81124f)
I20260812 06:37:14.496177 10607 raft_consensus.cc:515] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } }
I20260812 06:37:14.496693 10607 leader_election.cc:290] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1bd1bd41aa7c45c19c4e750d8e81124f (127.6.203.1:42589), 9cd71e9bb1634fd4992bbc5a24f7a6f5 (127.6.203.2:45473)
I20260812 06:37:14.497244  9910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b617582dd0f24339b52e664853e3bced" candidate_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" is_pre_election: true
I20260812 06:37:14.522639 10608 raft_consensus.cc:493] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1bd1bd41aa7c45c19c4e750d8e81124f)
I20260812 06:37:14.522832 10608 raft_consensus.cc:515] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } }
I20260812 06:37:14.523602 10608 leader_election.cc:290] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1bd1bd41aa7c45c19c4e750d8e81124f (127.6.203.1:42589), abfe9e6137aa4ab5abe1df00f96278ae (127.6.203.3:46091)
I20260812 06:37:14.524166 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b617582dd0f24339b52e664853e3bced" candidate_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" is_pre_election: true
I20260812 06:37:14.524351 10197 raft_consensus.cc:2468] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cd71e9bb1634fd4992bbc5a24f7a6f5 in term 5.
I20260812 06:37:14.524780  9777 leader_election.cc:304] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cd71e9bb1634fd4992bbc5a24f7a6f5, abfe9e6137aa4ab5abe1df00f96278ae; no voters: 
I20260812 06:37:14.525022 10608 raft_consensus.cc:2804] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 06:37:14.525079 10608 raft_consensus.cc:493] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1bd1bd41aa7c45c19c4e750d8e81124f)
I20260812 06:37:14.525156 10608 raft_consensus.cc:3060] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 5 FOLLOWER]: Advancing to term 6
I20260812 06:37:14.526623 10608 raft_consensus.cc:515] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } }
I20260812 06:37:14.527175 10608 leader_election.cc:290] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [CANDIDATE]: Term 6 election: Requested vote from peers 1bd1bd41aa7c45c19c4e750d8e81124f (127.6.203.1:42589), abfe9e6137aa4ab5abe1df00f96278ae (127.6.203.3:46091)
I20260812 06:37:14.530375 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b617582dd0f24339b52e664853e3bced" candidate_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "abfe9e6137aa4ab5abe1df00f96278ae"
I20260812 06:37:14.530565 10197 raft_consensus.cc:3060] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 5 FOLLOWER]: Advancing to term 6
I20260812 06:37:14.532069 10197 raft_consensus.cc:2468] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cd71e9bb1634fd4992bbc5a24f7a6f5 in term 6.
I20260812 06:37:14.532609  9777 leader_election.cc:304] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9cd71e9bb1634fd4992bbc5a24f7a6f5, abfe9e6137aa4ab5abe1df00f96278ae; no voters: 
I20260812 06:37:14.532832 10608 raft_consensus.cc:2804] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 6 FOLLOWER]: Leader election won for term 6
I20260812 06:37:14.533030 10608 raft_consensus.cc:697] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 6 LEADER]: Becoming Leader. State: Replica: 9cd71e9bb1634fd4992bbc5a24f7a6f5, State: Running, Role: LEADER
I20260812 06:37:14.533245 10608 consensus_queue.cc:237] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } }
I20260812 06:37:14.534118 10609 tablet_replica.cc:442] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5: TxnStatusTablet state changed. Reason: New leader 9cd71e9bb1634fd4992bbc5a24f7a6f5. Latest consensus state: current_term: 6 leader_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:14.534216 10609 tablet_replica.cc:445] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5: This TxnStatusTablet replica's current role is: LEADER
I20260812 06:37:14.534389 10612 txn_status_manager.cc:874] Waiting until node catch up with all replicated operations in previous term...
I20260812 06:37:14.534499 10612 txn_status_manager.cc:930] Loading transaction status metadata into memory...
I20260812 06:37:14.535458  9315 catalog_manager.cc:5719] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 reported cstate change: term changed from 5 to 6, leader changed from 1bd1bd41aa7c45c19c4e750d8e81124f (127.6.203.1) to 9cd71e9bb1634fd4992bbc5a24f7a6f5 (127.6.203.2). New cstate: current_term: 6 leader_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } health_report { overall_health: HEALTHY } } }
W20260812 06:37:14.554795 10428 txn_status_manager-itest.cc:377] KeepTransactionAlive() returned non-OK status: Timed out: KeepTransactionAlive RPC to 127.6.203.62:39207 timed out after 0.050s (SENT)
W20260812 06:37:14.557682 10345 meta_cache.cc:302] tablet b617582dd0f24339b52e664853e3bced: replica 1bd1bd41aa7c45c19c4e750d8e81124f (127.6.203.1:42589) has failed: Timed out: CoordinateTransaction RPC to 127.6.203.1:42589 timed out after 0.050s (SENT)
W20260812 06:37:14.557996  9372 rpcz_store.cc:267] Call kudu.transactions.TxnManagerService.KeepTransactionAlive from 127.0.0.1:48476 (request call id 77) took 53 ms (client timeout 50 ms). Trace:
W20260812 06:37:14.558081  9372 rpcz_store.cc:269] 0812 06:37:14.504722 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 06:37:14.504793 (+    71us) service_pool.cc:224] Handling call
0812 06:37:14.557971 (+ 53178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260812 06:37:14.579303 10197 raft_consensus.cc:1275] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 6 FOLLOWER]: Refusing update from remote peer 9cd71e9bb1634fd4992bbc5a24f7a6f5: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260812 06:37:14.579870 10609 consensus_queue.cc:1048] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260812 06:37:14.581049 10607 tablet_replica.cc:442] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae: TxnStatusTablet state changed. Reason: New leader 9cd71e9bb1634fd4992bbc5a24f7a6f5. Latest consensus state: current_term: 6 leader_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:14.581200 10607 tablet_replica.cc:445] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:37:14.582104 10609 tablet_replica.cc:442] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 6 leader_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:14.582213 10609 tablet_replica.cc:445] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5: This TxnStatusTablet replica's current role is: LEADER
I20260812 06:37:14.583048 10607 tablet_replica.cc:442] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 6 leader_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:14.583148 10607 tablet_replica.cc:445] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae: This TxnStatusTablet replica's current role is: FOLLOWER
W20260812 06:37:14.587435  9779 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.6.203.1:42589 timed out after 0.063s (SENT) [suppressed 3 similar messages]
W20260812 06:37:14.640138 10067 leader_election.cc:336] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 1bd1bd41aa7c45c19c4e750d8e81124f (127.6.203.1:42589): Timed out: RequestConsensusVote RPC to 127.6.203.1:42589 timed out after 0.071s (SENT)
I20260812 06:37:14.640305 10067 leader_election.cc:304] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abfe9e6137aa4ab5abe1df00f96278ae; no voters: 1bd1bd41aa7c45c19c4e750d8e81124f, 9cd71e9bb1634fd4992bbc5a24f7a6f5
I20260812 06:37:14.640596 10607 raft_consensus.cc:2749] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260812 06:37:14.652266  9779 leader_election.cc:336] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 1bd1bd41aa7c45c19c4e750d8e81124f (127.6.203.1:42589): Timed out: RequestConsensusVote RPC to 127.6.203.1:42589 timed out after 0.063s (SENT)
W20260812 06:37:14.680696  9779 leader_election.cc:336] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 1bd1bd41aa7c45c19c4e750d8e81124f (127.6.203.1:42589): Timed out: RequestConsensusVote RPC to 127.6.203.1:42589 timed out after 0.076s (SENT)
I20260812 06:37:15.499771  9636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b617582dd0f24339b52e664853e3bced" candidate_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f"
I20260812 06:37:15.500010  9633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b617582dd0f24339b52e664853e3bced" candidate_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" is_pre_election: true
I20260812 06:37:15.500213  9637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b617582dd0f24339b52e664853e3bced" candidate_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" is_pre_election: true
I20260812 06:37:15.500268  9632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b617582dd0f24339b52e664853e3bced" candidate_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f"
I20260812 06:37:15.500463  9640 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b617582dd0f24339b52e664853e3bced" candidate_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" is_pre_election: true
I20260812 06:37:15.500491  9639 raft_consensus.cc:3055] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 5 LEADER]: Stepping down as leader of term 5
I20260812 06:37:15.500550  9639 raft_consensus.cc:740] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1bd1bd41aa7c45c19c4e750d8e81124f, State: Running, Role: LEADER
I20260812 06:37:15.500677  9639 consensus_queue.cc:260] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } }
I20260812 06:37:15.500720  9910 raft_consensus.cc:1240] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 6 LEADER]: Rejecting Update request from peer 1bd1bd41aa7c45c19c4e750d8e81124f for earlier term 5. Current term is 6. Ops: []
I20260812 06:37:15.500234  9643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b617582dd0f24339b52e664853e3bced" candidate_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" is_pre_election: true
I20260812 06:37:15.500774  9639 raft_consensus.cc:3060] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 5 FOLLOWER]: Advancing to term 6
W20260812 06:37:15.501920  9505 txn_status_manager.cc:1397] failed to abort stale txn (ID 0) past 1.096s from last keepalive heartbeat (effective timeout is 0.500s): Illegal state: Cannot assign timestamp to op. Tablet is not in leader mode. Last heard from a leader: 0.002s ago.
I20260812 06:37:15.501955  9639 raft_consensus.cc:1275] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 6 FOLLOWER]: Refusing update from remote peer 9cd71e9bb1634fd4992bbc5a24f7a6f5: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260812 06:37:15.502032  9505 txn_status_manager.cc:1407] skipping staleness check for the rest of in-flight txn records since this txn status tablet replica is no longer a leader or not running
I20260812 06:37:15.502475 10608 consensus_queue.cc:1048] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260812 06:37:15.502588 10197 raft_consensus.cc:1240] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 6 FOLLOWER]: Rejecting Update request from peer 1bd1bd41aa7c45c19c4e750d8e81124f for earlier term 5. Current term is 6. Ops: []
I20260812 06:37:15.503625 10626 tablet_replica.cc:442] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 6 leader_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:15.503731 10626 tablet_replica.cc:445] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:37:15.503829 10629 tablet_replica.cc:442] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f: TxnStatusTablet state changed. Reason: New leader 9cd71e9bb1634fd4992bbc5a24f7a6f5. Latest consensus state: current_term: 6 leader_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:15.503904 10629 tablet_replica.cc:445] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:37:15.542052 10635 tablet_replica.cc:442] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 6 leader_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:15.542243 10635 tablet_replica.cc:445] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5: This TxnStatusTablet replica's current role is: LEADER
I20260812 06:37:16.505707  6956 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu with pid 9745
I20260812 06:37:16.563841 10644 raft_consensus.cc:493] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9cd71e9bb1634fd4992bbc5a24f7a6f5)
I20260812 06:37:16.563998 10644 raft_consensus.cc:515] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } }
I20260812 06:37:16.564471 10644 leader_election.cc:290] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers abfe9e6137aa4ab5abe1df00f96278ae (127.6.203.3:46091), 9cd71e9bb1634fd4992bbc5a24f7a6f5 (127.6.203.2:45473)
I20260812 06:37:16.564842 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b617582dd0f24339b52e664853e3bced" candidate_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" is_pre_election: true
I20260812 06:37:16.564998 10197 raft_consensus.cc:2468] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1bd1bd41aa7c45c19c4e750d8e81124f in term 6.
I20260812 06:37:16.565090 10647 raft_consensus.cc:493] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 9cd71e9bb1634fd4992bbc5a24f7a6f5)
W20260812 06:37:16.565112  9490 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.203.2:45473: connect: Connection refused (error 111) [suppressed 3 similar messages]
I20260812 06:37:16.565215 10647 raft_consensus.cc:515] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } }
I20260812 06:37:16.565384  9493 leader_election.cc:304] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bd1bd41aa7c45c19c4e750d8e81124f, abfe9e6137aa4ab5abe1df00f96278ae; no voters: 
I20260812 06:37:16.565557 10644 raft_consensus.cc:2804] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 06:37:16.565667 10644 raft_consensus.cc:493] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 6 FOLLOWER]: Starting leader election (detected failure of leader 9cd71e9bb1634fd4992bbc5a24f7a6f5)
I20260812 06:37:16.565680 10647 leader_election.cc:290] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1bd1bd41aa7c45c19c4e750d8e81124f (127.6.203.1:42589), 9cd71e9bb1634fd4992bbc5a24f7a6f5 (127.6.203.2:45473)
I20260812 06:37:16.565786 10644 raft_consensus.cc:3060] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 6 FOLLOWER]: Advancing to term 7
I20260812 06:37:16.565971  9639 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b617582dd0f24339b52e664853e3bced" candidate_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" is_pre_election: true
W20260812 06:37:16.566147  9490 leader_election.cc:336] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 9cd71e9bb1634fd4992bbc5a24f7a6f5 (127.6.203.2:45473): Network error: Client connection negotiation failed: client connection to 127.6.203.2:45473: connect: Connection refused (error 111)
I20260812 06:37:16.566804 10644 raft_consensus.cc:515] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } }
I20260812 06:37:16.567076  9639 raft_consensus.cc:2393] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abfe9e6137aa4ab5abe1df00f96278ae in current term 7: Already voted for candidate 1bd1bd41aa7c45c19c4e750d8e81124f in this term.
W20260812 06:37:16.567147 10061 leader_election.cc:336] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 9cd71e9bb1634fd4992bbc5a24f7a6f5 (127.6.203.2:45473): Network error: Client connection negotiation failed: client connection to 127.6.203.2:45473: connect: Connection refused (error 111)
I20260812 06:37:16.567436 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b617582dd0f24339b52e664853e3bced" candidate_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "abfe9e6137aa4ab5abe1df00f96278ae"
I20260812 06:37:16.567519 10197 raft_consensus.cc:3060] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 6 FOLLOWER]: Advancing to term 7
I20260812 06:37:16.567687 10644 leader_election.cc:290] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [CANDIDATE]: Term 7 election: Requested vote from peers abfe9e6137aa4ab5abe1df00f96278ae (127.6.203.3:46091), 9cd71e9bb1634fd4992bbc5a24f7a6f5 (127.6.203.2:45473)
I20260812 06:37:16.567780 10067 leader_election.cc:304] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abfe9e6137aa4ab5abe1df00f96278ae; no voters: 1bd1bd41aa7c45c19c4e750d8e81124f, 9cd71e9bb1634fd4992bbc5a24f7a6f5
I20260812 06:37:16.568413 10197 raft_consensus.cc:2468] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bd1bd41aa7c45c19c4e750d8e81124f in term 7.
W20260812 06:37:16.568488  9490 leader_election.cc:336] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 9cd71e9bb1634fd4992bbc5a24f7a6f5 (127.6.203.2:45473): Network error: Client connection negotiation failed: client connection to 127.6.203.2:45473: connect: Connection refused (error 111)
I20260812 06:37:16.568539 10647 raft_consensus.cc:2749] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 06:37:16.568708  9493 leader_election.cc:304] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1bd1bd41aa7c45c19c4e750d8e81124f, abfe9e6137aa4ab5abe1df00f96278ae; no voters: 9cd71e9bb1634fd4992bbc5a24f7a6f5
I20260812 06:37:16.568874 10644 raft_consensus.cc:2804] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 7 FOLLOWER]: Leader election won for term 7
I20260812 06:37:16.569027 10644 raft_consensus.cc:697] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 7 LEADER]: Becoming Leader. State: Replica: 1bd1bd41aa7c45c19c4e750d8e81124f, State: Running, Role: LEADER
I20260812 06:37:16.569217 10644 consensus_queue.cc:237] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } }
I20260812 06:37:16.569924 10654 tablet_replica.cc:442] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f: TxnStatusTablet state changed. Reason: New leader 1bd1bd41aa7c45c19c4e750d8e81124f. Latest consensus state: current_term: 7 leader_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:16.570032 10654 tablet_replica.cc:445] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f: This TxnStatusTablet replica's current role is: LEADER
I20260812 06:37:16.570277 10659 txn_status_manager.cc:874] Waiting until node catch up with all replicated operations in previous term...
I20260812 06:37:16.570401 10659 txn_status_manager.cc:930] Loading transaction status metadata into memory...
I20260812 06:37:16.570915  9314 catalog_manager.cc:5719] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f reported cstate change: term changed from 6 to 7, leader changed from 9cd71e9bb1634fd4992bbc5a24f7a6f5 (127.6.203.2) to 1bd1bd41aa7c45c19c4e750d8e81124f (127.6.203.1). New cstate: current_term: 7 leader_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } health_report { overall_health: UNKNOWN } } }
W20260812 06:37:16.606904 10340 meta_cache.cc:302] tablet b617582dd0f24339b52e664853e3bced: replica 9cd71e9bb1634fd4992bbc5a24f7a6f5 (127.6.203.2:45473) has failed: Network error: Client connection negotiation failed: client connection to 127.6.203.2:45473: connect: Connection refused (error 111)
W20260812 06:37:16.613790  9490 consensus_peers.cc:597] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f -> Peer 9cd71e9bb1634fd4992bbc5a24f7a6f5 (127.6.203.2:45473): Couldn't send request to peer 9cd71e9bb1634fd4992bbc5a24f7a6f5. Status: Network error: Client connection negotiation failed: client connection to 127.6.203.2:45473: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 06:37:16.629757 10197 raft_consensus.cc:1275] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 7 FOLLOWER]: Refusing update from remote peer 1bd1bd41aa7c45c19c4e750d8e81124f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260812 06:37:16.630308 10654 consensus_queue.cc:1048] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [LEADER]: Connected to new peer: Peer: permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260812 06:37:16.631505 10647 tablet_replica.cc:442] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae: TxnStatusTablet state changed. Reason: New leader 1bd1bd41aa7c45c19c4e750d8e81124f. Latest consensus state: current_term: 7 leader_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:16.631626 10647 tablet_replica.cc:445] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:37:16.632604 10644 tablet_replica.cc:442] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 7 leader_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:16.632714 10644 tablet_replica.cc:445] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f: This TxnStatusTablet replica's current role is: LEADER
I20260812 06:37:16.633250 10647 tablet_replica.cc:442] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 7 leader_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:16.633356 10647 tablet_replica.cc:445] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:37:16.638957  6956 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu
/tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.203.2:45473
--local_ip_for_outbound_sockets=127.6.203.2
--tserver_master_addrs=127.6.203.62:39207
--webserver_port=33017
--webserver_interface=127.6.203.2
--builtin_ntp_servers=127.6.203.20:46485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--txn_keepalive_interval_ms=500
--txn_staleness_tracker_interval_ms=100
--txn_staleness_tracker_disabled_interval_ms=100
--raft_heartbeat_interval_ms=50
--leader_failure_max_missed_heartbeat_periods=1.25
--enable_txn_system_client_init=true
--txn_schedule_background_tasks=false with env {}
W20260812 06:37:16.753074 10674 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:16.753388 10674 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:16.753435 10674 flags.cc:432] Enabled unsafe flag: --txn_schedule_background_tasks=false
W20260812 06:37:16.753473 10674 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:16.756896 10674 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:16.756986 10674 flags.cc:432] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 06:37:16.757005 10674 flags.cc:432] Enabled experimental flag: --txn_staleness_tracker_interval_ms=100
W20260812 06:37:16.757021 10674 flags.cc:432] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 06:37:16.757062 10674 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.203.2
I20260812 06:37:16.760910 10674 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.203.20:46485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1.25
--raft_heartbeat_interval_ms=50
--fs_data_dirs=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.203.2:45473
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.6.203.2
--webserver_port=33017
--txn_keepalive_interval_ms=500
--txn_schedule_background_tasks=false
--txn_staleness_tracker_interval_ms=100
--enable_txn_system_client_init=true
--tserver_master_addrs=127.6.203.62:39207
--txn_staleness_tracker_disabled_interval_ms=100
--never_fsync=true
--heap_profile_path=/tmp/kudu.10674
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.203.2

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:16.761943 10674 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:16.762967 10674 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 06:37:16.765601 10674 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 06:37:16.769629 10685 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:16.769739 10674 server_base.cc:1061] running on GCE node
W20260812 06:37:16.769577 10684 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:16.769593 10687 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:16.770166 10674 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:16.770725 10674 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:16.771914 10674 hybrid_clock.cc:648] HybridClock initialized: now 1786516636771892 us; error 44 us; skew 500 ppm
I20260812 06:37:16.773825 10674 webserver.cc:533] Webserver started at http://127.6.203.2:33017/ using document root <none> and password file <none>
I20260812 06:37:16.774391 10674 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:16.774501 10674 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:16.777895 10674 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 06:37:16.779847 10696 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:16.780858 10674 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:37:16.780977 10674 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-1/wal
uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5"
format_stamp: "Formatted at 2026-08-12 06:37:05 on dist-test-slave-z8x9"
I20260812 06:37:16.781490 10674 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:16.796631 10674 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:16.797528 10674 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:16.797734 10674 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:16.800024 10709 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260812 06:37:16.804121 10674 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 06:37:16.804219 10674 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.005s	user 0.001s	sys 0.000s
I20260812 06:37:16.804298 10674 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260812 06:37:16.806494 10674 ts_tablet_manager.cc:616] Registered 1 tablets
I20260812 06:37:16.806560 10674 ts_tablet_manager.cc:595] Time spent register tablets: real 0.002s	user 0.000s	sys 0.001s
I20260812 06:37:16.806846 10709 tablet_bootstrap.cc:492] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5: Bootstrap starting.
I20260812 06:37:16.819561 10674 rpc_server.cc:307] RPC server started. Bound to: 127.6.203.2:45473
I20260812 06:37:16.820849 10674 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-1/data/info.pb
I20260812 06:37:16.822275 10927 heartbeater.cc:344] Connected to a master server at 127.6.203.62:39207
I20260812 06:37:16.822458 10927 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:16.823124 10927 heartbeater.cc:507] Master 127.6.203.62:39207 requested a full tablet report, sending...
I20260812 06:37:16.825354  9315 ts_manager.cc:194] Re-registered known tserver with Master: 9cd71e9bb1634fd4992bbc5a24f7a6f5 (127.6.203.2:45473)
I20260812 06:37:16.826022 10709 log.cc:826] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:16.826354  9315 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.6.203.2:33349
I20260812 06:37:16.826514  6956 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu as pid 10674
I20260812 06:37:16.827549 10926 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.203.2:45473 every 8 connection(s)
I20260812 06:37:16.832376 10709 tablet_bootstrap.cc:492] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:37:16.832798 10709 tablet_bootstrap.cc:492] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5: Bootstrap complete.
I20260812 06:37:16.833961 10709 ts_tablet_manager.cc:1403] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5: Time spent bootstrapping tablet: real 0.027s	user 0.018s	sys 0.007s
I20260812 06:37:16.836665 10709 raft_consensus.cc:359] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 6 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } }
I20260812 06:37:16.836983 10709 raft_consensus.cc:740] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 6 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cd71e9bb1634fd4992bbc5a24f7a6f5, State: Initialized, Role: FOLLOWER
I20260812 06:37:16.837525 10709 consensus_queue.cc:260] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } }
I20260812 06:37:16.838186 10931 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 6 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:16.838363 10931 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:37:16.838235 10927 heartbeater.cc:499] Master 127.6.203.62:39207 was elected leader, sending a full tablet report...
I20260812 06:37:16.838440 10709 ts_tablet_manager.cc:1434] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260812 06:37:16.855322 10826 raft_consensus.cc:3060] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 6 FOLLOWER]: Advancing to term 7
I20260812 06:37:16.858803 10936 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 7 leader_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:16.859009 10936 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:37:16.859277 10931 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: New leader 1bd1bd41aa7c45c19c4e750d8e81124f. Latest consensus state: current_term: 7 leader_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:16.859416 10931 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:37:16.889540 10654 tablet_replica.cc:442] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 7 leader_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:16.889720 10654 tablet_replica.cc:445] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f: This TxnStatusTablet replica's current role is: LEADER
I20260812 06:37:17.835502  6956 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu with pid 9465
W20260812 06:37:17.857115 10345 connection.cc:573] client connection to 127.6.203.1:42589 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 06:37:17.857347 10345 meta_cache.cc:302] tablet b617582dd0f24339b52e664853e3bced: replica 1bd1bd41aa7c45c19c4e750d8e81124f (127.6.203.1:42589) has failed: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 06:37:17.876477 10947 raft_consensus.cc:493] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1bd1bd41aa7c45c19c4e750d8e81124f)
I20260812 06:37:17.876821 10947 raft_consensus.cc:515] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } }
I20260812 06:37:17.878360 10947 leader_election.cc:290] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1bd1bd41aa7c45c19c4e750d8e81124f (127.6.203.1:42589), abfe9e6137aa4ab5abe1df00f96278ae (127.6.203.3:46091)
W20260812 06:37:17.879230 10704 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.203.1:42589: connect: Connection refused (error 111)
W20260812 06:37:17.880214 10704 leader_election.cc:336] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 1bd1bd41aa7c45c19c4e750d8e81124f (127.6.203.1:42589): Network error: Client connection negotiation failed: client connection to 127.6.203.1:42589: connect: Connection refused (error 111)
I20260812 06:37:17.882509 10197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b617582dd0f24339b52e664853e3bced" candidate_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" is_pre_election: true
I20260812 06:37:17.883073 10700 leader_election.cc:304] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cd71e9bb1634fd4992bbc5a24f7a6f5; no voters: 1bd1bd41aa7c45c19c4e750d8e81124f, abfe9e6137aa4ab5abe1df00f96278ae
I20260812 06:37:17.883327 10947 raft_consensus.cc:2749] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 06:37:17.887887 10959 raft_consensus.cc:493] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1bd1bd41aa7c45c19c4e750d8e81124f)
I20260812 06:37:17.888026 10959 raft_consensus.cc:515] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } }
I20260812 06:37:17.888590 10959 leader_election.cc:290] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1bd1bd41aa7c45c19c4e750d8e81124f (127.6.203.1:42589), 9cd71e9bb1634fd4992bbc5a24f7a6f5 (127.6.203.2:45473)
W20260812 06:37:17.889590 10067 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.203.1:42589: connect: Connection refused (error 111) [suppressed 2 similar messages]
W20260812 06:37:17.890492 10067 leader_election.cc:336] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 1bd1bd41aa7c45c19c4e750d8e81124f (127.6.203.1:42589): Network error: Client connection negotiation failed: client connection to 127.6.203.1:42589: connect: Connection refused (error 111)
I20260812 06:37:17.892819 10826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b617582dd0f24339b52e664853e3bced" candidate_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" is_pre_election: true
I20260812 06:37:17.893065 10826 raft_consensus.cc:2468] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate abfe9e6137aa4ab5abe1df00f96278ae in term 7.
I20260812 06:37:17.893432 10061 leader_election.cc:304] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cd71e9bb1634fd4992bbc5a24f7a6f5, abfe9e6137aa4ab5abe1df00f96278ae; no voters: 1bd1bd41aa7c45c19c4e750d8e81124f
I20260812 06:37:17.893610 10959 raft_consensus.cc:2804] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260812 06:37:17.893675 10959 raft_consensus.cc:493] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1bd1bd41aa7c45c19c4e750d8e81124f)
I20260812 06:37:17.893734 10959 raft_consensus.cc:3060] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 7 FOLLOWER]: Advancing to term 8
I20260812 06:37:17.894851 10959 raft_consensus.cc:515] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } }
I20260812 06:37:17.895201 10959 leader_election.cc:290] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [CANDIDATE]: Term 8 election: Requested vote from peers 1bd1bd41aa7c45c19c4e750d8e81124f (127.6.203.1:42589), 9cd71e9bb1634fd4992bbc5a24f7a6f5 (127.6.203.2:45473)
I20260812 06:37:17.895596 10826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b617582dd0f24339b52e664853e3bced" candidate_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5"
I20260812 06:37:17.895732 10826 raft_consensus.cc:3060] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 7 FOLLOWER]: Advancing to term 8
W20260812 06:37:17.896306 10067 leader_election.cc:336] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 1bd1bd41aa7c45c19c4e750d8e81124f (127.6.203.1:42589): Network error: Client connection negotiation failed: client connection to 127.6.203.1:42589: connect: Connection refused (error 111)
W20260812 06:37:17.896777 10428 txn_status_manager-itest.cc:377] KeepTransactionAlive() returned non-OK status: Timed out: KeepTransactionAlive RPC to 127.6.203.62:39207 timed out after 0.050s (SENT)
I20260812 06:37:17.896860 10826 raft_consensus.cc:2468] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate abfe9e6137aa4ab5abe1df00f96278ae in term 8.
I20260812 06:37:17.897244 10061 leader_election.cc:304] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cd71e9bb1634fd4992bbc5a24f7a6f5, abfe9e6137aa4ab5abe1df00f96278ae; no voters: 1bd1bd41aa7c45c19c4e750d8e81124f
I20260812 06:37:17.897468 10959 raft_consensus.cc:2804] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 8 FOLLOWER]: Leader election won for term 8
I20260812 06:37:17.897814 10959 raft_consensus.cc:697] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 8 LEADER]: Becoming Leader. State: Replica: abfe9e6137aa4ab5abe1df00f96278ae, State: Running, Role: LEADER
I20260812 06:37:17.898205 10959 consensus_queue.cc:237] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } }
W20260812 06:37:17.898903 10345 meta_cache.cc:1015] Timed out: LookupRpc { table: 'kudu_system.kudu_transactions', partition-key: (RANGE (txn_id): <redacted>), attempt: 1 } failed: LookupRpc timed out after deadline expired: GetTableLocations RPC to 127.6.203.62:39207 timed out after 0.001s (SENT)
W20260812 06:37:17.899132  9369 rpcz_store.cc:267] Call kudu.transactions.TxnManagerService.KeepTransactionAlive from 127.0.0.1:48476 (request call id 109) took 50 ms (client timeout 50 ms). Trace:
W20260812 06:37:17.899214  9369 rpcz_store.cc:269] 0812 06:37:17.848396 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 06:37:17.848511 (+   115us) service_pool.cc:224] Handling call
0812 06:37:17.899112 (+ 50601us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260812 06:37:17.899446 10959 tablet_replica.cc:442] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae: TxnStatusTablet state changed. Reason: New leader abfe9e6137aa4ab5abe1df00f96278ae. Latest consensus state: current_term: 8 leader_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:17.899573 10959 tablet_replica.cc:445] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae: This TxnStatusTablet replica's current role is: LEADER
I20260812 06:37:17.899858 10971 txn_status_manager.cc:874] Waiting until node catch up with all replicated operations in previous term...
I20260812 06:37:17.900194 10971 txn_status_manager.cc:930] Loading transaction status metadata into memory...
I20260812 06:37:17.901760  9315 catalog_manager.cc:5719] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae reported cstate change: term changed from 7 to 8, leader changed from 1bd1bd41aa7c45c19c4e750d8e81124f (127.6.203.1) to abfe9e6137aa4ab5abe1df00f96278ae (127.6.203.3). New cstate: current_term: 8 leader_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260812 06:37:17.947671 10826 raft_consensus.cc:1275] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 8 FOLLOWER]: Refusing update from remote peer abfe9e6137aa4ab5abe1df00f96278ae: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260812 06:37:17.948343 10967 consensus_queue.cc:1048] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260812 06:37:17.949872 10947 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: New leader abfe9e6137aa4ab5abe1df00f96278ae. Latest consensus state: current_term: 8 leader_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:17.949991 10947 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:37:17.951709 10959 tablet_replica.cc:442] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 8 leader_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:17.951829 10959 tablet_replica.cc:445] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae: This TxnStatusTablet replica's current role is: LEADER
I20260812 06:37:17.952381 10947 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 8 leader_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:17.952493 10947 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: FOLLOWER
W20260812 06:37:17.953598 10067 consensus_peers.cc:597] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae -> Peer 1bd1bd41aa7c45c19c4e750d8e81124f (127.6.203.1:42589): Couldn't send request to peer 1bd1bd41aa7c45c19c4e750d8e81124f. Status: Network error: Client connection negotiation failed: client connection to 127.6.203.1:42589: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 06:37:17.963191  6956 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu
/tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.203.1:42589
--local_ip_for_outbound_sockets=127.6.203.1
--tserver_master_addrs=127.6.203.62:39207
--webserver_port=35707
--webserver_interface=127.6.203.1
--builtin_ntp_servers=127.6.203.20:46485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--txn_keepalive_interval_ms=500
--txn_staleness_tracker_interval_ms=100
--txn_staleness_tracker_disabled_interval_ms=100
--raft_heartbeat_interval_ms=50
--leader_failure_max_missed_heartbeat_periods=1.25
--enable_txn_system_client_init=true
--txn_schedule_background_tasks=false with env {}
W20260812 06:37:18.081722 10995 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:18.081969 10995 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:18.082036 10995 flags.cc:432] Enabled unsafe flag: --txn_schedule_background_tasks=false
W20260812 06:37:18.082105 10995 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:18.085707 10995 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:18.085855 10995 flags.cc:432] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 06:37:18.085909 10995 flags.cc:432] Enabled experimental flag: --txn_staleness_tracker_interval_ms=100
W20260812 06:37:18.085958 10995 flags.cc:432] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 06:37:18.086040 10995 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.203.1
I20260812 06:37:18.091260 10995 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.203.20:46485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1.25
--raft_heartbeat_interval_ms=50
--fs_data_dirs=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.203.1:42589
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.6.203.1
--webserver_port=35707
--txn_keepalive_interval_ms=500
--txn_schedule_background_tasks=false
--txn_staleness_tracker_interval_ms=100
--enable_txn_system_client_init=true
--tserver_master_addrs=127.6.203.62:39207
--txn_staleness_tracker_disabled_interval_ms=100
--never_fsync=true
--heap_profile_path=/tmp/kudu.10995
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.203.1

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:18.092811 10995 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:18.094141 10995 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 06:37:18.097289 10995 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 06:37:18.101971 11003 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:18.101975 11007 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:18.102435 10995 server_base.cc:1061] running on GCE node
W20260812 06:37:18.102540 11001 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:18.103000 10995 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:18.103690 10995 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:18.104879 10995 hybrid_clock.cc:648] HybridClock initialized: now 1786516638104859 us; error 31 us; skew 500 ppm
I20260812 06:37:18.107005 10995 webserver.cc:533] Webserver started at http://127.6.203.1:35707/ using document root <none> and password file <none>
I20260812 06:37:18.107733 10995 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:18.107852 10995 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:18.112059 10995 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.002s	sys 0.000s
I20260812 06:37:18.114384 11016 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:18.115748 10995 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260812 06:37:18.115907 10995 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-0/wal
uuid: "1bd1bd41aa7c45c19c4e750d8e81124f"
format_stamp: "Formatted at 2026-08-12 06:37:05 on dist-test-slave-z8x9"
I20260812 06:37:18.116333 10995 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:18.145725 10995 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:18.146410 10995 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:18.146611 10995 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:18.148648 11033 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260812 06:37:18.152611 10995 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 06:37:18.152696 10995 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.004s	user 0.000s	sys 0.000s
I20260812 06:37:18.152767 10995 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260812 06:37:18.155046 10995 ts_tablet_manager.cc:616] Registered 1 tablets
I20260812 06:37:18.155140 10995 ts_tablet_manager.cc:595] Time spent register tablets: real 0.002s	user 0.001s	sys 0.000s
I20260812 06:37:18.155475 11033 tablet_bootstrap.cc:492] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f: Bootstrap starting.
I20260812 06:37:18.167012 10995 rpc_server.cc:307] RPC server started. Bound to: 127.6.203.1:42589
I20260812 06:37:18.168385 10995 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-0/data/info.pb
I20260812 06:37:18.171146  6956 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu as pid 10995
I20260812 06:37:18.173020 11258 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.203.1:42589 every 8 connection(s)
I20260812 06:37:18.173924 11033 log.cc:826] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:18.174894 11260 heartbeater.cc:344] Connected to a master server at 127.6.203.62:39207
I20260812 06:37:18.175079 11260 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:18.175542 11260 heartbeater.cc:507] Master 127.6.203.62:39207 requested a full tablet report, sending...
I20260812 06:37:18.177394  9315 ts_manager.cc:194] Re-registered known tserver with Master: 1bd1bd41aa7c45c19c4e750d8e81124f (127.6.203.1:42589)
I20260812 06:37:18.178359  9315 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.6.203.1:34033
I20260812 06:37:18.180507 11033 tablet_bootstrap.cc:492] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=1 applied=8 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:37:18.180934 11033 tablet_bootstrap.cc:492] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f: Bootstrap complete.
I20260812 06:37:18.182125 11033 ts_tablet_manager.cc:1403] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f: Time spent bootstrapping tablet: real 0.027s	user 0.018s	sys 0.007s
I20260812 06:37:18.184837 11033 raft_consensus.cc:359] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 7 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } }
I20260812 06:37:18.185285 11033 raft_consensus.cc:740] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 7 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bd1bd41aa7c45c19c4e750d8e81124f, State: Initialized, Role: FOLLOWER
I20260812 06:37:18.185719 11033 consensus_queue.cc:260] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } }
I20260812 06:37:18.186367 11267 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 7 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:18.186439 11260 heartbeater.cc:499] Master 127.6.203.62:39207 was elected leader, sending a full tablet report...
I20260812 06:37:18.186527 11267 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:37:18.186546 11033 ts_tablet_manager.cc:1434] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f: Time spent starting tablet: real 0.004s	user 0.005s	sys 0.000s
I20260812 06:37:18.196885 11145 raft_consensus.cc:3060] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 7 FOLLOWER]: Advancing to term 8
I20260812 06:37:18.200357 11273 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 8 leader_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:18.200587 11273 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:37:18.200958 11267 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: New leader abfe9e6137aa4ab5abe1df00f96278ae. Latest consensus state: current_term: 8 leader_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:18.201056 11267 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:37:18.235402 10967 tablet_replica.cc:442] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 8 leader_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:18.235600 10967 tablet_replica.cc:445] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae: This TxnStatusTablet replica's current role is: LEADER
I20260812 06:37:19.173710  6956 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu with pid 10028
I20260812 06:37:19.181877 11276 raft_consensus.cc:493] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader abfe9e6137aa4ab5abe1df00f96278ae)
I20260812 06:37:19.182097 11276 raft_consensus.cc:515] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } }
I20260812 06:37:19.182691 11276 leader_election.cc:290] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 1bd1bd41aa7c45c19c4e750d8e81124f (127.6.203.1:42589), abfe9e6137aa4ab5abe1df00f96278ae (127.6.203.3:46091)
I20260812 06:37:19.188382 11145 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b617582dd0f24339b52e664853e3bced" candidate_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" is_pre_election: true
W20260812 06:37:19.191952 10700 connection.cc:573] client connection to 127.6.203.3:46091 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 06:37:19.192925 10700 leader_election.cc:336] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer abfe9e6137aa4ab5abe1df00f96278ae (127.6.203.3:46091): Network error: Client connection negotiation failed: client connection to 127.6.203.3:46091: connect: Connection refused (error 111)
I20260812 06:37:19.193017 10700 leader_election.cc:304] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9cd71e9bb1634fd4992bbc5a24f7a6f5; no voters: 1bd1bd41aa7c45c19c4e750d8e81124f, abfe9e6137aa4ab5abe1df00f96278ae
I20260812 06:37:19.193275 11276 raft_consensus.cc:2749] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 06:37:19.209059 11285 raft_consensus.cc:493] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader abfe9e6137aa4ab5abe1df00f96278ae)
I20260812 06:37:19.209509 11285 raft_consensus.cc:515] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } }
I20260812 06:37:19.210830 11285 leader_election.cc:290] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers abfe9e6137aa4ab5abe1df00f96278ae (127.6.203.3:46091), 9cd71e9bb1634fd4992bbc5a24f7a6f5 (127.6.203.2:45473)
W20260812 06:37:19.211488 11018 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.203.3:46091: connect: Connection refused (error 111)
W20260812 06:37:19.212736 11018 leader_election.cc:336] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer abfe9e6137aa4ab5abe1df00f96278ae (127.6.203.3:46091): Network error: Client connection negotiation failed: client connection to 127.6.203.3:46091: connect: Connection refused (error 111)
I20260812 06:37:19.214754 10826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b617582dd0f24339b52e664853e3bced" candidate_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" is_pre_election: true
I20260812 06:37:19.214900 10826 raft_consensus.cc:2468] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1bd1bd41aa7c45c19c4e750d8e81124f in term 8.
I20260812 06:37:19.215334 11017 leader_election.cc:304] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1bd1bd41aa7c45c19c4e750d8e81124f, 9cd71e9bb1634fd4992bbc5a24f7a6f5; no voters: abfe9e6137aa4ab5abe1df00f96278ae
I20260812 06:37:19.215554 11285 raft_consensus.cc:2804] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260812 06:37:19.215619 11285 raft_consensus.cc:493] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 8 FOLLOWER]: Starting leader election (detected failure of leader abfe9e6137aa4ab5abe1df00f96278ae)
I20260812 06:37:19.215672 11285 raft_consensus.cc:3060] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 8 FOLLOWER]: Advancing to term 9
I20260812 06:37:19.216635 11285 raft_consensus.cc:515] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } }
I20260812 06:37:19.217012 11285 leader_election.cc:290] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [CANDIDATE]: Term 9 election: Requested vote from peers abfe9e6137aa4ab5abe1df00f96278ae (127.6.203.3:46091), 9cd71e9bb1634fd4992bbc5a24f7a6f5 (127.6.203.2:45473)
I20260812 06:37:19.217447 10826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b617582dd0f24339b52e664853e3bced" candidate_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5"
I20260812 06:37:19.217602 10826 raft_consensus.cc:3060] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 8 FOLLOWER]: Advancing to term 9
W20260812 06:37:19.218070 11018 leader_election.cc:336] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer abfe9e6137aa4ab5abe1df00f96278ae (127.6.203.3:46091): Network error: Client connection negotiation failed: client connection to 127.6.203.3:46091: connect: Connection refused (error 111)
I20260812 06:37:19.218575 10826 raft_consensus.cc:2468] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bd1bd41aa7c45c19c4e750d8e81124f in term 9.
I20260812 06:37:19.218860 11017 leader_election.cc:304] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1bd1bd41aa7c45c19c4e750d8e81124f, 9cd71e9bb1634fd4992bbc5a24f7a6f5; no voters: abfe9e6137aa4ab5abe1df00f96278ae
I20260812 06:37:19.219040 11285 raft_consensus.cc:2804] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 9 FOLLOWER]: Leader election won for term 9
I20260812 06:37:19.219283 11285 raft_consensus.cc:697] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 9 LEADER]: Becoming Leader. State: Replica: 1bd1bd41aa7c45c19c4e750d8e81124f, State: Running, Role: LEADER
I20260812 06:37:19.219591 11285 consensus_queue.cc:237] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } }
I20260812 06:37:19.220654 11301 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: New leader 1bd1bd41aa7c45c19c4e750d8e81124f. Latest consensus state: current_term: 9 leader_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:19.220764 11301 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: LEADER
I20260812 06:37:19.221073 11304 txn_status_manager.cc:874] Waiting until node catch up with all replicated operations in previous term...
I20260812 06:37:19.221251 11304 txn_status_manager.cc:930] Loading transaction status metadata into memory...
I20260812 06:37:19.222095  9315 catalog_manager.cc:5719] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f reported cstate change: term changed from 8 to 9, leader changed from abfe9e6137aa4ab5abe1df00f96278ae (127.6.203.3) to 1bd1bd41aa7c45c19c4e750d8e81124f (127.6.203.1). New cstate: current_term: 9 leader_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } health_report { overall_health: UNKNOWN } } }
W20260812 06:37:19.229295 10341 meta_cache.cc:302] tablet b617582dd0f24339b52e664853e3bced: replica abfe9e6137aa4ab5abe1df00f96278ae (127.6.203.3:46091) has failed: Network error: Client connection negotiation failed: client connection to 127.6.203.3:46091: connect: Connection refused (error 111)
W20260812 06:37:19.271389 11018 consensus_peers.cc:597] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f -> Peer abfe9e6137aa4ab5abe1df00f96278ae (127.6.203.3:46091): Couldn't send request to peer abfe9e6137aa4ab5abe1df00f96278ae. Status: Network error: Client connection negotiation failed: client connection to 127.6.203.3:46091: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 06:37:19.281741 10826 raft_consensus.cc:1275] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 9 FOLLOWER]: Refusing update from remote peer 1bd1bd41aa7c45c19c4e750d8e81124f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260812 06:37:19.282372 11301 consensus_queue.cc:1048] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [LEADER]: Connected to new peer: Peer: permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260812 06:37:19.283885 11276 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: New leader 1bd1bd41aa7c45c19c4e750d8e81124f. Latest consensus state: current_term: 9 leader_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:19.284013 11276 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:37:19.285360 11285 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 9 leader_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:19.285480 11285 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: LEADER
I20260812 06:37:19.286583 11276 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 9 leader_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:19.286710 11276 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:37:19.288879  6956 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu
/tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.203.3:46091
--local_ip_for_outbound_sockets=127.6.203.3
--tserver_master_addrs=127.6.203.62:39207
--webserver_port=43995
--webserver_interface=127.6.203.3
--builtin_ntp_servers=127.6.203.20:46485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--txn_keepalive_interval_ms=500
--txn_staleness_tracker_interval_ms=100
--txn_staleness_tracker_disabled_interval_ms=100
--raft_heartbeat_interval_ms=50
--leader_failure_max_missed_heartbeat_periods=1.25
--enable_txn_system_client_init=true
--txn_schedule_background_tasks=false with env {}
W20260812 06:37:19.405049 11324 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:19.405367 11324 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:19.405441 11324 flags.cc:432] Enabled unsafe flag: --txn_schedule_background_tasks=false
W20260812 06:37:19.405508 11324 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:19.409147 11324 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:19.409276 11324 flags.cc:432] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 06:37:19.409296 11324 flags.cc:432] Enabled experimental flag: --txn_staleness_tracker_interval_ms=100
W20260812 06:37:19.409337 11324 flags.cc:432] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 06:37:19.409425 11324 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.203.3
I20260812 06:37:19.413962 11324 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.203.20:46485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1.25
--raft_heartbeat_interval_ms=50
--fs_data_dirs=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.203.3:46091
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.6.203.3
--webserver_port=43995
--txn_keepalive_interval_ms=500
--txn_schedule_background_tasks=false
--txn_staleness_tracker_interval_ms=100
--enable_txn_system_client_init=true
--tserver_master_addrs=127.6.203.62:39207
--txn_staleness_tracker_disabled_interval_ms=100
--never_fsync=true
--heap_profile_path=/tmp/kudu.11324
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.203.3

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:19.415089 11324 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:19.416200 11324 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 06:37:19.419044 11324 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 06:37:19.423000 11341 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:19.423098 11343 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:19.422923 11347 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:19.423273 11324 server_base.cc:1061] running on GCE node
I20260812 06:37:19.423664 11324 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:19.424206 11324 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:19.425374 11324 hybrid_clock.cc:648] HybridClock initialized: now 1786516639425343 us; error 51 us; skew 500 ppm
I20260812 06:37:19.427186 11324 webserver.cc:533] Webserver started at http://127.6.203.3:43995/ using document root <none> and password file <none>
I20260812 06:37:19.427748 11324 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:19.427850 11324 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:19.431102 11324 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 06:37:19.433032 11359 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:19.434024 11324 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:37:19.434151 11324 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-2/wal
uuid: "abfe9e6137aa4ab5abe1df00f96278ae"
format_stamp: "Formatted at 2026-08-12 06:37:05 on dist-test-slave-z8x9"
I20260812 06:37:19.434545 11324 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:19.447264 11324 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:19.448021 11324 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:19.448230 11324 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:19.450378 11381 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260812 06:37:19.454649 11324 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 06:37:19.454734 11324 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.005s	user 0.001s	sys 0.000s
I20260812 06:37:19.454802 11324 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260812 06:37:19.456974 11324 ts_tablet_manager.cc:616] Registered 1 tablets
I20260812 06:37:19.457052 11324 ts_tablet_manager.cc:595] Time spent register tablets: real 0.002s	user 0.000s	sys 0.000s
I20260812 06:37:19.457957 11381 tablet_bootstrap.cc:492] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae: Bootstrap starting.
I20260812 06:37:19.468568 11324 rpc_server.cc:307] RPC server started. Bound to: 127.6.203.3:46091
I20260812 06:37:19.469879 11324 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-2/data/info.pb
I20260812 06:37:19.470291 11587 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.203.3:46091 every 8 connection(s)
I20260812 06:37:19.476449  6956 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu as pid 11324
I20260812 06:37:19.477947 11590 heartbeater.cc:344] Connected to a master server at 127.6.203.62:39207
I20260812 06:37:19.478183 11590 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:19.478895 11590 heartbeater.cc:507] Master 127.6.203.62:39207 requested a full tablet report, sending...
I20260812 06:37:19.480782  9315 ts_manager.cc:194] Re-registered known tserver with Master: abfe9e6137aa4ab5abe1df00f96278ae (127.6.203.3:46091)
I20260812 06:37:19.481606 11381 log.cc:826] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:19.481681  9315 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.6.203.3:35015
I20260812 06:37:19.487864 11381 tablet_bootstrap.cc:492] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:37:19.488255 11381 tablet_bootstrap.cc:492] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae: Bootstrap complete.
I20260812 06:37:19.489393 11381 ts_tablet_manager.cc:1403] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae: Time spent bootstrapping tablet: real 0.032s	user 0.016s	sys 0.010s
I20260812 06:37:19.491868 11381 raft_consensus.cc:359] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 8 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } }
I20260812 06:37:19.492198 11381 raft_consensus.cc:740] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 8 FOLLOWER]: Becoming Follower/Learner. State: Replica: abfe9e6137aa4ab5abe1df00f96278ae, State: Initialized, Role: FOLLOWER
I20260812 06:37:19.492677 11381 consensus_queue.cc:260] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } }
I20260812 06:37:19.493558 11381 ts_tablet_manager.cc:1434] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae: Time spent starting tablet: real 0.004s	user 0.003s	sys 0.001s
I20260812 06:37:19.493691 11590 heartbeater.cc:499] Master 127.6.203.62:39207 was elected leader, sending a full tablet report...
I20260812 06:37:19.493639 11601 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 8 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:19.493814 11601 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:37:19.522414 11507 raft_consensus.cc:3060] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 8 FOLLOWER]: Advancing to term 9
I20260812 06:37:19.526274 11605 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 9 leader_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:19.526490 11605 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:37:19.526654 11601 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: New leader 1bd1bd41aa7c45c19c4e750d8e81124f. Latest consensus state: current_term: 9 leader_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:19.526782 11601 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:37:19.576910 11301 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 9 leader_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:19.577109 11301 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: LEADER
I20260812 06:37:20.489424  6956 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu with pid 10995
I20260812 06:37:20.510058 11613 raft_consensus.cc:493] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1bd1bd41aa7c45c19c4e750d8e81124f)
I20260812 06:37:20.510282 11613 raft_consensus.cc:515] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } }
I20260812 06:37:20.511509 11613 leader_election.cc:290] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1bd1bd41aa7c45c19c4e750d8e81124f (127.6.203.1:42589), 9cd71e9bb1634fd4992bbc5a24f7a6f5 (127.6.203.2:45473)
W20260812 06:37:20.512028 11365 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.203.1:42589: connect: Connection refused (error 111)
W20260812 06:37:20.512925 11365 leader_election.cc:336] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1bd1bd41aa7c45c19c4e750d8e81124f (127.6.203.1:42589): Network error: Client connection negotiation failed: client connection to 127.6.203.1:42589: connect: Connection refused (error 111)
I20260812 06:37:20.515347 10826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b617582dd0f24339b52e664853e3bced" candidate_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" is_pre_election: true
I20260812 06:37:20.515946 11361 leader_election.cc:304] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abfe9e6137aa4ab5abe1df00f96278ae; no voters: 1bd1bd41aa7c45c19c4e750d8e81124f, 9cd71e9bb1634fd4992bbc5a24f7a6f5
I20260812 06:37:20.516275 11613 raft_consensus.cc:2749] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260812 06:37:20.525216 11621 raft_consensus.cc:493] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1bd1bd41aa7c45c19c4e750d8e81124f)
I20260812 06:37:20.525360 11621 raft_consensus.cc:515] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } }
I20260812 06:37:20.525787 11621 leader_election.cc:290] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1bd1bd41aa7c45c19c4e750d8e81124f (127.6.203.1:42589), abfe9e6137aa4ab5abe1df00f96278ae (127.6.203.3:46091)
W20260812 06:37:20.527192 10704 leader_election.cc:336] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1bd1bd41aa7c45c19c4e750d8e81124f (127.6.203.1:42589): Network error: Client connection negotiation failed: client connection to 127.6.203.1:42589: connect: Connection refused (error 111)
I20260812 06:37:20.529815 11507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b617582dd0f24339b52e664853e3bced" candidate_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" is_pre_election: true
I20260812 06:37:20.530104 11507 raft_consensus.cc:2468] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9cd71e9bb1634fd4992bbc5a24f7a6f5 in term 9.
I20260812 06:37:20.530516 10700 leader_election.cc:304] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cd71e9bb1634fd4992bbc5a24f7a6f5, abfe9e6137aa4ab5abe1df00f96278ae; no voters: 1bd1bd41aa7c45c19c4e750d8e81124f
I20260812 06:37:20.530720 11621 raft_consensus.cc:2804] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260812 06:37:20.530793 11621 raft_consensus.cc:493] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1bd1bd41aa7c45c19c4e750d8e81124f)
I20260812 06:37:20.530838 11621 raft_consensus.cc:3060] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 9 FOLLOWER]: Advancing to term 10
I20260812 06:37:20.531883 11621 raft_consensus.cc:515] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } }
I20260812 06:37:20.532366 11621 leader_election.cc:290] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [CANDIDATE]: Term 10 election: Requested vote from peers 1bd1bd41aa7c45c19c4e750d8e81124f (127.6.203.1:42589), abfe9e6137aa4ab5abe1df00f96278ae (127.6.203.3:46091)
I20260812 06:37:20.532845 11507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b617582dd0f24339b52e664853e3bced" candidate_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "abfe9e6137aa4ab5abe1df00f96278ae"
I20260812 06:37:20.532987 11507 raft_consensus.cc:3060] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 9 FOLLOWER]: Advancing to term 10
W20260812 06:37:20.533576 10704 leader_election.cc:336] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 1bd1bd41aa7c45c19c4e750d8e81124f (127.6.203.1:42589): Network error: Client connection negotiation failed: client connection to 127.6.203.1:42589: connect: Connection refused (error 111)
I20260812 06:37:20.533919 11507 raft_consensus.cc:2468] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9cd71e9bb1634fd4992bbc5a24f7a6f5 in term 10.
I20260812 06:37:20.534248 10700 leader_election.cc:304] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9cd71e9bb1634fd4992bbc5a24f7a6f5, abfe9e6137aa4ab5abe1df00f96278ae; no voters: 1bd1bd41aa7c45c19c4e750d8e81124f
I20260812 06:37:20.534420 11621 raft_consensus.cc:2804] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 10 FOLLOWER]: Leader election won for term 10
I20260812 06:37:20.534632 11621 raft_consensus.cc:697] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 10 LEADER]: Becoming Leader. State: Replica: 9cd71e9bb1634fd4992bbc5a24f7a6f5, State: Running, Role: LEADER
I20260812 06:37:20.535048 11621 consensus_queue.cc:237] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } }
I20260812 06:37:20.536542 11625 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: New leader 9cd71e9bb1634fd4992bbc5a24f7a6f5. Latest consensus state: current_term: 10 leader_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:20.536722 11625 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: LEADER
I20260812 06:37:20.537075 11628 txn_status_manager.cc:874] Waiting until node catch up with all replicated operations in previous term...
I20260812 06:37:20.537269 11628 txn_status_manager.cc:930] Loading transaction status metadata into memory...
I20260812 06:37:20.538007  9315 catalog_manager.cc:5719] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 reported cstate change: term changed from 9 to 10, leader changed from 1bd1bd41aa7c45c19c4e750d8e81124f (127.6.203.1) to 9cd71e9bb1634fd4992bbc5a24f7a6f5 (127.6.203.2). New cstate: current_term: 10 leader_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } health_report { overall_health: HEALTHY } } }
W20260812 06:37:20.571465 10345 meta_cache.cc:302] tablet b617582dd0f24339b52e664853e3bced: replica 1bd1bd41aa7c45c19c4e750d8e81124f (127.6.203.1:42589) has failed: Network error: Client connection negotiation failed: client connection to 127.6.203.1:42589: connect: Connection refused (error 111)
I20260812 06:37:20.592599 11507 raft_consensus.cc:1275] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 10 FOLLOWER]: Refusing update from remote peer 9cd71e9bb1634fd4992bbc5a24f7a6f5: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260812 06:37:20.593436 11625 consensus_queue.cc:1048] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260812 06:37:20.595291 11613 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: New leader 9cd71e9bb1634fd4992bbc5a24f7a6f5. Latest consensus state: current_term: 10 leader_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:20.595458 11613 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: FOLLOWER
W20260812 06:37:20.596757 10704 consensus_peers.cc:597] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 -> Peer 1bd1bd41aa7c45c19c4e750d8e81124f (127.6.203.1:42589): Couldn't send request to peer 1bd1bd41aa7c45c19c4e750d8e81124f. Status: Network error: Client connection negotiation failed: client connection to 127.6.203.1:42589: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 06:37:20.597074 11625 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 10 leader_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:20.597250 11625 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: LEADER
I20260812 06:37:20.598486 11613 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 10 leader_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:20.598603 11613 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:37:20.600383  6956 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu
/tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.203.1:42589
--local_ip_for_outbound_sockets=127.6.203.1
--tserver_master_addrs=127.6.203.62:39207
--webserver_port=35707
--webserver_interface=127.6.203.1
--builtin_ntp_servers=127.6.203.20:46485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--txn_keepalive_interval_ms=500
--txn_staleness_tracker_interval_ms=100
--txn_staleness_tracker_disabled_interval_ms=100
--raft_heartbeat_interval_ms=50
--leader_failure_max_missed_heartbeat_periods=1.25
--enable_txn_system_client_init=true
--txn_schedule_background_tasks=false with env {}
W20260812 06:37:20.744969 11651 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:20.745245 11651 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:20.745366 11651 flags.cc:432] Enabled unsafe flag: --txn_schedule_background_tasks=false
W20260812 06:37:20.745451 11651 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:20.749316 11651 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:20.749449 11651 flags.cc:432] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 06:37:20.749498 11651 flags.cc:432] Enabled experimental flag: --txn_staleness_tracker_interval_ms=100
W20260812 06:37:20.749539 11651 flags.cc:432] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 06:37:20.749627 11651 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.203.1
I20260812 06:37:20.753772 11651 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.203.20:46485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1.25
--raft_heartbeat_interval_ms=50
--fs_data_dirs=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.203.1:42589
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.6.203.1
--webserver_port=35707
--txn_keepalive_interval_ms=500
--txn_schedule_background_tasks=false
--txn_staleness_tracker_interval_ms=100
--enable_txn_system_client_init=true
--tserver_master_addrs=127.6.203.62:39207
--txn_staleness_tracker_disabled_interval_ms=100
--never_fsync=true
--heap_profile_path=/tmp/kudu.11651
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.203.1

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:20.755074 11651 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:20.756405 11651 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 06:37:20.760653 11651 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 06:37:20.765216 11660 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:20.765197 11656 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:20.765461 11651 server_base.cc:1061] running on GCE node
W20260812 06:37:20.765877 11657 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:20.766426 11651 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:20.767151 11651 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:20.768342 11651 hybrid_clock.cc:648] HybridClock initialized: now 1786516640768331 us; error 26 us; skew 500 ppm
I20260812 06:37:20.770959 11651 webserver.cc:533] Webserver started at http://127.6.203.1:35707/ using document root <none> and password file <none>
I20260812 06:37:20.771818 11651 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:20.771919 11651 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:20.777567 11651 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260812 06:37:20.780587 11667 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:20.782058 11651 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260812 06:37:20.782191 11651 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-0/wal
uuid: "1bd1bd41aa7c45c19c4e750d8e81124f"
format_stamp: "Formatted at 2026-08-12 06:37:05 on dist-test-slave-z8x9"
I20260812 06:37:20.782788 11651 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:20.808594 11651 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:20.809623 11651 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:20.809885 11651 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:20.812481 11685 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260812 06:37:20.816979 11651 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 06:37:20.817052 11651 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.005s	user 0.001s	sys 0.000s
I20260812 06:37:20.817533 11651 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260812 06:37:20.820186 11651 ts_tablet_manager.cc:616] Registered 1 tablets
I20260812 06:37:20.820253 11651 ts_tablet_manager.cc:595] Time spent register tablets: real 0.003s	user 0.001s	sys 0.000s
I20260812 06:37:20.822747 11685 tablet_bootstrap.cc:492] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f: Bootstrap starting.
W20260812 06:37:20.836828 10704 consensus_peers.cc:597] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 -> Peer 1bd1bd41aa7c45c19c4e750d8e81124f (127.6.203.1:42589): Couldn't send request to peer 1bd1bd41aa7c45c19c4e750d8e81124f. Status: Network error: Client connection negotiation failed: client connection to 127.6.203.1:42589: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260812 06:37:20.837080 11651 rpc_server.cc:307] RPC server started. Bound to: 127.6.203.1:42589
I20260812 06:37:20.837332 11921 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.203.1:42589 every 8 connection(s)
I20260812 06:37:20.838498 11651 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-0/data/info.pb
I20260812 06:37:20.840812 11923 heartbeater.cc:344] Connected to a master server at 127.6.203.62:39207
I20260812 06:37:20.842165 11923 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:20.843346 11923 heartbeater.cc:507] Master 127.6.203.62:39207 requested a full tablet report, sending...
I20260812 06:37:20.844033 11685 log.cc:826] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:20.845403  9315 ts_manager.cc:194] Re-registered known tserver with Master: 1bd1bd41aa7c45c19c4e750d8e81124f (127.6.203.1:42589)
I20260812 06:37:20.845748  6956 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu as pid 11651
I20260812 06:37:20.846458  9315 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.6.203.1:51203
I20260812 06:37:20.851074 11685 tablet_bootstrap.cc:492] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=1 applied=10 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:37:20.851567 11685 tablet_bootstrap.cc:492] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f: Bootstrap complete.
I20260812 06:37:20.852855 11685 ts_tablet_manager.cc:1403] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f: Time spent bootstrapping tablet: real 0.031s	user 0.016s	sys 0.008s
I20260812 06:37:20.855337 11685 raft_consensus.cc:359] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 9 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } }
I20260812 06:37:20.855791 11685 raft_consensus.cc:740] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 9 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bd1bd41aa7c45c19c4e750d8e81124f, State: Initialized, Role: FOLLOWER
I20260812 06:37:20.856421 11685 consensus_queue.cc:260] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } }
I20260812 06:37:20.857316 11923 heartbeater.cc:499] Master 127.6.203.62:39207 was elected leader, sending a full tablet report...
I20260812 06:37:20.857262 11927 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 9 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:20.857415 11927 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:37:20.857514 11685 ts_tablet_manager.cc:1434] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260812 06:37:20.882072 11825 raft_consensus.cc:3060] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 9 FOLLOWER]: Advancing to term 10
I20260812 06:37:20.885419 11932 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 10 leader_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:20.885630 11932 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:37:20.885900 11927 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: New leader 9cd71e9bb1634fd4992bbc5a24f7a6f5. Latest consensus state: current_term: 10 leader_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:20.886014 11927 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:37:20.923758 11625 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 10 leader_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:20.923947 11625 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: LEADER
I20260812 06:37:21.847429  6956 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu with pid 10674
I20260812 06:37:21.865906 11934 raft_consensus.cc:493] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9cd71e9bb1634fd4992bbc5a24f7a6f5)
I20260812 06:37:21.866134 11934 raft_consensus.cc:515] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } }
I20260812 06:37:21.867499 11934 leader_election.cc:290] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers abfe9e6137aa4ab5abe1df00f96278ae (127.6.203.3:46091), 9cd71e9bb1634fd4992bbc5a24f7a6f5 (127.6.203.2:45473)
W20260812 06:37:21.868196 11668 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.203.2:45473: connect: Connection refused (error 111)
I20260812 06:37:21.868809 11943 raft_consensus.cc:493] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 9cd71e9bb1634fd4992bbc5a24f7a6f5)
I20260812 06:37:21.868929 11943 raft_consensus.cc:515] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } }
W20260812 06:37:21.869174 11668 leader_election.cc:336] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 9cd71e9bb1634fd4992bbc5a24f7a6f5 (127.6.203.2:45473): Network error: Client connection negotiation failed: client connection to 127.6.203.2:45473: connect: Connection refused (error 111)
I20260812 06:37:21.869894 11943 leader_election.cc:290] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 1bd1bd41aa7c45c19c4e750d8e81124f (127.6.203.1:42589), 9cd71e9bb1634fd4992bbc5a24f7a6f5 (127.6.203.2:45473)
W20260812 06:37:21.871251 11361 leader_election.cc:336] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 9cd71e9bb1634fd4992bbc5a24f7a6f5 (127.6.203.2:45473): Network error: Client connection negotiation failed: client connection to 127.6.203.2:45473: connect: Connection refused (error 111)
I20260812 06:37:21.872556 11507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b617582dd0f24339b52e664853e3bced" candidate_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" is_pre_election: true
I20260812 06:37:21.872778 11507 raft_consensus.cc:2468] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1bd1bd41aa7c45c19c4e750d8e81124f in term 10.
I20260812 06:37:21.873153 11670 leader_election.cc:304] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1bd1bd41aa7c45c19c4e750d8e81124f, abfe9e6137aa4ab5abe1df00f96278ae; no voters: 9cd71e9bb1634fd4992bbc5a24f7a6f5
I20260812 06:37:21.873518 11934 raft_consensus.cc:2804] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260812 06:37:21.873589 11934 raft_consensus.cc:493] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 9cd71e9bb1634fd4992bbc5a24f7a6f5)
I20260812 06:37:21.873631 11934 raft_consensus.cc:3060] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 10 FOLLOWER]: Advancing to term 11
I20260812 06:37:21.874688 11934 raft_consensus.cc:515] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } }
I20260812 06:37:21.875140 11934 leader_election.cc:290] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [CANDIDATE]: Term 11 election: Requested vote from peers abfe9e6137aa4ab5abe1df00f96278ae (127.6.203.3:46091), 9cd71e9bb1634fd4992bbc5a24f7a6f5 (127.6.203.2:45473)
I20260812 06:37:21.875497 11507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b617582dd0f24339b52e664853e3bced" candidate_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "abfe9e6137aa4ab5abe1df00f96278ae"
I20260812 06:37:21.875665 11507 raft_consensus.cc:3060] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 10 FOLLOWER]: Advancing to term 11
I20260812 06:37:21.875922 11825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b617582dd0f24339b52e664853e3bced" candidate_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" is_pre_election: true
I20260812 06:37:21.876168 11825 raft_consensus.cc:2393] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate abfe9e6137aa4ab5abe1df00f96278ae in current term 11: Already voted for candidate 1bd1bd41aa7c45c19c4e750d8e81124f in this term.
I20260812 06:37:21.876652 11365 leader_election.cc:304] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: abfe9e6137aa4ab5abe1df00f96278ae; no voters: 1bd1bd41aa7c45c19c4e750d8e81124f, 9cd71e9bb1634fd4992bbc5a24f7a6f5
I20260812 06:37:21.876798 11507 raft_consensus.cc:2468] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bd1bd41aa7c45c19c4e750d8e81124f in term 11.
I20260812 06:37:21.876920 11943 raft_consensus.cc:2749] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260812 06:37:21.877060 11668 leader_election.cc:336] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 9cd71e9bb1634fd4992bbc5a24f7a6f5 (127.6.203.2:45473): Network error: Client connection negotiation failed: client connection to 127.6.203.2:45473: connect: Connection refused (error 111)
I20260812 06:37:21.877209 11670 leader_election.cc:304] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1bd1bd41aa7c45c19c4e750d8e81124f, abfe9e6137aa4ab5abe1df00f96278ae; no voters: 9cd71e9bb1634fd4992bbc5a24f7a6f5
I20260812 06:37:21.877398 11934 raft_consensus.cc:2804] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 11 FOLLOWER]: Leader election won for term 11
I20260812 06:37:21.877656 11934 raft_consensus.cc:697] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [term 11 LEADER]: Becoming Leader. State: Replica: 1bd1bd41aa7c45c19c4e750d8e81124f, State: Running, Role: LEADER
I20260812 06:37:21.877990 11934 consensus_queue.cc:237] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } }
I20260812 06:37:21.879258 11953 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: New leader 1bd1bd41aa7c45c19c4e750d8e81124f. Latest consensus state: current_term: 11 leader_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:21.879398 11953 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: LEADER
I20260812 06:37:21.879745 11955 txn_status_manager.cc:874] Waiting until node catch up with all replicated operations in previous term...
I20260812 06:37:21.879908 11955 txn_status_manager.cc:930] Loading transaction status metadata into memory...
I20260812 06:37:21.881773  9315 catalog_manager.cc:5719] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f reported cstate change: term changed from 10 to 11, leader changed from 9cd71e9bb1634fd4992bbc5a24f7a6f5 (127.6.203.2) to 1bd1bd41aa7c45c19c4e750d8e81124f (127.6.203.1). New cstate: current_term: 11 leader_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } health_report { overall_health: UNKNOWN } } }
W20260812 06:37:21.911711 10340 meta_cache.cc:302] tablet b617582dd0f24339b52e664853e3bced: replica 9cd71e9bb1634fd4992bbc5a24f7a6f5 (127.6.203.2:45473) has failed: Network error: Client connection negotiation failed: client connection to 127.6.203.2:45473: connect: Connection refused (error 111)
I20260812 06:37:21.930887 11507 raft_consensus.cc:1275] T b617582dd0f24339b52e664853e3bced P abfe9e6137aa4ab5abe1df00f96278ae [term 11 FOLLOWER]: Refusing update from remote peer 1bd1bd41aa7c45c19c4e750d8e81124f: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
W20260812 06:37:21.931315 11668 consensus_peers.cc:597] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f -> Peer 9cd71e9bb1634fd4992bbc5a24f7a6f5 (127.6.203.2:45473): Couldn't send request to peer 9cd71e9bb1634fd4992bbc5a24f7a6f5. Status: Network error: Client connection negotiation failed: client connection to 127.6.203.2:45473: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 06:37:21.931454 11953 consensus_queue.cc:1048] T b617582dd0f24339b52e664853e3bced P 1bd1bd41aa7c45c19c4e750d8e81124f [LEADER]: Connected to new peer: Peer: permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260812 06:37:21.932824 11943 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: New leader 1bd1bd41aa7c45c19c4e750d8e81124f. Latest consensus state: current_term: 11 leader_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:21.932946 11943 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:37:21.934263 11934 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 11 leader_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:21.934382 11934 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: LEADER
I20260812 06:37:21.935129 11943 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 11 leader_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:21.935235 11943 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:37:21.938114  6956 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu
/tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.203.2:45473
--local_ip_for_outbound_sockets=127.6.203.2
--tserver_master_addrs=127.6.203.62:39207
--webserver_port=33017
--webserver_interface=127.6.203.2
--builtin_ntp_servers=127.6.203.20:46485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--txn_keepalive_interval_ms=500
--txn_staleness_tracker_interval_ms=100
--txn_staleness_tracker_disabled_interval_ms=100
--raft_heartbeat_interval_ms=50
--leader_failure_max_missed_heartbeat_periods=1.25
--enable_txn_system_client_init=true
--txn_schedule_background_tasks=false with env {}
W20260812 06:37:22.057875 11969 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:22.058166 11969 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:22.058259 11969 flags.cc:432] Enabled unsafe flag: --txn_schedule_background_tasks=false
W20260812 06:37:22.058331 11969 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:22.062201 11969 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:22.062350 11969 flags.cc:432] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 06:37:22.062400 11969 flags.cc:432] Enabled experimental flag: --txn_staleness_tracker_interval_ms=100
W20260812 06:37:22.062458 11969 flags.cc:432] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 06:37:22.062544 11969 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.203.2
I20260812 06:37:22.066716 11969 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.203.20:46485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1.25
--raft_heartbeat_interval_ms=50
--fs_data_dirs=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.203.2:45473
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.6.203.2
--webserver_port=33017
--txn_keepalive_interval_ms=500
--txn_schedule_background_tasks=false
--txn_staleness_tracker_interval_ms=100
--enable_txn_system_client_init=true
--tserver_master_addrs=127.6.203.62:39207
--txn_staleness_tracker_disabled_interval_ms=100
--never_fsync=true
--heap_profile_path=/tmp/kudu.11969
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.203.2

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:22.067947 11969 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:22.069123 11969 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 06:37:22.072062 11969 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 06:37:22.076328 11977 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:22.076427 11976 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:22.076512 11969 server_base.cc:1061] running on GCE node
W20260812 06:37:22.076427 11985 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:22.077044 11969 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:22.077838 11969 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:22.079031 11969 hybrid_clock.cc:648] HybridClock initialized: now 1786516642079000 us; error 39 us; skew 500 ppm
I20260812 06:37:22.082185 11969 webserver.cc:533] Webserver started at http://127.6.203.2:33017/ using document root <none> and password file <none>
I20260812 06:37:22.082978 11969 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:22.083076 11969 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:22.086755 11969 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.004s	sys 0.000s
I20260812 06:37:22.088841 11995 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:22.090234 11969 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:37:22.090340 11969 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-1/wal
uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5"
format_stamp: "Formatted at 2026-08-12 06:37:05 on dist-test-slave-z8x9"
I20260812 06:37:22.090751 11969 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:22.107369 11969 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:22.108037 11969 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:22.108204 11969 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:22.110357 12021 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260812 06:37:22.114261 11969 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 06:37:22.114362 11969 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.004s	user 0.001s	sys 0.000s
I20260812 06:37:22.114444 11969 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260812 06:37:22.117401 11969 ts_tablet_manager.cc:616] Registered 1 tablets
I20260812 06:37:22.117484 11969 ts_tablet_manager.cc:595] Time spent register tablets: real 0.003s	user 0.003s	sys 0.000s
I20260812 06:37:22.117870 12021 tablet_bootstrap.cc:492] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5: Bootstrap starting.
I20260812 06:37:22.132571 11969 rpc_server.cc:307] RPC server started. Bound to: 127.6.203.2:45473
I20260812 06:37:22.132591 12245 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.203.2:45473 every 8 connection(s)
I20260812 06:37:22.134130 11969 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786516615841258-6956-0/minicluster-data/ts-1/data/info.pb
I20260812 06:37:22.136301 12246 heartbeater.cc:344] Connected to a master server at 127.6.203.62:39207
I20260812 06:37:22.136618 12246 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:22.136888  6956 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu as pid 11969
I20260812 06:37:22.137259 12246 heartbeater.cc:507] Master 127.6.203.62:39207 requested a full tablet report, sending...
I20260812 06:37:22.139101  9315 ts_manager.cc:194] Re-registered known tserver with Master: 9cd71e9bb1634fd4992bbc5a24f7a6f5 (127.6.203.2:45473)
I20260812 06:37:22.139374 12021 log.cc:826] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:22.140184  9315 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.6.203.2:47835
I20260812 06:37:22.146211 12021 tablet_bootstrap.cc:492] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:37:22.146606 12021 tablet_bootstrap.cc:492] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5: Bootstrap complete.
I20260812 06:37:22.147665 12021 ts_tablet_manager.cc:1403] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5: Time spent bootstrapping tablet: real 0.030s	user 0.022s	sys 0.004s
I20260812 06:37:22.150465 12021 raft_consensus.cc:359] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 10 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } }
I20260812 06:37:22.150812 12021 raft_consensus.cc:740] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 10 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9cd71e9bb1634fd4992bbc5a24f7a6f5, State: Initialized, Role: FOLLOWER
I20260812 06:37:22.151264 12021 consensus_queue.cc:260] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } }
I20260812 06:37:22.152024 12246 heartbeater.cc:499] Master 127.6.203.62:39207 was elected leader, sending a full tablet report...
I20260812 06:37:22.151975 12250 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 10 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:22.152071 12021 ts_tablet_manager.cc:1434] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5: Time spent starting tablet: real 0.004s	user 0.006s	sys 0.000s
I20260812 06:37:22.152127 12250 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:37:22.170645 12159 raft_consensus.cc:3060] T b617582dd0f24339b52e664853e3bced P 9cd71e9bb1634fd4992bbc5a24f7a6f5 [term 10 FOLLOWER]: Advancing to term 11
I20260812 06:37:22.175206 12255 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 11 leader_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:22.175367 12255 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:37:22.175596 12250 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: New leader 1bd1bd41aa7c45c19c4e750d8e81124f. Latest consensus state: current_term: 11 leader_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:22.175717 12250 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:37:22.207741 11953 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 11 leader_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1bd1bd41aa7c45c19c4e750d8e81124f" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42589 } } peers { permanent_uuid: "abfe9e6137aa4ab5abe1df00f96278ae" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 46091 } } peers { permanent_uuid: "9cd71e9bb1634fd4992bbc5a24f7a6f5" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 45473 } } }
I20260812 06:37:22.207965 11953 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: LEADER
I20260812 06:37:23.628695 11684 txn_status_manager.cc:1391] automatically aborted stale txn (ID 0) past 0.571s from last keepalive heartbeat (effective timeout is 0.500s)
I20260812 06:37:23.678470  6956 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu with pid 11651
I20260812 06:37:23.705008  6956 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu with pid 11969
I20260812 06:37:23.722892  6956 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu with pid 11324
I20260812 06:37:23.740541  6956 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu with pid 9254
2026-08-12T06:37:23Z chronyd exiting
[       OK ] TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances (18806 ms)
[ RUN      ] TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted
2026-08-12T06:37:23Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T06:37:23Z Disabled control of system clock
I20260812 06:37:23.784516  6956 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu
/tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.203.62:44725
--webserver_interface=127.6.203.62
--webserver_port=0
--builtin_ntp_servers=127.6.203.20:38741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.6.203.62:44725
--txn_manager_enabled=true
--txn_manager_lazily_initialized=false with env {}
W20260812 06:37:23.899362 12292 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:23.899655 12292 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:23.899909 12292 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:23.903573 12292 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 06:37:23.903650 12292 flags.cc:432] Enabled experimental flag: --txn_manager_enabled=true
W20260812 06:37:23.903674 12292 flags.cc:432] Enabled experimental flag: --txn_manager_lazily_initialized=false
W20260812 06:37:23.903692 12292 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:23.903710 12292 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 06:37:23.903728 12292 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 06:37:23.907718 12292 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.203.20:38741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.6.203.62:44725
--txn_manager_enabled=true
--txn_manager_lazily_initialized=false
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.6.203.62:44725
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.6.203.62
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.12292
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:23.908823 12292 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:23.910028 12292 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 06:37:23.915910 12308 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:23.915971 12292 server_base.cc:1061] running on GCE node
W20260812 06:37:23.915910 12312 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:23.915942 12307 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:23.916750 12292 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:23.917778 12292 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:23.919005 12292 hybrid_clock.cc:648] HybridClock initialized: now 1786516643918985 us; error 36 us; skew 500 ppm
I20260812 06:37:23.921075 12292 webserver.cc:533] Webserver started at http://127.6.203.62:38487/ using document root <none> and password file <none>
I20260812 06:37:23.921705 12292 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:23.921805 12292 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:23.922047 12292 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:37:23.923913 12292 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/master-0/data/instance:
uuid: "fa86ca1e21a04aa18dc9c97575a93499"
format_stamp: "Formatted at 2026-08-12 06:37:23 on dist-test-slave-z8x9"
I20260812 06:37:23.924676 12292 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/master-0/wal/instance:
uuid: "fa86ca1e21a04aa18dc9c97575a93499"
format_stamp: "Formatted at 2026-08-12 06:37:23 on dist-test-slave-z8x9"
I20260812 06:37:23.928541 12292 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260812 06:37:23.931080 12319 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:23.932190 12292 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260812 06:37:23.932374 12292 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/master-0/data,/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/master-0/wal
uuid: "fa86ca1e21a04aa18dc9c97575a93499"
format_stamp: "Formatted at 2026-08-12 06:37:23 on dist-test-slave-z8x9"
I20260812 06:37:23.932497 12292 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:23.948877 12292 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:23.949693 12292 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:23.949898 12292 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:23.958472 12292 rpc_server.cc:307] RPC server started. Bound to: 127.6.203.62:44725
I20260812 06:37:23.958484 12457 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.203.62:44725 every 8 connection(s)
I20260812 06:37:23.959702 12292 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/master-0/data/info.pb
I20260812 06:37:23.961288  6956 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu as pid 12292
I20260812 06:37:23.961390  6956 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/master-0/wal/instance
I20260812 06:37:23.963129 12461 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:23.969295 12461 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa86ca1e21a04aa18dc9c97575a93499: Bootstrap starting.
I20260812 06:37:23.971823 12461 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fa86ca1e21a04aa18dc9c97575a93499: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:23.972640 12461 log.cc:826] T 00000000000000000000000000000000 P fa86ca1e21a04aa18dc9c97575a93499: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:23.974830 12461 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fa86ca1e21a04aa18dc9c97575a93499: No bootstrap required, opened a new log
I20260812 06:37:23.977459 12461 raft_consensus.cc:359] T 00000000000000000000000000000000 P fa86ca1e21a04aa18dc9c97575a93499 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa86ca1e21a04aa18dc9c97575a93499" member_type: VOTER last_known_addr { host: "127.6.203.62" port: 44725 } }
I20260812 06:37:23.977661 12461 raft_consensus.cc:385] T 00000000000000000000000000000000 P fa86ca1e21a04aa18dc9c97575a93499 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:23.977705 12461 raft_consensus.cc:740] T 00000000000000000000000000000000 P fa86ca1e21a04aa18dc9c97575a93499 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fa86ca1e21a04aa18dc9c97575a93499, State: Initialized, Role: FOLLOWER
I20260812 06:37:23.978073 12461 consensus_queue.cc:260] T 00000000000000000000000000000000 P fa86ca1e21a04aa18dc9c97575a93499 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa86ca1e21a04aa18dc9c97575a93499" member_type: VOTER last_known_addr { host: "127.6.203.62" port: 44725 } }
I20260812 06:37:23.978181 12461 raft_consensus.cc:399] T 00000000000000000000000000000000 P fa86ca1e21a04aa18dc9c97575a93499 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 06:37:23.978220 12461 raft_consensus.cc:493] T 00000000000000000000000000000000 P fa86ca1e21a04aa18dc9c97575a93499 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 06:37:23.978309 12461 raft_consensus.cc:3060] T 00000000000000000000000000000000 P fa86ca1e21a04aa18dc9c97575a93499 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:23.979372 12461 raft_consensus.cc:515] T 00000000000000000000000000000000 P fa86ca1e21a04aa18dc9c97575a93499 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa86ca1e21a04aa18dc9c97575a93499" member_type: VOTER last_known_addr { host: "127.6.203.62" port: 44725 } }
I20260812 06:37:23.979897 12461 leader_election.cc:304] T 00000000000000000000000000000000 P fa86ca1e21a04aa18dc9c97575a93499 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: fa86ca1e21a04aa18dc9c97575a93499; no voters: 
I20260812 06:37:23.980290 12461 leader_election.cc:290] T 00000000000000000000000000000000 P fa86ca1e21a04aa18dc9c97575a93499 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 06:37:23.980497 12472 raft_consensus.cc:2804] T 00000000000000000000000000000000 P fa86ca1e21a04aa18dc9c97575a93499 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:37:23.980751 12472 raft_consensus.cc:697] T 00000000000000000000000000000000 P fa86ca1e21a04aa18dc9c97575a93499 [term 1 LEADER]: Becoming Leader. State: Replica: fa86ca1e21a04aa18dc9c97575a93499, State: Running, Role: LEADER
I20260812 06:37:23.981050 12472 consensus_queue.cc:237] T 00000000000000000000000000000000 P fa86ca1e21a04aa18dc9c97575a93499 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa86ca1e21a04aa18dc9c97575a93499" member_type: VOTER last_known_addr { host: "127.6.203.62" port: 44725 } }
I20260812 06:37:23.981585 12461 sys_catalog.cc:565] T 00000000000000000000000000000000 P fa86ca1e21a04aa18dc9c97575a93499 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 06:37:23.982908 12475 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa86ca1e21a04aa18dc9c97575a93499 [sys.catalog]: SysCatalogTable state changed. Reason: New leader fa86ca1e21a04aa18dc9c97575a93499. Latest consensus state: current_term: 1 leader_uuid: "fa86ca1e21a04aa18dc9c97575a93499" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa86ca1e21a04aa18dc9c97575a93499" member_type: VOTER last_known_addr { host: "127.6.203.62" port: 44725 } } }
I20260812 06:37:23.983047 12475 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa86ca1e21a04aa18dc9c97575a93499 [sys.catalog]: This master's current role is: LEADER
I20260812 06:37:23.983294 12474 sys_catalog.cc:455] T 00000000000000000000000000000000 P fa86ca1e21a04aa18dc9c97575a93499 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "fa86ca1e21a04aa18dc9c97575a93499" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "fa86ca1e21a04aa18dc9c97575a93499" member_type: VOTER last_known_addr { host: "127.6.203.62" port: 44725 } } }
I20260812 06:37:23.983376 12474 sys_catalog.cc:458] T 00000000000000000000000000000000 P fa86ca1e21a04aa18dc9c97575a93499 [sys.catalog]: This master's current role is: LEADER
I20260812 06:37:23.983435 12485 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 06:37:23.986790 12485 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 06:37:23.992568 12485 catalog_manager.cc:1383] Generated new cluster ID: 6d3ed7facb124b528f481fe327844cf1
I20260812 06:37:23.992652 12485 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 06:37:24.007011 12485 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 06:37:24.007961 12485 catalog_manager.cc:1540] Loading token signing keys...
I20260812 06:37:24.019392 12485 catalog_manager.cc:6092] T 00000000000000000000000000000000 P fa86ca1e21a04aa18dc9c97575a93499: Generated new TSK 0
I20260812 06:37:24.020115 12485 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 06:37:24.023684  6956 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu
/tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.203.1:0
--local_ip_for_outbound_sockets=127.6.203.1
--webserver_interface=127.6.203.1
--webserver_port=0
--tserver_master_addrs=127.6.203.62:44725
--builtin_ntp_servers=127.6.203.20:38741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--txn_keepalive_interval_ms=500
--txn_staleness_tracker_interval_ms=100
--txn_staleness_tracker_disabled_interval_ms=100
--raft_heartbeat_interval_ms=50
--leader_failure_max_missed_heartbeat_periods=1.25
--enable_txn_system_client_init=true
--txn_schedule_background_tasks=false with env {}
I20260812 06:37:24.026736 12350 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47820:
name: "kudu_system.kudu_transactions"
schema {
  columns {
    name: "txn_id"
    type: INT64
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "entry_type"
    type: INT8
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "identifier"
    type: STRING
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "metadata"
    type: STRING
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
  indirect_data: "<redacted>"""
}
partition_schema {
  range_schema {
    columns {
      name: "txn_id"
    }
  }
}
table_type: TXN_STATUS_TABLE
W20260812 06:37:24.030400 12461 master.cc:465] Invalid argument: unable to initialize TxnManager: Error creating table kudu_system.kudu_transactions on the master: not enough live tablet servers to create a table with the requested replication factor 3; 0 tablet servers are alive: unable to init TxnManager, will retry in 1.000s
W20260812 06:37:24.148375 12513 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:24.148901 12513 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:24.149132 12513 flags.cc:432] Enabled unsafe flag: --txn_schedule_background_tasks=false
W20260812 06:37:24.149251 12513 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:24.153781 12513 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:24.153889 12513 flags.cc:432] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 06:37:24.153910 12513 flags.cc:432] Enabled experimental flag: --txn_staleness_tracker_interval_ms=100
W20260812 06:37:24.153963 12513 flags.cc:432] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 06:37:24.154062 12513 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.203.1
I20260812 06:37:24.158406 12513 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.203.20:38741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1.25
--raft_heartbeat_interval_ms=50
--fs_data_dirs=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.203.1:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.6.203.1
--webserver_port=0
--txn_keepalive_interval_ms=500
--txn_schedule_background_tasks=false
--txn_staleness_tracker_interval_ms=100
--enable_txn_system_client_init=true
--tserver_master_addrs=127.6.203.62:44725
--txn_staleness_tracker_disabled_interval_ms=100
--never_fsync=true
--heap_profile_path=/tmp/kudu.12513
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.203.1

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:24.159698 12513 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:24.160848 12513 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 06:37:24.163786 12513 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 06:37:24.168131 12520 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:24.168123 12522 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:24.168582 12513 server_base.cc:1061] running on GCE node
W20260812 06:37:24.168733 12529 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:24.169212 12513 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:24.170018 12513 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:24.171254 12513 hybrid_clock.cc:648] HybridClock initialized: now 1786516644171200 us; error 61 us; skew 500 ppm
I20260812 06:37:24.173708 12513 webserver.cc:533] Webserver started at http://127.6.203.1:39665/ using document root <none> and password file <none>
I20260812 06:37:24.174412 12513 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:24.174484 12513 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:24.174688 12513 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:37:24.176904 12513 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-0/data/instance:
uuid: "73addbf307924744aba317baa7729212"
format_stamp: "Formatted at 2026-08-12 06:37:24 on dist-test-slave-z8x9"
I20260812 06:37:24.177577 12513 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-0/wal/instance:
uuid: "73addbf307924744aba317baa7729212"
format_stamp: "Formatted at 2026-08-12 06:37:24 on dist-test-slave-z8x9"
I20260812 06:37:24.181926 12513 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260812 06:37:24.184957 12543 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:24.186239 12513 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260812 06:37:24.186367 12513 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-0/wal
uuid: "73addbf307924744aba317baa7729212"
format_stamp: "Formatted at 2026-08-12 06:37:24 on dist-test-slave-z8x9"
I20260812 06:37:24.186475 12513 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:24.207113 12513 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:24.207799 12513 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:24.207962 12513 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:24.209895 12513 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:37:24.209956 12513 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:24.210026 12513 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:37:24.210125 12513 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260812 06:37:24.222745 12513 rpc_server.cc:307] RPC server started. Bound to: 127.6.203.1:42879
I20260812 06:37:24.222774 12805 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.203.1:42879 every 8 connection(s)
I20260812 06:37:24.223869 12513 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-0/data/info.pb
I20260812 06:37:24.225745 12806 heartbeater.cc:344] Connected to a master server at 127.6.203.62:44725
I20260812 06:37:24.225957 12806 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:24.226646 12806 heartbeater.cc:507] Master 127.6.203.62:44725 requested a full tablet report, sending...
I20260812 06:37:24.228056 12350 ts_manager.cc:194] Registered new tserver with Master: 73addbf307924744aba317baa7729212 (127.6.203.1:42879)
I20260812 06:37:24.229467 12350 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.6.203.1:38813
I20260812 06:37:24.232738  6956 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu as pid 12513
I20260812 06:37:24.232890  6956 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-0/wal/instance
I20260812 06:37:24.235169  6956 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu
/tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.203.2:0
--local_ip_for_outbound_sockets=127.6.203.2
--webserver_interface=127.6.203.2
--webserver_port=0
--tserver_master_addrs=127.6.203.62:44725
--builtin_ntp_servers=127.6.203.20:38741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--txn_keepalive_interval_ms=500
--txn_staleness_tracker_interval_ms=100
--txn_staleness_tracker_disabled_interval_ms=100
--raft_heartbeat_interval_ms=50
--leader_failure_max_missed_heartbeat_periods=1.25
--enable_txn_system_client_init=true
--txn_schedule_background_tasks=false with env {}
W20260812 06:37:24.347328 12808 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:24.347570 12808 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:24.347612 12808 flags.cc:432] Enabled unsafe flag: --txn_schedule_background_tasks=false
W20260812 06:37:24.347795 12808 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:24.351334 12808 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:24.351425 12808 flags.cc:432] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 06:37:24.351445 12808 flags.cc:432] Enabled experimental flag: --txn_staleness_tracker_interval_ms=100
W20260812 06:37:24.351511 12808 flags.cc:432] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 06:37:24.351612 12808 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.203.2
I20260812 06:37:24.355610 12808 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.203.20:38741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1.25
--raft_heartbeat_interval_ms=50
--fs_data_dirs=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.203.2:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.6.203.2
--webserver_port=0
--txn_keepalive_interval_ms=500
--txn_schedule_background_tasks=false
--txn_staleness_tracker_interval_ms=100
--enable_txn_system_client_init=true
--tserver_master_addrs=127.6.203.62:44725
--txn_staleness_tracker_disabled_interval_ms=100
--never_fsync=true
--heap_profile_path=/tmp/kudu.12808
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.203.2

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:24.356777 12808 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:24.357949 12808 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 06:37:24.360872 12808 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 06:37:24.364959 12827 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:24.364948 12825 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:24.365128 12808 server_base.cc:1061] running on GCE node
W20260812 06:37:24.364969 12831 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:24.365628 12808 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:24.366223 12808 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:24.367398 12808 hybrid_clock.cc:648] HybridClock initialized: now 1786516644367385 us; error 40 us; skew 500 ppm
I20260812 06:37:24.369603 12808 webserver.cc:533] Webserver started at http://127.6.203.2:44721/ using document root <none> and password file <none>
I20260812 06:37:24.370188 12808 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:24.370247 12808 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:24.370456 12808 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:37:24.371980 12808 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-1/data/instance:
uuid: "de36baa29f7345fa806856c9562f1db1"
format_stamp: "Formatted at 2026-08-12 06:37:24 on dist-test-slave-z8x9"
I20260812 06:37:24.372475 12808 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-1/wal/instance:
uuid: "de36baa29f7345fa806856c9562f1db1"
format_stamp: "Formatted at 2026-08-12 06:37:24 on dist-test-slave-z8x9"
I20260812 06:37:24.376055 12808 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.006s	sys 0.000s
I20260812 06:37:24.378604 12840 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:24.379874 12808 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260812 06:37:24.380031 12808 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-1/wal
uuid: "de36baa29f7345fa806856c9562f1db1"
format_stamp: "Formatted at 2026-08-12 06:37:24 on dist-test-slave-z8x9"
I20260812 06:37:24.380158 12808 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:24.413748 12808 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:24.414870 12808 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:24.415162 12808 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:24.416970 12808 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:37:24.417058 12808 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:24.417218 12808 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:37:24.417277 12808 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:24.429865 12808 rpc_server.cc:307] RPC server started. Bound to: 127.6.203.2:38853
I20260812 06:37:24.429926 13077 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.203.2:38853 every 8 connection(s)
I20260812 06:37:24.431030 12808 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-1/data/info.pb
I20260812 06:37:24.432607 13082 heartbeater.cc:344] Connected to a master server at 127.6.203.62:44725
I20260812 06:37:24.432816 13082 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:24.433355  6956 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu as pid 12808
I20260812 06:37:24.433442 13082 heartbeater.cc:507] Master 127.6.203.62:44725 requested a full tablet report, sending...
I20260812 06:37:24.433485  6956 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-1/wal/instance
I20260812 06:37:24.434465 12350 ts_manager.cc:194] Registered new tserver with Master: de36baa29f7345fa806856c9562f1db1 (127.6.203.2:38853)
I20260812 06:37:24.435209 12350 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.6.203.2:49071
I20260812 06:37:24.435736  6956 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu
/tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.203.3:0
--local_ip_for_outbound_sockets=127.6.203.3
--webserver_interface=127.6.203.3
--webserver_port=0
--tserver_master_addrs=127.6.203.62:44725
--builtin_ntp_servers=127.6.203.20:38741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--txn_keepalive_interval_ms=500
--txn_staleness_tracker_interval_ms=100
--txn_staleness_tracker_disabled_interval_ms=100
--raft_heartbeat_interval_ms=50
--leader_failure_max_missed_heartbeat_periods=1.25
--enable_txn_system_client_init=true
--txn_schedule_background_tasks=false with env {}
W20260812 06:37:24.551448 13084 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:24.551734 13084 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:24.551779 13084 flags.cc:432] Enabled unsafe flag: --txn_schedule_background_tasks=false
W20260812 06:37:24.551854 13084 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:24.555564 13084 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:24.555691 13084 flags.cc:432] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 06:37:24.555711 13084 flags.cc:432] Enabled experimental flag: --txn_staleness_tracker_interval_ms=100
W20260812 06:37:24.555727 13084 flags.cc:432] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 06:37:24.555819 13084 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.203.3
I20260812 06:37:24.560454 13084 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.203.20:38741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1.25
--raft_heartbeat_interval_ms=50
--fs_data_dirs=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.203.3:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.6.203.3
--webserver_port=0
--txn_keepalive_interval_ms=500
--txn_schedule_background_tasks=false
--txn_staleness_tracker_interval_ms=100
--enable_txn_system_client_init=true
--tserver_master_addrs=127.6.203.62:44725
--txn_staleness_tracker_disabled_interval_ms=100
--never_fsync=true
--heap_profile_path=/tmp/kudu.13084
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.203.3

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:24.561816 13084 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:24.563122 13084 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 06:37:24.566618 13084 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 06:37:24.572043 13094 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:24.572227 13084 server_base.cc:1061] running on GCE node
W20260812 06:37:24.572089 13098 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:24.572484 13092 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:24.572986 13084 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:24.573787 13084 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:24.574981 13084 hybrid_clock.cc:648] HybridClock initialized: now 1786516644574946 us; error 51 us; skew 500 ppm
I20260812 06:37:24.577394 13084 webserver.cc:533] Webserver started at http://127.6.203.3:41489/ using document root <none> and password file <none>
I20260812 06:37:24.578073 13084 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:24.578141 13084 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:24.578383 13084 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 06:37:24.580193 13084 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-2/data/instance:
uuid: "0be6742934084ecd8b780ac710ff107a"
format_stamp: "Formatted at 2026-08-12 06:37:24 on dist-test-slave-z8x9"
I20260812 06:37:24.580796 13084 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-2/wal/instance:
uuid: "0be6742934084ecd8b780ac710ff107a"
format_stamp: "Formatted at 2026-08-12 06:37:24 on dist-test-slave-z8x9"
I20260812 06:37:24.587064 13084 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.004s	sys 0.003s
I20260812 06:37:24.593379 13110 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:24.594740 13084 fs_manager.cc:730] Time spent opening block manager: real 0.006s	user 0.004s	sys 0.000s
I20260812 06:37:24.594900 13084 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-2/wal
uuid: "0be6742934084ecd8b780ac710ff107a"
format_stamp: "Formatted at 2026-08-12 06:37:24 on dist-test-slave-z8x9"
I20260812 06:37:24.595048 13084 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:24.617374 13084 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:24.618319 13084 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:24.618543 13084 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:24.623203 13084 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 06:37:24.623308 13084 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:24.623378 13084 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 06:37:24.623416 13084 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:24.637643 13084 rpc_server.cc:307] RPC server started. Bound to: 127.6.203.3:36235
I20260812 06:37:24.637693 13374 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.203.3:36235 every 8 connection(s)
I20260812 06:37:24.638803 13084 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-2/data/info.pb
I20260812 06:37:24.639523  6956 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu as pid 13084
I20260812 06:37:24.639653  6956 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-2/wal/instance
I20260812 06:37:24.640527 13381 heartbeater.cc:344] Connected to a master server at 127.6.203.62:44725
I20260812 06:37:24.640735 13381 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:24.641364 13381 heartbeater.cc:507] Master 127.6.203.62:44725 requested a full tablet report, sending...
I20260812 06:37:24.642771 12350 ts_manager.cc:194] Registered new tserver with Master: 0be6742934084ecd8b780ac710ff107a (127.6.203.3:36235)
I20260812 06:37:24.643599 12350 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.6.203.3:46823
I20260812 06:37:24.654804  6956 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260812 06:37:25.060274 12350 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47826:
name: "kudu_system.kudu_transactions"
schema {
  columns {
    name: "txn_id"
    type: INT64
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "entry_type"
    type: INT8
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "identifier"
    type: STRING
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "metadata"
    type: STRING
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
  indirect_data: "<redacted>"""
}
partition_schema {
  range_schema {
    columns {
      name: "txn_id"
    }
  }
}
table_type: TXN_STATUS_TABLE
W20260812 06:37:25.060956 12350 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 06:37:25.080345 12668 tablet_service.cc:1511] Processing CreateTablet for tablet 430a7e38b466414aade54cee76676332 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=0be88ca2fe784888b6b798bd581d86e8]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 06:37:25.081046 12940 tablet_service.cc:1511] Processing CreateTablet for tablet 430a7e38b466414aade54cee76676332 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=0be88ca2fe784888b6b798bd581d86e8]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 06:37:25.081934 12668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 430a7e38b466414aade54cee76676332. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:25.082327 12940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 430a7e38b466414aade54cee76676332. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:25.087713 13218 tablet_service.cc:1511] Processing CreateTablet for tablet 430a7e38b466414aade54cee76676332 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=0be88ca2fe784888b6b798bd581d86e8]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 06:37:25.089099 13218 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 430a7e38b466414aade54cee76676332. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 06:37:25.090023 13418 tablet_bootstrap.cc:492] T 430a7e38b466414aade54cee76676332 P 73addbf307924744aba317baa7729212: Bootstrap starting.
I20260812 06:37:25.093758 13416 tablet_bootstrap.cc:492] T 430a7e38b466414aade54cee76676332 P de36baa29f7345fa806856c9562f1db1: Bootstrap starting.
I20260812 06:37:25.094267 13418 tablet_bootstrap.cc:654] T 430a7e38b466414aade54cee76676332 P 73addbf307924744aba317baa7729212: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:25.095546 13418 log.cc:826] T 430a7e38b466414aade54cee76676332 P 73addbf307924744aba317baa7729212: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:25.096669 13416 tablet_bootstrap.cc:654] T 430a7e38b466414aade54cee76676332 P de36baa29f7345fa806856c9562f1db1: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:25.097519 13416 log.cc:826] T 430a7e38b466414aade54cee76676332 P de36baa29f7345fa806856c9562f1db1: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:25.097771 13418 tablet_bootstrap.cc:492] T 430a7e38b466414aade54cee76676332 P 73addbf307924744aba317baa7729212: No bootstrap required, opened a new log
I20260812 06:37:25.098030 13418 ts_tablet_manager.cc:1403] T 430a7e38b466414aade54cee76676332 P 73addbf307924744aba317baa7729212: Time spent bootstrapping tablet: real 0.009s	user 0.007s	sys 0.000s
I20260812 06:37:25.099283 13416 tablet_bootstrap.cc:492] T 430a7e38b466414aade54cee76676332 P de36baa29f7345fa806856c9562f1db1: No bootstrap required, opened a new log
I20260812 06:37:25.099520 13416 ts_tablet_manager.cc:1403] T 430a7e38b466414aade54cee76676332 P de36baa29f7345fa806856c9562f1db1: Time spent bootstrapping tablet: real 0.006s	user 0.005s	sys 0.000s
I20260812 06:37:25.100330 13438 tablet_bootstrap.cc:492] T 430a7e38b466414aade54cee76676332 P 0be6742934084ecd8b780ac710ff107a: Bootstrap starting.
I20260812 06:37:25.102568 13418 raft_consensus.cc:359] T 430a7e38b466414aade54cee76676332 P 73addbf307924744aba317baa7729212 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73addbf307924744aba317baa7729212" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42879 } } peers { permanent_uuid: "0be6742934084ecd8b780ac710ff107a" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 36235 } } peers { permanent_uuid: "de36baa29f7345fa806856c9562f1db1" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 38853 } }
I20260812 06:37:25.102901 13418 raft_consensus.cc:385] T 430a7e38b466414aade54cee76676332 P 73addbf307924744aba317baa7729212 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:25.102986 13418 raft_consensus.cc:740] T 430a7e38b466414aade54cee76676332 P 73addbf307924744aba317baa7729212 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73addbf307924744aba317baa7729212, State: Initialized, Role: FOLLOWER
I20260812 06:37:25.102908 13416 raft_consensus.cc:359] T 430a7e38b466414aade54cee76676332 P de36baa29f7345fa806856c9562f1db1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73addbf307924744aba317baa7729212" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42879 } } peers { permanent_uuid: "0be6742934084ecd8b780ac710ff107a" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 36235 } } peers { permanent_uuid: "de36baa29f7345fa806856c9562f1db1" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 38853 } }
I20260812 06:37:25.103135 13416 raft_consensus.cc:385] T 430a7e38b466414aade54cee76676332 P de36baa29f7345fa806856c9562f1db1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:25.103178 13438 tablet_bootstrap.cc:654] T 430a7e38b466414aade54cee76676332 P 0be6742934084ecd8b780ac710ff107a: Neither blocks nor log segments found. Creating new log.
I20260812 06:37:25.103302 13416 raft_consensus.cc:740] T 430a7e38b466414aade54cee76676332 P de36baa29f7345fa806856c9562f1db1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de36baa29f7345fa806856c9562f1db1, State: Initialized, Role: FOLLOWER
I20260812 06:37:25.103505 13418 consensus_queue.cc:260] T 430a7e38b466414aade54cee76676332 P 73addbf307924744aba317baa7729212 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73addbf307924744aba317baa7729212" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42879 } } peers { permanent_uuid: "0be6742934084ecd8b780ac710ff107a" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 36235 } } peers { permanent_uuid: "de36baa29f7345fa806856c9562f1db1" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 38853 } }
I20260812 06:37:25.103736 13416 consensus_queue.cc:260] T 430a7e38b466414aade54cee76676332 P de36baa29f7345fa806856c9562f1db1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73addbf307924744aba317baa7729212" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42879 } } peers { permanent_uuid: "0be6742934084ecd8b780ac710ff107a" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 36235 } } peers { permanent_uuid: "de36baa29f7345fa806856c9562f1db1" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 38853 } }
I20260812 06:37:25.104192 13439 tablet_replica.cc:442] T 430a7e38b466414aade54cee76676332 P 73addbf307924744aba317baa7729212: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73addbf307924744aba317baa7729212" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42879 } } peers { permanent_uuid: "0be6742934084ecd8b780ac710ff107a" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 36235 } } peers { permanent_uuid: "de36baa29f7345fa806856c9562f1db1" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 38853 } } }
I20260812 06:37:25.104228 12806 heartbeater.cc:499] Master 127.6.203.62:44725 was elected leader, sending a full tablet report...
I20260812 06:37:25.104374 13439 tablet_replica.cc:445] T 430a7e38b466414aade54cee76676332 P 73addbf307924744aba317baa7729212: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:37:25.104518 13418 ts_tablet_manager.cc:1434] T 430a7e38b466414aade54cee76676332 P 73addbf307924744aba317baa7729212: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.004s
I20260812 06:37:25.104677 13416 ts_tablet_manager.cc:1434] T 430a7e38b466414aade54cee76676332 P de36baa29f7345fa806856c9562f1db1: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.005s
I20260812 06:37:25.105022 13082 heartbeater.cc:499] Master 127.6.203.62:44725 was elected leader, sending a full tablet report...
I20260812 06:37:25.105162 13440 tablet_replica.cc:442] T 430a7e38b466414aade54cee76676332 P de36baa29f7345fa806856c9562f1db1: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73addbf307924744aba317baa7729212" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42879 } } peers { permanent_uuid: "0be6742934084ecd8b780ac710ff107a" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 36235 } } peers { permanent_uuid: "de36baa29f7345fa806856c9562f1db1" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 38853 } } }
I20260812 06:37:25.104321 13438 log.cc:826] T 430a7e38b466414aade54cee76676332 P 0be6742934084ecd8b780ac710ff107a: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:25.105789 13440 tablet_replica.cc:445] T 430a7e38b466414aade54cee76676332 P de36baa29f7345fa806856c9562f1db1: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:37:25.107547 13440 raft_consensus.cc:493] T 430a7e38b466414aade54cee76676332 P de36baa29f7345fa806856c9562f1db1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:37:25.107717 13440 raft_consensus.cc:515] T 430a7e38b466414aade54cee76676332 P de36baa29f7345fa806856c9562f1db1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73addbf307924744aba317baa7729212" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42879 } } peers { permanent_uuid: "0be6742934084ecd8b780ac710ff107a" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 36235 } } peers { permanent_uuid: "de36baa29f7345fa806856c9562f1db1" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 38853 } }
I20260812 06:37:25.108899 13440 leader_election.cc:290] T 430a7e38b466414aade54cee76676332 P de36baa29f7345fa806856c9562f1db1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 73addbf307924744aba317baa7729212 (127.6.203.1:42879), 0be6742934084ecd8b780ac710ff107a (127.6.203.3:36235)
I20260812 06:37:25.112550 13438 tablet_bootstrap.cc:492] T 430a7e38b466414aade54cee76676332 P 0be6742934084ecd8b780ac710ff107a: No bootstrap required, opened a new log
I20260812 06:37:25.112883 13438 ts_tablet_manager.cc:1403] T 430a7e38b466414aade54cee76676332 P 0be6742934084ecd8b780ac710ff107a: Time spent bootstrapping tablet: real 0.013s	user 0.006s	sys 0.000s
I20260812 06:37:25.115183 13273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430a7e38b466414aade54cee76676332" candidate_uuid: "de36baa29f7345fa806856c9562f1db1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0be6742934084ecd8b780ac710ff107a" is_pre_election: true
I20260812 06:37:25.116206 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430a7e38b466414aade54cee76676332" candidate_uuid: "de36baa29f7345fa806856c9562f1db1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73addbf307924744aba317baa7729212" is_pre_election: true
W20260812 06:37:25.116291 12842 leader_election.cc:343] T 430a7e38b466414aade54cee76676332 P de36baa29f7345fa806856c9562f1db1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0be6742934084ecd8b780ac710ff107a (127.6.203.3:36235): Illegal state: must be running to vote when last-logged opid is not known
I20260812 06:37:25.116532 12707 raft_consensus.cc:2468] T 430a7e38b466414aade54cee76676332 P 73addbf307924744aba317baa7729212 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de36baa29f7345fa806856c9562f1db1 in term 0.
I20260812 06:37:25.116990 12847 leader_election.cc:304] T 430a7e38b466414aade54cee76676332 P de36baa29f7345fa806856c9562f1db1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73addbf307924744aba317baa7729212, de36baa29f7345fa806856c9562f1db1; no voters: 0be6742934084ecd8b780ac710ff107a
I20260812 06:37:25.117360 13440 raft_consensus.cc:2804] T 430a7e38b466414aade54cee76676332 P de36baa29f7345fa806856c9562f1db1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 06:37:25.117437 13440 raft_consensus.cc:493] T 430a7e38b466414aade54cee76676332 P de36baa29f7345fa806856c9562f1db1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:37:25.117486 13440 raft_consensus.cc:3060] T 430a7e38b466414aade54cee76676332 P de36baa29f7345fa806856c9562f1db1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:25.117841 13438 raft_consensus.cc:359] T 430a7e38b466414aade54cee76676332 P 0be6742934084ecd8b780ac710ff107a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73addbf307924744aba317baa7729212" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42879 } } peers { permanent_uuid: "0be6742934084ecd8b780ac710ff107a" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 36235 } } peers { permanent_uuid: "de36baa29f7345fa806856c9562f1db1" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 38853 } }
I20260812 06:37:25.118110 13438 raft_consensus.cc:385] T 430a7e38b466414aade54cee76676332 P 0be6742934084ecd8b780ac710ff107a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 06:37:25.118216 13438 raft_consensus.cc:740] T 430a7e38b466414aade54cee76676332 P 0be6742934084ecd8b780ac710ff107a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0be6742934084ecd8b780ac710ff107a, State: Initialized, Role: FOLLOWER
I20260812 06:37:25.118718 13440 raft_consensus.cc:515] T 430a7e38b466414aade54cee76676332 P de36baa29f7345fa806856c9562f1db1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73addbf307924744aba317baa7729212" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42879 } } peers { permanent_uuid: "0be6742934084ecd8b780ac710ff107a" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 36235 } } peers { permanent_uuid: "de36baa29f7345fa806856c9562f1db1" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 38853 } }
I20260812 06:37:25.118747 13438 consensus_queue.cc:260] T 430a7e38b466414aade54cee76676332 P 0be6742934084ecd8b780ac710ff107a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73addbf307924744aba317baa7729212" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42879 } } peers { permanent_uuid: "0be6742934084ecd8b780ac710ff107a" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 36235 } } peers { permanent_uuid: "de36baa29f7345fa806856c9562f1db1" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 38853 } }
I20260812 06:37:25.119168 13440 leader_election.cc:290] T 430a7e38b466414aade54cee76676332 P de36baa29f7345fa806856c9562f1db1 [CANDIDATE]: Term 1 election: Requested vote from peers 73addbf307924744aba317baa7729212 (127.6.203.1:42879), 0be6742934084ecd8b780ac710ff107a (127.6.203.3:36235)
I20260812 06:37:25.119743 13438 ts_tablet_manager.cc:1434] T 430a7e38b466414aade54cee76676332 P 0be6742934084ecd8b780ac710ff107a: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260812 06:37:25.119998 13273 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430a7e38b466414aade54cee76676332" candidate_uuid: "de36baa29f7345fa806856c9562f1db1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0be6742934084ecd8b780ac710ff107a"
I20260812 06:37:25.120168 13273 raft_consensus.cc:3060] T 430a7e38b466414aade54cee76676332 P 0be6742934084ecd8b780ac710ff107a [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:25.120189 13381 heartbeater.cc:499] Master 127.6.203.62:44725 was elected leader, sending a full tablet report...
I20260812 06:37:25.121732 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430a7e38b466414aade54cee76676332" candidate_uuid: "de36baa29f7345fa806856c9562f1db1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "73addbf307924744aba317baa7729212"
I20260812 06:37:25.121734 13273 raft_consensus.cc:2468] T 430a7e38b466414aade54cee76676332 P 0be6742934084ecd8b780ac710ff107a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de36baa29f7345fa806856c9562f1db1 in term 1.
I20260812 06:37:25.121889 12707 raft_consensus.cc:3060] T 430a7e38b466414aade54cee76676332 P 73addbf307924744aba317baa7729212 [term 0 FOLLOWER]: Advancing to term 1
I20260812 06:37:25.122678 12842 leader_election.cc:304] T 430a7e38b466414aade54cee76676332 P de36baa29f7345fa806856c9562f1db1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0be6742934084ecd8b780ac710ff107a, de36baa29f7345fa806856c9562f1db1; no voters: 
I20260812 06:37:25.122967 13440 raft_consensus.cc:2804] T 430a7e38b466414aade54cee76676332 P de36baa29f7345fa806856c9562f1db1 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 06:37:25.123099 12707 raft_consensus.cc:2468] T 430a7e38b466414aade54cee76676332 P 73addbf307924744aba317baa7729212 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de36baa29f7345fa806856c9562f1db1 in term 1.
I20260812 06:37:25.123260 13440 raft_consensus.cc:697] T 430a7e38b466414aade54cee76676332 P de36baa29f7345fa806856c9562f1db1 [term 1 LEADER]: Becoming Leader. State: Replica: de36baa29f7345fa806856c9562f1db1, State: Running, Role: LEADER
I20260812 06:37:25.123590 13440 consensus_queue.cc:237] T 430a7e38b466414aade54cee76676332 P de36baa29f7345fa806856c9562f1db1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73addbf307924744aba317baa7729212" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42879 } } peers { permanent_uuid: "0be6742934084ecd8b780ac710ff107a" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 36235 } } peers { permanent_uuid: "de36baa29f7345fa806856c9562f1db1" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 38853 } }
I20260812 06:37:25.124993 13448 tablet_replica.cc:442] T 430a7e38b466414aade54cee76676332 P 0be6742934084ecd8b780ac710ff107a: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73addbf307924744aba317baa7729212" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42879 } } peers { permanent_uuid: "0be6742934084ecd8b780ac710ff107a" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 36235 } } peers { permanent_uuid: "de36baa29f7345fa806856c9562f1db1" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 38853 } } }
I20260812 06:37:25.125160 13448 tablet_replica.cc:445] T 430a7e38b466414aade54cee76676332 P 0be6742934084ecd8b780ac710ff107a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:37:25.126073 13449 tablet_replica.cc:442] T 430a7e38b466414aade54cee76676332 P de36baa29f7345fa806856c9562f1db1: TxnStatusTablet state changed. Reason: New leader de36baa29f7345fa806856c9562f1db1. Latest consensus state: current_term: 1 leader_uuid: "de36baa29f7345fa806856c9562f1db1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73addbf307924744aba317baa7729212" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42879 } } peers { permanent_uuid: "0be6742934084ecd8b780ac710ff107a" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 36235 } } peers { permanent_uuid: "de36baa29f7345fa806856c9562f1db1" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 38853 } } }
I20260812 06:37:25.126185 13449 tablet_replica.cc:445] T 430a7e38b466414aade54cee76676332 P de36baa29f7345fa806856c9562f1db1: This TxnStatusTablet replica's current role is: LEADER
I20260812 06:37:25.126565 13466 txn_status_manager.cc:874] Waiting until node catch up with all replicated operations in previous term...
I20260812 06:37:25.126780 13466 txn_status_manager.cc:930] Loading transaction status metadata into memory...
I20260812 06:37:25.127142 12350 catalog_manager.cc:5719] T 430a7e38b466414aade54cee76676332 P de36baa29f7345fa806856c9562f1db1 reported cstate change: term changed from 0 to 1, leader changed from <none> to de36baa29f7345fa806856c9562f1db1 (127.6.203.2). New cstate: current_term: 1 leader_uuid: "de36baa29f7345fa806856c9562f1db1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73addbf307924744aba317baa7729212" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42879 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0be6742934084ecd8b780ac710ff107a" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 36235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de36baa29f7345fa806856c9562f1db1" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 38853 } health_report { overall_health: HEALTHY } } }
W20260812 06:37:25.137106 13475 txn_manager_proxy_rpc.cc:150] re-attempting BeginTransaction request to one of TxnManagers
W20260812 06:37:25.140761 13383 tablet.cc:2406] T 430a7e38b466414aade54cee76676332 P 0be6742934084ecd8b780ac710ff107a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 06:37:25.163890 13273 raft_consensus.cc:1275] T 430a7e38b466414aade54cee76676332 P 0be6742934084ecd8b780ac710ff107a [term 1 FOLLOWER]: Refusing update from remote peer de36baa29f7345fa806856c9562f1db1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:37:25.163923 12707 raft_consensus.cc:1275] T 430a7e38b466414aade54cee76676332 P 73addbf307924744aba317baa7729212 [term 1 FOLLOWER]: Refusing update from remote peer de36baa29f7345fa806856c9562f1db1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 06:37:25.164626 13449 consensus_queue.cc:1048] T 430a7e38b466414aade54cee76676332 P de36baa29f7345fa806856c9562f1db1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "73addbf307924744aba317baa7729212" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42879 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:37:25.164892 13440 consensus_queue.cc:1048] T 430a7e38b466414aade54cee76676332 P de36baa29f7345fa806856c9562f1db1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0be6742934084ecd8b780ac710ff107a" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 36235 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 06:37:25.169780 13448 tablet_replica.cc:442] T 430a7e38b466414aade54cee76676332 P 0be6742934084ecd8b780ac710ff107a: TxnStatusTablet state changed. Reason: New leader de36baa29f7345fa806856c9562f1db1. Latest consensus state: current_term: 1 leader_uuid: "de36baa29f7345fa806856c9562f1db1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73addbf307924744aba317baa7729212" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42879 } } peers { permanent_uuid: "0be6742934084ecd8b780ac710ff107a" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 36235 } } peers { permanent_uuid: "de36baa29f7345fa806856c9562f1db1" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 38853 } } }
I20260812 06:37:25.169919 13448 tablet_replica.cc:445] T 430a7e38b466414aade54cee76676332 P 0be6742934084ecd8b780ac710ff107a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:37:25.170388 13439 tablet_replica.cc:442] T 430a7e38b466414aade54cee76676332 P 73addbf307924744aba317baa7729212: TxnStatusTablet state changed. Reason: New leader de36baa29f7345fa806856c9562f1db1. Latest consensus state: current_term: 1 leader_uuid: "de36baa29f7345fa806856c9562f1db1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73addbf307924744aba317baa7729212" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42879 } } peers { permanent_uuid: "0be6742934084ecd8b780ac710ff107a" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 36235 } } peers { permanent_uuid: "de36baa29f7345fa806856c9562f1db1" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 38853 } } }
I20260812 06:37:25.170516 13439 tablet_replica.cc:445] T 430a7e38b466414aade54cee76676332 P 73addbf307924744aba317baa7729212: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:37:25.176049 13440 tablet_replica.cc:442] T 430a7e38b466414aade54cee76676332 P de36baa29f7345fa806856c9562f1db1: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "de36baa29f7345fa806856c9562f1db1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73addbf307924744aba317baa7729212" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42879 } } peers { permanent_uuid: "0be6742934084ecd8b780ac710ff107a" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 36235 } } peers { permanent_uuid: "de36baa29f7345fa806856c9562f1db1" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 38853 } } }
I20260812 06:37:25.176185 13440 tablet_replica.cc:445] T 430a7e38b466414aade54cee76676332 P de36baa29f7345fa806856c9562f1db1: This TxnStatusTablet replica's current role is: LEADER
I20260812 06:37:25.176939 13488 mvcc.cc:204] Tried to move back new op lower bound from 7317572178583498752 to 7317572178429763584. Current Snapshot: MvccSnapshot[applied={T|T < 7317572178583498752}]
I20260812 06:37:25.177244 13439 tablet_replica.cc:442] T 430a7e38b466414aade54cee76676332 P 73addbf307924744aba317baa7729212: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "de36baa29f7345fa806856c9562f1db1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73addbf307924744aba317baa7729212" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42879 } } peers { permanent_uuid: "0be6742934084ecd8b780ac710ff107a" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 36235 } } peers { permanent_uuid: "de36baa29f7345fa806856c9562f1db1" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 38853 } } }
I20260812 06:37:25.177359 13439 tablet_replica.cc:445] T 430a7e38b466414aade54cee76676332 P 73addbf307924744aba317baa7729212: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:37:25.177917 13448 tablet_replica.cc:442] T 430a7e38b466414aade54cee76676332 P 0be6742934084ecd8b780ac710ff107a: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "de36baa29f7345fa806856c9562f1db1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73addbf307924744aba317baa7729212" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42879 } } peers { permanent_uuid: "0be6742934084ecd8b780ac710ff107a" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 36235 } } peers { permanent_uuid: "de36baa29f7345fa806856c9562f1db1" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 38853 } } }
I20260812 06:37:25.178051 13448 tablet_replica.cc:445] T 430a7e38b466414aade54cee76676332 P 0be6742934084ecd8b780ac710ff107a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:37:25.178418 13449 tablet_replica.cc:442] T 430a7e38b466414aade54cee76676332 P de36baa29f7345fa806856c9562f1db1: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "de36baa29f7345fa806856c9562f1db1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73addbf307924744aba317baa7729212" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42879 } } peers { permanent_uuid: "0be6742934084ecd8b780ac710ff107a" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 36235 } } peers { permanent_uuid: "de36baa29f7345fa806856c9562f1db1" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 38853 } } }
I20260812 06:37:25.178535 13449 tablet_replica.cc:445] T 430a7e38b466414aade54cee76676332 P de36baa29f7345fa806856c9562f1db1: This TxnStatusTablet replica's current role is: LEADER
I20260812 06:37:25.184636  6956 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu with pid 12513
I20260812 06:37:25.203224  6956 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu with pid 12808
I20260812 06:37:25.226361  6956 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu with pid 13084
W20260812 06:37:25.437690 13397 meta_cache.cc:302] tablet 430a7e38b466414aade54cee76676332: replica de36baa29f7345fa806856c9562f1db1 (127.6.203.2:38853) has failed: Network error: Client connection negotiation failed: client connection to 127.6.203.2:38853: connect: Connection refused (error 111)
W20260812 06:37:25.575191 12424 rpcz_store.cc:267] Call kudu.transactions.TxnManagerService.KeepTransactionAlive from 127.0.0.1:47834 (request call id 3) took 139 ms (client timeout 124 ms). Trace:
W20260812 06:37:25.575323 12424 rpcz_store.cc:269] 0812 06:37:25.436161 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 06:37:25.436314 (+   153us) service_pool.cc:224] Handling call
0812 06:37:25.575152 (+138838us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260812 06:37:25.690016 12421 rpcz_store.cc:267] Call kudu.transactions.TxnManagerService.KeepTransactionAlive from 127.0.0.1:47834 (request call id 4) took 127 ms (client timeout 124 ms). Trace:
W20260812 06:37:25.690128 12421 rpcz_store.cc:269] 0812 06:37:25.563095 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 06:37:25.563217 (+   122us) service_pool.cc:224] Handling call
0812 06:37:25.689975 (+126758us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260812 06:37:25.819344 12424 rpcz_store.cc:267] Call kudu.transactions.TxnManagerService.KeepTransactionAlive from 127.0.0.1:47834 (request call id 5) took 129 ms (client timeout 124 ms). Trace:
W20260812 06:37:25.819494 12424 rpcz_store.cc:269] 0812 06:37:25.690174 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 06:37:25.690265 (+    91us) service_pool.cc:224] Handling call
0812 06:37:25.819315 (+129050us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260812 06:37:25.942668 13397 meta_cache.cc:1015] Timed out: LookupRpc { table: 'kudu_system.kudu_transactions', partition-key: (RANGE (txn_id): <redacted>), attempt: 1 } failed: LookupRpc timed out after deadline expired: GetTableLocations RPC to 127.6.203.62:44725 timed out after 0.001s (SENT)
W20260812 06:37:25.942971 12421 rpcz_store.cc:267] Call kudu.transactions.TxnManagerService.KeepTransactionAlive from 127.0.0.1:47834 (request call id 6) took 125 ms (client timeout 124 ms). Trace:
W20260812 06:37:25.943068 12421 rpcz_store.cc:269] 0812 06:37:25.817618 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 06:37:25.817828 (+   210us) service_pool.cc:224] Handling call
0812 06:37:25.942951 (+125123us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260812 06:37:26.077340 12421 rpcz_store.cc:267] Call kudu.transactions.TxnManagerService.KeepTransactionAlive from 127.0.0.1:47834 (request call id 7) took 132 ms (client timeout 124 ms). Trace:
W20260812 06:37:26.077461 12421 rpcz_store.cc:269] 0812 06:37:25.945022 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 06:37:25.945105 (+    83us) service_pool.cc:224] Handling call
0812 06:37:26.077311 (+132206us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260812 06:37:26.198292 12424 rpcz_store.cc:267] Call kudu.transactions.TxnManagerService.KeepTransactionAlive from 127.0.0.1:47834 (request call id 8) took 126 ms (client timeout 124 ms). Trace:
W20260812 06:37:26.198518 12424 rpcz_store.cc:269] 0812 06:37:26.072136 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 06:37:26.072332 (+   196us) service_pool.cc:224] Handling call
0812 06:37:26.198201 (+125869us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260812 06:37:26.326776 12424 rpcz_store.cc:267] Call kudu.transactions.TxnManagerService.KeepTransactionAlive from 127.0.0.1:47834 (request call id 9) took 127 ms (client timeout 124 ms). Trace:
W20260812 06:37:26.326906 12424 rpcz_store.cc:269] 0812 06:37:26.199376 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 06:37:26.199458 (+    82us) service_pool.cc:224] Handling call
0812 06:37:26.326743 (+127285us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260812 06:37:26.451413 12421 rpcz_store.cc:267] Call kudu.transactions.TxnManagerService.KeepTransactionAlive from 127.0.0.1:47834 (request call id 10) took 125 ms (client timeout 124 ms). Trace:
W20260812 06:37:26.451509 12421 rpcz_store.cc:269] 0812 06:37:26.326420 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 06:37:26.326521 (+   101us) service_pool.cc:224] Handling call
0812 06:37:26.451392 (+124871us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260812 06:37:26.455655 13397 meta_cache.cc:302] tablet 430a7e38b466414aade54cee76676332: replica de36baa29f7345fa806856c9562f1db1 (127.6.203.2:38853) has failed: Network error: Client connection negotiation failed: client connection to 127.6.203.2:38853: connect: Connection refused (error 111)
W20260812 06:37:26.584731 12421 rpcz_store.cc:267] Call kudu.transactions.TxnManagerService.KeepTransactionAlive from 127.0.0.1:47834 (request call id 11) took 131 ms (client timeout 124 ms). Trace:
W20260812 06:37:26.584843 12421 rpcz_store.cc:269] 0812 06:37:26.453428 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 06:37:26.453500 (+    72us) service_pool.cc:224] Handling call
0812 06:37:26.584707 (+131207us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260812 06:37:26.706341 12424 rpcz_store.cc:267] Call kudu.transactions.TxnManagerService.KeepTransactionAlive from 127.0.0.1:47834 (request call id 12) took 125 ms (client timeout 124 ms). Trace:
W20260812 06:37:26.706482 12424 rpcz_store.cc:269] 0812 06:37:26.580524 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 06:37:26.580652 (+   128us) service_pool.cc:224] Handling call
0812 06:37:26.706297 (+125645us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260812 06:37:26.749163  6956 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu
/tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.203.1:42879
--local_ip_for_outbound_sockets=127.6.203.1
--tserver_master_addrs=127.6.203.62:44725
--webserver_port=39665
--webserver_interface=127.6.203.1
--builtin_ntp_servers=127.6.203.20:38741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--txn_keepalive_interval_ms=500
--txn_staleness_tracker_interval_ms=100
--txn_staleness_tracker_disabled_interval_ms=100
--raft_heartbeat_interval_ms=50
--leader_failure_max_missed_heartbeat_periods=1.25
--enable_txn_system_client_init=true
--txn_schedule_background_tasks=false with env {}
W20260812 06:37:26.845486 12424 rpcz_store.cc:267] Call kudu.transactions.TxnManagerService.KeepTransactionAlive from 127.0.0.1:47834 (request call id 13) took 138 ms (client timeout 124 ms). Trace:
W20260812 06:37:26.845587 12424 rpcz_store.cc:269] 0812 06:37:26.707265 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 06:37:26.707338 (+    73us) service_pool.cc:224] Handling call
0812 06:37:26.845450 (+138112us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260812 06:37:26.867060 13508 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:26.867358 13508 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:26.867443 13508 flags.cc:432] Enabled unsafe flag: --txn_schedule_background_tasks=false
W20260812 06:37:26.867511 13508 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:26.871476 13508 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:26.871625 13508 flags.cc:432] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 06:37:26.871690 13508 flags.cc:432] Enabled experimental flag: --txn_staleness_tracker_interval_ms=100
W20260812 06:37:26.871726 13508 flags.cc:432] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 06:37:26.871840 13508 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.203.1
I20260812 06:37:26.876366 13508 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.203.20:38741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1.25
--raft_heartbeat_interval_ms=50
--fs_data_dirs=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.203.1:42879
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.6.203.1
--webserver_port=39665
--txn_keepalive_interval_ms=500
--txn_schedule_background_tasks=false
--txn_staleness_tracker_interval_ms=100
--enable_txn_system_client_init=true
--tserver_master_addrs=127.6.203.62:44725
--txn_staleness_tracker_disabled_interval_ms=100
--never_fsync=true
--heap_profile_path=/tmp/kudu.13508
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.203.1

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:26.877671 13508 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:26.878801 13508 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 06:37:26.882839 13508 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 06:37:26.887845 13514 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:26.887838 13517 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:26.887838 13515 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:26.887991 13508 server_base.cc:1061] running on GCE node
I20260812 06:37:26.888537 13508 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:26.889140 13508 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:26.890384 13508 hybrid_clock.cc:648] HybridClock initialized: now 1786516646890360 us; error 40 us; skew 500 ppm
I20260812 06:37:26.892679 13508 webserver.cc:533] Webserver started at http://127.6.203.1:39665/ using document root <none> and password file <none>
I20260812 06:37:26.893406 13508 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:26.893505 13508 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:26.897743 13508 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.003s	sys 0.000s
I20260812 06:37:26.899993 13526 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:26.901561 13508 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260812 06:37:26.901791 13508 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-0/data,/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-0/wal
uuid: "73addbf307924744aba317baa7729212"
format_stamp: "Formatted at 2026-08-12 06:37:24 on dist-test-slave-z8x9"
I20260812 06:37:26.902392 13508 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:26.917445 13508 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:26.918130 13508 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:26.918336 13508 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:26.920747 13546 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260812 06:37:26.924461 13508 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 06:37:26.924557 13508 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.004s	user 0.001s	sys 0.000s
I20260812 06:37:26.924628 13508 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260812 06:37:26.927201 13508 ts_tablet_manager.cc:616] Registered 1 tablets
I20260812 06:37:26.927287 13508 ts_tablet_manager.cc:595] Time spent register tablets: real 0.003s	user 0.003s	sys 0.000s
I20260812 06:37:26.927613 13546 tablet_bootstrap.cc:492] T 430a7e38b466414aade54cee76676332 P 73addbf307924744aba317baa7729212: Bootstrap starting.
I20260812 06:37:26.939670 13508 rpc_server.cc:307] RPC server started. Bound to: 127.6.203.1:42879
I20260812 06:37:26.939747 13802 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.203.1:42879 every 8 connection(s)
I20260812 06:37:26.941525 13508 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-0/data/info.pb
I20260812 06:37:26.944648 13803 heartbeater.cc:344] Connected to a master server at 127.6.203.62:44725
I20260812 06:37:26.944861 13803 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:26.945418 13803 heartbeater.cc:507] Master 127.6.203.62:44725 requested a full tablet report, sending...
I20260812 06:37:26.946930 13546 log.cc:826] T 430a7e38b466414aade54cee76676332 P 73addbf307924744aba317baa7729212: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:26.947296  6956 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu as pid 13508
I20260812 06:37:26.947717 12353 ts_manager.cc:194] Re-registered known tserver with Master: 73addbf307924744aba317baa7729212 (127.6.203.1:42879)
I20260812 06:37:26.947813  6956 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu
/tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.203.2:38853
--local_ip_for_outbound_sockets=127.6.203.2
--tserver_master_addrs=127.6.203.62:44725
--webserver_port=44721
--webserver_interface=127.6.203.2
--builtin_ntp_servers=127.6.203.20:38741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--txn_keepalive_interval_ms=500
--txn_staleness_tracker_interval_ms=100
--txn_staleness_tracker_disabled_interval_ms=100
--raft_heartbeat_interval_ms=50
--leader_failure_max_missed_heartbeat_periods=1.25
--enable_txn_system_client_init=true
--txn_schedule_background_tasks=false with env {}
I20260812 06:37:26.948999 12353 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.6.203.1:34401
I20260812 06:37:26.953043 13546 tablet_bootstrap.cc:492] T 430a7e38b466414aade54cee76676332 P 73addbf307924744aba317baa7729212: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:37:26.953677 13546 tablet_bootstrap.cc:492] T 430a7e38b466414aade54cee76676332 P 73addbf307924744aba317baa7729212: Bootstrap complete.
I20260812 06:37:26.954810 13546 ts_tablet_manager.cc:1403] T 430a7e38b466414aade54cee76676332 P 73addbf307924744aba317baa7729212: Time spent bootstrapping tablet: real 0.027s	user 0.016s	sys 0.007s
I20260812 06:37:26.957934 13546 raft_consensus.cc:359] T 430a7e38b466414aade54cee76676332 P 73addbf307924744aba317baa7729212 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73addbf307924744aba317baa7729212" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42879 } } peers { permanent_uuid: "0be6742934084ecd8b780ac710ff107a" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 36235 } } peers { permanent_uuid: "de36baa29f7345fa806856c9562f1db1" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 38853 } }
I20260812 06:37:26.958319 13546 raft_consensus.cc:740] T 430a7e38b466414aade54cee76676332 P 73addbf307924744aba317baa7729212 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 73addbf307924744aba317baa7729212, State: Initialized, Role: FOLLOWER
I20260812 06:37:26.958839 13546 consensus_queue.cc:260] T 430a7e38b466414aade54cee76676332 P 73addbf307924744aba317baa7729212 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73addbf307924744aba317baa7729212" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42879 } } peers { permanent_uuid: "0be6742934084ecd8b780ac710ff107a" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 36235 } } peers { permanent_uuid: "de36baa29f7345fa806856c9562f1db1" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 38853 } }
I20260812 06:37:26.959829 13546 ts_tablet_manager.cc:1434] T 430a7e38b466414aade54cee76676332 P 73addbf307924744aba317baa7729212: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
W20260812 06:37:26.960204 12421 rpcz_store.cc:267] Call kudu.transactions.TxnManagerService.KeepTransactionAlive from 127.0.0.1:47834 (request call id 14) took 126 ms (client timeout 124 ms). Trace:
W20260812 06:37:26.960295 12421 rpcz_store.cc:269] 0812 06:37:26.834249 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 06:37:26.834344 (+    95us) service_pool.cc:224] Handling call
0812 06:37:26.960178 (+125834us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260812 06:37:26.960388 13803 heartbeater.cc:499] Master 127.6.203.62:44725 was elected leader, sending a full tablet report...
I20260812 06:37:26.960392 13808 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73addbf307924744aba317baa7729212" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42879 } } peers { permanent_uuid: "0be6742934084ecd8b780ac710ff107a" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 36235 } } peers { permanent_uuid: "de36baa29f7345fa806856c9562f1db1" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 38853 } } }
I20260812 06:37:26.960604 13808 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:37:27.007413 13808 raft_consensus.cc:493] T 430a7e38b466414aade54cee76676332 P 73addbf307924744aba317baa7729212 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:37:27.007716 13808 raft_consensus.cc:515] T 430a7e38b466414aade54cee76676332 P 73addbf307924744aba317baa7729212 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73addbf307924744aba317baa7729212" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42879 } } peers { permanent_uuid: "0be6742934084ecd8b780ac710ff107a" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 36235 } } peers { permanent_uuid: "de36baa29f7345fa806856c9562f1db1" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 38853 } }
I20260812 06:37:27.009014 13808 leader_election.cc:290] T 430a7e38b466414aade54cee76676332 P 73addbf307924744aba317baa7729212 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0be6742934084ecd8b780ac710ff107a (127.6.203.3:36235), de36baa29f7345fa806856c9562f1db1 (127.6.203.2:38853)
W20260812 06:37:27.009589 13527 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.6.203.3:36235: connect: Connection refused (error 111)
W20260812 06:37:27.010542 13534 leader_election.cc:336] T 430a7e38b466414aade54cee76676332 P 73addbf307924744aba317baa7729212 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de36baa29f7345fa806856c9562f1db1 (127.6.203.2:38853): Network error: Client connection negotiation failed: client connection to 127.6.203.2:38853: connect: Connection refused (error 111)
W20260812 06:37:27.010759 13527 leader_election.cc:336] T 430a7e38b466414aade54cee76676332 P 73addbf307924744aba317baa7729212 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0be6742934084ecd8b780ac710ff107a (127.6.203.3:36235): Network error: Client connection negotiation failed: client connection to 127.6.203.3:36235: connect: Connection refused (error 111)
I20260812 06:37:27.010846 13527 leader_election.cc:304] T 430a7e38b466414aade54cee76676332 P 73addbf307924744aba317baa7729212 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73addbf307924744aba317baa7729212; no voters: 0be6742934084ecd8b780ac710ff107a, de36baa29f7345fa806856c9562f1db1
I20260812 06:37:27.011068 13808 raft_consensus.cc:2749] T 430a7e38b466414aade54cee76676332 P 73addbf307924744aba317baa7729212 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260812 06:37:27.082391 13806 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:27.082659 13806 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:27.082751 13806 flags.cc:432] Enabled unsafe flag: --txn_schedule_background_tasks=false
W20260812 06:37:27.082849 13806 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:27.087426 13806 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:27.087531 13806 flags.cc:432] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 06:37:27.087551 13806 flags.cc:432] Enabled experimental flag: --txn_staleness_tracker_interval_ms=100
W20260812 06:37:27.087613 13806 flags.cc:432] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 06:37:27.087716 13806 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.203.2
W20260812 06:37:27.090674 12421 rpcz_store.cc:267] Call kudu.transactions.TxnManagerService.KeepTransactionAlive from 127.0.0.1:47834 (request call id 15) took 129 ms (client timeout 124 ms). Trace:
W20260812 06:37:27.090777 12421 rpcz_store.cc:269] 0812 06:37:26.961496 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 06:37:26.961543 (+    47us) service_pool.cc:224] Handling call
0812 06:37:27.090651 (+129108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260812 06:37:27.092821 13806 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.203.20:38741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1.25
--raft_heartbeat_interval_ms=50
--fs_data_dirs=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.203.2:38853
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.6.203.2
--webserver_port=44721
--txn_keepalive_interval_ms=500
--txn_schedule_background_tasks=false
--txn_staleness_tracker_interval_ms=100
--enable_txn_system_client_init=true
--tserver_master_addrs=127.6.203.62:44725
--txn_staleness_tracker_disabled_interval_ms=100
--never_fsync=true
--heap_profile_path=/tmp/kudu.13806
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.203.2

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:27.094050 13806 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:27.095152 13806 file_cache.cc:504] Constructed file cache file cache with capacity 419430
I20260812 06:37:27.095863 13808 raft_consensus.cc:493] T 430a7e38b466414aade54cee76676332 P 73addbf307924744aba317baa7729212 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:37:27.095996 13808 raft_consensus.cc:515] T 430a7e38b466414aade54cee76676332 P 73addbf307924744aba317baa7729212 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73addbf307924744aba317baa7729212" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42879 } } peers { permanent_uuid: "0be6742934084ecd8b780ac710ff107a" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 36235 } } peers { permanent_uuid: "de36baa29f7345fa806856c9562f1db1" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 38853 } }
I20260812 06:37:27.096450 13808 leader_election.cc:290] T 430a7e38b466414aade54cee76676332 P 73addbf307924744aba317baa7729212 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0be6742934084ecd8b780ac710ff107a (127.6.203.3:36235), de36baa29f7345fa806856c9562f1db1 (127.6.203.2:38853)
W20260812 06:37:27.097764 13534 leader_election.cc:336] T 430a7e38b466414aade54cee76676332 P 73addbf307924744aba317baa7729212 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer de36baa29f7345fa806856c9562f1db1 (127.6.203.2:38853): Network error: Client connection negotiation failed: client connection to 127.6.203.2:38853: connect: Connection refused (error 111)
W20260812 06:37:27.097937 13527 leader_election.cc:336] T 430a7e38b466414aade54cee76676332 P 73addbf307924744aba317baa7729212 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0be6742934084ecd8b780ac710ff107a (127.6.203.3:36235): Network error: Client connection negotiation failed: client connection to 127.6.203.3:36235: connect: Connection refused (error 111)
I20260812 06:37:27.098021 13527 leader_election.cc:304] T 430a7e38b466414aade54cee76676332 P 73addbf307924744aba317baa7729212 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 73addbf307924744aba317baa7729212; no voters: 0be6742934084ecd8b780ac710ff107a, de36baa29f7345fa806856c9562f1db1
I20260812 06:37:27.098176 13808 raft_consensus.cc:2749] T 430a7e38b466414aade54cee76676332 P 73addbf307924744aba317baa7729212 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
E20260812 06:37:27.099159 13806 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 06:37:27.103477 13821 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:27.103571 13826 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:27.103785 13806 server_base.cc:1061] running on GCE node
W20260812 06:37:27.103917 13829 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:27.104374 13806 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:27.105062 13806 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:27.106297 13806 hybrid_clock.cc:648] HybridClock initialized: now 1786516647106269 us; error 70 us; skew 500 ppm
I20260812 06:37:27.108737 13806 webserver.cc:533] Webserver started at http://127.6.203.2:44721/ using document root <none> and password file <none>
I20260812 06:37:27.109506 13806 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:27.109615 13806 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:27.113050 13806 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 06:37:27.115247 13847 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:27.116640 13806 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260812 06:37:27.116823 13806 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-1/data,/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-1/wal
uuid: "de36baa29f7345fa806856c9562f1db1"
format_stamp: "Formatted at 2026-08-12 06:37:24 on dist-test-slave-z8x9"
I20260812 06:37:27.117334 13806 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:27.131454 13806 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:27.132172 13806 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:27.132378 13806 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:27.134362 13859 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260812 06:37:27.138195 13806 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 06:37:27.138284 13806 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.004s	user 0.001s	sys 0.000s
I20260812 06:37:27.138337 13806 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260812 06:37:27.140522 13806 ts_tablet_manager.cc:616] Registered 1 tablets
I20260812 06:37:27.140589 13806 ts_tablet_manager.cc:595] Time spent register tablets: real 0.002s	user 0.000s	sys 0.000s
I20260812 06:37:27.141942 13859 tablet_bootstrap.cc:492] T 430a7e38b466414aade54cee76676332 P de36baa29f7345fa806856c9562f1db1: Bootstrap starting.
I20260812 06:37:27.152186 13806 rpc_server.cc:307] RPC server started. Bound to: 127.6.203.2:38853
I20260812 06:37:27.152403 14093 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.203.2:38853 every 8 connection(s)
I20260812 06:37:27.153669 13806 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-1/data/info.pb
I20260812 06:37:27.156162 14096 heartbeater.cc:344] Connected to a master server at 127.6.203.62:44725
I20260812 06:37:27.156524 14096 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:27.157112 14096 heartbeater.cc:507] Master 127.6.203.62:44725 requested a full tablet report, sending...
I20260812 06:37:27.160126  6956 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu as pid 13806
I20260812 06:37:27.160486 12350 ts_manager.cc:194] Re-registered known tserver with Master: de36baa29f7345fa806856c9562f1db1 (127.6.203.2:38853)
I20260812 06:37:27.160606 13859 log.cc:826] T 430a7e38b466414aade54cee76676332 P de36baa29f7345fa806856c9562f1db1: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:27.160660  6956 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu
/tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.6.203.3:36235
--local_ip_for_outbound_sockets=127.6.203.3
--tserver_master_addrs=127.6.203.62:44725
--webserver_port=41489
--webserver_interface=127.6.203.3
--builtin_ntp_servers=127.6.203.20:38741
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--txn_keepalive_interval_ms=500
--txn_staleness_tracker_interval_ms=100
--txn_staleness_tracker_disabled_interval_ms=100
--raft_heartbeat_interval_ms=50
--leader_failure_max_missed_heartbeat_periods=1.25
--enable_txn_system_client_init=true
--txn_schedule_background_tasks=false with env {}
I20260812 06:37:27.161661 12350 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.6.203.2:59039
I20260812 06:37:27.166990 13859 tablet_bootstrap.cc:492] T 430a7e38b466414aade54cee76676332 P de36baa29f7345fa806856c9562f1db1: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:37:27.167484 13859 tablet_bootstrap.cc:492] T 430a7e38b466414aade54cee76676332 P de36baa29f7345fa806856c9562f1db1: Bootstrap complete.
I20260812 06:37:27.168628 13859 ts_tablet_manager.cc:1403] T 430a7e38b466414aade54cee76676332 P de36baa29f7345fa806856c9562f1db1: Time spent bootstrapping tablet: real 0.027s	user 0.018s	sys 0.005s
I20260812 06:37:27.171288 13859 raft_consensus.cc:359] T 430a7e38b466414aade54cee76676332 P de36baa29f7345fa806856c9562f1db1 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73addbf307924744aba317baa7729212" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42879 } } peers { permanent_uuid: "0be6742934084ecd8b780ac710ff107a" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 36235 } } peers { permanent_uuid: "de36baa29f7345fa806856c9562f1db1" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 38853 } }
I20260812 06:37:27.171661 13859 raft_consensus.cc:740] T 430a7e38b466414aade54cee76676332 P de36baa29f7345fa806856c9562f1db1 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: de36baa29f7345fa806856c9562f1db1, State: Initialized, Role: FOLLOWER
I20260812 06:37:27.172164 13859 consensus_queue.cc:260] T 430a7e38b466414aade54cee76676332 P de36baa29f7345fa806856c9562f1db1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73addbf307924744aba317baa7729212" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42879 } } peers { permanent_uuid: "0be6742934084ecd8b780ac710ff107a" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 36235 } } peers { permanent_uuid: "de36baa29f7345fa806856c9562f1db1" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 38853 } }
I20260812 06:37:27.172845 14105 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73addbf307924744aba317baa7729212" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42879 } } peers { permanent_uuid: "0be6742934084ecd8b780ac710ff107a" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 36235 } } peers { permanent_uuid: "de36baa29f7345fa806856c9562f1db1" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 38853 } } }
I20260812 06:37:27.172955 14096 heartbeater.cc:499] Master 127.6.203.62:44725 was elected leader, sending a full tablet report...
I20260812 06:37:27.173024 14105 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:37:27.173265 13859 ts_tablet_manager.cc:1434] T 430a7e38b466414aade54cee76676332 P de36baa29f7345fa806856c9562f1db1: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260812 06:37:27.223353 13808 raft_consensus.cc:493] T 430a7e38b466414aade54cee76676332 P 73addbf307924744aba317baa7729212 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 06:37:27.223522 13808 raft_consensus.cc:515] T 430a7e38b466414aade54cee76676332 P 73addbf307924744aba317baa7729212 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73addbf307924744aba317baa7729212" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42879 } } peers { permanent_uuid: "0be6742934084ecd8b780ac710ff107a" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 36235 } } peers { permanent_uuid: "de36baa29f7345fa806856c9562f1db1" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 38853 } }
I20260812 06:37:27.224033 13808 leader_election.cc:290] T 430a7e38b466414aade54cee76676332 P 73addbf307924744aba317baa7729212 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0be6742934084ecd8b780ac710ff107a (127.6.203.3:36235), de36baa29f7345fa806856c9562f1db1 (127.6.203.2:38853)
W20260812 06:37:27.225075 12424 rpcz_store.cc:267] Call kudu.transactions.TxnManagerService.KeepTransactionAlive from 127.0.0.1:47834 (request call id 16) took 136 ms (client timeout 124 ms). Trace:
W20260812 06:37:27.225152 12424 rpcz_store.cc:269] 0812 06:37:27.088462 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 06:37:27.088634 (+   172us) service_pool.cc:224] Handling call
0812 06:37:27.225051 (+136417us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260812 06:37:27.225347 13527 leader_election.cc:336] T 430a7e38b466414aade54cee76676332 P 73addbf307924744aba317baa7729212 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0be6742934084ecd8b780ac710ff107a (127.6.203.3:36235): Network error: Client connection negotiation failed: client connection to 127.6.203.3:36235: connect: Connection refused (error 111)
I20260812 06:37:27.229609 14007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430a7e38b466414aade54cee76676332" candidate_uuid: "73addbf307924744aba317baa7729212" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "de36baa29f7345fa806856c9562f1db1" is_pre_election: true
I20260812 06:37:27.229982 14007 raft_consensus.cc:2468] T 430a7e38b466414aade54cee76676332 P de36baa29f7345fa806856c9562f1db1 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 73addbf307924744aba317baa7729212 in term 1.
I20260812 06:37:27.230495 13534 leader_election.cc:304] T 430a7e38b466414aade54cee76676332 P 73addbf307924744aba317baa7729212 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73addbf307924744aba317baa7729212, de36baa29f7345fa806856c9562f1db1; no voters: 0be6742934084ecd8b780ac710ff107a
I20260812 06:37:27.230795 13808 raft_consensus.cc:2804] T 430a7e38b466414aade54cee76676332 P 73addbf307924744aba317baa7729212 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 06:37:27.230870 13808 raft_consensus.cc:493] T 430a7e38b466414aade54cee76676332 P 73addbf307924744aba317baa7729212 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 06:37:27.230923 13808 raft_consensus.cc:3060] T 430a7e38b466414aade54cee76676332 P 73addbf307924744aba317baa7729212 [term 1 FOLLOWER]: Advancing to term 2
I20260812 06:37:27.233652 13808 raft_consensus.cc:515] T 430a7e38b466414aade54cee76676332 P 73addbf307924744aba317baa7729212 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73addbf307924744aba317baa7729212" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42879 } } peers { permanent_uuid: "0be6742934084ecd8b780ac710ff107a" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 36235 } } peers { permanent_uuid: "de36baa29f7345fa806856c9562f1db1" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 38853 } }
I20260812 06:37:27.234407 13808 leader_election.cc:290] T 430a7e38b466414aade54cee76676332 P 73addbf307924744aba317baa7729212 [CANDIDATE]: Term 2 election: Requested vote from peers 0be6742934084ecd8b780ac710ff107a (127.6.203.3:36235), de36baa29f7345fa806856c9562f1db1 (127.6.203.2:38853)
I20260812 06:37:27.234716 14007 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "430a7e38b466414aade54cee76676332" candidate_uuid: "73addbf307924744aba317baa7729212" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "de36baa29f7345fa806856c9562f1db1"
I20260812 06:37:27.234858 14007 raft_consensus.cc:3060] T 430a7e38b466414aade54cee76676332 P de36baa29f7345fa806856c9562f1db1 [term 1 FOLLOWER]: Advancing to term 2
W20260812 06:37:27.235618 13527 leader_election.cc:336] T 430a7e38b466414aade54cee76676332 P 73addbf307924744aba317baa7729212 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 0be6742934084ecd8b780ac710ff107a (127.6.203.3:36235): Network error: Client connection negotiation failed: client connection to 127.6.203.3:36235: connect: Connection refused (error 111)
I20260812 06:37:27.237466 14007 raft_consensus.cc:2468] T 430a7e38b466414aade54cee76676332 P de36baa29f7345fa806856c9562f1db1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 73addbf307924744aba317baa7729212 in term 2.
I20260812 06:37:27.237864 13534 leader_election.cc:304] T 430a7e38b466414aade54cee76676332 P 73addbf307924744aba317baa7729212 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 73addbf307924744aba317baa7729212, de36baa29f7345fa806856c9562f1db1; no voters: 0be6742934084ecd8b780ac710ff107a
I20260812 06:37:27.238087 13808 raft_consensus.cc:2804] T 430a7e38b466414aade54cee76676332 P 73addbf307924744aba317baa7729212 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 06:37:27.238387 13808 raft_consensus.cc:697] T 430a7e38b466414aade54cee76676332 P 73addbf307924744aba317baa7729212 [term 2 LEADER]: Becoming Leader. State: Replica: 73addbf307924744aba317baa7729212, State: Running, Role: LEADER
I20260812 06:37:27.238899 13808 consensus_queue.cc:237] T 430a7e38b466414aade54cee76676332 P 73addbf307924744aba317baa7729212 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73addbf307924744aba317baa7729212" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42879 } } peers { permanent_uuid: "0be6742934084ecd8b780ac710ff107a" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 36235 } } peers { permanent_uuid: "de36baa29f7345fa806856c9562f1db1" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 38853 } }
I20260812 06:37:27.241676 14111 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: New leader 73addbf307924744aba317baa7729212. Latest consensus state: current_term: 2 leader_uuid: "73addbf307924744aba317baa7729212" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73addbf307924744aba317baa7729212" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42879 } } peers { permanent_uuid: "0be6742934084ecd8b780ac710ff107a" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 36235 } } peers { permanent_uuid: "de36baa29f7345fa806856c9562f1db1" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 38853 } } }
I20260812 06:37:27.241812 14111 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: LEADER
I20260812 06:37:27.242113 14113 txn_status_manager.cc:874] Waiting until node catch up with all replicated operations in previous term...
I20260812 06:37:27.242268 14113 txn_status_manager.cc:930] Loading transaction status metadata into memory...
I20260812 06:37:27.243321 12353 catalog_manager.cc:5719] T 430a7e38b466414aade54cee76676332 P 73addbf307924744aba317baa7729212 reported cstate change: term changed from 1 to 2, leader changed from de36baa29f7345fa806856c9562f1db1 (127.6.203.2) to 73addbf307924744aba317baa7729212 (127.6.203.1). New cstate: current_term: 2 leader_uuid: "73addbf307924744aba317baa7729212" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73addbf307924744aba317baa7729212" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42879 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0be6742934084ecd8b780ac710ff107a" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 36235 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de36baa29f7345fa806856c9562f1db1" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 38853 } health_report { overall_health: UNKNOWN } } }
I20260812 06:37:27.283476 14007 raft_consensus.cc:1275] T 430a7e38b466414aade54cee76676332 P de36baa29f7345fa806856c9562f1db1 [term 2 FOLLOWER]: Refusing update from remote peer 73addbf307924744aba317baa7729212: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260812 06:37:27.284241 14111 consensus_queue.cc:1048] T 430a7e38b466414aade54cee76676332 P 73addbf307924744aba317baa7729212 [LEADER]: Connected to new peer: Peer: permanent_uuid: "de36baa29f7345fa806856c9562f1db1" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 38853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 06:37:27.286733 14105 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: New leader 73addbf307924744aba317baa7729212. Latest consensus state: current_term: 2 leader_uuid: "73addbf307924744aba317baa7729212" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73addbf307924744aba317baa7729212" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42879 } } peers { permanent_uuid: "0be6742934084ecd8b780ac710ff107a" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 36235 } } peers { permanent_uuid: "de36baa29f7345fa806856c9562f1db1" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 38853 } } }
I20260812 06:37:27.286865 14105 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:37:27.288825 14111 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "73addbf307924744aba317baa7729212" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73addbf307924744aba317baa7729212" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42879 } } peers { permanent_uuid: "0be6742934084ecd8b780ac710ff107a" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 36235 } } peers { permanent_uuid: "de36baa29f7345fa806856c9562f1db1" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 38853 } } }
I20260812 06:37:27.288944 14111 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: LEADER
W20260812 06:37:27.290391 13527 consensus_peers.cc:597] T 430a7e38b466414aade54cee76676332 P 73addbf307924744aba317baa7729212 -> Peer 0be6742934084ecd8b780ac710ff107a (127.6.203.3:36235): Couldn't send request to peer 0be6742934084ecd8b780ac710ff107a. Status: Network error: Client connection negotiation failed: client connection to 127.6.203.3:36235: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 06:37:27.291363 14105 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "73addbf307924744aba317baa7729212" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73addbf307924744aba317baa7729212" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42879 } } peers { permanent_uuid: "0be6742934084ecd8b780ac710ff107a" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 36235 } } peers { permanent_uuid: "de36baa29f7345fa806856c9562f1db1" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 38853 } } }
I20260812 06:37:27.291472 14105 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: FOLLOWER
W20260812 06:37:27.302026 14102 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 06:37:27.302330 14102 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 06:37:27.302409 14102 flags.cc:432] Enabled unsafe flag: --txn_schedule_background_tasks=false
W20260812 06:37:27.302452 14102 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 06:37:27.305989 14102 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 06:37:27.306090 14102 flags.cc:432] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 06:37:27.306109 14102 flags.cc:432] Enabled experimental flag: --txn_staleness_tracker_interval_ms=100
W20260812 06:37:27.306175 14102 flags.cc:432] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 06:37:27.306281 14102 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.6.203.3
I20260812 06:37:27.310460 14102 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.6.203.20:38741
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1.25
--raft_heartbeat_interval_ms=50
--fs_data_dirs=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.6.203.3:36235
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.6.203.3
--webserver_port=41489
--txn_keepalive_interval_ms=500
--txn_schedule_background_tasks=false
--txn_staleness_tracker_interval_ms=100
--enable_txn_system_client_init=true
--tserver_master_addrs=127.6.203.62:44725
--txn_staleness_tracker_disabled_interval_ms=100
--never_fsync=true
--heap_profile_path=/tmp/kudu.14102
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.6.203.3

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 06:37:27.311666 14102 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 06:37:27.312846 14102 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 06:37:27.315719 14102 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 06:37:27.319917 14136 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:27.320152 14144 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 06:37:27.320176 14139 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 06:37:27.320415 14102 server_base.cc:1061] running on GCE node
I20260812 06:37:27.320864 14102 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 06:37:27.321501 14102 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 06:37:27.322705 14102 hybrid_clock.cc:648] HybridClock initialized: now 1786516647322684 us; error 37 us; skew 500 ppm
I20260812 06:37:27.324719 14102 webserver.cc:533] Webserver started at http://127.6.203.3:41489/ using document root <none> and password file <none>
I20260812 06:37:27.325425 14102 fs_manager.cc:362] Metadata directory not provided
I20260812 06:37:27.325503 14102 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 06:37:27.329356 14102 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260812 06:37:27.331915 14161 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 06:37:27.333070 14102 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 06:37:27.333292 14102 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-2/data,/tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-2/wal
uuid: "0be6742934084ecd8b780ac710ff107a"
format_stamp: "Formatted at 2026-08-12 06:37:24 on dist-test-slave-z8x9"
I20260812 06:37:27.333774 14102 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 06:37:27.373340 14102 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 06:37:27.374100 14102 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 06:37:27.374330 14102 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 06:37:27.377034 14176 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260812 06:37:27.381650 14102 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 06:37:27.381748 14102 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.005s	user 0.001s	sys 0.000s
I20260812 06:37:27.381834 14102 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260812 06:37:27.384495 14102 ts_tablet_manager.cc:616] Registered 1 tablets
I20260812 06:37:27.384564 14102 ts_tablet_manager.cc:595] Time spent register tablets: real 0.003s	user 0.002s	sys 0.000s
I20260812 06:37:27.387987 14176 tablet_bootstrap.cc:492] T 430a7e38b466414aade54cee76676332 P 0be6742934084ecd8b780ac710ff107a: Bootstrap starting.
I20260812 06:37:27.396922 14102 rpc_server.cc:307] RPC server started. Bound to: 127.6.203.3:36235
I20260812 06:37:27.396947 14398 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.6.203.3:36235 every 8 connection(s)
I20260812 06:37:27.398193 14102 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskJ_yRM0/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786516615841258-6956-0/minicluster-data/ts-2/data/info.pb
I20260812 06:37:27.400907 14399 heartbeater.cc:344] Connected to a master server at 127.6.203.62:44725
I20260812 06:37:27.401207 14399 heartbeater.cc:461] Registering TS with master...
I20260812 06:37:27.401641  6956 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu as pid 14102
I20260812 06:37:27.401950 14399 heartbeater.cc:507] Master 127.6.203.62:44725 requested a full tablet report, sending...
I20260812 06:37:27.404105 12353 ts_manager.cc:194] Re-registered known tserver with Master: 0be6742934084ecd8b780ac710ff107a (127.6.203.3:36235)
I20260812 06:37:27.405035 12353 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.6.203.3:55501
I20260812 06:37:27.411851 14176 log.cc:826] T 430a7e38b466414aade54cee76676332 P 0be6742934084ecd8b780ac710ff107a: Log is configured to *not* fsync() on all Append() calls
I20260812 06:37:27.418619 14176 tablet_bootstrap.cc:492] T 430a7e38b466414aade54cee76676332 P 0be6742934084ecd8b780ac710ff107a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 06:37:27.419250 14176 tablet_bootstrap.cc:492] T 430a7e38b466414aade54cee76676332 P 0be6742934084ecd8b780ac710ff107a: Bootstrap complete.
I20260812 06:37:27.421171 14176 ts_tablet_manager.cc:1403] T 430a7e38b466414aade54cee76676332 P 0be6742934084ecd8b780ac710ff107a: Time spent bootstrapping tablet: real 0.036s	user 0.014s	sys 0.010s
I20260812 06:37:27.424923 14176 raft_consensus.cc:359] T 430a7e38b466414aade54cee76676332 P 0be6742934084ecd8b780ac710ff107a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73addbf307924744aba317baa7729212" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42879 } } peers { permanent_uuid: "0be6742934084ecd8b780ac710ff107a" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 36235 } } peers { permanent_uuid: "de36baa29f7345fa806856c9562f1db1" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 38853 } }
I20260812 06:37:27.425494 14176 raft_consensus.cc:740] T 430a7e38b466414aade54cee76676332 P 0be6742934084ecd8b780ac710ff107a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0be6742934084ecd8b780ac710ff107a, State: Initialized, Role: FOLLOWER
I20260812 06:37:27.426118 14176 consensus_queue.cc:260] T 430a7e38b466414aade54cee76676332 P 0be6742934084ecd8b780ac710ff107a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73addbf307924744aba317baa7729212" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42879 } } peers { permanent_uuid: "0be6742934084ecd8b780ac710ff107a" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 36235 } } peers { permanent_uuid: "de36baa29f7345fa806856c9562f1db1" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 38853 } }
I20260812 06:37:27.427356 14176 ts_tablet_manager.cc:1434] T 430a7e38b466414aade54cee76676332 P 0be6742934084ecd8b780ac710ff107a: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260812 06:37:27.427452 14399 heartbeater.cc:499] Master 127.6.203.62:44725 was elected leader, sending a full tablet report...
I20260812 06:37:27.427403 14406 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73addbf307924744aba317baa7729212" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42879 } } peers { permanent_uuid: "0be6742934084ecd8b780ac710ff107a" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 36235 } } peers { permanent_uuid: "de36baa29f7345fa806856c9562f1db1" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 38853 } } }
I20260812 06:37:27.427556 14406 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:37:27.451813 14289 raft_consensus.cc:3060] T 430a7e38b466414aade54cee76676332 P 0be6742934084ecd8b780ac710ff107a [term 1 FOLLOWER]: Advancing to term 2
I20260812 06:37:27.455866 14414 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "73addbf307924744aba317baa7729212" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73addbf307924744aba317baa7729212" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42879 } } peers { permanent_uuid: "0be6742934084ecd8b780ac710ff107a" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 36235 } } peers { permanent_uuid: "de36baa29f7345fa806856c9562f1db1" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 38853 } } }
I20260812 06:37:27.456246 14414 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:37:27.456691 14406 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: New leader 73addbf307924744aba317baa7729212. Latest consensus state: current_term: 2 leader_uuid: "73addbf307924744aba317baa7729212" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73addbf307924744aba317baa7729212" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42879 } } peers { permanent_uuid: "0be6742934084ecd8b780ac710ff107a" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 36235 } } peers { permanent_uuid: "de36baa29f7345fa806856c9562f1db1" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 38853 } } }
I20260812 06:37:27.456811 14406 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 06:37:27.506506 13808 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "73addbf307924744aba317baa7729212" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73addbf307924744aba317baa7729212" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42879 } } peers { permanent_uuid: "0be6742934084ecd8b780ac710ff107a" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 36235 } } peers { permanent_uuid: "de36baa29f7345fa806856c9562f1db1" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 38853 } } }
I20260812 06:37:27.506685 13808 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: LEADER
I20260812 06:37:29.917711  6956 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu with pid 13508
I20260812 06:37:29.948285  6956 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu with pid 13806
I20260812 06:37:29.977489 14439 raft_consensus.cc:493] T 430a7e38b466414aade54cee76676332 P 0be6742934084ecd8b780ac710ff107a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 73addbf307924744aba317baa7729212)
I20260812 06:37:29.977705 14439 raft_consensus.cc:515] T 430a7e38b466414aade54cee76676332 P 0be6742934084ecd8b780ac710ff107a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "73addbf307924744aba317baa7729212" member_type: VOTER last_known_addr { host: "127.6.203.1" port: 42879 } } peers { permanent_uuid: "0be6742934084ecd8b780ac710ff107a" member_type: VOTER last_known_addr { host: "127.6.203.3" port: 36235 } } peers { permanent_uuid: "de36baa29f7345fa806856c9562f1db1" member_type: VOTER last_known_addr { host: "127.6.203.2" port: 38853 } }
I20260812 06:37:29.980084  6956 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu with pid 14102
I20260812 06:37:29.996524  6956 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskJ_yRM0/build/debug/bin/kudu with pid 12292
2026-08-12T06:37:30Z chronyd exiting
[       OK ] TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted (6256 ms)
[----------] 4 tests from TxnStatusManagerITest (34178 ms total)

[----------] Global test environment tear-down
[==========] 4 tests from 1 test suite ran. (34178 ms total)
[  PASSED  ] 4 tests.
