[==========] Running 4 tests from 1 test suite.
[----------] Global test environment set-up.
[----------] 4 tests from TxnStatusManagerITest
[ RUN      ] TxnStatusManagerITest.StaleTransactionsCleanup
2026-08-12T08:03:07Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T08:03:07Z Disabled control of system clock
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260812 08:03:07.240442 13037 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu
/tmp/dist-test-tasksRvS6i/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786521787214093-13037-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786521787214093-13037-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786521787214093-13037-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786521787214093-13037-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.187.126:41115
--webserver_interface=127.12.187.126
--webserver_port=0
--builtin_ntp_servers=127.12.187.84:35341
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.187.126:41115
--txn_manager_enabled=true
--txn_manager_lazily_initialized=false with env {}
W20260812 08:03:07.343880 13047 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:07.344117 13047 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:07.344157 13047 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:03:07.347545 13047 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:03:07.347615 13047 flags.cc:432] Enabled experimental flag: --txn_manager_enabled=true
W20260812 08:03:07.347632 13047 flags.cc:432] Enabled experimental flag: --txn_manager_lazily_initialized=false
W20260812 08:03:07.347647 13047 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:07.347666 13047 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:03:07.347684 13047 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:03:07.351524 13047 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786521787214093-13037-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.187.84:35341
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786521787214093-13037-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786521787214093-13037-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.187.126:41115
--txn_manager_enabled=true
--txn_manager_lazily_initialized=false
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.187.126:41115
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786521787214093-13037-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.187.126
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.13047
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:07.352608 13047 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:07.353768 13047 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:03:07.359154 13061 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:07.359222 13058 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:07.359344 13047 server_base.cc:1061] running on GCE node
W20260812 08:03:07.359221 13057 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:07.359937 13047 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:07.360831 13047 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:07.362010 13047 hybrid_clock.cc:648] HybridClock initialized: now 1786521787362021 us; error 56 us; skew 500 ppm
I20260812 08:03:07.363775 13047 webserver.cc:533] Webserver started at http://127.12.187.126:45709/ using document root <none> and password file <none>
I20260812 08:03:07.364353 13047 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:07.364439 13047 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:07.364653 13047 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:03:07.366276 13047 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786521787214093-13037-0/minicluster-data/master-0/data/instance:
uuid: "12b4e338524b4ef0af815ab2efab4c12"
format_stamp: "Formatted at 2026-08-12 08:03:07 on dist-test-slave-8hhm"
I20260812 08:03:07.366758 13047 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786521787214093-13037-0/minicluster-data/master-0/wal/instance:
uuid: "12b4e338524b4ef0af815ab2efab4c12"
format_stamp: "Formatted at 2026-08-12 08:03:07 on dist-test-slave-8hhm"
I20260812 08:03:07.370041 13047 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260812 08:03:07.372211 13069 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:07.373133 13047 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:03:07.373302 13047 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786521787214093-13037-0/minicluster-data/master-0/data,/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786521787214093-13037-0/minicluster-data/master-0/wal
uuid: "12b4e338524b4ef0af815ab2efab4c12"
format_stamp: "Formatted at 2026-08-12 08:03:07 on dist-test-slave-8hhm"
I20260812 08:03:07.373405 13047 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786521787214093-13037-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786521787214093-13037-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786521787214093-13037-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:07.382481 13047 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:07.383081 13047 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:07.383268 13047 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:07.391608 13047 rpc_server.cc:307] RPC server started. Bound to: 127.12.187.126:41115
I20260812 08:03:07.391620 13180 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.187.126:41115 every 8 connection(s)
I20260812 08:03:07.392619 13047 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786521787214093-13037-0/minicluster-data/master-0/data/info.pb
I20260812 08:03:07.395377 13181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:03:07.396155 13037 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu as pid 13047
I20260812 08:03:07.396312 13037 external_mini_cluster.cc:1448] Reading /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786521787214093-13037-0/minicluster-data/master-0/wal/instance
I20260812 08:03:07.400660 13181 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 12b4e338524b4ef0af815ab2efab4c12: Bootstrap starting.
I20260812 08:03:07.402946 13181 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 12b4e338524b4ef0af815ab2efab4c12: Neither blocks nor log segments found. Creating new log.
I20260812 08:03:07.403823 13181 log.cc:826] T 00000000000000000000000000000000 P 12b4e338524b4ef0af815ab2efab4c12: Log is configured to *not* fsync() on all Append() calls
I20260812 08:03:07.405524 13181 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 12b4e338524b4ef0af815ab2efab4c12: No bootstrap required, opened a new log
I20260812 08:03:07.407887 13181 raft_consensus.cc:359] T 00000000000000000000000000000000 P 12b4e338524b4ef0af815ab2efab4c12 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12b4e338524b4ef0af815ab2efab4c12" member_type: VOTER last_known_addr { host: "127.12.187.126" port: 41115 } }
I20260812 08:03:07.408066 13181 raft_consensus.cc:385] T 00000000000000000000000000000000 P 12b4e338524b4ef0af815ab2efab4c12 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:03:07.408145 13181 raft_consensus.cc:740] T 00000000000000000000000000000000 P 12b4e338524b4ef0af815ab2efab4c12 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 12b4e338524b4ef0af815ab2efab4c12, State: Initialized, Role: FOLLOWER
I20260812 08:03:07.408617 13181 consensus_queue.cc:260] T 00000000000000000000000000000000 P 12b4e338524b4ef0af815ab2efab4c12 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12b4e338524b4ef0af815ab2efab4c12" member_type: VOTER last_known_addr { host: "127.12.187.126" port: 41115 } }
I20260812 08:03:07.408764 13181 raft_consensus.cc:399] T 00000000000000000000000000000000 P 12b4e338524b4ef0af815ab2efab4c12 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 08:03:07.408865 13181 raft_consensus.cc:493] T 00000000000000000000000000000000 P 12b4e338524b4ef0af815ab2efab4c12 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 08:03:07.408993 13181 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 12b4e338524b4ef0af815ab2efab4c12 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:03:07.409895 13181 raft_consensus.cc:515] T 00000000000000000000000000000000 P 12b4e338524b4ef0af815ab2efab4c12 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12b4e338524b4ef0af815ab2efab4c12" member_type: VOTER last_known_addr { host: "127.12.187.126" port: 41115 } }
I20260812 08:03:07.410262 13181 leader_election.cc:304] T 00000000000000000000000000000000 P 12b4e338524b4ef0af815ab2efab4c12 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 12b4e338524b4ef0af815ab2efab4c12; no voters: 
I20260812 08:03:07.410561 13181 leader_election.cc:290] T 00000000000000000000000000000000 P 12b4e338524b4ef0af815ab2efab4c12 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 08:03:07.410701 13189 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 12b4e338524b4ef0af815ab2efab4c12 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:03:07.410949 13189 raft_consensus.cc:697] T 00000000000000000000000000000000 P 12b4e338524b4ef0af815ab2efab4c12 [term 1 LEADER]: Becoming Leader. State: Replica: 12b4e338524b4ef0af815ab2efab4c12, State: Running, Role: LEADER
I20260812 08:03:07.411301 13189 consensus_queue.cc:237] T 00000000000000000000000000000000 P 12b4e338524b4ef0af815ab2efab4c12 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12b4e338524b4ef0af815ab2efab4c12" member_type: VOTER last_known_addr { host: "127.12.187.126" port: 41115 } }
I20260812 08:03:07.411650 13181 sys_catalog.cc:565] T 00000000000000000000000000000000 P 12b4e338524b4ef0af815ab2efab4c12 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 08:03:07.412865 13192 sys_catalog.cc:455] T 00000000000000000000000000000000 P 12b4e338524b4ef0af815ab2efab4c12 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "12b4e338524b4ef0af815ab2efab4c12" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12b4e338524b4ef0af815ab2efab4c12" member_type: VOTER last_known_addr { host: "127.12.187.126" port: 41115 } } }
I20260812 08:03:07.412990 13192 sys_catalog.cc:458] T 00000000000000000000000000000000 P 12b4e338524b4ef0af815ab2efab4c12 [sys.catalog]: This master's current role is: LEADER
I20260812 08:03:07.413364 13202 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:03:07.413339 13193 sys_catalog.cc:455] T 00000000000000000000000000000000 P 12b4e338524b4ef0af815ab2efab4c12 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 12b4e338524b4ef0af815ab2efab4c12. Latest consensus state: current_term: 1 leader_uuid: "12b4e338524b4ef0af815ab2efab4c12" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "12b4e338524b4ef0af815ab2efab4c12" member_type: VOTER last_known_addr { host: "127.12.187.126" port: 41115 } } }
I20260812 08:03:07.414090 13193 sys_catalog.cc:458] T 00000000000000000000000000000000 P 12b4e338524b4ef0af815ab2efab4c12 [sys.catalog]: This master's current role is: LEADER
I20260812 08:03:07.416411 13202 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:03:07.421818 13202 catalog_manager.cc:1383] Generated new cluster ID: c2f5e2ec4397483cae6da0cc82d608be
I20260812 08:03:07.421921 13202 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:03:07.436111 13202 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 08:03:07.437004 13202 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:03:07.443981 13202 catalog_manager.cc:6092] T 00000000000000000000000000000000 P 12b4e338524b4ef0af815ab2efab4c12: Generated new TSK 0
I20260812 08:03:07.444614 13202 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 08:03:07.449812 13037 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu
/tmp/dist-test-tasksRvS6i/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786521787214093-13037-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786521787214093-13037-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786521787214093-13037-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786521787214093-13037-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.187.65:0
--local_ip_for_outbound_sockets=127.12.187.65
--webserver_interface=127.12.187.65
--webserver_port=0
--tserver_master_addrs=127.12.187.126:41115
--builtin_ntp_servers=127.12.187.84:35341
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--txn_keepalive_interval_ms=500
--txn_staleness_tracker_interval_ms=100
--txn_staleness_tracker_disabled_interval_ms=100
--raft_heartbeat_interval_ms=50
--leader_failure_max_missed_heartbeat_periods=1.25
--enable_txn_system_client_init=true
--txn_schedule_background_tasks=false with env {}
I20260812 08:03:07.450647 13100 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47076:
name: "kudu_system.kudu_transactions"
schema {
  columns {
    name: "txn_id"
    type: INT64
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "entry_type"
    type: INT8
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "identifier"
    type: STRING
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "metadata"
    type: STRING
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
  indirect_data: "<redacted>"""
}
partition_schema {
  range_schema {
    columns {
      name: "txn_id"
    }
  }
}
table_type: TXN_STATUS_TABLE
W20260812 08:03:07.455490 13181 master.cc:465] Invalid argument: unable to initialize TxnManager: Error creating table kudu_system.kudu_transactions on the master: not enough live tablet servers to create a table with the requested replication factor 3; 0 tablet servers are alive: unable to init TxnManager, will retry in 1.000s
W20260812 08:03:07.554852 13225 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:07.555068 13225 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:07.555110 13225 flags.cc:432] Enabled unsafe flag: --txn_schedule_background_tasks=false
W20260812 08:03:07.555186 13225 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:03:07.558506 13225 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:07.558583 13225 flags.cc:432] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 08:03:07.558602 13225 flags.cc:432] Enabled experimental flag: --txn_staleness_tracker_interval_ms=100
W20260812 08:03:07.558655 13225 flags.cc:432] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 08:03:07.558743 13225 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.187.65
I20260812 08:03:07.562501 13225 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786521787214093-13037-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.187.84:35341
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1.25
--raft_heartbeat_interval_ms=50
--fs_data_dirs=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786521787214093-13037-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786521787214093-13037-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.187.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786521787214093-13037-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.187.65
--webserver_port=0
--txn_keepalive_interval_ms=500
--txn_schedule_background_tasks=false
--txn_staleness_tracker_interval_ms=100
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.187.126:41115
--txn_staleness_tracker_disabled_interval_ms=100
--never_fsync=true
--heap_profile_path=/tmp/kudu.13225
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.187.65

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:07.563529 13225 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:07.564606 13225 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 08:03:07.567399 13225 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 08:03:07.571017 13239 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:07.571002 13244 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:07.571067 13242 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:07.571626 13225 server_base.cc:1061] running on GCE node
I20260812 08:03:07.572005 13225 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:07.572578 13225 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:07.573741 13225 hybrid_clock.cc:648] HybridClock initialized: now 1786521787573723 us; error 34 us; skew 500 ppm
I20260812 08:03:07.575686 13225 webserver.cc:533] Webserver started at http://127.12.187.65:39519/ using document root <none> and password file <none>
I20260812 08:03:07.576268 13225 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:07.576323 13225 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:07.576520 13225 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:03:07.578200 13225 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786521787214093-13037-0/minicluster-data/ts-0/data/instance:
uuid: "5f9145c2a7554c3aaa5b82e59a008f29"
format_stamp: "Formatted at 2026-08-12 08:03:07 on dist-test-slave-8hhm"
I20260812 08:03:07.578684 13225 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786521787214093-13037-0/minicluster-data/ts-0/wal/instance:
uuid: "5f9145c2a7554c3aaa5b82e59a008f29"
format_stamp: "Formatted at 2026-08-12 08:03:07 on dist-test-slave-8hhm"
I20260812 08:03:07.582038 13225 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260812 08:03:07.584401 13259 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:07.585568 13225 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:03:07.585706 13225 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786521787214093-13037-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786521787214093-13037-0/minicluster-data/ts-0/wal
uuid: "5f9145c2a7554c3aaa5b82e59a008f29"
format_stamp: "Formatted at 2026-08-12 08:03:07 on dist-test-slave-8hhm"
I20260812 08:03:07.585817 13225 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786521787214093-13037-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786521787214093-13037-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786521787214093-13037-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:07.606244 13225 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:07.606849 13225 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:07.607038 13225 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:07.608590 13225 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:03:07.608660 13225 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:07.608726 13225 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:03:07.608771 13225 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:07.620252 13225 rpc_server.cc:307] RPC server started. Bound to: 127.12.187.65:41007
I20260812 08:03:07.620272 13469 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.187.65:41007 every 8 connection(s)
I20260812 08:03:07.621160 13225 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786521787214093-13037-0/minicluster-data/ts-0/data/info.pb
I20260812 08:03:07.622545 13471 heartbeater.cc:344] Connected to a master server at 127.12.187.126:41115
I20260812 08:03:07.622715 13471 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:07.623209 13471 heartbeater.cc:507] Master 127.12.187.126:41115 requested a full tablet report, sending...
I20260812 08:03:07.624624 13100 ts_manager.cc:194] Registered new tserver with Master: 5f9145c2a7554c3aaa5b82e59a008f29 (127.12.187.65:41007)
I20260812 08:03:07.625973 13100 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.12.187.65:49009
I20260812 08:03:07.626556 13037 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu as pid 13225
I20260812 08:03:07.626688 13037 external_mini_cluster.cc:1448] Reading /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786521787214093-13037-0/minicluster-data/ts-0/wal/instance
I20260812 08:03:07.628760 13037 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu
/tmp/dist-test-tasksRvS6i/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786521787214093-13037-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786521787214093-13037-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786521787214093-13037-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786521787214093-13037-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.187.66:0
--local_ip_for_outbound_sockets=127.12.187.66
--webserver_interface=127.12.187.66
--webserver_port=0
--tserver_master_addrs=127.12.187.126:41115
--builtin_ntp_servers=127.12.187.84:35341
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--txn_keepalive_interval_ms=500
--txn_staleness_tracker_interval_ms=100
--txn_staleness_tracker_disabled_interval_ms=100
--raft_heartbeat_interval_ms=50
--leader_failure_max_missed_heartbeat_periods=1.25
--enable_txn_system_client_init=true
--txn_schedule_background_tasks=false with env {}
W20260812 08:03:07.732787 13473 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:07.733012 13473 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:07.733062 13473 flags.cc:432] Enabled unsafe flag: --txn_schedule_background_tasks=false
W20260812 08:03:07.733091 13473 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:03:07.736285 13473 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:07.736364 13473 flags.cc:432] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 08:03:07.736383 13473 flags.cc:432] Enabled experimental flag: --txn_staleness_tracker_interval_ms=100
W20260812 08:03:07.736399 13473 flags.cc:432] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 08:03:07.736440 13473 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.187.66
I20260812 08:03:07.740280 13473 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786521787214093-13037-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.187.84:35341
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1.25
--raft_heartbeat_interval_ms=50
--fs_data_dirs=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786521787214093-13037-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786521787214093-13037-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.187.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786521787214093-13037-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.187.66
--webserver_port=0
--txn_keepalive_interval_ms=500
--txn_schedule_background_tasks=false
--txn_staleness_tracker_interval_ms=100
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.187.126:41115
--txn_staleness_tracker_disabled_interval_ms=100
--never_fsync=true
--heap_profile_path=/tmp/kudu.13473
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.187.66

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:07.741318 13473 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:07.742420 13473 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 08:03:07.745070 13473 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 08:03:07.748939 13480 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:07.748999 13482 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:07.749022 13479 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:07.749185 13473 server_base.cc:1061] running on GCE node
I20260812 08:03:07.749588 13473 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:07.750165 13473 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:07.751314 13473 hybrid_clock.cc:648] HybridClock initialized: now 1786521787751298 us; error 35 us; skew 500 ppm
I20260812 08:03:07.753296 13473 webserver.cc:533] Webserver started at http://127.12.187.66:46807/ using document root <none> and password file <none>
I20260812 08:03:07.753877 13473 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:07.753959 13473 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:07.754182 13473 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:03:07.755750 13473 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786521787214093-13037-0/minicluster-data/ts-1/data/instance:
uuid: "3392e6f83eb744a7bc64e3c13d3548ab"
format_stamp: "Formatted at 2026-08-12 08:03:07 on dist-test-slave-8hhm"
I20260812 08:03:07.756209 13473 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786521787214093-13037-0/minicluster-data/ts-1/wal/instance:
uuid: "3392e6f83eb744a7bc64e3c13d3548ab"
format_stamp: "Formatted at 2026-08-12 08:03:07 on dist-test-slave-8hhm"
I20260812 08:03:07.759575 13473 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.001s	sys 0.004s
I20260812 08:03:07.761811 13492 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:07.762838 13473 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 08:03:07.762969 13473 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786521787214093-13037-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786521787214093-13037-0/minicluster-data/ts-1/wal
uuid: "3392e6f83eb744a7bc64e3c13d3548ab"
format_stamp: "Formatted at 2026-08-12 08:03:07 on dist-test-slave-8hhm"
I20260812 08:03:07.763087 13473 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786521787214093-13037-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786521787214093-13037-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786521787214093-13037-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:07.773468 13473 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:07.774080 13473 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:07.774281 13473 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:07.776048 13473 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:03:07.776122 13473 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:07.776191 13473 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:03:07.776226 13473 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:07.788882 13473 rpc_server.cc:307] RPC server started. Bound to: 127.12.187.66:44309
I20260812 08:03:07.788939 13686 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.187.66:44309 every 8 connection(s)
I20260812 08:03:07.790146 13473 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786521787214093-13037-0/minicluster-data/ts-1/data/info.pb
I20260812 08:03:07.791498 13687 heartbeater.cc:344] Connected to a master server at 127.12.187.126:41115
I20260812 08:03:07.791682 13687 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:07.792171 13687 heartbeater.cc:507] Master 127.12.187.126:41115 requested a full tablet report, sending...
I20260812 08:03:07.793289 13100 ts_manager.cc:194] Registered new tserver with Master: 3392e6f83eb744a7bc64e3c13d3548ab (127.12.187.66:44309)
I20260812 08:03:07.793859 13100 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.12.187.66:41905
I20260812 08:03:07.795080 13037 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu as pid 13473
I20260812 08:03:07.795207 13037 external_mini_cluster.cc:1448] Reading /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786521787214093-13037-0/minicluster-data/ts-1/wal/instance
I20260812 08:03:07.797158 13037 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu
/tmp/dist-test-tasksRvS6i/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786521787214093-13037-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786521787214093-13037-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786521787214093-13037-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786521787214093-13037-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.187.67:0
--local_ip_for_outbound_sockets=127.12.187.67
--webserver_interface=127.12.187.67
--webserver_port=0
--tserver_master_addrs=127.12.187.126:41115
--builtin_ntp_servers=127.12.187.84:35341
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--txn_keepalive_interval_ms=500
--txn_staleness_tracker_interval_ms=100
--txn_staleness_tracker_disabled_interval_ms=100
--raft_heartbeat_interval_ms=50
--leader_failure_max_missed_heartbeat_periods=1.25
--enable_txn_system_client_init=true
--txn_schedule_background_tasks=false with env {}
W20260812 08:03:07.903926 13693 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:07.904145 13693 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:07.904184 13693 flags.cc:432] Enabled unsafe flag: --txn_schedule_background_tasks=false
W20260812 08:03:07.904212 13693 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:03:07.907387 13693 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:07.907462 13693 flags.cc:432] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 08:03:07.907481 13693 flags.cc:432] Enabled experimental flag: --txn_staleness_tracker_interval_ms=100
W20260812 08:03:07.907496 13693 flags.cc:432] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 08:03:07.907536 13693 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.187.67
I20260812 08:03:07.911381 13693 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786521787214093-13037-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.187.84:35341
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1.25
--raft_heartbeat_interval_ms=50
--fs_data_dirs=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786521787214093-13037-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786521787214093-13037-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.187.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786521787214093-13037-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.187.67
--webserver_port=0
--txn_keepalive_interval_ms=500
--txn_schedule_background_tasks=false
--txn_staleness_tracker_interval_ms=100
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.187.126:41115
--txn_staleness_tracker_disabled_interval_ms=100
--never_fsync=true
--heap_profile_path=/tmp/kudu.13693
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.187.67

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:07.912459 13693 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:07.913748 13693 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 08:03:07.916385 13693 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 08:03:07.920388 13708 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:07.920388 13705 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:07.920393 13704 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:07.920517 13693 server_base.cc:1061] running on GCE node
I20260812 08:03:07.921041 13693 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:07.921627 13693 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:07.922777 13693 hybrid_clock.cc:648] HybridClock initialized: now 1786521787922761 us; error 30 us; skew 500 ppm
I20260812 08:03:07.924641 13693 webserver.cc:533] Webserver started at http://127.12.187.67:41343/ using document root <none> and password file <none>
I20260812 08:03:07.925295 13693 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:07.925359 13693 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:07.925557 13693 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:03:07.927070 13693 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786521787214093-13037-0/minicluster-data/ts-2/data/instance:
uuid: "30f4e7b362b64ae5943a36d843516828"
format_stamp: "Formatted at 2026-08-12 08:03:07 on dist-test-slave-8hhm"
I20260812 08:03:07.927537 13693 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786521787214093-13037-0/minicluster-data/ts-2/wal/instance:
uuid: "30f4e7b362b64ae5943a36d843516828"
format_stamp: "Formatted at 2026-08-12 08:03:07 on dist-test-slave-8hhm"
I20260812 08:03:07.930775 13693 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260812 08:03:07.932749 13720 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:07.933790 13693 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:03:07.933907 13693 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786521787214093-13037-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786521787214093-13037-0/minicluster-data/ts-2/wal
uuid: "30f4e7b362b64ae5943a36d843516828"
format_stamp: "Formatted at 2026-08-12 08:03:07 on dist-test-slave-8hhm"
I20260812 08:03:07.933998 13693 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786521787214093-13037-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786521787214093-13037-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786521787214093-13037-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:07.955736 13693 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:07.956414 13693 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:07.956637 13693 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:07.958491 13693 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:03:07.958581 13693 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:07.958650 13693 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:03:07.958693 13693 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:07.970870 13693 rpc_server.cc:307] RPC server started. Bound to: 127.12.187.67:40681
I20260812 08:03:07.970907 13921 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.187.67:40681 every 8 connection(s)
I20260812 08:03:07.971889 13693 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786521787214093-13037-0/minicluster-data/ts-2/data/info.pb
I20260812 08:03:07.973363 13922 heartbeater.cc:344] Connected to a master server at 127.12.187.126:41115
I20260812 08:03:07.973538 13922 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:07.974004 13922 heartbeater.cc:507] Master 127.12.187.126:41115 requested a full tablet report, sending...
I20260812 08:03:07.973999 13037 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu as pid 13693
I20260812 08:03:07.974112 13037 external_mini_cluster.cc:1448] Reading /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.StaleTransactionsCleanup.1786521787214093-13037-0/minicluster-data/ts-2/wal/instance
I20260812 08:03:07.974974 13100 ts_manager.cc:194] Registered new tserver with Master: 30f4e7b362b64ae5943a36d843516828 (127.12.187.67:40681)
I20260812 08:03:07.975600 13100 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.12.187.67:32781
I20260812 08:03:07.976922 13037 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260812 08:03:08.489253 13100 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47094:
name: "kudu_system.kudu_transactions"
schema {
  columns {
    name: "txn_id"
    type: INT64
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "entry_type"
    type: INT8
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "identifier"
    type: STRING
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "metadata"
    type: STRING
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
  indirect_data: "<redacted>"""
}
partition_schema {
  range_schema {
    columns {
      name: "txn_id"
    }
  }
}
table_type: TXN_STATUS_TABLE
W20260812 08:03:08.489988 13100 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 08:03:08.504603 13341 tablet_service.cc:1511] Processing CreateTablet for tablet 0eced203dc0943989890d2500275dd10 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=ed1165aa41fa485d9be77bebc4168631]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 08:03:08.504578 13579 tablet_service.cc:1511] Processing CreateTablet for tablet 0eced203dc0943989890d2500275dd10 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=ed1165aa41fa485d9be77bebc4168631]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 08:03:08.505807 13579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0eced203dc0943989890d2500275dd10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:03:08.505851 13341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0eced203dc0943989890d2500275dd10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:03:08.505637 13799 tablet_service.cc:1511] Processing CreateTablet for tablet 0eced203dc0943989890d2500275dd10 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=ed1165aa41fa485d9be77bebc4168631]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 08:03:08.506645 13799 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0eced203dc0943989890d2500275dd10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:03:08.511370 13961 tablet_bootstrap.cc:492] T 0eced203dc0943989890d2500275dd10 P 3392e6f83eb744a7bc64e3c13d3548ab: Bootstrap starting.
I20260812 08:03:08.512689 13964 tablet_bootstrap.cc:492] T 0eced203dc0943989890d2500275dd10 P 30f4e7b362b64ae5943a36d843516828: Bootstrap starting.
I20260812 08:03:08.513576 13962 tablet_bootstrap.cc:492] T 0eced203dc0943989890d2500275dd10 P 5f9145c2a7554c3aaa5b82e59a008f29: Bootstrap starting.
I20260812 08:03:08.513788 13961 tablet_bootstrap.cc:654] T 0eced203dc0943989890d2500275dd10 P 3392e6f83eb744a7bc64e3c13d3548ab: Neither blocks nor log segments found. Creating new log.
I20260812 08:03:08.514663 13964 tablet_bootstrap.cc:654] T 0eced203dc0943989890d2500275dd10 P 30f4e7b362b64ae5943a36d843516828: Neither blocks nor log segments found. Creating new log.
I20260812 08:03:08.514674 13961 log.cc:826] T 0eced203dc0943989890d2500275dd10 P 3392e6f83eb744a7bc64e3c13d3548ab: Log is configured to *not* fsync() on all Append() calls
I20260812 08:03:08.515451 13964 log.cc:826] T 0eced203dc0943989890d2500275dd10 P 30f4e7b362b64ae5943a36d843516828: Log is configured to *not* fsync() on all Append() calls
I20260812 08:03:08.515573 13962 tablet_bootstrap.cc:654] T 0eced203dc0943989890d2500275dd10 P 5f9145c2a7554c3aaa5b82e59a008f29: Neither blocks nor log segments found. Creating new log.
I20260812 08:03:08.516299 13962 log.cc:826] T 0eced203dc0943989890d2500275dd10 P 5f9145c2a7554c3aaa5b82e59a008f29: Log is configured to *not* fsync() on all Append() calls
I20260812 08:03:08.516490 13961 tablet_bootstrap.cc:492] T 0eced203dc0943989890d2500275dd10 P 3392e6f83eb744a7bc64e3c13d3548ab: No bootstrap required, opened a new log
I20260812 08:03:08.516672 13961 ts_tablet_manager.cc:1403] T 0eced203dc0943989890d2500275dd10 P 3392e6f83eb744a7bc64e3c13d3548ab: Time spent bootstrapping tablet: real 0.005s	user 0.004s	sys 0.000s
I20260812 08:03:08.516984 13964 tablet_bootstrap.cc:492] T 0eced203dc0943989890d2500275dd10 P 30f4e7b362b64ae5943a36d843516828: No bootstrap required, opened a new log
I20260812 08:03:08.517174 13964 ts_tablet_manager.cc:1403] T 0eced203dc0943989890d2500275dd10 P 30f4e7b362b64ae5943a36d843516828: Time spent bootstrapping tablet: real 0.005s	user 0.003s	sys 0.000s
I20260812 08:03:08.517870 13962 tablet_bootstrap.cc:492] T 0eced203dc0943989890d2500275dd10 P 5f9145c2a7554c3aaa5b82e59a008f29: No bootstrap required, opened a new log
I20260812 08:03:08.518043 13962 ts_tablet_manager.cc:1403] T 0eced203dc0943989890d2500275dd10 P 5f9145c2a7554c3aaa5b82e59a008f29: Time spent bootstrapping tablet: real 0.005s	user 0.004s	sys 0.000s
I20260812 08:03:08.519884 13961 raft_consensus.cc:359] T 0eced203dc0943989890d2500275dd10 P 3392e6f83eb744a7bc64e3c13d3548ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3392e6f83eb744a7bc64e3c13d3548ab" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 44309 } } peers { permanent_uuid: "30f4e7b362b64ae5943a36d843516828" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 40681 } } peers { permanent_uuid: "5f9145c2a7554c3aaa5b82e59a008f29" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 41007 } }
I20260812 08:03:08.520112 13961 raft_consensus.cc:385] T 0eced203dc0943989890d2500275dd10 P 3392e6f83eb744a7bc64e3c13d3548ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:03:08.520046 13964 raft_consensus.cc:359] T 0eced203dc0943989890d2500275dd10 P 30f4e7b362b64ae5943a36d843516828 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3392e6f83eb744a7bc64e3c13d3548ab" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 44309 } } peers { permanent_uuid: "30f4e7b362b64ae5943a36d843516828" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 40681 } } peers { permanent_uuid: "5f9145c2a7554c3aaa5b82e59a008f29" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 41007 } }
I20260812 08:03:08.520213 13961 raft_consensus.cc:740] T 0eced203dc0943989890d2500275dd10 P 3392e6f83eb744a7bc64e3c13d3548ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3392e6f83eb744a7bc64e3c13d3548ab, State: Initialized, Role: FOLLOWER
I20260812 08:03:08.520257 13964 raft_consensus.cc:385] T 0eced203dc0943989890d2500275dd10 P 30f4e7b362b64ae5943a36d843516828 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:03:08.520334 13964 raft_consensus.cc:740] T 0eced203dc0943989890d2500275dd10 P 30f4e7b362b64ae5943a36d843516828 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 30f4e7b362b64ae5943a36d843516828, State: Initialized, Role: FOLLOWER
I20260812 08:03:08.520664 13961 consensus_queue.cc:260] T 0eced203dc0943989890d2500275dd10 P 3392e6f83eb744a7bc64e3c13d3548ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3392e6f83eb744a7bc64e3c13d3548ab" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 44309 } } peers { permanent_uuid: "30f4e7b362b64ae5943a36d843516828" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 40681 } } peers { permanent_uuid: "5f9145c2a7554c3aaa5b82e59a008f29" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 41007 } }
I20260812 08:03:08.520720 13964 consensus_queue.cc:260] T 0eced203dc0943989890d2500275dd10 P 30f4e7b362b64ae5943a36d843516828 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3392e6f83eb744a7bc64e3c13d3548ab" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 44309 } } peers { permanent_uuid: "30f4e7b362b64ae5943a36d843516828" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 40681 } } peers { permanent_uuid: "5f9145c2a7554c3aaa5b82e59a008f29" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 41007 } }
I20260812 08:03:08.520995 13962 raft_consensus.cc:359] T 0eced203dc0943989890d2500275dd10 P 5f9145c2a7554c3aaa5b82e59a008f29 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3392e6f83eb744a7bc64e3c13d3548ab" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 44309 } } peers { permanent_uuid: "30f4e7b362b64ae5943a36d843516828" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 40681 } } peers { permanent_uuid: "5f9145c2a7554c3aaa5b82e59a008f29" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 41007 } }
I20260812 08:03:08.521265 13962 raft_consensus.cc:385] T 0eced203dc0943989890d2500275dd10 P 5f9145c2a7554c3aaa5b82e59a008f29 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:03:08.521302 13922 heartbeater.cc:499] Master 127.12.187.126:41115 was elected leader, sending a full tablet report...
I20260812 08:03:08.521337 13962 raft_consensus.cc:740] T 0eced203dc0943989890d2500275dd10 P 5f9145c2a7554c3aaa5b82e59a008f29 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f9145c2a7554c3aaa5b82e59a008f29, State: Initialized, Role: FOLLOWER
I20260812 08:03:08.521302 13971 tablet_replica.cc:442] T 0eced203dc0943989890d2500275dd10 P 30f4e7b362b64ae5943a36d843516828: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3392e6f83eb744a7bc64e3c13d3548ab" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 44309 } } peers { permanent_uuid: "30f4e7b362b64ae5943a36d843516828" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 40681 } } peers { permanent_uuid: "5f9145c2a7554c3aaa5b82e59a008f29" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 41007 } } }
I20260812 08:03:08.521479 13971 tablet_replica.cc:445] T 0eced203dc0943989890d2500275dd10 P 30f4e7b362b64ae5943a36d843516828: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 08:03:08.521711 13962 consensus_queue.cc:260] T 0eced203dc0943989890d2500275dd10 P 5f9145c2a7554c3aaa5b82e59a008f29 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3392e6f83eb744a7bc64e3c13d3548ab" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 44309 } } peers { permanent_uuid: "30f4e7b362b64ae5943a36d843516828" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 40681 } } peers { permanent_uuid: "5f9145c2a7554c3aaa5b82e59a008f29" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 41007 } }
I20260812 08:03:08.522495 13961 ts_tablet_manager.cc:1434] T 0eced203dc0943989890d2500275dd10 P 3392e6f83eb744a7bc64e3c13d3548ab: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260812 08:03:08.522495 13962 ts_tablet_manager.cc:1434] T 0eced203dc0943989890d2500275dd10 P 5f9145c2a7554c3aaa5b82e59a008f29: Time spent starting tablet: real 0.004s	user 0.005s	sys 0.000s
I20260812 08:03:08.522814 13471 heartbeater.cc:499] Master 127.12.187.126:41115 was elected leader, sending a full tablet report...
I20260812 08:03:08.522825 13687 heartbeater.cc:499] Master 127.12.187.126:41115 was elected leader, sending a full tablet report...
I20260812 08:03:08.523727 13974 tablet_replica.cc:442] T 0eced203dc0943989890d2500275dd10 P 3392e6f83eb744a7bc64e3c13d3548ab: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3392e6f83eb744a7bc64e3c13d3548ab" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 44309 } } peers { permanent_uuid: "30f4e7b362b64ae5943a36d843516828" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 40681 } } peers { permanent_uuid: "5f9145c2a7554c3aaa5b82e59a008f29" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 41007 } } }
I20260812 08:03:08.523849 13974 tablet_replica.cc:445] T 0eced203dc0943989890d2500275dd10 P 3392e6f83eb744a7bc64e3c13d3548ab: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 08:03:08.523835 13972 tablet_replica.cc:442] T 0eced203dc0943989890d2500275dd10 P 5f9145c2a7554c3aaa5b82e59a008f29: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3392e6f83eb744a7bc64e3c13d3548ab" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 44309 } } peers { permanent_uuid: "30f4e7b362b64ae5943a36d843516828" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 40681 } } peers { permanent_uuid: "5f9145c2a7554c3aaa5b82e59a008f29" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 41007 } } }
I20260812 08:03:08.523957 13972 tablet_replica.cc:445] T 0eced203dc0943989890d2500275dd10 P 5f9145c2a7554c3aaa5b82e59a008f29: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 08:03:08.524724 13964 ts_tablet_manager.cc:1434] T 0eced203dc0943989890d2500275dd10 P 30f4e7b362b64ae5943a36d843516828: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.003s
I20260812 08:03:08.538075 13972 raft_consensus.cc:493] T 0eced203dc0943989890d2500275dd10 P 5f9145c2a7554c3aaa5b82e59a008f29 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:03:08.538293 13972 raft_consensus.cc:515] T 0eced203dc0943989890d2500275dd10 P 5f9145c2a7554c3aaa5b82e59a008f29 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3392e6f83eb744a7bc64e3c13d3548ab" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 44309 } } peers { permanent_uuid: "30f4e7b362b64ae5943a36d843516828" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 40681 } } peers { permanent_uuid: "5f9145c2a7554c3aaa5b82e59a008f29" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 41007 } }
I20260812 08:03:08.539727 13972 leader_election.cc:290] T 0eced203dc0943989890d2500275dd10 P 5f9145c2a7554c3aaa5b82e59a008f29 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3392e6f83eb744a7bc64e3c13d3548ab (127.12.187.66:44309), 30f4e7b362b64ae5943a36d843516828 (127.12.187.67:40681)
W20260812 08:03:08.541821 13692 tablet.cc:2406] T 0eced203dc0943989890d2500275dd10 P 3392e6f83eb744a7bc64e3c13d3548ab: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:03:08.544173 13607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eced203dc0943989890d2500275dd10" candidate_uuid: "5f9145c2a7554c3aaa5b82e59a008f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3392e6f83eb744a7bc64e3c13d3548ab" is_pre_election: true
I20260812 08:03:08.544480 13607 raft_consensus.cc:2468] T 0eced203dc0943989890d2500275dd10 P 3392e6f83eb744a7bc64e3c13d3548ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f9145c2a7554c3aaa5b82e59a008f29 in term 0.
I20260812 08:03:08.545054 13266 leader_election.cc:304] T 0eced203dc0943989890d2500275dd10 P 5f9145c2a7554c3aaa5b82e59a008f29 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3392e6f83eb744a7bc64e3c13d3548ab, 5f9145c2a7554c3aaa5b82e59a008f29; no voters: 
I20260812 08:03:08.545363 13972 raft_consensus.cc:2804] T 0eced203dc0943989890d2500275dd10 P 5f9145c2a7554c3aaa5b82e59a008f29 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 08:03:08.545431 13972 raft_consensus.cc:493] T 0eced203dc0943989890d2500275dd10 P 5f9145c2a7554c3aaa5b82e59a008f29 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 08:03:08.545472 13972 raft_consensus.cc:3060] T 0eced203dc0943989890d2500275dd10 P 5f9145c2a7554c3aaa5b82e59a008f29 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:03:08.546005 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eced203dc0943989890d2500275dd10" candidate_uuid: "5f9145c2a7554c3aaa5b82e59a008f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f4e7b362b64ae5943a36d843516828" is_pre_election: true
I20260812 08:03:08.546267 13833 raft_consensus.cc:2468] T 0eced203dc0943989890d2500275dd10 P 30f4e7b362b64ae5943a36d843516828 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5f9145c2a7554c3aaa5b82e59a008f29 in term 0.
I20260812 08:03:08.546710 13972 raft_consensus.cc:515] T 0eced203dc0943989890d2500275dd10 P 5f9145c2a7554c3aaa5b82e59a008f29 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3392e6f83eb744a7bc64e3c13d3548ab" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 44309 } } peers { permanent_uuid: "30f4e7b362b64ae5943a36d843516828" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 40681 } } peers { permanent_uuid: "5f9145c2a7554c3aaa5b82e59a008f29" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 41007 } }
I20260812 08:03:08.547087 13972 leader_election.cc:290] T 0eced203dc0943989890d2500275dd10 P 5f9145c2a7554c3aaa5b82e59a008f29 [CANDIDATE]: Term 1 election: Requested vote from peers 3392e6f83eb744a7bc64e3c13d3548ab (127.12.187.66:44309), 30f4e7b362b64ae5943a36d843516828 (127.12.187.67:40681)
I20260812 08:03:08.547421 13607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eced203dc0943989890d2500275dd10" candidate_uuid: "5f9145c2a7554c3aaa5b82e59a008f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3392e6f83eb744a7bc64e3c13d3548ab"
I20260812 08:03:08.547533 13833 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0eced203dc0943989890d2500275dd10" candidate_uuid: "5f9145c2a7554c3aaa5b82e59a008f29" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "30f4e7b362b64ae5943a36d843516828"
I20260812 08:03:08.547554 13607 raft_consensus.cc:3060] T 0eced203dc0943989890d2500275dd10 P 3392e6f83eb744a7bc64e3c13d3548ab [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:03:08.547643 13833 raft_consensus.cc:3060] T 0eced203dc0943989890d2500275dd10 P 30f4e7b362b64ae5943a36d843516828 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:03:08.548484 13607 raft_consensus.cc:2468] T 0eced203dc0943989890d2500275dd10 P 3392e6f83eb744a7bc64e3c13d3548ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f9145c2a7554c3aaa5b82e59a008f29 in term 1.
I20260812 08:03:08.548818 13833 raft_consensus.cc:2468] T 0eced203dc0943989890d2500275dd10 P 30f4e7b362b64ae5943a36d843516828 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5f9145c2a7554c3aaa5b82e59a008f29 in term 1.
I20260812 08:03:08.548903 13266 leader_election.cc:304] T 0eced203dc0943989890d2500275dd10 P 5f9145c2a7554c3aaa5b82e59a008f29 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3392e6f83eb744a7bc64e3c13d3548ab, 5f9145c2a7554c3aaa5b82e59a008f29; no voters: 
I20260812 08:03:08.549240 13972 raft_consensus.cc:2804] T 0eced203dc0943989890d2500275dd10 P 5f9145c2a7554c3aaa5b82e59a008f29 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:03:08.549464 13972 raft_consensus.cc:697] T 0eced203dc0943989890d2500275dd10 P 5f9145c2a7554c3aaa5b82e59a008f29 [term 1 LEADER]: Becoming Leader. State: Replica: 5f9145c2a7554c3aaa5b82e59a008f29, State: Running, Role: LEADER
I20260812 08:03:08.549821 13972 consensus_queue.cc:237] T 0eced203dc0943989890d2500275dd10 P 5f9145c2a7554c3aaa5b82e59a008f29 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3392e6f83eb744a7bc64e3c13d3548ab" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 44309 } } peers { permanent_uuid: "30f4e7b362b64ae5943a36d843516828" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 40681 } } peers { permanent_uuid: "5f9145c2a7554c3aaa5b82e59a008f29" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 41007 } }
I20260812 08:03:08.552340 13987 tablet_replica.cc:442] T 0eced203dc0943989890d2500275dd10 P 5f9145c2a7554c3aaa5b82e59a008f29: TxnStatusTablet state changed. Reason: New leader 5f9145c2a7554c3aaa5b82e59a008f29. Latest consensus state: current_term: 1 leader_uuid: "5f9145c2a7554c3aaa5b82e59a008f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3392e6f83eb744a7bc64e3c13d3548ab" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 44309 } } peers { permanent_uuid: "30f4e7b362b64ae5943a36d843516828" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 40681 } } peers { permanent_uuid: "5f9145c2a7554c3aaa5b82e59a008f29" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 41007 } } }
I20260812 08:03:08.552512 13987 tablet_replica.cc:445] T 0eced203dc0943989890d2500275dd10 P 5f9145c2a7554c3aaa5b82e59a008f29: This TxnStatusTablet replica's current role is: LEADER
I20260812 08:03:08.552956 13990 txn_status_manager.cc:874] Waiting until node catch up with all replicated operations in previous term...
I20260812 08:03:08.553251 13990 txn_status_manager.cc:930] Loading transaction status metadata into memory...
I20260812 08:03:08.553743 13095 catalog_manager.cc:5719] T 0eced203dc0943989890d2500275dd10 P 5f9145c2a7554c3aaa5b82e59a008f29 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5f9145c2a7554c3aaa5b82e59a008f29 (127.12.187.65). New cstate: current_term: 1 leader_uuid: "5f9145c2a7554c3aaa5b82e59a008f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3392e6f83eb744a7bc64e3c13d3548ab" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 44309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "30f4e7b362b64ae5943a36d843516828" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 40681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5f9145c2a7554c3aaa5b82e59a008f29" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 41007 } health_report { overall_health: HEALTHY } } }
I20260812 08:03:08.576350 13607 raft_consensus.cc:1275] T 0eced203dc0943989890d2500275dd10 P 3392e6f83eb744a7bc64e3c13d3548ab [term 1 FOLLOWER]: Refusing update from remote peer 5f9145c2a7554c3aaa5b82e59a008f29: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 08:03:08.576437 13833 raft_consensus.cc:1275] T 0eced203dc0943989890d2500275dd10 P 30f4e7b362b64ae5943a36d843516828 [term 1 FOLLOWER]: Refusing update from remote peer 5f9145c2a7554c3aaa5b82e59a008f29: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 08:03:08.577044 13987 consensus_queue.cc:1048] T 0eced203dc0943989890d2500275dd10 P 5f9145c2a7554c3aaa5b82e59a008f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3392e6f83eb744a7bc64e3c13d3548ab" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 44309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:03:08.577235 13972 consensus_queue.cc:1048] T 0eced203dc0943989890d2500275dd10 P 5f9145c2a7554c3aaa5b82e59a008f29 [LEADER]: Connected to new peer: Peer: permanent_uuid: "30f4e7b362b64ae5943a36d843516828" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 40681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:03:08.581761 13974 tablet_replica.cc:442] T 0eced203dc0943989890d2500275dd10 P 3392e6f83eb744a7bc64e3c13d3548ab: TxnStatusTablet state changed. Reason: New leader 5f9145c2a7554c3aaa5b82e59a008f29. Latest consensus state: current_term: 1 leader_uuid: "5f9145c2a7554c3aaa5b82e59a008f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3392e6f83eb744a7bc64e3c13d3548ab" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 44309 } } peers { permanent_uuid: "30f4e7b362b64ae5943a36d843516828" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 40681 } } peers { permanent_uuid: "5f9145c2a7554c3aaa5b82e59a008f29" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 41007 } } }
I20260812 08:03:08.581893 13974 tablet_replica.cc:445] T 0eced203dc0943989890d2500275dd10 P 3392e6f83eb744a7bc64e3c13d3548ab: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 08:03:08.582147 13971 tablet_replica.cc:442] T 0eced203dc0943989890d2500275dd10 P 30f4e7b362b64ae5943a36d843516828: TxnStatusTablet state changed. Reason: New leader 5f9145c2a7554c3aaa5b82e59a008f29. Latest consensus state: current_term: 1 leader_uuid: "5f9145c2a7554c3aaa5b82e59a008f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3392e6f83eb744a7bc64e3c13d3548ab" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 44309 } } peers { permanent_uuid: "30f4e7b362b64ae5943a36d843516828" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 40681 } } peers { permanent_uuid: "5f9145c2a7554c3aaa5b82e59a008f29" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 41007 } } }
I20260812 08:03:08.582269 13971 tablet_replica.cc:445] T 0eced203dc0943989890d2500275dd10 P 30f4e7b362b64ae5943a36d843516828: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 08:03:08.585955 13972 tablet_replica.cc:442] T 0eced203dc0943989890d2500275dd10 P 5f9145c2a7554c3aaa5b82e59a008f29: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5f9145c2a7554c3aaa5b82e59a008f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3392e6f83eb744a7bc64e3c13d3548ab" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 44309 } } peers { permanent_uuid: "30f4e7b362b64ae5943a36d843516828" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 40681 } } peers { permanent_uuid: "5f9145c2a7554c3aaa5b82e59a008f29" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 41007 } } }
I20260812 08:03:08.586068 13972 tablet_replica.cc:445] T 0eced203dc0943989890d2500275dd10 P 5f9145c2a7554c3aaa5b82e59a008f29: This TxnStatusTablet replica's current role is: LEADER
I20260812 08:03:08.586023 13987 tablet_replica.cc:442] T 0eced203dc0943989890d2500275dd10 P 5f9145c2a7554c3aaa5b82e59a008f29: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5f9145c2a7554c3aaa5b82e59a008f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3392e6f83eb744a7bc64e3c13d3548ab" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 44309 } } peers { permanent_uuid: "30f4e7b362b64ae5943a36d843516828" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 40681 } } peers { permanent_uuid: "5f9145c2a7554c3aaa5b82e59a008f29" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 41007 } } }
I20260812 08:03:08.586117 13987 tablet_replica.cc:445] T 0eced203dc0943989890d2500275dd10 P 5f9145c2a7554c3aaa5b82e59a008f29: This TxnStatusTablet replica's current role is: LEADER
I20260812 08:03:08.587491 13974 tablet_replica.cc:442] T 0eced203dc0943989890d2500275dd10 P 3392e6f83eb744a7bc64e3c13d3548ab: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5f9145c2a7554c3aaa5b82e59a008f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3392e6f83eb744a7bc64e3c13d3548ab" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 44309 } } peers { permanent_uuid: "30f4e7b362b64ae5943a36d843516828" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 40681 } } peers { permanent_uuid: "5f9145c2a7554c3aaa5b82e59a008f29" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 41007 } } }
I20260812 08:03:08.587594 13974 tablet_replica.cc:445] T 0eced203dc0943989890d2500275dd10 P 3392e6f83eb744a7bc64e3c13d3548ab: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 08:03:08.588743 13998 mvcc.cc:204] Tried to move back new op lower bound from 7317593246001893376 to 7317593245903155200. Current Snapshot: MvccSnapshot[applied={T|T < 7317593246001893376}]
I20260812 08:03:08.590086 13971 tablet_replica.cc:442] T 0eced203dc0943989890d2500275dd10 P 30f4e7b362b64ae5943a36d843516828: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5f9145c2a7554c3aaa5b82e59a008f29" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3392e6f83eb744a7bc64e3c13d3548ab" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 44309 } } peers { permanent_uuid: "30f4e7b362b64ae5943a36d843516828" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 40681 } } peers { permanent_uuid: "5f9145c2a7554c3aaa5b82e59a008f29" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 41007 } } }
I20260812 08:03:08.590214 13971 tablet_replica.cc:445] T 0eced203dc0943989890d2500275dd10 P 30f4e7b362b64ae5943a36d843516828: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 08:03:09.116639 13270 txn_status_manager.cc:1391] automatically aborted stale txn (ID 0) past 0.524s from last keepalive heartbeat (effective timeout is 0.500s)
I20260812 08:03:11.608404 13037 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu with pid 13225
I20260812 08:03:11.627452 13037 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu with pid 13473
I20260812 08:03:11.638906 13037 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu with pid 13693
I20260812 08:03:11.651777 13037 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu with pid 13047
2026-08-12T08:03:11Z chronyd exiting
[       OK ] TxnStatusManagerITest.StaleTransactionsCleanup (4457 ms)
[ RUN      ] TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime
2026-08-12T08:03:11Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T08:03:11Z Disabled control of system clock
I20260812 08:03:11.690169 13037 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu
/tmp/dist-test-tasksRvS6i/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786521787214093-13037-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786521787214093-13037-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786521787214093-13037-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786521787214093-13037-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.187.126:45077
--webserver_interface=127.12.187.126
--webserver_port=0
--builtin_ntp_servers=127.12.187.84:39627
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.187.126:45077
--txn_manager_enabled=true
--txn_manager_lazily_initialized=false with env {}
W20260812 08:03:11.793216 14044 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:11.793565 14044 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:11.793641 14044 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:03:11.797210 14044 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:03:11.797345 14044 flags.cc:432] Enabled experimental flag: --txn_manager_enabled=true
W20260812 08:03:11.797363 14044 flags.cc:432] Enabled experimental flag: --txn_manager_lazily_initialized=false
W20260812 08:03:11.797379 14044 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:11.797397 14044 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:03:11.797456 14044 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:03:11.801523 14044 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786521787214093-13037-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.187.84:39627
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786521787214093-13037-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786521787214093-13037-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.187.126:45077
--txn_manager_enabled=true
--txn_manager_lazily_initialized=false
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.187.126:45077
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786521787214093-13037-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.187.126
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.14044
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:11.802685 14044 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:11.803828 14044 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:03:11.809324 14052 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:11.809324 14051 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:11.809320 14055 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:11.809737 14044 server_base.cc:1061] running on GCE node
I20260812 08:03:11.810225 14044 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:11.811142 14044 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:11.812327 14044 hybrid_clock.cc:648] HybridClock initialized: now 1786521791812315 us; error 38 us; skew 500 ppm
I20260812 08:03:11.814193 14044 webserver.cc:533] Webserver started at http://127.12.187.126:43775/ using document root <none> and password file <none>
I20260812 08:03:11.814810 14044 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:11.814900 14044 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:11.815112 14044 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:03:11.816653 14044 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786521787214093-13037-0/minicluster-data/master-0/data/instance:
uuid: "8d1f26cdfd5840f7aed75cb3552e3c6f"
format_stamp: "Formatted at 2026-08-12 08:03:11 on dist-test-slave-8hhm"
I20260812 08:03:11.817157 14044 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786521787214093-13037-0/minicluster-data/master-0/wal/instance:
uuid: "8d1f26cdfd5840f7aed75cb3552e3c6f"
format_stamp: "Formatted at 2026-08-12 08:03:11 on dist-test-slave-8hhm"
I20260812 08:03:11.820503 14044 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.001s
I20260812 08:03:11.828722 14065 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:11.829929 14044 fs_manager.cc:730] Time spent opening block manager: real 0.008s	user 0.002s	sys 0.000s
I20260812 08:03:11.830073 14044 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786521787214093-13037-0/minicluster-data/master-0/data,/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786521787214093-13037-0/minicluster-data/master-0/wal
uuid: "8d1f26cdfd5840f7aed75cb3552e3c6f"
format_stamp: "Formatted at 2026-08-12 08:03:11 on dist-test-slave-8hhm"
I20260812 08:03:11.830181 14044 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786521787214093-13037-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786521787214093-13037-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786521787214093-13037-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:11.842779 14044 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:11.843434 14044 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:11.843644 14044 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:11.852283 14044 rpc_server.cc:307] RPC server started. Bound to: 127.12.187.126:45077
I20260812 08:03:11.852300 14169 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.187.126:45077 every 8 connection(s)
I20260812 08:03:11.853386 14044 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786521787214093-13037-0/minicluster-data/master-0/data/info.pb
I20260812 08:03:11.855698 13037 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu as pid 14044
I20260812 08:03:11.855808 13037 external_mini_cluster.cc:1448] Reading /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786521787214093-13037-0/minicluster-data/master-0/wal/instance
I20260812 08:03:11.856479 14172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:03:11.861997 14172 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8d1f26cdfd5840f7aed75cb3552e3c6f: Bootstrap starting.
I20260812 08:03:11.864137 14172 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8d1f26cdfd5840f7aed75cb3552e3c6f: Neither blocks nor log segments found. Creating new log.
I20260812 08:03:11.864773 14172 log.cc:826] T 00000000000000000000000000000000 P 8d1f26cdfd5840f7aed75cb3552e3c6f: Log is configured to *not* fsync() on all Append() calls
I20260812 08:03:11.866408 14172 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8d1f26cdfd5840f7aed75cb3552e3c6f: No bootstrap required, opened a new log
I20260812 08:03:11.869305 14172 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8d1f26cdfd5840f7aed75cb3552e3c6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d1f26cdfd5840f7aed75cb3552e3c6f" member_type: VOTER last_known_addr { host: "127.12.187.126" port: 45077 } }
I20260812 08:03:11.869498 14172 raft_consensus.cc:385] T 00000000000000000000000000000000 P 8d1f26cdfd5840f7aed75cb3552e3c6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:03:11.869580 14172 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8d1f26cdfd5840f7aed75cb3552e3c6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8d1f26cdfd5840f7aed75cb3552e3c6f, State: Initialized, Role: FOLLOWER
I20260812 08:03:11.869963 14172 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8d1f26cdfd5840f7aed75cb3552e3c6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d1f26cdfd5840f7aed75cb3552e3c6f" member_type: VOTER last_known_addr { host: "127.12.187.126" port: 45077 } }
I20260812 08:03:11.870105 14172 raft_consensus.cc:399] T 00000000000000000000000000000000 P 8d1f26cdfd5840f7aed75cb3552e3c6f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 08:03:11.870193 14172 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8d1f26cdfd5840f7aed75cb3552e3c6f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 08:03:11.870322 14172 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8d1f26cdfd5840f7aed75cb3552e3c6f [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:03:11.871234 14172 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8d1f26cdfd5840f7aed75cb3552e3c6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d1f26cdfd5840f7aed75cb3552e3c6f" member_type: VOTER last_known_addr { host: "127.12.187.126" port: 45077 } }
I20260812 08:03:11.871587 14172 leader_election.cc:304] T 00000000000000000000000000000000 P 8d1f26cdfd5840f7aed75cb3552e3c6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8d1f26cdfd5840f7aed75cb3552e3c6f; no voters: 
I20260812 08:03:11.871919 14172 leader_election.cc:290] T 00000000000000000000000000000000 P 8d1f26cdfd5840f7aed75cb3552e3c6f [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 08:03:11.872044 14184 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8d1f26cdfd5840f7aed75cb3552e3c6f [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:03:11.872275 14184 raft_consensus.cc:697] T 00000000000000000000000000000000 P 8d1f26cdfd5840f7aed75cb3552e3c6f [term 1 LEADER]: Becoming Leader. State: Replica: 8d1f26cdfd5840f7aed75cb3552e3c6f, State: Running, Role: LEADER
I20260812 08:03:11.872555 14184 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8d1f26cdfd5840f7aed75cb3552e3c6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d1f26cdfd5840f7aed75cb3552e3c6f" member_type: VOTER last_known_addr { host: "127.12.187.126" port: 45077 } }
I20260812 08:03:11.873023 14172 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8d1f26cdfd5840f7aed75cb3552e3c6f [sys.catalog]: configured and running, proceeding with master startup.
I20260812 08:03:11.874397 14186 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d1f26cdfd5840f7aed75cb3552e3c6f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8d1f26cdfd5840f7aed75cb3552e3c6f. Latest consensus state: current_term: 1 leader_uuid: "8d1f26cdfd5840f7aed75cb3552e3c6f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d1f26cdfd5840f7aed75cb3552e3c6f" member_type: VOTER last_known_addr { host: "127.12.187.126" port: 45077 } } }
I20260812 08:03:11.874537 14186 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d1f26cdfd5840f7aed75cb3552e3c6f [sys.catalog]: This master's current role is: LEADER
I20260812 08:03:11.874799 14185 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8d1f26cdfd5840f7aed75cb3552e3c6f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8d1f26cdfd5840f7aed75cb3552e3c6f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8d1f26cdfd5840f7aed75cb3552e3c6f" member_type: VOTER last_known_addr { host: "127.12.187.126" port: 45077 } } }
I20260812 08:03:11.874918 14185 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8d1f26cdfd5840f7aed75cb3552e3c6f [sys.catalog]: This master's current role is: LEADER
I20260812 08:03:11.875205 14195 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:03:11.878283 14195 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:03:11.884086 14195 catalog_manager.cc:1383] Generated new cluster ID: 104074616daa48a1b3d8d4c286d75bd6
I20260812 08:03:11.884153 14195 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:03:11.895448 14195 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 08:03:11.896546 14195 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:03:11.908052 14195 catalog_manager.cc:6092] T 00000000000000000000000000000000 P 8d1f26cdfd5840f7aed75cb3552e3c6f: Generated new TSK 0
I20260812 08:03:11.908751 14195 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 08:03:11.911820 13037 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu
/tmp/dist-test-tasksRvS6i/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786521787214093-13037-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786521787214093-13037-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786521787214093-13037-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786521787214093-13037-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.187.65:0
--local_ip_for_outbound_sockets=127.12.187.65
--webserver_interface=127.12.187.65
--webserver_port=0
--tserver_master_addrs=127.12.187.126:45077
--builtin_ntp_servers=127.12.187.84:39627
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--txn_keepalive_interval_ms=500
--txn_staleness_tracker_interval_ms=100
--txn_staleness_tracker_disabled_interval_ms=100
--raft_heartbeat_interval_ms=50
--leader_failure_max_missed_heartbeat_periods=1.25
--enable_txn_system_client_init=true
--txn_schedule_background_tasks=false with env {}
I20260812 08:03:11.914244 14090 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44072:
name: "kudu_system.kudu_transactions"
schema {
  columns {
    name: "txn_id"
    type: INT64
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "entry_type"
    type: INT8
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "identifier"
    type: STRING
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "metadata"
    type: STRING
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
  indirect_data: "<redacted>"""
}
partition_schema {
  range_schema {
    columns {
      name: "txn_id"
    }
  }
}
table_type: TXN_STATUS_TABLE
W20260812 08:03:11.918917 14172 master.cc:465] Invalid argument: unable to initialize TxnManager: Error creating table kudu_system.kudu_transactions on the master: not enough live tablet servers to create a table with the requested replication factor 3; 0 tablet servers are alive: unable to init TxnManager, will retry in 1.000s
W20260812 08:03:12.016287 14222 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:12.016511 14222 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:12.016554 14222 flags.cc:432] Enabled unsafe flag: --txn_schedule_background_tasks=false
W20260812 08:03:12.016624 14222 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:03:12.020097 14222 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:12.020179 14222 flags.cc:432] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 08:03:12.020227 14222 flags.cc:432] Enabled experimental flag: --txn_staleness_tracker_interval_ms=100
W20260812 08:03:12.020268 14222 flags.cc:432] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 08:03:12.020371 14222 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.187.65
I20260812 08:03:12.024201 14222 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786521787214093-13037-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.187.84:39627
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1.25
--raft_heartbeat_interval_ms=50
--fs_data_dirs=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786521787214093-13037-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786521787214093-13037-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.187.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786521787214093-13037-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.187.65
--webserver_port=0
--txn_keepalive_interval_ms=500
--txn_schedule_background_tasks=false
--txn_staleness_tracker_interval_ms=100
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.187.126:45077
--txn_staleness_tracker_disabled_interval_ms=100
--never_fsync=true
--heap_profile_path=/tmp/kudu.14222
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.187.65

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:12.025298 14222 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:12.026412 14222 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 08:03:12.029073 14222 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 08:03:12.032670 14230 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:12.032691 14228 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:12.032912 14222 server_base.cc:1061] running on GCE node
W20260812 08:03:12.033021 14233 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:12.033427 14222 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:12.033962 14222 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:12.035163 14222 hybrid_clock.cc:648] HybridClock initialized: now 1786521792035127 us; error 55 us; skew 500 ppm
I20260812 08:03:12.037006 14222 webserver.cc:533] Webserver started at http://127.12.187.65:41633/ using document root <none> and password file <none>
I20260812 08:03:12.037655 14222 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:12.037731 14222 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:12.037961 14222 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:03:12.039496 14222 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786521787214093-13037-0/minicluster-data/ts-0/data/instance:
uuid: "95fd2b11e0234342b20b9651b523d5dc"
format_stamp: "Formatted at 2026-08-12 08:03:12 on dist-test-slave-8hhm"
I20260812 08:03:12.039984 14222 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786521787214093-13037-0/minicluster-data/ts-0/wal/instance:
uuid: "95fd2b11e0234342b20b9651b523d5dc"
format_stamp: "Formatted at 2026-08-12 08:03:12 on dist-test-slave-8hhm"
I20260812 08:03:12.043349 14222 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260812 08:03:12.045512 14242 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:12.046626 14222 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260812 08:03:12.046747 14222 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786521787214093-13037-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786521787214093-13037-0/minicluster-data/ts-0/wal
uuid: "95fd2b11e0234342b20b9651b523d5dc"
format_stamp: "Formatted at 2026-08-12 08:03:12 on dist-test-slave-8hhm"
I20260812 08:03:12.046844 14222 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786521787214093-13037-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786521787214093-13037-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786521787214093-13037-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:12.090274 14222 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:12.091004 14222 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:12.091219 14222 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:12.092885 14222 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:03:12.092967 14222 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:12.093036 14222 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:03:12.093081 14222 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:12.105119 14222 rpc_server.cc:307] RPC server started. Bound to: 127.12.187.65:40787
I20260812 08:03:12.105186 14445 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.187.65:40787 every 8 connection(s)
I20260812 08:03:12.106307 14222 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786521787214093-13037-0/minicluster-data/ts-0/data/info.pb
I20260812 08:03:12.107887 14446 heartbeater.cc:344] Connected to a master server at 127.12.187.126:45077
I20260812 08:03:12.108075 14446 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:12.108608 14446 heartbeater.cc:507] Master 127.12.187.126:45077 requested a full tablet report, sending...
I20260812 08:03:12.108968 13037 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu as pid 14222
I20260812 08:03:12.109134 13037 external_mini_cluster.cc:1448] Reading /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786521787214093-13037-0/minicluster-data/ts-0/wal/instance
I20260812 08:03:12.111593 14090 ts_manager.cc:194] Registered new tserver with Master: 95fd2b11e0234342b20b9651b523d5dc (127.12.187.65:40787)
I20260812 08:03:12.111642 13037 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu
/tmp/dist-test-tasksRvS6i/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786521787214093-13037-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786521787214093-13037-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786521787214093-13037-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786521787214093-13037-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.187.66:0
--local_ip_for_outbound_sockets=127.12.187.66
--webserver_interface=127.12.187.66
--webserver_port=0
--tserver_master_addrs=127.12.187.126:45077
--builtin_ntp_servers=127.12.187.84:39627
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--txn_keepalive_interval_ms=500
--txn_staleness_tracker_interval_ms=100
--txn_staleness_tracker_disabled_interval_ms=100
--raft_heartbeat_interval_ms=50
--leader_failure_max_missed_heartbeat_periods=1.25
--enable_txn_system_client_init=true
--txn_schedule_background_tasks=false with env {}
I20260812 08:03:12.113147 14090 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.12.187.65:44215
W20260812 08:03:12.216599 14450 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:12.216801 14450 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:12.216845 14450 flags.cc:432] Enabled unsafe flag: --txn_schedule_background_tasks=false
W20260812 08:03:12.216873 14450 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:03:12.220180 14450 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:12.220254 14450 flags.cc:432] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 08:03:12.220273 14450 flags.cc:432] Enabled experimental flag: --txn_staleness_tracker_interval_ms=100
W20260812 08:03:12.220288 14450 flags.cc:432] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 08:03:12.220328 14450 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.187.66
I20260812 08:03:12.224047 14450 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786521787214093-13037-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.187.84:39627
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1.25
--raft_heartbeat_interval_ms=50
--fs_data_dirs=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786521787214093-13037-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786521787214093-13037-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.187.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786521787214093-13037-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.187.66
--webserver_port=0
--txn_keepalive_interval_ms=500
--txn_schedule_background_tasks=false
--txn_staleness_tracker_interval_ms=100
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.187.126:45077
--txn_staleness_tracker_disabled_interval_ms=100
--never_fsync=true
--heap_profile_path=/tmp/kudu.14450
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.187.66

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:12.225023 14450 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:12.226063 14450 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 08:03:12.228719 14450 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 08:03:12.232388 14460 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:12.232442 14459 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:12.232370 14463 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:12.232757 14450 server_base.cc:1061] running on GCE node
I20260812 08:03:12.233121 14450 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:12.233678 14450 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:12.234860 14450 hybrid_clock.cc:648] HybridClock initialized: now 1786521792234844 us; error 31 us; skew 500 ppm
I20260812 08:03:12.236673 14450 webserver.cc:533] Webserver started at http://127.12.187.66:39815/ using document root <none> and password file <none>
I20260812 08:03:12.237308 14450 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:12.237393 14450 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:12.237601 14450 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:03:12.239248 14450 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786521787214093-13037-0/minicluster-data/ts-1/data/instance:
uuid: "f0aeab7b73994d49978e78f34dc9ebe6"
format_stamp: "Formatted at 2026-08-12 08:03:12 on dist-test-slave-8hhm"
I20260812 08:03:12.239725 14450 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786521787214093-13037-0/minicluster-data/ts-1/wal/instance:
uuid: "f0aeab7b73994d49978e78f34dc9ebe6"
format_stamp: "Formatted at 2026-08-12 08:03:12 on dist-test-slave-8hhm"
I20260812 08:03:12.242944 14450 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260812 08:03:12.245461 14474 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:12.246394 14450 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 08:03:12.246534 14450 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786521787214093-13037-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786521787214093-13037-0/minicluster-data/ts-1/wal
uuid: "f0aeab7b73994d49978e78f34dc9ebe6"
format_stamp: "Formatted at 2026-08-12 08:03:12 on dist-test-slave-8hhm"
I20260812 08:03:12.246630 14450 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786521787214093-13037-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786521787214093-13037-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786521787214093-13037-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:12.259320 14450 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:12.259930 14450 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:12.260131 14450 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:12.261761 14450 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:03:12.261854 14450 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:12.261942 14450 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:03:12.261981 14450 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:12.273998 14450 rpc_server.cc:307] RPC server started. Bound to: 127.12.187.66:46591
I20260812 08:03:12.274097 14679 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.187.66:46591 every 8 connection(s)
I20260812 08:03:12.275027 14450 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786521787214093-13037-0/minicluster-data/ts-1/data/info.pb
I20260812 08:03:12.276535 14684 heartbeater.cc:344] Connected to a master server at 127.12.187.126:45077
I20260812 08:03:12.276731 14684 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:12.277354 14684 heartbeater.cc:507] Master 127.12.187.126:45077 requested a full tablet report, sending...
I20260812 08:03:12.278283 14090 ts_manager.cc:194] Registered new tserver with Master: f0aeab7b73994d49978e78f34dc9ebe6 (127.12.187.66:46591)
I20260812 08:03:12.278990 13037 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu as pid 14450
I20260812 08:03:12.279016 14090 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.12.187.66:42675
I20260812 08:03:12.279104 13037 external_mini_cluster.cc:1448] Reading /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786521787214093-13037-0/minicluster-data/ts-1/wal/instance
I20260812 08:03:12.281083 13037 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu
/tmp/dist-test-tasksRvS6i/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786521787214093-13037-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786521787214093-13037-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786521787214093-13037-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786521787214093-13037-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.187.67:0
--local_ip_for_outbound_sockets=127.12.187.67
--webserver_interface=127.12.187.67
--webserver_port=0
--tserver_master_addrs=127.12.187.126:45077
--builtin_ntp_servers=127.12.187.84:39627
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--txn_keepalive_interval_ms=500
--txn_staleness_tracker_interval_ms=100
--txn_staleness_tracker_disabled_interval_ms=100
--raft_heartbeat_interval_ms=50
--leader_failure_max_missed_heartbeat_periods=1.25
--enable_txn_system_client_init=true
--txn_schedule_background_tasks=false with env {}
W20260812 08:03:12.388019 14688 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:12.388243 14688 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:12.388286 14688 flags.cc:432] Enabled unsafe flag: --txn_schedule_background_tasks=false
W20260812 08:03:12.388316 14688 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:03:12.391592 14688 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:12.391669 14688 flags.cc:432] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 08:03:12.391688 14688 flags.cc:432] Enabled experimental flag: --txn_staleness_tracker_interval_ms=100
W20260812 08:03:12.391705 14688 flags.cc:432] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 08:03:12.391767 14688 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.187.67
I20260812 08:03:12.395809 14688 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786521787214093-13037-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.187.84:39627
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1.25
--raft_heartbeat_interval_ms=50
--fs_data_dirs=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786521787214093-13037-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786521787214093-13037-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.187.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786521787214093-13037-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.187.67
--webserver_port=0
--txn_keepalive_interval_ms=500
--txn_schedule_background_tasks=false
--txn_staleness_tracker_interval_ms=100
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.187.126:45077
--txn_staleness_tracker_disabled_interval_ms=100
--never_fsync=true
--heap_profile_path=/tmp/kudu.14688
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.187.67

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:12.396924 14688 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:12.398092 14688 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 08:03:12.400657 14688 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 08:03:12.404232 14699 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:12.404241 14700 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:12.404228 14705 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:12.404961 14688 server_base.cc:1061] running on GCE node
I20260812 08:03:12.405395 14688 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:12.405963 14688 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:12.407163 14688 hybrid_clock.cc:648] HybridClock initialized: now 1786521792407150 us; error 32 us; skew 500 ppm
I20260812 08:03:12.408948 14688 webserver.cc:533] Webserver started at http://127.12.187.67:41969/ using document root <none> and password file <none>
I20260812 08:03:12.409622 14688 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:12.409710 14688 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:12.409924 14688 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:03:12.411434 14688 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786521787214093-13037-0/minicluster-data/ts-2/data/instance:
uuid: "87b11d6d4b7145e4aa26d690cdd18e87"
format_stamp: "Formatted at 2026-08-12 08:03:12 on dist-test-slave-8hhm"
I20260812 08:03:12.411943 14688 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786521787214093-13037-0/minicluster-data/ts-2/wal/instance:
uuid: "87b11d6d4b7145e4aa26d690cdd18e87"
format_stamp: "Formatted at 2026-08-12 08:03:12 on dist-test-slave-8hhm"
I20260812 08:03:12.415273 14688 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260812 08:03:12.417451 14717 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:12.418449 14688 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 08:03:12.418593 14688 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786521787214093-13037-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786521787214093-13037-0/minicluster-data/ts-2/wal
uuid: "87b11d6d4b7145e4aa26d690cdd18e87"
format_stamp: "Formatted at 2026-08-12 08:03:12 on dist-test-slave-8hhm"
I20260812 08:03:12.418699 14688 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786521787214093-13037-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786521787214093-13037-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786521787214093-13037-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:12.441730 14688 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:12.442402 14688 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:12.442566 14688 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:12.444188 14688 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:03:12.444255 14688 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:12.444308 14688 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:03:12.444343 14688 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:12.456151 14688 rpc_server.cc:307] RPC server started. Bound to: 127.12.187.67:43853
I20260812 08:03:12.456447 14925 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.187.67:43853 every 8 connection(s)
I20260812 08:03:12.457283 14688 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786521787214093-13037-0/minicluster-data/ts-2/data/info.pb
I20260812 08:03:12.457809 13037 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu as pid 14688
I20260812 08:03:12.457921 13037 external_mini_cluster.cc:1448] Reading /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime.1786521787214093-13037-0/minicluster-data/ts-2/wal/instance
I20260812 08:03:12.459355 14927 heartbeater.cc:344] Connected to a master server at 127.12.187.126:45077
I20260812 08:03:12.459549 14927 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:12.460100 14927 heartbeater.cc:507] Master 127.12.187.126:45077 requested a full tablet report, sending...
I20260812 08:03:12.461082 14090 ts_manager.cc:194] Registered new tserver with Master: 87b11d6d4b7145e4aa26d690cdd18e87 (127.12.187.67:43853)
I20260812 08:03:12.461768 14090 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.12.187.67:57667
I20260812 08:03:12.472813 13037 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260812 08:03:12.944957 14090 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44092:
name: "kudu_system.kudu_transactions"
schema {
  columns {
    name: "txn_id"
    type: INT64
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "entry_type"
    type: INT8
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "identifier"
    type: STRING
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "metadata"
    type: STRING
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
  indirect_data: "<redacted>"""
}
partition_schema {
  range_schema {
    columns {
      name: "txn_id"
    }
  }
}
table_type: TXN_STATUS_TABLE
W20260812 08:03:12.945503 14090 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 08:03:12.960443 14331 tablet_service.cc:1511] Processing CreateTablet for tablet 14e573885ac34a4c9b19f4edc1977c01 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=243e1a6ee22f443fb5ce5980477819a7]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 08:03:12.961547 14331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14e573885ac34a4c9b19f4edc1977c01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:03:12.961288 14801 tablet_service.cc:1511] Processing CreateTablet for tablet 14e573885ac34a4c9b19f4edc1977c01 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=243e1a6ee22f443fb5ce5980477819a7]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 08:03:12.962435 14801 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14e573885ac34a4c9b19f4edc1977c01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:03:12.965817 14569 tablet_service.cc:1511] Processing CreateTablet for tablet 14e573885ac34a4c9b19f4edc1977c01 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=243e1a6ee22f443fb5ce5980477819a7]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 08:03:12.966918 14569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14e573885ac34a4c9b19f4edc1977c01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:03:12.967548 14975 tablet_bootstrap.cc:492] T 14e573885ac34a4c9b19f4edc1977c01 P 95fd2b11e0234342b20b9651b523d5dc: Bootstrap starting.
I20260812 08:03:12.968070 14976 tablet_bootstrap.cc:492] T 14e573885ac34a4c9b19f4edc1977c01 P 87b11d6d4b7145e4aa26d690cdd18e87: Bootstrap starting.
I20260812 08:03:12.970356 14976 tablet_bootstrap.cc:654] T 14e573885ac34a4c9b19f4edc1977c01 P 87b11d6d4b7145e4aa26d690cdd18e87: Neither blocks nor log segments found. Creating new log.
I20260812 08:03:12.970355 14975 tablet_bootstrap.cc:654] T 14e573885ac34a4c9b19f4edc1977c01 P 95fd2b11e0234342b20b9651b523d5dc: Neither blocks nor log segments found. Creating new log.
I20260812 08:03:12.971205 14976 log.cc:826] T 14e573885ac34a4c9b19f4edc1977c01 P 87b11d6d4b7145e4aa26d690cdd18e87: Log is configured to *not* fsync() on all Append() calls
I20260812 08:03:12.971802 14975 log.cc:826] T 14e573885ac34a4c9b19f4edc1977c01 P 95fd2b11e0234342b20b9651b523d5dc: Log is configured to *not* fsync() on all Append() calls
I20260812 08:03:12.972985 14976 tablet_bootstrap.cc:492] T 14e573885ac34a4c9b19f4edc1977c01 P 87b11d6d4b7145e4aa26d690cdd18e87: No bootstrap required, opened a new log
I20260812 08:03:12.972982 14980 tablet_bootstrap.cc:492] T 14e573885ac34a4c9b19f4edc1977c01 P f0aeab7b73994d49978e78f34dc9ebe6: Bootstrap starting.
I20260812 08:03:12.973176 14976 ts_tablet_manager.cc:1403] T 14e573885ac34a4c9b19f4edc1977c01 P 87b11d6d4b7145e4aa26d690cdd18e87: Time spent bootstrapping tablet: real 0.005s	user 0.004s	sys 0.000s
I20260812 08:03:12.973366 14975 tablet_bootstrap.cc:492] T 14e573885ac34a4c9b19f4edc1977c01 P 95fd2b11e0234342b20b9651b523d5dc: No bootstrap required, opened a new log
I20260812 08:03:12.973544 14975 ts_tablet_manager.cc:1403] T 14e573885ac34a4c9b19f4edc1977c01 P 95fd2b11e0234342b20b9651b523d5dc: Time spent bootstrapping tablet: real 0.006s	user 0.004s	sys 0.000s
I20260812 08:03:12.975596 14980 tablet_bootstrap.cc:654] T 14e573885ac34a4c9b19f4edc1977c01 P f0aeab7b73994d49978e78f34dc9ebe6: Neither blocks nor log segments found. Creating new log.
I20260812 08:03:12.976244 14976 raft_consensus.cc:359] T 14e573885ac34a4c9b19f4edc1977c01 P 87b11d6d4b7145e4aa26d690cdd18e87 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b11d6d4b7145e4aa26d690cdd18e87" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 43853 } } peers { permanent_uuid: "95fd2b11e0234342b20b9651b523d5dc" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 40787 } } peers { permanent_uuid: "f0aeab7b73994d49978e78f34dc9ebe6" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 46591 } }
I20260812 08:03:12.976352 14980 log.cc:826] T 14e573885ac34a4c9b19f4edc1977c01 P f0aeab7b73994d49978e78f34dc9ebe6: Log is configured to *not* fsync() on all Append() calls
I20260812 08:03:12.976438 14976 raft_consensus.cc:385] T 14e573885ac34a4c9b19f4edc1977c01 P 87b11d6d4b7145e4aa26d690cdd18e87 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:03:12.976509 14976 raft_consensus.cc:740] T 14e573885ac34a4c9b19f4edc1977c01 P 87b11d6d4b7145e4aa26d690cdd18e87 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87b11d6d4b7145e4aa26d690cdd18e87, State: Initialized, Role: FOLLOWER
I20260812 08:03:12.976949 14976 consensus_queue.cc:260] T 14e573885ac34a4c9b19f4edc1977c01 P 87b11d6d4b7145e4aa26d690cdd18e87 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b11d6d4b7145e4aa26d690cdd18e87" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 43853 } } peers { permanent_uuid: "95fd2b11e0234342b20b9651b523d5dc" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 40787 } } peers { permanent_uuid: "f0aeab7b73994d49978e78f34dc9ebe6" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 46591 } }
I20260812 08:03:12.977613 14927 heartbeater.cc:499] Master 127.12.187.126:45077 was elected leader, sending a full tablet report...
I20260812 08:03:12.977648 14985 tablet_replica.cc:442] T 14e573885ac34a4c9b19f4edc1977c01 P 87b11d6d4b7145e4aa26d690cdd18e87: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b11d6d4b7145e4aa26d690cdd18e87" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 43853 } } peers { permanent_uuid: "95fd2b11e0234342b20b9651b523d5dc" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 40787 } } peers { permanent_uuid: "f0aeab7b73994d49978e78f34dc9ebe6" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 46591 } } }
I20260812 08:03:12.977758 14985 tablet_replica.cc:445] T 14e573885ac34a4c9b19f4edc1977c01 P 87b11d6d4b7145e4aa26d690cdd18e87: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 08:03:12.977615 14975 raft_consensus.cc:359] T 14e573885ac34a4c9b19f4edc1977c01 P 95fd2b11e0234342b20b9651b523d5dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b11d6d4b7145e4aa26d690cdd18e87" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 43853 } } peers { permanent_uuid: "95fd2b11e0234342b20b9651b523d5dc" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 40787 } } peers { permanent_uuid: "f0aeab7b73994d49978e78f34dc9ebe6" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 46591 } }
I20260812 08:03:12.977783 14976 ts_tablet_manager.cc:1434] T 14e573885ac34a4c9b19f4edc1977c01 P 87b11d6d4b7145e4aa26d690cdd18e87: Time spent starting tablet: real 0.004s	user 0.003s	sys 0.000s
I20260812 08:03:12.977813 14975 raft_consensus.cc:385] T 14e573885ac34a4c9b19f4edc1977c01 P 95fd2b11e0234342b20b9651b523d5dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:03:12.977875 14975 raft_consensus.cc:740] T 14e573885ac34a4c9b19f4edc1977c01 P 95fd2b11e0234342b20b9651b523d5dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95fd2b11e0234342b20b9651b523d5dc, State: Initialized, Role: FOLLOWER
I20260812 08:03:12.978281 14975 consensus_queue.cc:260] T 14e573885ac34a4c9b19f4edc1977c01 P 95fd2b11e0234342b20b9651b523d5dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b11d6d4b7145e4aa26d690cdd18e87" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 43853 } } peers { permanent_uuid: "95fd2b11e0234342b20b9651b523d5dc" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 40787 } } peers { permanent_uuid: "f0aeab7b73994d49978e78f34dc9ebe6" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 46591 } }
I20260812 08:03:12.978866 14446 heartbeater.cc:499] Master 127.12.187.126:45077 was elected leader, sending a full tablet report...
I20260812 08:03:12.979329 14980 tablet_bootstrap.cc:492] T 14e573885ac34a4c9b19f4edc1977c01 P f0aeab7b73994d49978e78f34dc9ebe6: No bootstrap required, opened a new log
I20260812 08:03:12.979499 14980 ts_tablet_manager.cc:1403] T 14e573885ac34a4c9b19f4edc1977c01 P f0aeab7b73994d49978e78f34dc9ebe6: Time spent bootstrapping tablet: real 0.007s	user 0.004s	sys 0.000s
I20260812 08:03:12.979794 14986 tablet_replica.cc:442] T 14e573885ac34a4c9b19f4edc1977c01 P 95fd2b11e0234342b20b9651b523d5dc: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b11d6d4b7145e4aa26d690cdd18e87" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 43853 } } peers { permanent_uuid: "95fd2b11e0234342b20b9651b523d5dc" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 40787 } } peers { permanent_uuid: "f0aeab7b73994d49978e78f34dc9ebe6" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 46591 } } }
I20260812 08:03:12.979954 14986 tablet_replica.cc:445] T 14e573885ac34a4c9b19f4edc1977c01 P 95fd2b11e0234342b20b9651b523d5dc: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 08:03:12.980629 14975 ts_tablet_manager.cc:1434] T 14e573885ac34a4c9b19f4edc1977c01 P 95fd2b11e0234342b20b9651b523d5dc: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260812 08:03:12.983067 14980 raft_consensus.cc:359] T 14e573885ac34a4c9b19f4edc1977c01 P f0aeab7b73994d49978e78f34dc9ebe6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b11d6d4b7145e4aa26d690cdd18e87" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 43853 } } peers { permanent_uuid: "95fd2b11e0234342b20b9651b523d5dc" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 40787 } } peers { permanent_uuid: "f0aeab7b73994d49978e78f34dc9ebe6" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 46591 } }
I20260812 08:03:12.983268 14980 raft_consensus.cc:385] T 14e573885ac34a4c9b19f4edc1977c01 P f0aeab7b73994d49978e78f34dc9ebe6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:03:12.983336 14980 raft_consensus.cc:740] T 14e573885ac34a4c9b19f4edc1977c01 P f0aeab7b73994d49978e78f34dc9ebe6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0aeab7b73994d49978e78f34dc9ebe6, State: Initialized, Role: FOLLOWER
I20260812 08:03:12.983762 14980 consensus_queue.cc:260] T 14e573885ac34a4c9b19f4edc1977c01 P f0aeab7b73994d49978e78f34dc9ebe6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b11d6d4b7145e4aa26d690cdd18e87" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 43853 } } peers { permanent_uuid: "95fd2b11e0234342b20b9651b523d5dc" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 40787 } } peers { permanent_uuid: "f0aeab7b73994d49978e78f34dc9ebe6" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 46591 } }
I20260812 08:03:12.984351 14684 heartbeater.cc:499] Master 127.12.187.126:45077 was elected leader, sending a full tablet report...
I20260812 08:03:12.984594 14980 ts_tablet_manager.cc:1434] T 14e573885ac34a4c9b19f4edc1977c01 P f0aeab7b73994d49978e78f34dc9ebe6: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260812 08:03:12.985333 14987 tablet_replica.cc:442] T 14e573885ac34a4c9b19f4edc1977c01 P f0aeab7b73994d49978e78f34dc9ebe6: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b11d6d4b7145e4aa26d690cdd18e87" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 43853 } } peers { permanent_uuid: "95fd2b11e0234342b20b9651b523d5dc" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 40787 } } peers { permanent_uuid: "f0aeab7b73994d49978e78f34dc9ebe6" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 46591 } } }
I20260812 08:03:12.985469 14987 tablet_replica.cc:445] T 14e573885ac34a4c9b19f4edc1977c01 P f0aeab7b73994d49978e78f34dc9ebe6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 08:03:12.992873 14985 raft_consensus.cc:493] T 14e573885ac34a4c9b19f4edc1977c01 P 87b11d6d4b7145e4aa26d690cdd18e87 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:03:12.993083 14985 raft_consensus.cc:515] T 14e573885ac34a4c9b19f4edc1977c01 P 87b11d6d4b7145e4aa26d690cdd18e87 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b11d6d4b7145e4aa26d690cdd18e87" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 43853 } } peers { permanent_uuid: "95fd2b11e0234342b20b9651b523d5dc" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 40787 } } peers { permanent_uuid: "f0aeab7b73994d49978e78f34dc9ebe6" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 46591 } }
I20260812 08:03:12.994120 14985 leader_election.cc:290] T 14e573885ac34a4c9b19f4edc1977c01 P 87b11d6d4b7145e4aa26d690cdd18e87 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95fd2b11e0234342b20b9651b523d5dc (127.12.187.65:40787), f0aeab7b73994d49978e78f34dc9ebe6 (127.12.187.66:46591)
I20260812 08:03:12.995805 14440 generic_service.cc:175] {username='slave'} at 127.0.0.1:48580 changed flags via RPC: txn_staleness_tracker_interval_ms from '100' to '0'
I20260812 08:03:12.997287 14670 generic_service.cc:175] {username='slave'} at 127.0.0.1:53670 changed flags via RPC: txn_staleness_tracker_interval_ms from '100' to '0'
I20260812 08:03:12.998343 14912 generic_service.cc:175] {username='slave'} at 127.0.0.1:45242 changed flags via RPC: txn_staleness_tracker_interval_ms from '100' to '0'
I20260812 08:03:12.999542 14603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e573885ac34a4c9b19f4edc1977c01" candidate_uuid: "87b11d6d4b7145e4aa26d690cdd18e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0aeab7b73994d49978e78f34dc9ebe6" is_pre_election: true
I20260812 08:03:12.999540 14361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e573885ac34a4c9b19f4edc1977c01" candidate_uuid: "87b11d6d4b7145e4aa26d690cdd18e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95fd2b11e0234342b20b9651b523d5dc" is_pre_election: true
I20260812 08:03:12.999810 14603 raft_consensus.cc:2468] T 14e573885ac34a4c9b19f4edc1977c01 P f0aeab7b73994d49978e78f34dc9ebe6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87b11d6d4b7145e4aa26d690cdd18e87 in term 0.
I20260812 08:03:12.999810 14361 raft_consensus.cc:2468] T 14e573885ac34a4c9b19f4edc1977c01 P 95fd2b11e0234342b20b9651b523d5dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87b11d6d4b7145e4aa26d690cdd18e87 in term 0.
I20260812 08:03:13.000262 14720 leader_election.cc:304] T 14e573885ac34a4c9b19f4edc1977c01 P 87b11d6d4b7145e4aa26d690cdd18e87 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87b11d6d4b7145e4aa26d690cdd18e87, f0aeab7b73994d49978e78f34dc9ebe6; no voters: 
I20260812 08:03:13.000540 14985 raft_consensus.cc:2804] T 14e573885ac34a4c9b19f4edc1977c01 P 87b11d6d4b7145e4aa26d690cdd18e87 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 08:03:13.000634 14985 raft_consensus.cc:493] T 14e573885ac34a4c9b19f4edc1977c01 P 87b11d6d4b7145e4aa26d690cdd18e87 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 08:03:13.000705 14985 raft_consensus.cc:3060] T 14e573885ac34a4c9b19f4edc1977c01 P 87b11d6d4b7145e4aa26d690cdd18e87 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:03:13.001845 14985 raft_consensus.cc:515] T 14e573885ac34a4c9b19f4edc1977c01 P 87b11d6d4b7145e4aa26d690cdd18e87 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b11d6d4b7145e4aa26d690cdd18e87" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 43853 } } peers { permanent_uuid: "95fd2b11e0234342b20b9651b523d5dc" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 40787 } } peers { permanent_uuid: "f0aeab7b73994d49978e78f34dc9ebe6" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 46591 } }
I20260812 08:03:13.002278 14985 leader_election.cc:290] T 14e573885ac34a4c9b19f4edc1977c01 P 87b11d6d4b7145e4aa26d690cdd18e87 [CANDIDATE]: Term 1 election: Requested vote from peers 95fd2b11e0234342b20b9651b523d5dc (127.12.187.65:40787), f0aeab7b73994d49978e78f34dc9ebe6 (127.12.187.66:46591)
I20260812 08:03:13.002571 14361 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e573885ac34a4c9b19f4edc1977c01" candidate_uuid: "87b11d6d4b7145e4aa26d690cdd18e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95fd2b11e0234342b20b9651b523d5dc"
I20260812 08:03:13.002708 14361 raft_consensus.cc:3060] T 14e573885ac34a4c9b19f4edc1977c01 P 95fd2b11e0234342b20b9651b523d5dc [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:03:13.002763 14603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14e573885ac34a4c9b19f4edc1977c01" candidate_uuid: "87b11d6d4b7145e4aa26d690cdd18e87" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0aeab7b73994d49978e78f34dc9ebe6"
I20260812 08:03:13.002885 14603 raft_consensus.cc:3060] T 14e573885ac34a4c9b19f4edc1977c01 P f0aeab7b73994d49978e78f34dc9ebe6 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:03:13.003873 14361 raft_consensus.cc:2468] T 14e573885ac34a4c9b19f4edc1977c01 P 95fd2b11e0234342b20b9651b523d5dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87b11d6d4b7145e4aa26d690cdd18e87 in term 1.
I20260812 08:03:13.004004 14603 raft_consensus.cc:2468] T 14e573885ac34a4c9b19f4edc1977c01 P f0aeab7b73994d49978e78f34dc9ebe6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87b11d6d4b7145e4aa26d690cdd18e87 in term 1.
I20260812 08:03:13.004287 14718 leader_election.cc:304] T 14e573885ac34a4c9b19f4edc1977c01 P 87b11d6d4b7145e4aa26d690cdd18e87 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87b11d6d4b7145e4aa26d690cdd18e87, 95fd2b11e0234342b20b9651b523d5dc; no voters: 
I20260812 08:03:13.004551 14985 raft_consensus.cc:2804] T 14e573885ac34a4c9b19f4edc1977c01 P 87b11d6d4b7145e4aa26d690cdd18e87 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:03:13.004802 14985 raft_consensus.cc:697] T 14e573885ac34a4c9b19f4edc1977c01 P 87b11d6d4b7145e4aa26d690cdd18e87 [term 1 LEADER]: Becoming Leader. State: Replica: 87b11d6d4b7145e4aa26d690cdd18e87, State: Running, Role: LEADER
I20260812 08:03:13.005119 14985 consensus_queue.cc:237] T 14e573885ac34a4c9b19f4edc1977c01 P 87b11d6d4b7145e4aa26d690cdd18e87 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b11d6d4b7145e4aa26d690cdd18e87" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 43853 } } peers { permanent_uuid: "95fd2b11e0234342b20b9651b523d5dc" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 40787 } } peers { permanent_uuid: "f0aeab7b73994d49978e78f34dc9ebe6" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 46591 } }
I20260812 08:03:13.007414 15000 tablet_replica.cc:442] T 14e573885ac34a4c9b19f4edc1977c01 P 87b11d6d4b7145e4aa26d690cdd18e87: TxnStatusTablet state changed. Reason: New leader 87b11d6d4b7145e4aa26d690cdd18e87. Latest consensus state: current_term: 1 leader_uuid: "87b11d6d4b7145e4aa26d690cdd18e87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b11d6d4b7145e4aa26d690cdd18e87" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 43853 } } peers { permanent_uuid: "95fd2b11e0234342b20b9651b523d5dc" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 40787 } } peers { permanent_uuid: "f0aeab7b73994d49978e78f34dc9ebe6" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 46591 } } }
I20260812 08:03:13.007511 15000 tablet_replica.cc:445] T 14e573885ac34a4c9b19f4edc1977c01 P 87b11d6d4b7145e4aa26d690cdd18e87: This TxnStatusTablet replica's current role is: LEADER
I20260812 08:03:13.007882 15003 txn_status_manager.cc:874] Waiting until node catch up with all replicated operations in previous term...
I20260812 08:03:13.008095 15003 txn_status_manager.cc:930] Loading transaction status metadata into memory...
I20260812 08:03:13.008325 14090 catalog_manager.cc:5719] T 14e573885ac34a4c9b19f4edc1977c01 P 87b11d6d4b7145e4aa26d690cdd18e87 reported cstate change: term changed from 0 to 1, leader changed from <none> to 87b11d6d4b7145e4aa26d690cdd18e87 (127.12.187.67). New cstate: current_term: 1 leader_uuid: "87b11d6d4b7145e4aa26d690cdd18e87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b11d6d4b7145e4aa26d690cdd18e87" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 43853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95fd2b11e0234342b20b9651b523d5dc" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 40787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f0aeab7b73994d49978e78f34dc9ebe6" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 46591 } health_report { overall_health: UNKNOWN } } }
W20260812 08:03:13.026492 14687 tablet.cc:2406] T 14e573885ac34a4c9b19f4edc1977c01 P f0aeab7b73994d49978e78f34dc9ebe6: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:03:13.035869 14603 raft_consensus.cc:1275] T 14e573885ac34a4c9b19f4edc1977c01 P f0aeab7b73994d49978e78f34dc9ebe6 [term 1 FOLLOWER]: Refusing update from remote peer 87b11d6d4b7145e4aa26d690cdd18e87: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 08:03:13.035902 14361 raft_consensus.cc:1275] T 14e573885ac34a4c9b19f4edc1977c01 P 95fd2b11e0234342b20b9651b523d5dc [term 1 FOLLOWER]: Refusing update from remote peer 87b11d6d4b7145e4aa26d690cdd18e87: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 08:03:13.036590 14985 consensus_queue.cc:1048] T 14e573885ac34a4c9b19f4edc1977c01 P 87b11d6d4b7145e4aa26d690cdd18e87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0aeab7b73994d49978e78f34dc9ebe6" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 46591 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:03:13.036834 15000 consensus_queue.cc:1048] T 14e573885ac34a4c9b19f4edc1977c01 P 87b11d6d4b7145e4aa26d690cdd18e87 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95fd2b11e0234342b20b9651b523d5dc" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 40787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:03:13.040544 14986 tablet_replica.cc:442] T 14e573885ac34a4c9b19f4edc1977c01 P 95fd2b11e0234342b20b9651b523d5dc: TxnStatusTablet state changed. Reason: New leader 87b11d6d4b7145e4aa26d690cdd18e87. Latest consensus state: current_term: 1 leader_uuid: "87b11d6d4b7145e4aa26d690cdd18e87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b11d6d4b7145e4aa26d690cdd18e87" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 43853 } } peers { permanent_uuid: "95fd2b11e0234342b20b9651b523d5dc" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 40787 } } peers { permanent_uuid: "f0aeab7b73994d49978e78f34dc9ebe6" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 46591 } } }
I20260812 08:03:13.040666 14986 tablet_replica.cc:445] T 14e573885ac34a4c9b19f4edc1977c01 P 95fd2b11e0234342b20b9651b523d5dc: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 08:03:13.040939 14987 tablet_replica.cc:442] T 14e573885ac34a4c9b19f4edc1977c01 P f0aeab7b73994d49978e78f34dc9ebe6: TxnStatusTablet state changed. Reason: New leader 87b11d6d4b7145e4aa26d690cdd18e87. Latest consensus state: current_term: 1 leader_uuid: "87b11d6d4b7145e4aa26d690cdd18e87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b11d6d4b7145e4aa26d690cdd18e87" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 43853 } } peers { permanent_uuid: "95fd2b11e0234342b20b9651b523d5dc" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 40787 } } peers { permanent_uuid: "f0aeab7b73994d49978e78f34dc9ebe6" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 46591 } } }
I20260812 08:03:13.041069 14987 tablet_replica.cc:445] T 14e573885ac34a4c9b19f4edc1977c01 P f0aeab7b73994d49978e78f34dc9ebe6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 08:03:13.044148 15000 tablet_replica.cc:442] T 14e573885ac34a4c9b19f4edc1977c01 P 87b11d6d4b7145e4aa26d690cdd18e87: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "87b11d6d4b7145e4aa26d690cdd18e87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b11d6d4b7145e4aa26d690cdd18e87" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 43853 } } peers { permanent_uuid: "95fd2b11e0234342b20b9651b523d5dc" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 40787 } } peers { permanent_uuid: "f0aeab7b73994d49978e78f34dc9ebe6" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 46591 } } }
I20260812 08:03:13.044270 15000 tablet_replica.cc:445] T 14e573885ac34a4c9b19f4edc1977c01 P 87b11d6d4b7145e4aa26d690cdd18e87: This TxnStatusTablet replica's current role is: LEADER
I20260812 08:03:13.045989 14985 tablet_replica.cc:442] T 14e573885ac34a4c9b19f4edc1977c01 P 87b11d6d4b7145e4aa26d690cdd18e87: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "87b11d6d4b7145e4aa26d690cdd18e87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b11d6d4b7145e4aa26d690cdd18e87" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 43853 } } peers { permanent_uuid: "95fd2b11e0234342b20b9651b523d5dc" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 40787 } } peers { permanent_uuid: "f0aeab7b73994d49978e78f34dc9ebe6" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 46591 } } }
I20260812 08:03:13.046113 14985 tablet_replica.cc:445] T 14e573885ac34a4c9b19f4edc1977c01 P 87b11d6d4b7145e4aa26d690cdd18e87: This TxnStatusTablet replica's current role is: LEADER
I20260812 08:03:13.047204 14987 tablet_replica.cc:442] T 14e573885ac34a4c9b19f4edc1977c01 P f0aeab7b73994d49978e78f34dc9ebe6: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "87b11d6d4b7145e4aa26d690cdd18e87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b11d6d4b7145e4aa26d690cdd18e87" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 43853 } } peers { permanent_uuid: "95fd2b11e0234342b20b9651b523d5dc" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 40787 } } peers { permanent_uuid: "f0aeab7b73994d49978e78f34dc9ebe6" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 46591 } } }
I20260812 08:03:13.047312 14987 tablet_replica.cc:445] T 14e573885ac34a4c9b19f4edc1977c01 P f0aeab7b73994d49978e78f34dc9ebe6: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 08:03:13.047746 15010 mvcc.cc:204] Tried to move back new op lower bound from 7317593264267599872 to 7317593264151851008. Current Snapshot: MvccSnapshot[applied={T|T < 7317593264267599872}]
I20260812 08:03:13.049926 14986 tablet_replica.cc:442] T 14e573885ac34a4c9b19f4edc1977c01 P 95fd2b11e0234342b20b9651b523d5dc: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "87b11d6d4b7145e4aa26d690cdd18e87" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87b11d6d4b7145e4aa26d690cdd18e87" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 43853 } } peers { permanent_uuid: "95fd2b11e0234342b20b9651b523d5dc" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 40787 } } peers { permanent_uuid: "f0aeab7b73994d49978e78f34dc9ebe6" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 46591 } } }
I20260812 08:03:13.050047 14986 tablet_replica.cc:445] T 14e573885ac34a4c9b19f4edc1977c01 P 95fd2b11e0234342b20b9651b523d5dc: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 08:03:13.051070 15013 mvcc.cc:204] Tried to move back new op lower bound from 7317593264267599872 to 7317593264151851008. Current Snapshot: MvccSnapshot[applied={T|T < 7317593264267599872 or (T in {7317593264267599872})}]
I20260812 08:03:14.551337 14440 generic_service.cc:175] {username='slave'} at 127.0.0.1:48580 changed flags via RPC: txn_staleness_tracker_interval_ms from '0' to '100'
I20260812 08:03:14.552412 14670 generic_service.cc:175] {username='slave'} at 127.0.0.1:53670 changed flags via RPC: txn_staleness_tracker_interval_ms from '0' to '100'
I20260812 08:03:14.553237 14912 generic_service.cc:175] {username='slave'} at 127.0.0.1:45242 changed flags via RPC: txn_staleness_tracker_interval_ms from '0' to '100'
I20260812 08:03:14.753118 14728 txn_status_manager.cc:1391] automatically aborted stale txn (ID 0) past 1.701s from last keepalive heartbeat (effective timeout is 0.500s)
I20260812 08:03:16.055704 13037 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu with pid 14222
W20260812 08:03:16.071003 14066 connection.cc:573] server connection from 127.12.187.65:44215 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 08:03:16.071203 13037 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu with pid 14450
W20260812 08:03:16.083519 14718 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.187.65:40787: connect: Connection refused (error 111)
W20260812 08:03:16.084546 14718 consensus_peers.cc:597] T 14e573885ac34a4c9b19f4edc1977c01 P 87b11d6d4b7145e4aa26d690cdd18e87 -> Peer 95fd2b11e0234342b20b9651b523d5dc (127.12.187.65:40787): Couldn't send request to peer 95fd2b11e0234342b20b9651b523d5dc. Status: Network error: Client connection negotiation failed: client connection to 127.12.187.65:40787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 08:03:16.089268 14720 connection.cc:573] client connection to 127.12.187.66:46591 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 08:03:16.089929 13037 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu with pid 14688
I20260812 08:03:16.103523 13037 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu with pid 14044
2026-08-12T08:03:16Z chronyd exiting
[       OK ] TxnStatusManagerITest.ToggleStaleTxnTrackerInRuntime (4457 ms)
[ RUN      ] TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances
2026-08-12T08:03:16Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T08:03:16Z Disabled control of system clock
I20260812 08:03:16.147630 13037 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu
/tmp/dist-test-tasksRvS6i/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.187.126:36763
--webserver_interface=127.12.187.126
--webserver_port=0
--builtin_ntp_servers=127.12.187.84:33799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.187.126:36763
--txn_manager_enabled=true
--txn_manager_lazily_initialized=false with env {}
W20260812 08:03:16.251237 15049 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:16.251441 15049 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:16.251479 15049 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:03:16.254784 15049 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:03:16.254839 15049 flags.cc:432] Enabled experimental flag: --txn_manager_enabled=true
W20260812 08:03:16.254856 15049 flags.cc:432] Enabled experimental flag: --txn_manager_lazily_initialized=false
W20260812 08:03:16.254873 15049 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:16.254889 15049 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:03:16.254906 15049 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:03:16.258740 15049 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.187.84:33799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.187.126:36763
--txn_manager_enabled=true
--txn_manager_lazily_initialized=false
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.187.126:36763
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.187.126
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.15049
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:16.259712 15049 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:16.260690 15049 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:03:16.266284 15059 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:16.266281 15062 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:16.266458 15060 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:16.266505 15049 server_base.cc:1061] running on GCE node
I20260812 08:03:16.267134 15049 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:16.268028 15049 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:16.269275 15049 hybrid_clock.cc:648] HybridClock initialized: now 1786521796269252 us; error 37 us; skew 500 ppm
I20260812 08:03:16.271109 15049 webserver.cc:533] Webserver started at http://127.12.187.126:44429/ using document root <none> and password file <none>
I20260812 08:03:16.271732 15049 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:16.271822 15049 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:16.272044 15049 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:03:16.273681 15049 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/master-0/data/instance:
uuid: "8e78e58b191846149d8e2c38dfafe9e1"
format_stamp: "Formatted at 2026-08-12 08:03:16 on dist-test-slave-8hhm"
I20260812 08:03:16.274113 15049 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/master-0/wal/instance:
uuid: "8e78e58b191846149d8e2c38dfafe9e1"
format_stamp: "Formatted at 2026-08-12 08:03:16 on dist-test-slave-8hhm"
I20260812 08:03:16.277362 15049 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.004s	sys 0.000s
I20260812 08:03:16.279479 15075 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:16.280572 15049 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:03:16.280678 15049 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/master-0/data,/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/master-0/wal
uuid: "8e78e58b191846149d8e2c38dfafe9e1"
format_stamp: "Formatted at 2026-08-12 08:03:16 on dist-test-slave-8hhm"
I20260812 08:03:16.280812 15049 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:16.307775 15049 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:16.308544 15049 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:16.308760 15049 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:16.317664 15049 rpc_server.cc:307] RPC server started. Bound to: 127.12.187.126:36763
I20260812 08:03:16.317710 15179 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.187.126:36763 every 8 connection(s)
I20260812 08:03:16.318722 15049 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/master-0/data/info.pb
I20260812 08:03:16.321857 15180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:03:16.323045 13037 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu as pid 15049
I20260812 08:03:16.323134 13037 external_mini_cluster.cc:1448] Reading /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/master-0/wal/instance
I20260812 08:03:16.328675 15180 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8e78e58b191846149d8e2c38dfafe9e1: Bootstrap starting.
I20260812 08:03:16.331617 15180 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8e78e58b191846149d8e2c38dfafe9e1: Neither blocks nor log segments found. Creating new log.
I20260812 08:03:16.332471 15180 log.cc:826] T 00000000000000000000000000000000 P 8e78e58b191846149d8e2c38dfafe9e1: Log is configured to *not* fsync() on all Append() calls
I20260812 08:03:16.334426 15180 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8e78e58b191846149d8e2c38dfafe9e1: No bootstrap required, opened a new log
I20260812 08:03:16.337560 15180 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8e78e58b191846149d8e2c38dfafe9e1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e78e58b191846149d8e2c38dfafe9e1" member_type: VOTER last_known_addr { host: "127.12.187.126" port: 36763 } }
I20260812 08:03:16.337759 15180 raft_consensus.cc:385] T 00000000000000000000000000000000 P 8e78e58b191846149d8e2c38dfafe9e1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:03:16.337801 15180 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8e78e58b191846149d8e2c38dfafe9e1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e78e58b191846149d8e2c38dfafe9e1, State: Initialized, Role: FOLLOWER
I20260812 08:03:16.338165 15180 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8e78e58b191846149d8e2c38dfafe9e1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e78e58b191846149d8e2c38dfafe9e1" member_type: VOTER last_known_addr { host: "127.12.187.126" port: 36763 } }
I20260812 08:03:16.338284 15180 raft_consensus.cc:399] T 00000000000000000000000000000000 P 8e78e58b191846149d8e2c38dfafe9e1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 08:03:16.338336 15180 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8e78e58b191846149d8e2c38dfafe9e1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 08:03:16.338420 15180 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8e78e58b191846149d8e2c38dfafe9e1 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:03:16.339282 15180 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8e78e58b191846149d8e2c38dfafe9e1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e78e58b191846149d8e2c38dfafe9e1" member_type: VOTER last_known_addr { host: "127.12.187.126" port: 36763 } }
I20260812 08:03:16.339607 15180 leader_election.cc:304] T 00000000000000000000000000000000 P 8e78e58b191846149d8e2c38dfafe9e1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8e78e58b191846149d8e2c38dfafe9e1; no voters: 
I20260812 08:03:16.339921 15180 leader_election.cc:290] T 00000000000000000000000000000000 P 8e78e58b191846149d8e2c38dfafe9e1 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 08:03:16.340020 15186 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8e78e58b191846149d8e2c38dfafe9e1 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:03:16.340256 15186 raft_consensus.cc:697] T 00000000000000000000000000000000 P 8e78e58b191846149d8e2c38dfafe9e1 [term 1 LEADER]: Becoming Leader. State: Replica: 8e78e58b191846149d8e2c38dfafe9e1, State: Running, Role: LEADER
I20260812 08:03:16.340585 15186 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8e78e58b191846149d8e2c38dfafe9e1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e78e58b191846149d8e2c38dfafe9e1" member_type: VOTER last_known_addr { host: "127.12.187.126" port: 36763 } }
I20260812 08:03:16.341256 15180 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8e78e58b191846149d8e2c38dfafe9e1 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 08:03:16.342450 15187 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e78e58b191846149d8e2c38dfafe9e1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8e78e58b191846149d8e2c38dfafe9e1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e78e58b191846149d8e2c38dfafe9e1" member_type: VOTER last_known_addr { host: "127.12.187.126" port: 36763 } } }
I20260812 08:03:16.342626 15187 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e78e58b191846149d8e2c38dfafe9e1 [sys.catalog]: This master's current role is: LEADER
I20260812 08:03:16.343129 15191 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8e78e58b191846149d8e2c38dfafe9e1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8e78e58b191846149d8e2c38dfafe9e1. Latest consensus state: current_term: 1 leader_uuid: "8e78e58b191846149d8e2c38dfafe9e1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8e78e58b191846149d8e2c38dfafe9e1" member_type: VOTER last_known_addr { host: "127.12.187.126" port: 36763 } } }
I20260812 08:03:16.343350 15191 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8e78e58b191846149d8e2c38dfafe9e1 [sys.catalog]: This master's current role is: LEADER
I20260812 08:03:16.343380 15207 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:03:16.346127 15207 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:03:16.351985 15207 catalog_manager.cc:1383] Generated new cluster ID: 875b67a649b643a2b8c523da0d56cc84
I20260812 08:03:16.352118 15207 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:03:16.363207 15207 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 08:03:16.363979 15207 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:03:16.372797 15207 catalog_manager.cc:6092] T 00000000000000000000000000000000 P 8e78e58b191846149d8e2c38dfafe9e1: Generated new TSK 0
I20260812 08:03:16.373394 15207 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 08:03:16.380789 13037 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu
/tmp/dist-test-tasksRvS6i/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.187.65:0
--local_ip_for_outbound_sockets=127.12.187.65
--webserver_interface=127.12.187.65
--webserver_port=0
--tserver_master_addrs=127.12.187.126:36763
--builtin_ntp_servers=127.12.187.84:33799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--txn_keepalive_interval_ms=500
--txn_staleness_tracker_interval_ms=100
--txn_staleness_tracker_disabled_interval_ms=100
--raft_heartbeat_interval_ms=50
--leader_failure_max_missed_heartbeat_periods=1.25
--enable_txn_system_client_init=true
--txn_schedule_background_tasks=false with env {}
I20260812 08:03:16.381093 15107 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33002:
name: "kudu_system.kudu_transactions"
schema {
  columns {
    name: "txn_id"
    type: INT64
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "entry_type"
    type: INT8
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "identifier"
    type: STRING
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "metadata"
    type: STRING
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
  indirect_data: "<redacted>"""
}
partition_schema {
  range_schema {
    columns {
      name: "txn_id"
    }
  }
}
table_type: TXN_STATUS_TABLE
W20260812 08:03:16.385748 15180 master.cc:465] Invalid argument: unable to initialize TxnManager: Error creating table kudu_system.kudu_transactions on the master: not enough live tablet servers to create a table with the requested replication factor 3; 0 tablet servers are alive: unable to init TxnManager, will retry in 1.000s
W20260812 08:03:16.488289 15244 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:16.488529 15244 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:16.488610 15244 flags.cc:432] Enabled unsafe flag: --txn_schedule_background_tasks=false
W20260812 08:03:16.488682 15244 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:03:16.492036 15244 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:16.492173 15244 flags.cc:432] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 08:03:16.492234 15244 flags.cc:432] Enabled experimental flag: --txn_staleness_tracker_interval_ms=100
W20260812 08:03:16.492271 15244 flags.cc:432] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 08:03:16.492345 15244 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.187.65
I20260812 08:03:16.496249 15244 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.187.84:33799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1.25
--raft_heartbeat_interval_ms=50
--fs_data_dirs=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.187.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.187.65
--webserver_port=0
--txn_keepalive_interval_ms=500
--txn_schedule_background_tasks=false
--txn_staleness_tracker_interval_ms=100
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.187.126:36763
--txn_staleness_tracker_disabled_interval_ms=100
--never_fsync=true
--heap_profile_path=/tmp/kudu.15244
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.187.65

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:16.497659 15244 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:16.498787 15244 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 08:03:16.501607 15244 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 08:03:16.505379 15252 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:16.505415 15256 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:16.505437 15251 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:16.505617 15244 server_base.cc:1061] running on GCE node
I20260812 08:03:16.506204 15244 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:16.506835 15244 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:16.508028 15244 hybrid_clock.cc:648] HybridClock initialized: now 1786521796507989 us; error 48 us; skew 500 ppm
I20260812 08:03:16.510188 15244 webserver.cc:533] Webserver started at http://127.12.187.65:34711/ using document root <none> and password file <none>
I20260812 08:03:16.510874 15244 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:16.510950 15244 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:16.511158 15244 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:03:16.513342 15244 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-0/data/instance:
uuid: "7e87a26275e4471f8960440233b86bc7"
format_stamp: "Formatted at 2026-08-12 08:03:16 on dist-test-slave-8hhm"
I20260812 08:03:16.513949 15244 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-0/wal/instance:
uuid: "7e87a26275e4471f8960440233b86bc7"
format_stamp: "Formatted at 2026-08-12 08:03:16 on dist-test-slave-8hhm"
I20260812 08:03:16.518159 15244 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260812 08:03:16.520577 15268 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:16.521700 15244 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 08:03:16.521807 15244 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-0/wal
uuid: "7e87a26275e4471f8960440233b86bc7"
format_stamp: "Formatted at 2026-08-12 08:03:16 on dist-test-slave-8hhm"
I20260812 08:03:16.521893 15244 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:16.543779 15244 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:16.544525 15244 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:16.544739 15244 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:16.546417 15244 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:03:16.546468 15244 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:16.546507 15244 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:03:16.546561 15244 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:16.557427 15244 rpc_server.cc:307] RPC server started. Bound to: 127.12.187.65:43717
I20260812 08:03:16.557448 15465 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.187.65:43717 every 8 connection(s)
I20260812 08:03:16.558523 15244 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-0/data/info.pb
I20260812 08:03:16.559919 13037 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu as pid 15244
I20260812 08:03:16.559959 15468 heartbeater.cc:344] Connected to a master server at 127.12.187.126:36763
I20260812 08:03:16.560035 13037 external_mini_cluster.cc:1448] Reading /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-0/wal/instance
I20260812 08:03:16.560144 15468 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:16.560675 15468 heartbeater.cc:507] Master 127.12.187.126:36763 requested a full tablet report, sending...
I20260812 08:03:16.562089 15107 ts_manager.cc:194] Registered new tserver with Master: 7e87a26275e4471f8960440233b86bc7 (127.12.187.65:43717)
I20260812 08:03:16.562187 13037 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu
/tmp/dist-test-tasksRvS6i/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.187.66:0
--local_ip_for_outbound_sockets=127.12.187.66
--webserver_interface=127.12.187.66
--webserver_port=0
--tserver_master_addrs=127.12.187.126:36763
--builtin_ntp_servers=127.12.187.84:33799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--txn_keepalive_interval_ms=500
--txn_staleness_tracker_interval_ms=100
--txn_staleness_tracker_disabled_interval_ms=100
--raft_heartbeat_interval_ms=50
--leader_failure_max_missed_heartbeat_periods=1.25
--enable_txn_system_client_init=true
--txn_schedule_background_tasks=false with env {}
I20260812 08:03:16.563649 15107 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.12.187.65:35147
W20260812 08:03:16.666215 15470 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:16.666453 15470 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:16.666493 15470 flags.cc:432] Enabled unsafe flag: --txn_schedule_background_tasks=false
W20260812 08:03:16.666580 15470 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:03:16.669986 15470 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:16.670068 15470 flags.cc:432] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 08:03:16.670089 15470 flags.cc:432] Enabled experimental flag: --txn_staleness_tracker_interval_ms=100
W20260812 08:03:16.670173 15470 flags.cc:432] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 08:03:16.670279 15470 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.187.66
I20260812 08:03:16.674165 15470 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.187.84:33799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1.25
--raft_heartbeat_interval_ms=50
--fs_data_dirs=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.187.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.187.66
--webserver_port=0
--txn_keepalive_interval_ms=500
--txn_schedule_background_tasks=false
--txn_staleness_tracker_interval_ms=100
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.187.126:36763
--txn_staleness_tracker_disabled_interval_ms=100
--never_fsync=true
--heap_profile_path=/tmp/kudu.15470
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.187.66

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:16.675237 15470 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:16.676416 15470 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 08:03:16.679164 15470 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 08:03:16.683019 15483 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:16.683143 15487 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:16.683051 15480 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:16.683324 15470 server_base.cc:1061] running on GCE node
I20260812 08:03:16.683640 15470 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:16.684154 15470 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:16.685290 15470 hybrid_clock.cc:648] HybridClock initialized: now 1786521796685253 us; error 40 us; skew 500 ppm
I20260812 08:03:16.687004 15470 webserver.cc:533] Webserver started at http://127.12.187.66:43121/ using document root <none> and password file <none>
I20260812 08:03:16.687536 15470 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:16.687602 15470 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:16.687839 15470 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:03:16.689405 15470 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-1/data/instance:
uuid: "1af245ab88fa4a69a4e94a41cfa1c947"
format_stamp: "Formatted at 2026-08-12 08:03:16 on dist-test-slave-8hhm"
I20260812 08:03:16.689877 15470 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-1/wal/instance:
uuid: "1af245ab88fa4a69a4e94a41cfa1c947"
format_stamp: "Formatted at 2026-08-12 08:03:16 on dist-test-slave-8hhm"
I20260812 08:03:16.692986 15470 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.001s
I20260812 08:03:16.695024 15495 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:16.695946 15470 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:03:16.696082 15470 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-1/wal
uuid: "1af245ab88fa4a69a4e94a41cfa1c947"
format_stamp: "Formatted at 2026-08-12 08:03:16 on dist-test-slave-8hhm"
I20260812 08:03:16.696183 15470 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:16.712459 15470 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:16.713111 15470 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:16.713357 15470 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:16.714897 15470 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:03:16.714987 15470 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:16.715039 15470 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:03:16.715065 15470 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:16.726518 15470 rpc_server.cc:307] RPC server started. Bound to: 127.12.187.66:41261
I20260812 08:03:16.726552 15692 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.187.66:41261 every 8 connection(s)
I20260812 08:03:16.727658 15470 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-1/data/info.pb
I20260812 08:03:16.729174 15693 heartbeater.cc:344] Connected to a master server at 127.12.187.126:36763
I20260812 08:03:16.729362 15693 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:16.729349 13037 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu as pid 15470
I20260812 08:03:16.729455 13037 external_mini_cluster.cc:1448] Reading /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-1/wal/instance
I20260812 08:03:16.729897 15693 heartbeater.cc:507] Master 127.12.187.126:36763 requested a full tablet report, sending...
I20260812 08:03:16.730906 15107 ts_manager.cc:194] Registered new tserver with Master: 1af245ab88fa4a69a4e94a41cfa1c947 (127.12.187.66:41261)
I20260812 08:03:16.731578 15107 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.12.187.66:46725
I20260812 08:03:16.731699 13037 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu
/tmp/dist-test-tasksRvS6i/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.187.67:0
--local_ip_for_outbound_sockets=127.12.187.67
--webserver_interface=127.12.187.67
--webserver_port=0
--tserver_master_addrs=127.12.187.126:36763
--builtin_ntp_servers=127.12.187.84:33799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--txn_keepalive_interval_ms=500
--txn_staleness_tracker_interval_ms=100
--txn_staleness_tracker_disabled_interval_ms=100
--raft_heartbeat_interval_ms=50
--leader_failure_max_missed_heartbeat_periods=1.25
--enable_txn_system_client_init=true
--txn_schedule_background_tasks=false with env {}
W20260812 08:03:16.837293 15695 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:16.837502 15695 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:16.837567 15695 flags.cc:432] Enabled unsafe flag: --txn_schedule_background_tasks=false
W20260812 08:03:16.837641 15695 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:03:16.840965 15695 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:16.841073 15695 flags.cc:432] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 08:03:16.841094 15695 flags.cc:432] Enabled experimental flag: --txn_staleness_tracker_interval_ms=100
W20260812 08:03:16.841109 15695 flags.cc:432] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 08:03:16.841150 15695 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.187.67
I20260812 08:03:16.845199 15695 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.187.84:33799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1.25
--raft_heartbeat_interval_ms=50
--fs_data_dirs=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.187.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.187.67
--webserver_port=0
--txn_keepalive_interval_ms=500
--txn_schedule_background_tasks=false
--txn_staleness_tracker_interval_ms=100
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.187.126:36763
--txn_staleness_tracker_disabled_interval_ms=100
--never_fsync=true
--heap_profile_path=/tmp/kudu.15695
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.187.67

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:16.846346 15695 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:16.847566 15695 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 08:03:16.850296 15695 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 08:03:16.853920 15704 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:16.853950 15703 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:16.853948 15706 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:16.854327 15695 server_base.cc:1061] running on GCE node
I20260812 08:03:16.854692 15695 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:16.855230 15695 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:16.856441 15695 hybrid_clock.cc:648] HybridClock initialized: now 1786521796856423 us; error 37 us; skew 500 ppm
I20260812 08:03:16.858421 15695 webserver.cc:533] Webserver started at http://127.12.187.67:45409/ using document root <none> and password file <none>
I20260812 08:03:16.859032 15695 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:16.859122 15695 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:16.859337 15695 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:03:16.860846 15695 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-2/data/instance:
uuid: "e34cdbd5bd04469e92a6e15e7ae007a8"
format_stamp: "Formatted at 2026-08-12 08:03:16 on dist-test-slave-8hhm"
I20260812 08:03:16.861416 15695 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-2/wal/instance:
uuid: "e34cdbd5bd04469e92a6e15e7ae007a8"
format_stamp: "Formatted at 2026-08-12 08:03:16 on dist-test-slave-8hhm"
I20260812 08:03:16.864692 15695 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.000s
I20260812 08:03:16.866967 15718 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:16.868026 15695 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260812 08:03:16.868157 15695 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-2/wal
uuid: "e34cdbd5bd04469e92a6e15e7ae007a8"
format_stamp: "Formatted at 2026-08-12 08:03:16 on dist-test-slave-8hhm"
I20260812 08:03:16.868266 15695 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:16.912653 15695 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:16.913486 15695 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:16.913697 15695 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:16.915351 15695 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:03:16.915432 15695 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:16.915508 15695 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:03:16.915541 15695 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:16.926139 15695 rpc_server.cc:307] RPC server started. Bound to: 127.12.187.67:33175
I20260812 08:03:16.926535 15918 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.187.67:33175 every 8 connection(s)
I20260812 08:03:16.927326 15695 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-2/data/info.pb
I20260812 08:03:16.928762 13037 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu as pid 15695
I20260812 08:03:16.928859 13037 external_mini_cluster.cc:1448] Reading /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-2/wal/instance
I20260812 08:03:16.928882 15920 heartbeater.cc:344] Connected to a master server at 127.12.187.126:36763
I20260812 08:03:16.929090 15920 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:16.929749 15920 heartbeater.cc:507] Master 127.12.187.126:36763 requested a full tablet report, sending...
I20260812 08:03:16.930763 15107 ts_manager.cc:194] Registered new tserver with Master: e34cdbd5bd04469e92a6e15e7ae007a8 (127.12.187.67:33175)
I20260812 08:03:16.931480 15107 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.12.187.67:54151
I20260812 08:03:16.931684 13037 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260812 08:03:17.413658 15107 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33012:
name: "kudu_system.kudu_transactions"
schema {
  columns {
    name: "txn_id"
    type: INT64
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "entry_type"
    type: INT8
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "identifier"
    type: STRING
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "metadata"
    type: STRING
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
  indirect_data: "<redacted>"""
}
partition_schema {
  range_schema {
    columns {
      name: "txn_id"
    }
  }
}
table_type: TXN_STATUS_TABLE
W20260812 08:03:17.414278 15107 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 08:03:17.429451 15349 tablet_service.cc:1511] Processing CreateTablet for tablet 0f9160eee4cc4be28bce822ec9b2fdc0 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=43b0150094704cafa498a6a54a721d7c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 08:03:17.430251 15575 tablet_service.cc:1511] Processing CreateTablet for tablet 0f9160eee4cc4be28bce822ec9b2fdc0 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=43b0150094704cafa498a6a54a721d7c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 08:03:17.430424 15807 tablet_service.cc:1511] Processing CreateTablet for tablet 0f9160eee4cc4be28bce822ec9b2fdc0 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=43b0150094704cafa498a6a54a721d7c]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 08:03:17.431236 15349 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f9160eee4cc4be28bce822ec9b2fdc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:03:17.431299 15575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f9160eee4cc4be28bce822ec9b2fdc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:03:17.431540 15807 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f9160eee4cc4be28bce822ec9b2fdc0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:03:17.436832 15967 tablet_bootstrap.cc:492] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947: Bootstrap starting.
I20260812 08:03:17.437551 15969 tablet_bootstrap.cc:492] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8: Bootstrap starting.
I20260812 08:03:17.438375 15972 tablet_bootstrap.cc:492] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7: Bootstrap starting.
I20260812 08:03:17.439474 15967 tablet_bootstrap.cc:654] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947: Neither blocks nor log segments found. Creating new log.
I20260812 08:03:17.439486 15969 tablet_bootstrap.cc:654] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8: Neither blocks nor log segments found. Creating new log.
I20260812 08:03:17.440287 15972 tablet_bootstrap.cc:654] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7: Neither blocks nor log segments found. Creating new log.
I20260812 08:03:17.440353 15967 log.cc:826] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947: Log is configured to *not* fsync() on all Append() calls
I20260812 08:03:17.440353 15969 log.cc:826] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8: Log is configured to *not* fsync() on all Append() calls
I20260812 08:03:17.441088 15972 log.cc:826] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7: Log is configured to *not* fsync() on all Append() calls
I20260812 08:03:17.442155 15969 tablet_bootstrap.cc:492] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8: No bootstrap required, opened a new log
I20260812 08:03:17.442385 15969 ts_tablet_manager.cc:1403] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8: Time spent bootstrapping tablet: real 0.005s	user 0.005s	sys 0.000s
I20260812 08:03:17.442795 15972 tablet_bootstrap.cc:492] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7: No bootstrap required, opened a new log
I20260812 08:03:17.442983 15972 ts_tablet_manager.cc:1403] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7: Time spent bootstrapping tablet: real 0.005s	user 0.004s	sys 0.000s
I20260812 08:03:17.443157 15967 tablet_bootstrap.cc:492] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947: No bootstrap required, opened a new log
I20260812 08:03:17.443380 15967 ts_tablet_manager.cc:1403] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947: Time spent bootstrapping tablet: real 0.007s	user 0.005s	sys 0.000s
I20260812 08:03:17.445413 15969 raft_consensus.cc:359] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } }
I20260812 08:03:17.445626 15969 raft_consensus.cc:385] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:03:17.445698 15969 raft_consensus.cc:740] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e34cdbd5bd04469e92a6e15e7ae007a8, State: Initialized, Role: FOLLOWER
I20260812 08:03:17.446146 15969 consensus_queue.cc:260] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } }
I20260812 08:03:17.446527 15967 raft_consensus.cc:359] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } }
I20260812 08:03:17.446731 15967 raft_consensus.cc:385] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:03:17.446791 15967 raft_consensus.cc:740] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1af245ab88fa4a69a4e94a41cfa1c947, State: Initialized, Role: FOLLOWER
I20260812 08:03:17.446780 15920 heartbeater.cc:499] Master 127.12.187.126:36763 was elected leader, sending a full tablet report...
I20260812 08:03:17.446905 15979 tablet_replica.cc:442] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:17.446849 15972 raft_consensus.cc:359] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } }
I20260812 08:03:17.447027 15972 raft_consensus.cc:385] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:03:17.447086 15972 raft_consensus.cc:740] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e87a26275e4471f8960440233b86bc7, State: Initialized, Role: FOLLOWER
I20260812 08:03:17.447407 15979 tablet_replica.cc:445] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 08:03:17.447297 15967 consensus_queue.cc:260] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } }
I20260812 08:03:17.447479 15972 consensus_queue.cc:260] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } }
I20260812 08:03:17.447656 15979 raft_consensus.cc:493] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:03:17.447841 15979 raft_consensus.cc:515] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } }
I20260812 08:03:17.448285 15967 ts_tablet_manager.cc:1434] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260812 08:03:17.448522 15972 ts_tablet_manager.cc:1434] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260812 08:03:17.448863 15468 heartbeater.cc:499] Master 127.12.187.126:36763 was elected leader, sending a full tablet report...
I20260812 08:03:17.449002 15982 tablet_replica.cc:442] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:17.449110 15982 tablet_replica.cc:445] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 08:03:17.449424 15981 tablet_replica.cc:442] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:17.449536 15981 tablet_replica.cc:445] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 08:03:17.450062 15693 heartbeater.cc:499] Master 127.12.187.126:36763 was elected leader, sending a full tablet report...
I20260812 08:03:17.451510 15969 ts_tablet_manager.cc:1434] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260812 08:03:17.453715 15979 leader_election.cc:290] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7e87a26275e4471f8960440233b86bc7 (127.12.187.65:43717), 1af245ab88fa4a69a4e94a41cfa1c947 (127.12.187.66:41261)
I20260812 08:03:17.454996 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9160eee4cc4be28bce822ec9b2fdc0" candidate_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87a26275e4471f8960440233b86bc7" is_pre_election: true
I20260812 08:03:17.455307 15377 raft_consensus.cc:2468] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e34cdbd5bd04469e92a6e15e7ae007a8 in term 0.
I20260812 08:03:17.455796 15721 leader_election.cc:304] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e87a26275e4471f8960440233b86bc7, e34cdbd5bd04469e92a6e15e7ae007a8; no voters: 
I20260812 08:03:17.456073 15980 raft_consensus.cc:2804] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 08:03:17.456144 15980 raft_consensus.cc:493] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 08:03:17.456193 15980 raft_consensus.cc:3060] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:03:17.457449 15980 raft_consensus.cc:515] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } }
I20260812 08:03:17.457852 15980 leader_election.cc:290] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [CANDIDATE]: Term 1 election: Requested vote from peers 7e87a26275e4471f8960440233b86bc7 (127.12.187.65:43717), 1af245ab88fa4a69a4e94a41cfa1c947 (127.12.187.66:41261)
I20260812 08:03:17.458673 15603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9160eee4cc4be28bce822ec9b2fdc0" candidate_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1af245ab88fa4a69a4e94a41cfa1c947"
I20260812 08:03:17.458673 15606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9160eee4cc4be28bce822ec9b2fdc0" candidate_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" is_pre_election: true
I20260812 08:03:17.458977 15606 raft_consensus.cc:2468] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e34cdbd5bd04469e92a6e15e7ae007a8 in term 0.
I20260812 08:03:17.459288 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9160eee4cc4be28bce822ec9b2fdc0" candidate_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7e87a26275e4471f8960440233b86bc7"
I20260812 08:03:17.459430 15377 raft_consensus.cc:3060] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:03:17.460551 15377 raft_consensus.cc:2468] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e34cdbd5bd04469e92a6e15e7ae007a8 in term 1.
I20260812 08:03:17.460839 15721 leader_election.cc:304] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e87a26275e4471f8960440233b86bc7, e34cdbd5bd04469e92a6e15e7ae007a8; no voters: 1af245ab88fa4a69a4e94a41cfa1c947
I20260812 08:03:17.461018 15980 raft_consensus.cc:2804] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:03:17.461131 15980 raft_consensus.cc:697] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 1 LEADER]: Becoming Leader. State: Replica: e34cdbd5bd04469e92a6e15e7ae007a8, State: Running, Role: LEADER
I20260812 08:03:17.461617 15980 consensus_queue.cc:237] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } }
I20260812 08:03:17.464335 15979 tablet_replica.cc:442] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8: TxnStatusTablet state changed. Reason: New leader e34cdbd5bd04469e92a6e15e7ae007a8. Latest consensus state: current_term: 1 leader_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:17.464457 15979 tablet_replica.cc:445] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8: This TxnStatusTablet replica's current role is: LEADER
I20260812 08:03:17.465332 15992 txn_status_manager.cc:874] Waiting until node catch up with all replicated operations in previous term...
I20260812 08:03:17.465531 15992 txn_status_manager.cc:930] Loading transaction status metadata into memory...
I20260812 08:03:17.466391 15107 catalog_manager.cc:5719] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 reported cstate change: term changed from 0 to 1, leader changed from <none> to e34cdbd5bd04469e92a6e15e7ae007a8 (127.12.187.67). New cstate: current_term: 1 leader_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } health_report { overall_health: HEALTHY } } }
W20260812 08:03:17.479054 15694 tablet.cc:2406] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260812 08:03:17.487928 15603 raft_consensus.cc:3060] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:03:17.488253 15377 raft_consensus.cc:1275] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 1 FOLLOWER]: Refusing update from remote peer e34cdbd5bd04469e92a6e15e7ae007a8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 08:03:17.488983 15980 consensus_queue.cc:1048] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:03:17.489289 15603 raft_consensus.cc:1275] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 1 FOLLOWER]: Refusing update from remote peer e34cdbd5bd04469e92a6e15e7ae007a8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 08:03:17.489815 15980 consensus_queue.cc:1048] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:03:17.493122 15982 tablet_replica.cc:442] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7: TxnStatusTablet state changed. Reason: New leader e34cdbd5bd04469e92a6e15e7ae007a8. Latest consensus state: current_term: 1 leader_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:17.493319 15982 tablet_replica.cc:445] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 08:03:17.493468 15981 tablet_replica.cc:442] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947: TxnStatusTablet state changed. Reason: New leader e34cdbd5bd04469e92a6e15e7ae007a8. Latest consensus state: current_term: 1 leader_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:17.493579 15981 tablet_replica.cc:445] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 08:03:17.496268 15979 tablet_replica.cc:442] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:17.496376 15979 tablet_replica.cc:445] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8: This TxnStatusTablet replica's current role is: LEADER
I20260812 08:03:17.498080 15982 tablet_replica.cc:442] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:17.498194 15982 tablet_replica.cc:445] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 08:03:17.498867 16011 mvcc.cc:204] Tried to move back new op lower bound from 7317593282504269824 to 7317593282406547456. Current Snapshot: MvccSnapshot[applied={T|T < 7317593282504269824}]
I20260812 08:03:17.503285 15979 tablet_replica.cc:442] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:17.503396 15979 tablet_replica.cc:445] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8: This TxnStatusTablet replica's current role is: LEADER
I20260812 08:03:17.505944 15981 tablet_replica.cc:442] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:17.506072 15981 tablet_replica.cc:445] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947: This TxnStatusTablet replica's current role is: FOLLOWER
W20260812 08:03:17.552779 16018 txn_status_manager-itest.cc:377] KeepTransactionAlive() returned non-OK status: Timed out: KeepTransactionAlive RPC to 127.12.187.126:36763 timed out after 0.050s (SENT)
W20260812 08:03:17.559402 15946 meta_cache.cc:302] tablet 0f9160eee4cc4be28bce822ec9b2fdc0: replica e34cdbd5bd04469e92a6e15e7ae007a8 (127.12.187.67:33175) has failed: Timed out: CoordinateTransaction RPC to 127.12.187.67:33175 timed out after 0.050s (SENT)
W20260812 08:03:17.559780 15157 rpcz_store.cc:267] Call kudu.transactions.TxnManagerService.KeepTransactionAlive from 127.0.0.1:33028 (request call id 0) took 51 ms (client timeout 50 ms). Trace:
W20260812 08:03:17.559880 15157 rpcz_store.cc:269] 0812 08:03:17.508568 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:03:17.508632 (+    64us) service_pool.cc:224] Handling call
0812 08:03:17.559746 (+ 51114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260812 08:03:17.560696 15982 raft_consensus.cc:493] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e34cdbd5bd04469e92a6e15e7ae007a8)
I20260812 08:03:17.560806 15982 raft_consensus.cc:515] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } }
I20260812 08:03:17.561946 15982 leader_election.cc:290] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1af245ab88fa4a69a4e94a41cfa1c947 (127.12.187.66:41261), e34cdbd5bd04469e92a6e15e7ae007a8 (127.12.187.67:33175)
I20260812 08:03:17.565935 15603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9160eee4cc4be28bce822ec9b2fdc0" candidate_uuid: "7e87a26275e4471f8960440233b86bc7" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" is_pre_election: true
I20260812 08:03:17.567883 15981 raft_consensus.cc:493] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e34cdbd5bd04469e92a6e15e7ae007a8)
I20260812 08:03:17.568024 15981 raft_consensus.cc:515] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } }
I20260812 08:03:17.568988 15981 leader_election.cc:290] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7e87a26275e4471f8960440233b86bc7 (127.12.187.65:43717), e34cdbd5bd04469e92a6e15e7ae007a8 (127.12.187.67:33175)
I20260812 08:03:17.572885 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9160eee4cc4be28bce822ec9b2fdc0" candidate_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7e87a26275e4471f8960440233b86bc7" is_pre_election: true
I20260812 08:03:17.573035 15377 raft_consensus.cc:2468] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1af245ab88fa4a69a4e94a41cfa1c947 in term 1.
I20260812 08:03:17.573457 15498 leader_election.cc:304] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1af245ab88fa4a69a4e94a41cfa1c947, 7e87a26275e4471f8960440233b86bc7; no voters: 
I20260812 08:03:17.573729 15981 raft_consensus.cc:2804] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 08:03:17.573796 15981 raft_consensus.cc:493] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e34cdbd5bd04469e92a6e15e7ae007a8)
I20260812 08:03:17.573844 15981 raft_consensus.cc:3060] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:03:17.574754 15981 raft_consensus.cc:515] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } }
I20260812 08:03:17.575188 15981 leader_election.cc:290] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [CANDIDATE]: Term 2 election: Requested vote from peers 7e87a26275e4471f8960440233b86bc7 (127.12.187.65:43717), e34cdbd5bd04469e92a6e15e7ae007a8 (127.12.187.67:33175)
I20260812 08:03:17.575557 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9160eee4cc4be28bce822ec9b2fdc0" candidate_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "7e87a26275e4471f8960440233b86bc7"
I20260812 08:03:17.575680 15377 raft_consensus.cc:3060] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:03:17.576442 15377 raft_consensus.cc:2468] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1af245ab88fa4a69a4e94a41cfa1c947 in term 2.
I20260812 08:03:17.576757 15498 leader_election.cc:304] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1af245ab88fa4a69a4e94a41cfa1c947, 7e87a26275e4471f8960440233b86bc7; no voters: 
I20260812 08:03:17.576952 15981 raft_consensus.cc:2804] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 08:03:17.577203 15981 raft_consensus.cc:697] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 2 LEADER]: Becoming Leader. State: Replica: 1af245ab88fa4a69a4e94a41cfa1c947, State: Running, Role: LEADER
I20260812 08:03:17.577720 15981 consensus_queue.cc:237] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } }
I20260812 08:03:17.578802 16040 tablet_replica.cc:442] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947: TxnStatusTablet state changed. Reason: New leader 1af245ab88fa4a69a4e94a41cfa1c947. Latest consensus state: current_term: 2 leader_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:17.578920 16040 tablet_replica.cc:445] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947: This TxnStatusTablet replica's current role is: LEADER
I20260812 08:03:17.579233 16042 txn_status_manager.cc:874] Waiting until node catch up with all replicated operations in previous term...
I20260812 08:03:17.579423 16042 txn_status_manager.cc:930] Loading transaction status metadata into memory...
I20260812 08:03:17.580392 15106 catalog_manager.cc:5719] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 reported cstate change: term changed from 1 to 2, leader changed from e34cdbd5bd04469e92a6e15e7ae007a8 (127.12.187.67) to 1af245ab88fa4a69a4e94a41cfa1c947 (127.12.187.66). New cstate: current_term: 2 leader_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } health_report { overall_health: UNKNOWN } } }
W20260812 08:03:17.626972 15273 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: connection negotiation to 127.12.187.67:33175 for RPC RequestConsensusVote timed out after 0.064s (ON_OUTBOUND_QUEUE)
I20260812 08:03:17.640596 15377 raft_consensus.cc:1275] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 2 FOLLOWER]: Refusing update from remote peer 1af245ab88fa4a69a4e94a41cfa1c947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260812 08:03:17.640838 15499 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: connection negotiation to 127.12.187.67:33175 for RPC RequestConsensusVote timed out after 0.071s (ON_OUTBOUND_QUEUE)
I20260812 08:03:17.641302 16040 consensus_queue.cc:1048] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 08:03:17.642768 15982 tablet_replica.cc:442] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7: TxnStatusTablet state changed. Reason: New leader 1af245ab88fa4a69a4e94a41cfa1c947. Latest consensus state: current_term: 2 leader_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:17.642889 15982 tablet_replica.cc:445] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 08:03:17.644168 15981 tablet_replica.cc:442] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:17.644300 15981 tablet_replica.cc:445] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947: This TxnStatusTablet replica's current role is: LEADER
I20260812 08:03:17.644877 15982 tablet_replica.cc:442] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:17.644977 15982 tablet_replica.cc:445] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7: This TxnStatusTablet replica's current role is: FOLLOWER
W20260812 08:03:17.692828 15273 leader_election.cc:336] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e34cdbd5bd04469e92a6e15e7ae007a8 (127.12.187.67:33175): Timed out: connection negotiation to 127.12.187.67:33175 for RPC RequestConsensusVote timed out after 0.064s (ON_OUTBOUND_QUEUE)
I20260812 08:03:17.692981 15273 leader_election.cc:304] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e87a26275e4471f8960440233b86bc7; no voters: 1af245ab88fa4a69a4e94a41cfa1c947, e34cdbd5bd04469e92a6e15e7ae007a8
I20260812 08:03:17.693336 15982 raft_consensus.cc:2749] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260812 08:03:17.713617 15499 leader_election.cc:336] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer e34cdbd5bd04469e92a6e15e7ae007a8 (127.12.187.67:33175): Timed out: connection negotiation to 127.12.187.67:33175 for RPC RequestConsensusVote timed out after 0.071s (ON_OUTBOUND_QUEUE)
W20260812 08:03:17.761163 15499 leader_election.cc:336] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer e34cdbd5bd04469e92a6e15e7ae007a8 (127.12.187.67:33175): Timed out: connection negotiation to 127.12.187.67:33175 for RPC RequestConsensusVote timed out after 0.092s (ON_OUTBOUND_QUEUE)
I20260812 08:03:18.519716 15377 raft_consensus.cc:1240] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 2 FOLLOWER]: Rejecting Update request from peer e34cdbd5bd04469e92a6e15e7ae007a8 for earlier term 1. Current term is 2. Ops: []
I20260812 08:03:18.520267 15979 consensus_queue.cc:1059] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 3, Time since last communication: 0.000s
I20260812 08:03:18.520449 15979 raft_consensus.cc:3055] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 1 LEADER]: Stepping down as leader of term 1
I20260812 08:03:18.520503 15979 raft_consensus.cc:740] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e34cdbd5bd04469e92a6e15e7ae007a8, State: Running, Role: LEADER
I20260812 08:03:18.520650 15979 consensus_queue.cc:260] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } }
I20260812 08:03:18.520887 15979 raft_consensus.cc:3060] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:03:18.523563 15836 raft_consensus.cc:1275] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 2 FOLLOWER]: Refusing update from remote peer 1af245ab88fa4a69a4e94a41cfa1c947: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260812 08:03:18.524035 15726 txn_status_manager.cc:1397] failed to abort stale txn (ID 0) past 1.019s from last keepalive heartbeat (effective timeout is 0.500s): Illegal state: Cannot assign timestamp to op. Tablet is not in leader mode. Last heard from a leader: 0.005s ago.
I20260812 08:03:18.524128 15726 txn_status_manager.cc:1407] skipping staleness check for the rest of in-flight txn records since this txn status tablet replica is no longer a leader or not running
I20260812 08:03:18.524189 16040 consensus_queue.cc:1048] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 08:03:18.525524 16026 tablet_replica.cc:442] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8: TxnStatusTablet state changed. Reason: New leader 1af245ab88fa4a69a4e94a41cfa1c947. Latest consensus state: current_term: 2 leader_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:18.525626 16026 tablet_replica.cc:445] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 08:03:18.525719 16026 tablet_replica.cc:442] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:18.525787 16026 tablet_replica.cc:445] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 08:03:18.565569 16052 tablet_replica.cc:442] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:18.565824 16052 tablet_replica.cc:445] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947: This TxnStatusTablet replica's current role is: LEADER
I20260812 08:03:19.543215 16059 raft_consensus.cc:493] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1af245ab88fa4a69a4e94a41cfa1c947)
I20260812 08:03:19.543358 16059 raft_consensus.cc:515] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } }
I20260812 08:03:19.543926 16059 leader_election.cc:290] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 7e87a26275e4471f8960440233b86bc7 (127.12.187.65:43717), 1af245ab88fa4a69a4e94a41cfa1c947 (127.12.187.66:41261)
I20260812 08:03:19.544546 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9160eee4cc4be28bce822ec9b2fdc0" candidate_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "7e87a26275e4471f8960440233b86bc7" is_pre_election: true
I20260812 08:03:19.545722 16061 raft_consensus.cc:493] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1af245ab88fa4a69a4e94a41cfa1c947)
I20260812 08:03:19.545816 16061 raft_consensus.cc:515] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } }
I20260812 08:03:19.546500 16061 leader_election.cc:290] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1af245ab88fa4a69a4e94a41cfa1c947 (127.12.187.66:41261), e34cdbd5bd04469e92a6e15e7ae007a8 (127.12.187.67:33175)
I20260812 08:03:19.547082 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9160eee4cc4be28bce822ec9b2fdc0" candidate_uuid: "7e87a26275e4471f8960440233b86bc7" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" is_pre_election: true
I20260812 08:03:19.547282 15836 raft_consensus.cc:2468] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e87a26275e4471f8960440233b86bc7 in term 2.
I20260812 08:03:19.547703 15273 leader_election.cc:304] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e87a26275e4471f8960440233b86bc7, e34cdbd5bd04469e92a6e15e7ae007a8; no voters: 
I20260812 08:03:19.547931 16061 raft_consensus.cc:2804] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260812 08:03:19.547991 16061 raft_consensus.cc:493] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1af245ab88fa4a69a4e94a41cfa1c947)
I20260812 08:03:19.548040 16061 raft_consensus.cc:3060] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 2 FOLLOWER]: Advancing to term 3
I20260812 08:03:19.548982 16061 raft_consensus.cc:515] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } }
I20260812 08:03:19.549449 16061 leader_election.cc:290] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [CANDIDATE]: Term 3 election: Requested vote from peers 1af245ab88fa4a69a4e94a41cfa1c947 (127.12.187.66:41261), e34cdbd5bd04469e92a6e15e7ae007a8 (127.12.187.67:33175)
I20260812 08:03:19.549853 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9160eee4cc4be28bce822ec9b2fdc0" candidate_uuid: "7e87a26275e4471f8960440233b86bc7" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8"
I20260812 08:03:19.549978 15836 raft_consensus.cc:3060] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 2 FOLLOWER]: Advancing to term 3
I20260812 08:03:19.550805 15836 raft_consensus.cc:2468] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e87a26275e4471f8960440233b86bc7 in term 3.
I20260812 08:03:19.551118 15273 leader_election.cc:304] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e87a26275e4471f8960440233b86bc7, e34cdbd5bd04469e92a6e15e7ae007a8; no voters: 
I20260812 08:03:19.551357 16061 raft_consensus.cc:2804] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 3 FOLLOWER]: Leader election won for term 3
I20260812 08:03:19.551551 16061 raft_consensus.cc:697] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 3 LEADER]: Becoming Leader. State: Replica: 7e87a26275e4471f8960440233b86bc7, State: Running, Role: LEADER
I20260812 08:03:19.551874 16061 consensus_queue.cc:237] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } }
I20260812 08:03:19.553434 16062 tablet_replica.cc:442] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7: TxnStatusTablet state changed. Reason: New leader 7e87a26275e4471f8960440233b86bc7. Latest consensus state: current_term: 3 leader_uuid: "7e87a26275e4471f8960440233b86bc7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:19.553534 16062 tablet_replica.cc:445] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7: This TxnStatusTablet replica's current role is: LEADER
I20260812 08:03:19.553791 16065 txn_status_manager.cc:874] Waiting until node catch up with all replicated operations in previous term...
I20260812 08:03:19.553946 16065 txn_status_manager.cc:930] Loading transaction status metadata into memory...
I20260812 08:03:19.554775 15107 catalog_manager.cc:5719] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 reported cstate change: term changed from 2 to 3, leader changed from 1af245ab88fa4a69a4e94a41cfa1c947 (127.12.187.66) to 7e87a26275e4471f8960440233b86bc7 (127.12.187.65). New cstate: current_term: 3 leader_uuid: "7e87a26275e4471f8960440233b86bc7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } health_report { overall_health: UNKNOWN } } }
I20260812 08:03:19.593068 15836 raft_consensus.cc:1275] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 3 FOLLOWER]: Refusing update from remote peer 7e87a26275e4471f8960440233b86bc7: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260812 08:03:19.593690 16062 consensus_queue.cc:1048] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260812 08:03:19.595053 16059 tablet_replica.cc:442] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8: TxnStatusTablet state changed. Reason: New leader 7e87a26275e4471f8960440233b86bc7. Latest consensus state: current_term: 3 leader_uuid: "7e87a26275e4471f8960440233b86bc7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:19.595171 16059 tablet_replica.cc:445] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 08:03:19.596392 16061 tablet_replica.cc:442] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "7e87a26275e4471f8960440233b86bc7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:19.596513 16061 tablet_replica.cc:445] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7: This TxnStatusTablet replica's current role is: LEADER
I20260812 08:03:19.596843 16059 tablet_replica.cc:442] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "7e87a26275e4471f8960440233b86bc7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:19.596936 16059 tablet_replica.cc:445] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8: This TxnStatusTablet replica's current role is: FOLLOWER
W20260812 08:03:19.627784 15721 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.187.66:41261 timed out after 0.083s (SENT)
W20260812 08:03:19.653827 16018 txn_status_manager-itest.cc:377] KeepTransactionAlive() returned non-OK status: Timed out: KeepTransactionAlive RPC to 127.12.187.126:36763 timed out after 0.050s (SENT)
W20260812 08:03:19.654511 15945 meta_cache.cc:302] tablet 0f9160eee4cc4be28bce822ec9b2fdc0: replica 1af245ab88fa4a69a4e94a41cfa1c947 (127.12.187.66:41261) has failed: Timed out: CoordinateTransaction RPC to 127.12.187.66:41261 timed out after 0.050s (SENT)
W20260812 08:03:19.654822 15157 rpcz_store.cc:267] Call kudu.transactions.TxnManagerService.KeepTransactionAlive from 127.0.0.1:33028 (request call id 20) took 51 ms (client timeout 50 ms). Trace:
W20260812 08:03:19.654882 15157 rpcz_store.cc:269] 0812 08:03:19.603743 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:03:19.603817 (+    74us) service_pool.cc:224] Handling call
0812 08:03:19.654798 (+ 50981us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260812 08:03:19.701141 15272 leader_election.cc:336] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1af245ab88fa4a69a4e94a41cfa1c947 (127.12.187.66:41261): Timed out: RequestConsensusVote RPC to 127.12.187.66:41261 timed out after 0.076s (SENT)
W20260812 08:03:19.710580 15272 leader_election.cc:336] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 1af245ab88fa4a69a4e94a41cfa1c947 (127.12.187.66:41261): Timed out: RequestConsensusVote RPC to 127.12.187.66:41261 timed out after 0.080s (SENT)
W20260812 08:03:19.711750 15721 leader_election.cc:336] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1af245ab88fa4a69a4e94a41cfa1c947 (127.12.187.66:41261): Timed out: RequestConsensusVote RPC to 127.12.187.66:41261 timed out after 0.083s (SENT)
I20260812 08:03:19.711844 15721 leader_election.cc:304] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e34cdbd5bd04469e92a6e15e7ae007a8; no voters: 1af245ab88fa4a69a4e94a41cfa1c947, 7e87a26275e4471f8960440233b86bc7
I20260812 08:03:19.712119 16059 raft_consensus.cc:2749] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260812 08:03:20.537648 15603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9160eee4cc4be28bce822ec9b2fdc0" candidate_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" is_pre_election: true
I20260812 08:03:20.537705 15606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9160eee4cc4be28bce822ec9b2fdc0" candidate_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" is_pre_election: true
I20260812 08:03:20.538508 15603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9160eee4cc4be28bce822ec9b2fdc0" candidate_uuid: "7e87a26275e4471f8960440233b86bc7" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" is_pre_election: true
I20260812 08:03:20.538508 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9160eee4cc4be28bce822ec9b2fdc0" candidate_uuid: "7e87a26275e4471f8960440233b86bc7" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "1af245ab88fa4a69a4e94a41cfa1c947"
I20260812 08:03:20.539405 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9160eee4cc4be28bce822ec9b2fdc0" candidate_uuid: "7e87a26275e4471f8960440233b86bc7" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" is_pre_election: true
I20260812 08:03:20.539611 15836 raft_consensus.cc:1240] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 3 FOLLOWER]: Rejecting Update request from peer 1af245ab88fa4a69a4e94a41cfa1c947 for earlier term 2. Current term is 3. Ops: []
I20260812 08:03:20.539952 15601 raft_consensus.cc:3055] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 2 LEADER]: Stepping down as leader of term 2
I20260812 08:03:20.540017 15601 raft_consensus.cc:740] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1af245ab88fa4a69a4e94a41cfa1c947, State: Running, Role: LEADER
I20260812 08:03:20.540154 15601 consensus_queue.cc:260] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } }
I20260812 08:03:20.540218 15606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9160eee4cc4be28bce822ec9b2fdc0" candidate_uuid: "7e87a26275e4471f8960440233b86bc7" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "1af245ab88fa4a69a4e94a41cfa1c947"
I20260812 08:03:20.540416 15601 raft_consensus.cc:3060] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 2 FOLLOWER]: Advancing to term 3
I20260812 08:03:20.540944 15377 raft_consensus.cc:1240] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 3 LEADER]: Rejecting Update request from peer 1af245ab88fa4a69a4e94a41cfa1c947 for earlier term 2. Current term is 3. Ops: []
I20260812 08:03:20.541568 15601 raft_consensus.cc:1275] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 3 FOLLOWER]: Refusing update from remote peer 7e87a26275e4471f8960440233b86bc7: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 4. (term mismatch)
I20260812 08:03:20.541637 15601 pending_rounds.cc:85] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947: Aborting all ops after (but not including) 3
I20260812 08:03:20.541695 15601 pending_rounds.cc:107] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947: Aborting uncommitted WRITE_OP operation due to leader change: 2.4
W20260812 08:03:20.542111 15504 txn_status_manager.cc:1397] failed to abort stale txn (ID 0) past 1.035s from last keepalive heartbeat (effective timeout is 0.500s): Aborted: Op aborted by new leader
I20260812 08:03:20.542205 15504 txn_status_manager.cc:1407] skipping staleness check for the rest of in-flight txn records since this txn status tablet replica is no longer a leader or not running
I20260812 08:03:20.542586 16062 consensus_queue.cc:1048] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260812 08:03:20.543706 16088 tablet_replica.cc:442] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947: TxnStatusTablet state changed. Reason: New leader 7e87a26275e4471f8960440233b86bc7. Latest consensus state: current_term: 3 leader_uuid: "7e87a26275e4471f8960440233b86bc7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:20.543711 16090 tablet_replica.cc:442] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "7e87a26275e4471f8960440233b86bc7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:20.543895 16090 tablet_replica.cc:445] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 08:03:20.544025 16088 tablet_replica.cc:445] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 08:03:20.605331 16062 tablet_replica.cc:442] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "7e87a26275e4471f8960440233b86bc7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:20.605521 16062 tablet_replica.cc:445] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7: This TxnStatusTablet replica's current role is: LEADER
I20260812 08:03:21.582135 16099 raft_consensus.cc:493] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7e87a26275e4471f8960440233b86bc7)
I20260812 08:03:21.582298 16099 raft_consensus.cc:515] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } }
I20260812 08:03:21.582873 16099 leader_election.cc:290] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7e87a26275e4471f8960440233b86bc7 (127.12.187.65:43717), e34cdbd5bd04469e92a6e15e7ae007a8 (127.12.187.67:33175)
I20260812 08:03:21.583485 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9160eee4cc4be28bce822ec9b2fdc0" candidate_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" is_pre_election: true
I20260812 08:03:21.603488 16101 raft_consensus.cc:493] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 7e87a26275e4471f8960440233b86bc7)
I20260812 08:03:21.603600 16101 raft_consensus.cc:515] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } }
I20260812 08:03:21.604044 16101 leader_election.cc:290] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 7e87a26275e4471f8960440233b86bc7 (127.12.187.65:43717), 1af245ab88fa4a69a4e94a41cfa1c947 (127.12.187.66:41261)
I20260812 08:03:21.604703 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9160eee4cc4be28bce822ec9b2fdc0" candidate_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" is_pre_election: true
I20260812 08:03:21.604869 15601 raft_consensus.cc:2468] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e34cdbd5bd04469e92a6e15e7ae007a8 in term 3.
I20260812 08:03:21.605320 15721 leader_election.cc:304] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1af245ab88fa4a69a4e94a41cfa1c947, e34cdbd5bd04469e92a6e15e7ae007a8; no voters: 
I20260812 08:03:21.605533 16101 raft_consensus.cc:2804] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260812 08:03:21.605630 16101 raft_consensus.cc:493] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 7e87a26275e4471f8960440233b86bc7)
I20260812 08:03:21.605701 16101 raft_consensus.cc:3060] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 3 FOLLOWER]: Advancing to term 4
I20260812 08:03:21.606598 16101 raft_consensus.cc:515] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } }
I20260812 08:03:21.606946 16101 leader_election.cc:290] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [CANDIDATE]: Term 4 election: Requested vote from peers 7e87a26275e4471f8960440233b86bc7 (127.12.187.65:43717), 1af245ab88fa4a69a4e94a41cfa1c947 (127.12.187.66:41261)
I20260812 08:03:21.607434 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9160eee4cc4be28bce822ec9b2fdc0" candidate_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "1af245ab88fa4a69a4e94a41cfa1c947"
I20260812 08:03:21.607558 15601 raft_consensus.cc:3060] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 3 FOLLOWER]: Advancing to term 4
I20260812 08:03:21.608355 15601 raft_consensus.cc:2468] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e34cdbd5bd04469e92a6e15e7ae007a8 in term 4.
I20260812 08:03:21.608665 15721 leader_election.cc:304] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1af245ab88fa4a69a4e94a41cfa1c947, e34cdbd5bd04469e92a6e15e7ae007a8; no voters: 
I20260812 08:03:21.608888 16101 raft_consensus.cc:2804] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 4 FOLLOWER]: Leader election won for term 4
I20260812 08:03:21.609074 16101 raft_consensus.cc:697] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 4 LEADER]: Becoming Leader. State: Replica: e34cdbd5bd04469e92a6e15e7ae007a8, State: Running, Role: LEADER
I20260812 08:03:21.609417 16101 consensus_queue.cc:237] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } }
I20260812 08:03:21.610117 16103 tablet_replica.cc:442] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8: TxnStatusTablet state changed. Reason: New leader e34cdbd5bd04469e92a6e15e7ae007a8. Latest consensus state: current_term: 4 leader_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:21.610229 16103 tablet_replica.cc:445] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8: This TxnStatusTablet replica's current role is: LEADER
I20260812 08:03:21.610484 16109 txn_status_manager.cc:874] Waiting until node catch up with all replicated operations in previous term...
I20260812 08:03:21.610613 16109 txn_status_manager.cc:930] Loading transaction status metadata into memory...
I20260812 08:03:21.611117 15107 catalog_manager.cc:5719] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 reported cstate change: term changed from 3 to 4, leader changed from 7e87a26275e4471f8960440233b86bc7 (127.12.187.65) to e34cdbd5bd04469e92a6e15e7ae007a8 (127.12.187.67). New cstate: current_term: 4 leader_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } health_report { overall_health: HEALTHY } } }
W20260812 08:03:21.653350 16018 txn_status_manager-itest.cc:377] KeepTransactionAlive() returned non-OK status: Timed out: KeepTransactionAlive RPC to 127.12.187.126:36763 timed out after 0.050s (SENT)
W20260812 08:03:21.653908 15945 meta_cache.cc:302] tablet 0f9160eee4cc4be28bce822ec9b2fdc0: replica 7e87a26275e4471f8960440233b86bc7 (127.12.187.65:43717) has failed: Timed out: CoordinateTransaction RPC to 127.12.187.65:43717 timed out after 0.050s (SENT)
W20260812 08:03:21.654232 15157 rpcz_store.cc:267] Call kudu.transactions.TxnManagerService.KeepTransactionAlive from 127.0.0.1:33028 (request call id 39) took 51 ms (client timeout 50 ms). Trace:
W20260812 08:03:21.654322 15157 rpcz_store.cc:269] 0812 08:03:21.603178 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:03:21.603242 (+    64us) service_pool.cc:224] Handling call
0812 08:03:21.654206 (+ 50964us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260812 08:03:21.665908 15601 raft_consensus.cc:1275] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 4 FOLLOWER]: Refusing update from remote peer e34cdbd5bd04469e92a6e15e7ae007a8: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260812 08:03:21.666491 16103 consensus_queue.cc:1048] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260812 08:03:21.667973 16099 tablet_replica.cc:442] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947: TxnStatusTablet state changed. Reason: New leader e34cdbd5bd04469e92a6e15e7ae007a8. Latest consensus state: current_term: 4 leader_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:21.668103 16099 tablet_replica.cc:445] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 08:03:21.669322 16101 tablet_replica.cc:442] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:21.669458 16101 tablet_replica.cc:445] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8: This TxnStatusTablet replica's current role is: LEADER
I20260812 08:03:21.669890 16099 tablet_replica.cc:442] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:21.669982 16099 tablet_replica.cc:445] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947: This TxnStatusTablet replica's current role is: FOLLOWER
W20260812 08:03:21.712790 15498 leader_election.cc:336] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7e87a26275e4471f8960440233b86bc7 (127.12.187.65:43717): Timed out: RequestConsensusVote RPC to 127.12.187.65:43717 timed out after 0.064s (SENT)
I20260812 08:03:21.712949 15498 leader_election.cc:304] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1af245ab88fa4a69a4e94a41cfa1c947; no voters: 7e87a26275e4471f8960440233b86bc7, e34cdbd5bd04469e92a6e15e7ae007a8
I20260812 08:03:21.713171 16099 raft_consensus.cc:2749] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260812 08:03:21.745452 15721 leader_election.cc:336] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 7e87a26275e4471f8960440233b86bc7 (127.12.187.65:43717): Timed out: RequestConsensusVote RPC to 127.12.187.65:43717 timed out after 0.070s (SENT)
W20260812 08:03:21.759804 15721 leader_election.cc:336] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 7e87a26275e4471f8960440233b86bc7 (127.12.187.65:43717): Timed out: RequestConsensusVote RPC to 127.12.187.65:43717 timed out after 0.076s (SENT)
I20260812 08:03:22.558271 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9160eee4cc4be28bce822ec9b2fdc0" candidate_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7e87a26275e4471f8960440233b86bc7" is_pre_election: true
I20260812 08:03:22.558712 15375 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9160eee4cc4be28bce822ec9b2fdc0" candidate_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7e87a26275e4471f8960440233b86bc7" is_pre_election: true
I20260812 08:03:22.558904 15377 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9160eee4cc4be28bce822ec9b2fdc0" candidate_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7e87a26275e4471f8960440233b86bc7" is_pre_election: true
I20260812 08:03:22.559620 15369 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9160eee4cc4be28bce822ec9b2fdc0" candidate_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7e87a26275e4471f8960440233b86bc7"
I20260812 08:03:22.559882 15371 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9160eee4cc4be28bce822ec9b2fdc0" candidate_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7e87a26275e4471f8960440233b86bc7" is_pre_election: true
I20260812 08:03:22.560179 15372 raft_consensus.cc:3055] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 3 LEADER]: Stepping down as leader of term 3
I20260812 08:03:22.560247 15372 raft_consensus.cc:740] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7e87a26275e4471f8960440233b86bc7, State: Running, Role: LEADER
I20260812 08:03:22.560379 15836 raft_consensus.cc:1240] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 4 LEADER]: Rejecting Update request from peer 7e87a26275e4471f8960440233b86bc7 for earlier term 3. Current term is 4. Ops: []
I20260812 08:03:22.560398 15372 consensus_queue.cc:260] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } }
I20260812 08:03:22.560539 15372 raft_consensus.cc:3060] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 3 FOLLOWER]: Advancing to term 4
I20260812 08:03:22.561493 15373 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9160eee4cc4be28bce822ec9b2fdc0" candidate_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "7e87a26275e4471f8960440233b86bc7"
I20260812 08:03:22.561806 15372 raft_consensus.cc:1275] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 4 FOLLOWER]: Refusing update from remote peer e34cdbd5bd04469e92a6e15e7ae007a8: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260812 08:03:22.562314 16101 consensus_queue.cc:1048] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260812 08:03:22.563148 15601 raft_consensus.cc:1240] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 4 FOLLOWER]: Rejecting Update request from peer 7e87a26275e4471f8960440233b86bc7 for earlier term 3. Current term is 4. Ops: []
I20260812 08:03:22.563572 16062 tablet_replica.cc:442] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7: TxnStatusTablet state changed. Reason: New leader e34cdbd5bd04469e92a6e15e7ae007a8. Latest consensus state: current_term: 4 leader_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:22.563669 16062 tablet_replica.cc:445] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 08:03:22.563750 16062 tablet_replica.cc:442] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 4 leader_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:22.563798 16062 tablet_replica.cc:445] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7: This TxnStatusTablet replica's current role is: FOLLOWER
W20260812 08:03:22.563921 15278 txn_status_manager.cc:1397] failed to abort stale txn (ID 0) past 1.056s from last keepalive heartbeat (effective timeout is 0.500s): Illegal state: Cannot assign timestamp to op. Tablet is not in leader mode. Last heard from a leader: 0.004s ago.
I20260812 08:03:22.564010 15278 txn_status_manager.cc:1407] skipping staleness check for the rest of in-flight txn records since this txn status tablet replica is no longer a leader or not running
I20260812 08:03:22.605245 16101 tablet_replica.cc:442] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 4 leader_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:22.605417 16101 tablet_replica.cc:445] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8: This TxnStatusTablet replica's current role is: LEADER
I20260812 08:03:23.591913 16135 raft_consensus.cc:493] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e34cdbd5bd04469e92a6e15e7ae007a8)
I20260812 08:03:23.592043 16135 raft_consensus.cc:515] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } }
I20260812 08:03:23.592571 16135 leader_election.cc:290] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 1af245ab88fa4a69a4e94a41cfa1c947 (127.12.187.66:41261), e34cdbd5bd04469e92a6e15e7ae007a8 (127.12.187.67:33175)
I20260812 08:03:23.593003 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9160eee4cc4be28bce822ec9b2fdc0" candidate_uuid: "7e87a26275e4471f8960440233b86bc7" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" is_pre_election: true
I20260812 08:03:23.624168 16136 raft_consensus.cc:493] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e34cdbd5bd04469e92a6e15e7ae007a8)
I20260812 08:03:23.624308 16136 raft_consensus.cc:515] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } }
I20260812 08:03:23.624765 16136 leader_election.cc:290] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 7e87a26275e4471f8960440233b86bc7 (127.12.187.65:43717), e34cdbd5bd04469e92a6e15e7ae007a8 (127.12.187.67:33175)
I20260812 08:03:23.625357 15372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9160eee4cc4be28bce822ec9b2fdc0" candidate_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7e87a26275e4471f8960440233b86bc7" is_pre_election: true
I20260812 08:03:23.625558 15372 raft_consensus.cc:2468] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1af245ab88fa4a69a4e94a41cfa1c947 in term 4.
I20260812 08:03:23.625988 15498 leader_election.cc:304] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1af245ab88fa4a69a4e94a41cfa1c947, 7e87a26275e4471f8960440233b86bc7; no voters: 
I20260812 08:03:23.626199 16136 raft_consensus.cc:2804] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260812 08:03:23.626271 16136 raft_consensus.cc:493] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e34cdbd5bd04469e92a6e15e7ae007a8)
I20260812 08:03:23.626298 16136 raft_consensus.cc:3060] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 4 FOLLOWER]: Advancing to term 5
I20260812 08:03:23.627142 16136 raft_consensus.cc:515] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } }
I20260812 08:03:23.627521 16136 leader_election.cc:290] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [CANDIDATE]: Term 5 election: Requested vote from peers 7e87a26275e4471f8960440233b86bc7 (127.12.187.65:43717), e34cdbd5bd04469e92a6e15e7ae007a8 (127.12.187.67:33175)
I20260812 08:03:23.627928 15372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9160eee4cc4be28bce822ec9b2fdc0" candidate_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "7e87a26275e4471f8960440233b86bc7"
I20260812 08:03:23.628069 15372 raft_consensus.cc:3060] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 4 FOLLOWER]: Advancing to term 5
I20260812 08:03:23.628865 15372 raft_consensus.cc:2468] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1af245ab88fa4a69a4e94a41cfa1c947 in term 5.
I20260812 08:03:23.629249 15498 leader_election.cc:304] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1af245ab88fa4a69a4e94a41cfa1c947, 7e87a26275e4471f8960440233b86bc7; no voters: 
I20260812 08:03:23.629434 16136 raft_consensus.cc:2804] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 5 FOLLOWER]: Leader election won for term 5
I20260812 08:03:23.629594 16136 raft_consensus.cc:697] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 5 LEADER]: Becoming Leader. State: Replica: 1af245ab88fa4a69a4e94a41cfa1c947, State: Running, Role: LEADER
I20260812 08:03:23.629756 16136 consensus_queue.cc:237] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } }
I20260812 08:03:23.630447 16137 tablet_replica.cc:442] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947: TxnStatusTablet state changed. Reason: New leader 1af245ab88fa4a69a4e94a41cfa1c947. Latest consensus state: current_term: 5 leader_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:23.630556 16137 tablet_replica.cc:445] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947: This TxnStatusTablet replica's current role is: LEADER
I20260812 08:03:23.630762 16141 txn_status_manager.cc:874] Waiting until node catch up with all replicated operations in previous term...
I20260812 08:03:23.630868 16141 txn_status_manager.cc:930] Loading transaction status metadata into memory...
I20260812 08:03:23.631599 15106 catalog_manager.cc:5719] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 reported cstate change: term changed from 4 to 5, leader changed from e34cdbd5bd04469e92a6e15e7ae007a8 (127.12.187.67) to 1af245ab88fa4a69a4e94a41cfa1c947 (127.12.187.66). New cstate: current_term: 5 leader_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } health_report { overall_health: UNKNOWN } } }
W20260812 08:03:23.647189 16018 txn_status_manager-itest.cc:377] KeepTransactionAlive() returned non-OK status: Timed out: KeepTransactionAlive RPC to 127.12.187.126:36763 timed out after 0.050s (SENT)
W20260812 08:03:23.647766 15946 meta_cache.cc:302] tablet 0f9160eee4cc4be28bce822ec9b2fdc0: replica e34cdbd5bd04469e92a6e15e7ae007a8 (127.12.187.67:33175) has failed: Timed out: CoordinateTransaction RPC to 127.12.187.67:33175 timed out after 0.050s (SENT)
W20260812 08:03:23.648038 15157 rpcz_store.cc:267] Call kudu.transactions.TxnManagerService.KeepTransactionAlive from 127.0.0.1:33028 (request call id 58) took 51 ms (client timeout 50 ms). Trace:
W20260812 08:03:23.648098 15157 rpcz_store.cc:269] 0812 08:03:23.596883 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:03:23.597004 (+   121us) service_pool.cc:224] Handling call
0812 08:03:23.648015 (+ 51011us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260812 08:03:23.655331 15273 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.187.67:33175 timed out after 0.062s (SENT) [suppressed 2 similar messages]
I20260812 08:03:23.679229 15372 raft_consensus.cc:1275] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 5 FOLLOWER]: Refusing update from remote peer 1af245ab88fa4a69a4e94a41cfa1c947: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260812 08:03:23.679792 16137 consensus_queue.cc:1048] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260812 08:03:23.681080 16135 tablet_replica.cc:442] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7: TxnStatusTablet state changed. Reason: New leader 1af245ab88fa4a69a4e94a41cfa1c947. Latest consensus state: current_term: 5 leader_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:23.681231 16135 tablet_replica.cc:445] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 08:03:23.682207 16136 tablet_replica.cc:442] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 5 leader_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:23.682327 16136 tablet_replica.cc:445] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947: This TxnStatusTablet replica's current role is: LEADER
I20260812 08:03:23.682873 16135 tablet_replica.cc:442] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 5 leader_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:23.682981 16135 tablet_replica.cc:445] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7: This TxnStatusTablet replica's current role is: FOLLOWER
W20260812 08:03:23.701488 15499 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.187.67:33175 timed out after 0.076s (SENT) [suppressed 2 similar messages]
W20260812 08:03:23.718117 15273 leader_election.cc:336] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e34cdbd5bd04469e92a6e15e7ae007a8 (127.12.187.67:33175): Timed out: RequestConsensusVote RPC to 127.12.187.67:33175 timed out after 0.062s (SENT)
I20260812 08:03:23.718232 15273 leader_election.cc:304] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e87a26275e4471f8960440233b86bc7; no voters: 1af245ab88fa4a69a4e94a41cfa1c947, e34cdbd5bd04469e92a6e15e7ae007a8
I20260812 08:03:23.718434 16135 raft_consensus.cc:2749] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260812 08:03:23.778854 15499 leader_election.cc:336] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer e34cdbd5bd04469e92a6e15e7ae007a8 (127.12.187.67:33175): Timed out: RequestConsensusVote RPC to 127.12.187.67:33175 timed out after 0.076s (SENT)
W20260812 08:03:23.807374 15499 leader_election.cc:336] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer e34cdbd5bd04469e92a6e15e7ae007a8 (127.12.187.67:33175): Timed out: RequestConsensusVote RPC to 127.12.187.67:33175 timed out after 0.089s (SENT)
I20260812 08:03:24.582805 15836 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9160eee4cc4be28bce822ec9b2fdc0" candidate_uuid: "7e87a26275e4471f8960440233b86bc7" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" is_pre_election: true
I20260812 08:03:24.584167 15372 raft_consensus.cc:1217] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 5 FOLLOWER]: Deduplicated request from leader. Original: 4.5->[4.6-4.6]   Dedup: 4.6->[]
I20260812 08:03:24.584218 15601 raft_consensus.cc:1217] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 5 LEADER]: Deduplicated request from leader. Original: 4.5->[4.6-4.6]   Dedup: 4.6->[]
I20260812 08:03:24.584336 15372 raft_consensus.cc:1240] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 5 FOLLOWER]: Rejecting Update request from peer e34cdbd5bd04469e92a6e15e7ae007a8 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260812 08:03:24.584353 15601 raft_consensus.cc:1240] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 5 LEADER]: Rejecting Update request from peer e34cdbd5bd04469e92a6e15e7ae007a8 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260812 08:03:24.584633 15830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9160eee4cc4be28bce822ec9b2fdc0" candidate_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" is_pre_election: true
I20260812 08:03:24.584772 15831 raft_consensus.cc:3055] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 4 LEADER]: Stepping down as leader of term 4
I20260812 08:03:24.584833 15831 raft_consensus.cc:740] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e34cdbd5bd04469e92a6e15e7ae007a8, State: Running, Role: LEADER
I20260812 08:03:24.585000 15831 consensus_queue.cc:260] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } }
I20260812 08:03:24.585100 16162 consensus_queue.cc:1059] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 6, Time since last communication: 0.000s
I20260812 08:03:24.585244 16162 consensus_queue.cc:1243] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [NON_LEADER]: Peer 1af245ab88fa4a69a4e94a41cfa1c947 log is divergent from this leader: its last log entry 5.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260812 08:03:24.585335 15829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9160eee4cc4be28bce822ec9b2fdc0" candidate_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8"
I20260812 08:03:24.585477 15834 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9160eee4cc4be28bce822ec9b2fdc0" candidate_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" is_pre_election: true
I20260812 08:03:24.585490 15832 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9160eee4cc4be28bce822ec9b2fdc0" candidate_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8"
I20260812 08:03:24.585733 15835 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9160eee4cc4be28bce822ec9b2fdc0" candidate_uuid: "7e87a26275e4471f8960440233b86bc7" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" is_pre_election: true
I20260812 08:03:24.585676 15831 raft_consensus.cc:3060] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 4 FOLLOWER]: Advancing to term 5
W20260812 08:03:24.586192 16159 consensus_queue.cc:1175] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "7e87a26275e4471f8960440233b86bc7" responder_term: 5 status { last_received { term: 5 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer e34cdbd5bd04469e92a6e15e7ae007a8 for earlier term 4. Current term is 5. Ops: [4.6-4.6]" } } last_received_current_leader { term: 5 index: 6 } }
I20260812 08:03:24.587291 15831 raft_consensus.cc:1275] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 5 FOLLOWER]: Refusing update from remote peer 1af245ab88fa4a69a4e94a41cfa1c947: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260812 08:03:24.587364 15831 pending_rounds.cc:85] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8: Aborting all ops after (but not including) 5
I20260812 08:03:24.587436 15831 pending_rounds.cc:107] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8: Aborting uncommitted WRITE_OP operation due to leader change: 4.6
W20260812 08:03:24.587992 15726 txn_status_manager.cc:1397] failed to abort stale txn (ID 0) past 1.086s from last keepalive heartbeat (effective timeout is 0.500s): Aborted: Op aborted by new leader
I20260812 08:03:24.588054 15726 txn_status_manager.cc:1407] skipping staleness check for the rest of in-flight txn records since this txn status tablet replica is no longer a leader or not running
I20260812 08:03:24.588207 16136 consensus_queue.cc:1048] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260812 08:03:24.589294 16160 tablet_replica.cc:442] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 5 leader_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:24.589392 16160 tablet_replica.cc:445] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 08:03:24.589552 16159 tablet_replica.cc:442] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8: TxnStatusTablet state changed. Reason: New leader 1af245ab88fa4a69a4e94a41cfa1c947. Latest consensus state: current_term: 5 leader_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:24.589690 16159 tablet_replica.cc:445] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 08:03:24.651448 16159 raft_consensus.cc:493] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1af245ab88fa4a69a4e94a41cfa1c947)
I20260812 08:03:24.651460 16136 tablet_replica.cc:442] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 5 leader_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:24.651623 16136 tablet_replica.cc:445] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947: This TxnStatusTablet replica's current role is: LEADER
I20260812 08:03:24.651611 16159 raft_consensus.cc:515] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } }
I20260812 08:03:24.652141 16159 leader_election.cc:290] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7e87a26275e4471f8960440233b86bc7 (127.12.187.65:43717), 1af245ab88fa4a69a4e94a41cfa1c947 (127.12.187.66:41261)
I20260812 08:03:24.652568 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9160eee4cc4be28bce822ec9b2fdc0" candidate_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" is_pre_election: true
I20260812 08:03:24.652606 15372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9160eee4cc4be28bce822ec9b2fdc0" candidate_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7e87a26275e4471f8960440233b86bc7" is_pre_election: true
I20260812 08:03:24.653096 15721 leader_election.cc:304] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e34cdbd5bd04469e92a6e15e7ae007a8; no voters: 1af245ab88fa4a69a4e94a41cfa1c947, 7e87a26275e4471f8960440233b86bc7
I20260812 08:03:24.653263 16159 raft_consensus.cc:2749] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 08:03:24.838477 16171 raft_consensus.cc:493] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1af245ab88fa4a69a4e94a41cfa1c947)
I20260812 08:03:24.838660 16171 raft_consensus.cc:515] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } }
I20260812 08:03:24.839188 16171 leader_election.cc:290] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1af245ab88fa4a69a4e94a41cfa1c947 (127.12.187.66:41261), e34cdbd5bd04469e92a6e15e7ae007a8 (127.12.187.67:33175)
I20260812 08:03:24.839609 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9160eee4cc4be28bce822ec9b2fdc0" candidate_uuid: "7e87a26275e4471f8960440233b86bc7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" is_pre_election: true
I20260812 08:03:24.839672 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9160eee4cc4be28bce822ec9b2fdc0" candidate_uuid: "7e87a26275e4471f8960440233b86bc7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" is_pre_election: true
I20260812 08:03:24.840128 15273 leader_election.cc:304] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e87a26275e4471f8960440233b86bc7; no voters: 1af245ab88fa4a69a4e94a41cfa1c947, e34cdbd5bd04469e92a6e15e7ae007a8
I20260812 08:03:24.840348 16171 raft_consensus.cc:2749] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 08:03:25.614480 16173 raft_consensus.cc:493] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1af245ab88fa4a69a4e94a41cfa1c947)
I20260812 08:03:25.614667 16173 raft_consensus.cc:515] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } }
I20260812 08:03:25.615232 16173 leader_election.cc:290] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 1af245ab88fa4a69a4e94a41cfa1c947 (127.12.187.66:41261), e34cdbd5bd04469e92a6e15e7ae007a8 (127.12.187.67:33175)
I20260812 08:03:25.615845 15831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9160eee4cc4be28bce822ec9b2fdc0" candidate_uuid: "7e87a26275e4471f8960440233b86bc7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" is_pre_election: true
I20260812 08:03:25.628320 16177 raft_consensus.cc:493] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 1af245ab88fa4a69a4e94a41cfa1c947)
I20260812 08:03:25.628463 16177 raft_consensus.cc:515] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } }
I20260812 08:03:25.628886 16177 leader_election.cc:290] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 7e87a26275e4471f8960440233b86bc7 (127.12.187.65:43717), 1af245ab88fa4a69a4e94a41cfa1c947 (127.12.187.66:41261)
I20260812 08:03:25.629514 15372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9160eee4cc4be28bce822ec9b2fdc0" candidate_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7e87a26275e4471f8960440233b86bc7" is_pre_election: true
I20260812 08:03:25.629686 15372 raft_consensus.cc:2468] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e34cdbd5bd04469e92a6e15e7ae007a8 in term 5.
I20260812 08:03:25.630163 15721 leader_election.cc:304] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e87a26275e4471f8960440233b86bc7, e34cdbd5bd04469e92a6e15e7ae007a8; no voters: 
I20260812 08:03:25.630416 16177 raft_consensus.cc:2804] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260812 08:03:25.630481 16177 raft_consensus.cc:493] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 1af245ab88fa4a69a4e94a41cfa1c947)
I20260812 08:03:25.630529 16177 raft_consensus.cc:3060] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 5 FOLLOWER]: Advancing to term 6
I20260812 08:03:25.631490 16177 raft_consensus.cc:515] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } }
I20260812 08:03:25.631901 16177 leader_election.cc:290] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [CANDIDATE]: Term 6 election: Requested vote from peers 7e87a26275e4471f8960440233b86bc7 (127.12.187.65:43717), 1af245ab88fa4a69a4e94a41cfa1c947 (127.12.187.66:41261)
I20260812 08:03:25.632391 15372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9160eee4cc4be28bce822ec9b2fdc0" candidate_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "7e87a26275e4471f8960440233b86bc7"
I20260812 08:03:25.632530 15372 raft_consensus.cc:3060] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 5 FOLLOWER]: Advancing to term 6
I20260812 08:03:25.633482 15372 raft_consensus.cc:2468] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e34cdbd5bd04469e92a6e15e7ae007a8 in term 6.
I20260812 08:03:25.633935 15721 leader_election.cc:304] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7e87a26275e4471f8960440233b86bc7, e34cdbd5bd04469e92a6e15e7ae007a8; no voters: 
I20260812 08:03:25.634219 16177 raft_consensus.cc:2804] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 6 FOLLOWER]: Leader election won for term 6
I20260812 08:03:25.634444 16177 raft_consensus.cc:697] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 6 LEADER]: Becoming Leader. State: Replica: e34cdbd5bd04469e92a6e15e7ae007a8, State: Running, Role: LEADER
I20260812 08:03:25.634624 16177 consensus_queue.cc:237] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } }
I20260812 08:03:25.635414 16180 tablet_replica.cc:442] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8: TxnStatusTablet state changed. Reason: New leader e34cdbd5bd04469e92a6e15e7ae007a8. Latest consensus state: current_term: 6 leader_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:25.635528 16180 tablet_replica.cc:445] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8: This TxnStatusTablet replica's current role is: LEADER
I20260812 08:03:25.635744 16184 txn_status_manager.cc:874] Waiting until node catch up with all replicated operations in previous term...
I20260812 08:03:25.635849 16184 txn_status_manager.cc:930] Loading transaction status metadata into memory...
I20260812 08:03:25.636925 15107 catalog_manager.cc:5719] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 reported cstate change: term changed from 5 to 6, leader changed from 1af245ab88fa4a69a4e94a41cfa1c947 (127.12.187.66) to e34cdbd5bd04469e92a6e15e7ae007a8 (127.12.187.67). New cstate: current_term: 6 leader_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } health_report { overall_health: HEALTHY } } }
I20260812 08:03:25.685740 15372 raft_consensus.cc:1275] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 6 FOLLOWER]: Refusing update from remote peer e34cdbd5bd04469e92a6e15e7ae007a8: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260812 08:03:25.686326 16177 consensus_queue.cc:1048] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260812 08:03:25.687529 16173 tablet_replica.cc:442] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7: TxnStatusTablet state changed. Reason: New leader e34cdbd5bd04469e92a6e15e7ae007a8. Latest consensus state: current_term: 6 leader_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:25.687666 16173 tablet_replica.cc:445] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 08:03:25.688632 16180 tablet_replica.cc:442] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 6 leader_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:25.688766 16180 tablet_replica.cc:445] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8: This TxnStatusTablet replica's current role is: LEADER
I20260812 08:03:25.689672 16173 tablet_replica.cc:442] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 6 leader_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:25.689785 16173 tablet_replica.cc:445] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7: This TxnStatusTablet replica's current role is: FOLLOWER
W20260812 08:03:25.692334 15721 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.12.187.66:41261 timed out after 0.063s (SENT) [suppressed 2 similar messages]
W20260812 08:03:25.741847 16018 txn_status_manager-itest.cc:377] KeepTransactionAlive() returned non-OK status: Timed out: KeepTransactionAlive RPC to 127.12.187.126:36763 timed out after 0.050s (SENT)
W20260812 08:03:25.742312 15945 meta_cache.cc:302] tablet 0f9160eee4cc4be28bce822ec9b2fdc0: replica 1af245ab88fa4a69a4e94a41cfa1c947 (127.12.187.66:41261) has failed: Timed out: CoordinateTransaction RPC to 127.12.187.66:41261 timed out after 0.050s (SENT)
W20260812 08:03:25.742583 15157 rpcz_store.cc:267] Call kudu.transactions.TxnManagerService.KeepTransactionAlive from 127.0.0.1:33028 (request call id 78) took 51 ms (client timeout 50 ms). Trace:
W20260812 08:03:25.742672 15157 rpcz_store.cc:269] 0812 08:03:25.691589 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:03:25.691660 (+    71us) service_pool.cc:224] Handling call
0812 08:03:25.742563 (+ 50903us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260812 08:03:25.756685 15721 leader_election.cc:336] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 1af245ab88fa4a69a4e94a41cfa1c947 (127.12.187.66:41261): Timed out: RequestConsensusVote RPC to 127.12.187.66:41261 timed out after 0.063s (SENT)
W20260812 08:03:25.780303 15721 leader_election.cc:336] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 1af245ab88fa4a69a4e94a41cfa1c947 (127.12.187.66:41261): Timed out: RequestConsensusVote RPC to 127.12.187.66:41261 timed out after 0.073s (SENT)
W20260812 08:03:25.791020 15272 leader_election.cc:336] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 1af245ab88fa4a69a4e94a41cfa1c947 (127.12.187.66:41261): Timed out: RequestConsensusVote RPC to 127.12.187.66:41261 timed out after 0.087s (SENT)
I20260812 08:03:25.791149 15272 leader_election.cc:304] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e87a26275e4471f8960440233b86bc7; no voters: 1af245ab88fa4a69a4e94a41cfa1c947, e34cdbd5bd04469e92a6e15e7ae007a8
I20260812 08:03:25.791404 16173 raft_consensus.cc:2749] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260812 08:03:26.605031 15372 raft_consensus.cc:1240] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 6 FOLLOWER]: Rejecting Update request from peer 1af245ab88fa4a69a4e94a41cfa1c947 for earlier term 5. Current term is 6. Ops: []
I20260812 08:03:26.605067 15594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9160eee4cc4be28bce822ec9b2fdc0" candidate_uuid: "7e87a26275e4471f8960440233b86bc7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" is_pre_election: true
I20260812 08:03:26.605321 15591 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9160eee4cc4be28bce822ec9b2fdc0" candidate_uuid: "7e87a26275e4471f8960440233b86bc7" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" is_pre_election: true
I20260812 08:03:26.605396 15598 raft_consensus.cc:3055] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 5 LEADER]: Stepping down as leader of term 5
I20260812 08:03:26.605458 15598 raft_consensus.cc:740] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 1af245ab88fa4a69a4e94a41cfa1c947, State: Running, Role: LEADER
I20260812 08:03:26.605603 15598 consensus_queue.cc:260] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } }
I20260812 08:03:26.605705 15598 raft_consensus.cc:3060] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 5 FOLLOWER]: Advancing to term 6
I20260812 08:03:26.606309 15601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9160eee4cc4be28bce822ec9b2fdc0" candidate_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" is_pre_election: true
I20260812 08:03:26.606562 15606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9160eee4cc4be28bce822ec9b2fdc0" candidate_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1af245ab88fa4a69a4e94a41cfa1c947"
I20260812 08:03:26.606614 15831 raft_consensus.cc:1217] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 6 LEADER]: Deduplicated request from leader. Original: 5.6->[5.7-5.7]   Dedup: 5.7->[]
I20260812 08:03:26.606715 15831 raft_consensus.cc:1240] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 6 LEADER]: Rejecting Update request from peer 1af245ab88fa4a69a4e94a41cfa1c947 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260812 08:03:26.606777 15595 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9160eee4cc4be28bce822ec9b2fdc0" candidate_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" is_pre_election: true
I20260812 08:03:26.606822 15598 raft_consensus.cc:1275] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 6 FOLLOWER]: Refusing update from remote peer e34cdbd5bd04469e92a6e15e7ae007a8: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260812 08:03:26.606868 15598 pending_rounds.cc:85] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947: Aborting all ops after (but not including) 6
I20260812 08:03:26.606889 15598 pending_rounds.cc:107] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947: Aborting uncommitted WRITE_OP operation due to leader change: 5.7
W20260812 08:03:26.607136 15504 txn_status_manager.cc:1397] failed to abort stale txn (ID 0) past 1.013s from last keepalive heartbeat (effective timeout is 0.500s): Aborted: Op aborted by new leader
I20260812 08:03:26.607203 15504 txn_status_manager.cc:1407] skipping staleness check for the rest of in-flight txn records since this txn status tablet replica is no longer a leader or not running
I20260812 08:03:26.606310 15603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9160eee4cc4be28bce822ec9b2fdc0" candidate_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "1af245ab88fa4a69a4e94a41cfa1c947"
I20260812 08:03:26.607645 16180 consensus_queue.cc:1048] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260812 08:03:26.608217 15603 raft_consensus.cc:2468] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e34cdbd5bd04469e92a6e15e7ae007a8 in term 6.
I20260812 08:03:26.609375 16203 tablet_replica.cc:442] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 6 leader_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:26.609465 16203 tablet_replica.cc:445] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 08:03:26.609581 16204 tablet_replica.cc:442] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947: TxnStatusTablet state changed. Reason: New leader e34cdbd5bd04469e92a6e15e7ae007a8. Latest consensus state: current_term: 6 leader_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:26.609674 16204 tablet_replica.cc:445] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 08:03:26.653146 16180 tablet_replica.cc:442] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 6 leader_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:26.653389 16180 tablet_replica.cc:445] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8: This TxnStatusTablet replica's current role is: LEADER
I20260812 08:03:27.617170 13037 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu with pid 15695
I20260812 08:03:27.642189 16211 raft_consensus.cc:493] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e34cdbd5bd04469e92a6e15e7ae007a8)
I20260812 08:03:27.642313 16211 raft_consensus.cc:515] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } }
I20260812 08:03:27.642745 16211 leader_election.cc:290] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 1af245ab88fa4a69a4e94a41cfa1c947 (127.12.187.66:41261), e34cdbd5bd04469e92a6e15e7ae007a8 (127.12.187.67:33175)
I20260812 08:03:27.643112 15598 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9160eee4cc4be28bce822ec9b2fdc0" candidate_uuid: "7e87a26275e4471f8960440233b86bc7" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" is_pre_election: true
W20260812 08:03:27.644212 15273 leader_election.cc:336] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e34cdbd5bd04469e92a6e15e7ae007a8 (127.12.187.67:33175): Network error: Client connection negotiation failed: client connection to 127.12.187.67:33175: connect: Connection refused (error 111)
I20260812 08:03:27.644294 15273 leader_election.cc:304] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7e87a26275e4471f8960440233b86bc7; no voters: 1af245ab88fa4a69a4e94a41cfa1c947, e34cdbd5bd04469e92a6e15e7ae007a8
I20260812 08:03:27.644524 16211 raft_consensus.cc:2749] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260812 08:03:27.670377 16215 raft_consensus.cc:493] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e34cdbd5bd04469e92a6e15e7ae007a8)
I20260812 08:03:27.670501 16215 raft_consensus.cc:515] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } }
I20260812 08:03:27.670992 16215 leader_election.cc:290] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 7e87a26275e4471f8960440233b86bc7 (127.12.187.65:43717), e34cdbd5bd04469e92a6e15e7ae007a8 (127.12.187.67:33175)
I20260812 08:03:27.671446 15372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9160eee4cc4be28bce822ec9b2fdc0" candidate_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e87a26275e4471f8960440233b86bc7" is_pre_election: true
I20260812 08:03:27.671617 15372 raft_consensus.cc:2468] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1af245ab88fa4a69a4e94a41cfa1c947 in term 6.
I20260812 08:03:27.672031 15498 leader_election.cc:304] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1af245ab88fa4a69a4e94a41cfa1c947, 7e87a26275e4471f8960440233b86bc7; no voters: 
I20260812 08:03:27.672227 16215 raft_consensus.cc:2804] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260812 08:03:27.672312 16215 raft_consensus.cc:493] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e34cdbd5bd04469e92a6e15e7ae007a8)
I20260812 08:03:27.672367 16215 raft_consensus.cc:3060] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 6 FOLLOWER]: Advancing to term 7
W20260812 08:03:27.672432 15499 leader_election.cc:336] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer e34cdbd5bd04469e92a6e15e7ae007a8 (127.12.187.67:33175): Network error: Client connection negotiation failed: client connection to 127.12.187.67:33175: connect: Connection refused (error 111)
I20260812 08:03:27.673321 16215 raft_consensus.cc:515] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } }
I20260812 08:03:27.673714 16215 leader_election.cc:290] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [CANDIDATE]: Term 7 election: Requested vote from peers 7e87a26275e4471f8960440233b86bc7 (127.12.187.65:43717), e34cdbd5bd04469e92a6e15e7ae007a8 (127.12.187.67:33175)
I20260812 08:03:27.674024 15372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9160eee4cc4be28bce822ec9b2fdc0" candidate_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "7e87a26275e4471f8960440233b86bc7"
I20260812 08:03:27.674150 15372 raft_consensus.cc:3060] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 6 FOLLOWER]: Advancing to term 7
W20260812 08:03:27.674738 15499 leader_election.cc:336] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer e34cdbd5bd04469e92a6e15e7ae007a8 (127.12.187.67:33175): Network error: Client connection negotiation failed: client connection to 127.12.187.67:33175: connect: Connection refused (error 111)
I20260812 08:03:27.675205 15372 raft_consensus.cc:2468] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1af245ab88fa4a69a4e94a41cfa1c947 in term 7.
I20260812 08:03:27.675498 15498 leader_election.cc:304] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1af245ab88fa4a69a4e94a41cfa1c947, 7e87a26275e4471f8960440233b86bc7; no voters: e34cdbd5bd04469e92a6e15e7ae007a8
I20260812 08:03:27.675719 16215 raft_consensus.cc:2804] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 7 FOLLOWER]: Leader election won for term 7
I20260812 08:03:27.675915 16215 raft_consensus.cc:697] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 7 LEADER]: Becoming Leader. State: Replica: 1af245ab88fa4a69a4e94a41cfa1c947, State: Running, Role: LEADER
I20260812 08:03:27.676085 16215 consensus_queue.cc:237] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } }
I20260812 08:03:27.676870 16221 tablet_replica.cc:442] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947: TxnStatusTablet state changed. Reason: New leader 1af245ab88fa4a69a4e94a41cfa1c947. Latest consensus state: current_term: 7 leader_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:27.677021 16221 tablet_replica.cc:445] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947: This TxnStatusTablet replica's current role is: LEADER
I20260812 08:03:27.677312 16223 txn_status_manager.cc:874] Waiting until node catch up with all replicated operations in previous term...
I20260812 08:03:27.677434 16223 txn_status_manager.cc:930] Loading transaction status metadata into memory...
I20260812 08:03:27.678170 15107 catalog_manager.cc:5719] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 reported cstate change: term changed from 6 to 7, leader changed from e34cdbd5bd04469e92a6e15e7ae007a8 (127.12.187.67) to 1af245ab88fa4a69a4e94a41cfa1c947 (127.12.187.66). New cstate: current_term: 7 leader_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } health_report { overall_health: UNKNOWN } } }
W20260812 08:03:27.686761 15946 meta_cache.cc:302] tablet 0f9160eee4cc4be28bce822ec9b2fdc0: replica e34cdbd5bd04469e92a6e15e7ae007a8 (127.12.187.67:33175) has failed: Network error: Client connection negotiation failed: client connection to 127.12.187.67:33175: connect: Connection refused (error 111)
I20260812 08:03:27.717619 15372 raft_consensus.cc:1275] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 7 FOLLOWER]: Refusing update from remote peer 1af245ab88fa4a69a4e94a41cfa1c947: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260812 08:03:27.718114 16221 consensus_queue.cc:1048] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260812 08:03:27.719324 16211 tablet_replica.cc:442] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7: TxnStatusTablet state changed. Reason: New leader 1af245ab88fa4a69a4e94a41cfa1c947. Latest consensus state: current_term: 7 leader_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:27.719449 16211 tablet_replica.cc:445] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 08:03:27.720567 16215 tablet_replica.cc:442] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 7 leader_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:27.720688 16215 tablet_replica.cc:445] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947: This TxnStatusTablet replica's current role is: LEADER
I20260812 08:03:27.720906 16211 tablet_replica.cc:442] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 7 leader_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:27.720999 16211 tablet_replica.cc:445] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7: This TxnStatusTablet replica's current role is: FOLLOWER
W20260812 08:03:27.722154 15499 consensus_peers.cc:597] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 -> Peer e34cdbd5bd04469e92a6e15e7ae007a8 (127.12.187.67:33175): Couldn't send request to peer e34cdbd5bd04469e92a6e15e7ae007a8. Status: Network error: Client connection negotiation failed: client connection to 127.12.187.67:33175: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 08:03:27.726938 13037 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu
/tmp/dist-test-tasksRvS6i/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.187.67:33175
--local_ip_for_outbound_sockets=127.12.187.67
--tserver_master_addrs=127.12.187.126:36763
--webserver_port=45409
--webserver_interface=127.12.187.67
--builtin_ntp_servers=127.12.187.84:33799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--txn_keepalive_interval_ms=500
--txn_staleness_tracker_interval_ms=100
--txn_staleness_tracker_disabled_interval_ms=100
--raft_heartbeat_interval_ms=50
--leader_failure_max_missed_heartbeat_periods=1.25
--enable_txn_system_client_init=true
--txn_schedule_background_tasks=false with env {}
W20260812 08:03:27.838657 16235 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:27.838887 16235 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:27.838958 16235 flags.cc:432] Enabled unsafe flag: --txn_schedule_background_tasks=false
W20260812 08:03:27.839033 16235 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:03:27.842559 16235 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:27.842646 16235 flags.cc:432] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 08:03:27.842711 16235 flags.cc:432] Enabled experimental flag: --txn_staleness_tracker_interval_ms=100
W20260812 08:03:27.842752 16235 flags.cc:432] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 08:03:27.842829 16235 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.187.67
I20260812 08:03:27.846805 16235 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.187.84:33799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1.25
--raft_heartbeat_interval_ms=50
--fs_data_dirs=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.187.67:33175
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.187.67
--webserver_port=45409
--txn_keepalive_interval_ms=500
--txn_schedule_background_tasks=false
--txn_staleness_tracker_interval_ms=100
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.187.126:36763
--txn_staleness_tracker_disabled_interval_ms=100
--never_fsync=true
--heap_profile_path=/tmp/kudu.16235
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.187.67

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:27.847820 16235 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:27.848877 16235 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 08:03:27.851547 16235 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 08:03:27.855587 16244 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:27.855636 16247 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:27.855654 16243 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:27.855790 16235 server_base.cc:1061] running on GCE node
I20260812 08:03:27.856220 16235 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:27.856809 16235 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:27.858024 16235 hybrid_clock.cc:648] HybridClock initialized: now 1786521807857994 us; error 42 us; skew 500 ppm
I20260812 08:03:27.860067 16235 webserver.cc:533] Webserver started at http://127.12.187.67:45409/ using document root <none> and password file <none>
I20260812 08:03:27.860656 16235 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:27.860775 16235 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:27.864166 16235 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:03:27.866242 16254 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:27.867245 16235 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:03:27.867336 16235 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-2/wal
uuid: "e34cdbd5bd04469e92a6e15e7ae007a8"
format_stamp: "Formatted at 2026-08-12 08:03:16 on dist-test-slave-8hhm"
I20260812 08:03:27.867753 16235 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:27.897992 16235 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:27.898830 16235 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:27.899036 16235 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:27.901010 16268 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260812 08:03:27.904790 16235 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 08:03:27.904860 16235 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.004s	user 0.000s	sys 0.000s
I20260812 08:03:27.904929 16235 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260812 08:03:27.906940 16235 ts_tablet_manager.cc:616] Registered 1 tablets
I20260812 08:03:27.907004 16235 ts_tablet_manager.cc:595] Time spent register tablets: real 0.002s	user 0.000s	sys 0.000s
I20260812 08:03:27.907650 16268 tablet_bootstrap.cc:492] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8: Bootstrap starting.
I20260812 08:03:27.920014 16235 rpc_server.cc:307] RPC server started. Bound to: 127.12.187.67:33175
I20260812 08:03:27.920054 16464 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.187.67:33175 every 8 connection(s)
I20260812 08:03:27.921499 16235 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-2/data/info.pb
I20260812 08:03:27.923504 16465 heartbeater.cc:344] Connected to a master server at 127.12.187.126:36763
I20260812 08:03:27.923684 16465 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:27.924202 16465 heartbeater.cc:507] Master 127.12.187.126:36763 requested a full tablet report, sending...
I20260812 08:03:27.924285 13037 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu as pid 16235
I20260812 08:03:27.926451 15106 ts_manager.cc:194] Re-registered known tserver with Master: e34cdbd5bd04469e92a6e15e7ae007a8 (127.12.187.67:33175)
I20260812 08:03:27.927434 15106 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.12.187.67:45387
I20260812 08:03:27.928524 16268 log.cc:826] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8: Log is configured to *not* fsync() on all Append() calls
I20260812 08:03:27.935107 16268 tablet_bootstrap.cc:492] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=1 applied=7 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 08:03:27.935438 16268 tablet_bootstrap.cc:492] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8: Bootstrap complete.
I20260812 08:03:27.936532 16268 ts_tablet_manager.cc:1403] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.012s
I20260812 08:03:27.938872 16268 raft_consensus.cc:359] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 6 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } }
I20260812 08:03:27.939179 16268 raft_consensus.cc:740] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 6 FOLLOWER]: Becoming Follower/Learner. State: Replica: e34cdbd5bd04469e92a6e15e7ae007a8, State: Initialized, Role: FOLLOWER
I20260812 08:03:27.939535 16268 consensus_queue.cc:260] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } }
I20260812 08:03:27.940114 16471 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 6 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:27.940198 16465 heartbeater.cc:499] Master 127.12.187.126:36763 was elected leader, sending a full tablet report...
I20260812 08:03:27.940251 16471 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 08:03:27.940382 16268 ts_tablet_manager.cc:1434] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8: Time spent starting tablet: real 0.004s	user 0.006s	sys 0.001s
I20260812 08:03:27.972582 16370 raft_consensus.cc:3060] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 6 FOLLOWER]: Advancing to term 7
I20260812 08:03:27.975945 16475 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 7 leader_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:27.976176 16475 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 08:03:27.976827 16471 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: New leader 1af245ab88fa4a69a4e94a41cfa1c947. Latest consensus state: current_term: 7 leader_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:27.976963 16471 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 08:03:28.030478 16215 tablet_replica.cc:442] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 7 leader_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:28.030649 16215 tablet_replica.cc:445] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947: This TxnStatusTablet replica's current role is: LEADER
I20260812 08:03:28.926608 13037 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu with pid 15470
I20260812 08:03:28.977360 16481 raft_consensus.cc:493] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1af245ab88fa4a69a4e94a41cfa1c947)
I20260812 08:03:28.977516 16481 raft_consensus.cc:515] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } }
I20260812 08:03:28.978506 16481 leader_election.cc:290] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 7e87a26275e4471f8960440233b86bc7 (127.12.187.65:43717), 1af245ab88fa4a69a4e94a41cfa1c947 (127.12.187.66:41261)
W20260812 08:03:28.979537 16258 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.187.66:41261: connect: Connection refused (error 111)
W20260812 08:03:28.980506 16258 leader_election.cc:336] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 1af245ab88fa4a69a4e94a41cfa1c947 (127.12.187.66:41261): Network error: Client connection negotiation failed: client connection to 127.12.187.66:41261: connect: Connection refused (error 111)
I20260812 08:03:28.983165 15372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9160eee4cc4be28bce822ec9b2fdc0" candidate_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "7e87a26275e4471f8960440233b86bc7" is_pre_election: true
I20260812 08:03:28.983713 16258 leader_election.cc:304] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e34cdbd5bd04469e92a6e15e7ae007a8; no voters: 1af245ab88fa4a69a4e94a41cfa1c947, 7e87a26275e4471f8960440233b86bc7
I20260812 08:03:28.983944 16481 raft_consensus.cc:2749] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260812 08:03:28.988734 16488 raft_consensus.cc:493] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 1af245ab88fa4a69a4e94a41cfa1c947)
I20260812 08:03:28.988834 16488 raft_consensus.cc:515] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } }
I20260812 08:03:28.989364 16488 leader_election.cc:290] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 1af245ab88fa4a69a4e94a41cfa1c947 (127.12.187.66:41261), e34cdbd5bd04469e92a6e15e7ae007a8 (127.12.187.67:33175)
W20260812 08:03:28.989889 15272 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.187.66:41261: connect: Connection refused (error 111) [suppressed 2 similar messages]
W20260812 08:03:28.990687 15272 leader_election.cc:336] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 1af245ab88fa4a69a4e94a41cfa1c947 (127.12.187.66:41261): Network error: Client connection negotiation failed: client connection to 127.12.187.66:41261: connect: Connection refused (error 111)
I20260812 08:03:28.992998 16370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9160eee4cc4be28bce822ec9b2fdc0" candidate_uuid: "7e87a26275e4471f8960440233b86bc7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" is_pre_election: true
I20260812 08:03:28.993273 16370 raft_consensus.cc:2468] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e87a26275e4471f8960440233b86bc7 in term 7.
I20260812 08:03:28.993621 15273 leader_election.cc:304] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e87a26275e4471f8960440233b86bc7, e34cdbd5bd04469e92a6e15e7ae007a8; no voters: 1af245ab88fa4a69a4e94a41cfa1c947
I20260812 08:03:28.993839 16488 raft_consensus.cc:2804] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260812 08:03:28.993911 16488 raft_consensus.cc:493] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 1af245ab88fa4a69a4e94a41cfa1c947)
I20260812 08:03:28.993971 16488 raft_consensus.cc:3060] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 7 FOLLOWER]: Advancing to term 8
I20260812 08:03:28.994853 16488 raft_consensus.cc:515] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } }
I20260812 08:03:28.995216 16488 leader_election.cc:290] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [CANDIDATE]: Term 8 election: Requested vote from peers 1af245ab88fa4a69a4e94a41cfa1c947 (127.12.187.66:41261), e34cdbd5bd04469e92a6e15e7ae007a8 (127.12.187.67:33175)
I20260812 08:03:28.995586 16370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9160eee4cc4be28bce822ec9b2fdc0" candidate_uuid: "7e87a26275e4471f8960440233b86bc7" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8"
I20260812 08:03:28.995723 16370 raft_consensus.cc:3060] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 7 FOLLOWER]: Advancing to term 8
W20260812 08:03:28.996243 15272 leader_election.cc:336] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 1af245ab88fa4a69a4e94a41cfa1c947 (127.12.187.66:41261): Network error: Client connection negotiation failed: client connection to 127.12.187.66:41261: connect: Connection refused (error 111)
I20260812 08:03:28.996587 16370 raft_consensus.cc:2468] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e87a26275e4471f8960440233b86bc7 in term 8.
I20260812 08:03:28.996882 15273 leader_election.cc:304] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e87a26275e4471f8960440233b86bc7, e34cdbd5bd04469e92a6e15e7ae007a8; no voters: 1af245ab88fa4a69a4e94a41cfa1c947
I20260812 08:03:28.997040 16488 raft_consensus.cc:2804] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 8 FOLLOWER]: Leader election won for term 8
I20260812 08:03:28.997294 16488 raft_consensus.cc:697] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 8 LEADER]: Becoming Leader. State: Replica: 7e87a26275e4471f8960440233b86bc7, State: Running, Role: LEADER
I20260812 08:03:28.997480 16488 consensus_queue.cc:237] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } }
I20260812 08:03:28.998142 16493 tablet_replica.cc:442] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7: TxnStatusTablet state changed. Reason: New leader 7e87a26275e4471f8960440233b86bc7. Latest consensus state: current_term: 8 leader_uuid: "7e87a26275e4471f8960440233b86bc7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:28.998276 16493 tablet_replica.cc:445] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7: This TxnStatusTablet replica's current role is: LEADER
I20260812 08:03:28.998531 16495 txn_status_manager.cc:874] Waiting until node catch up with all replicated operations in previous term...
I20260812 08:03:28.998631 16495 txn_status_manager.cc:930] Loading transaction status metadata into memory...
I20260812 08:03:28.999449 15106 catalog_manager.cc:5719] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 reported cstate change: term changed from 7 to 8, leader changed from 1af245ab88fa4a69a4e94a41cfa1c947 (127.12.187.66) to 7e87a26275e4471f8960440233b86bc7 (127.12.187.65). New cstate: current_term: 8 leader_uuid: "7e87a26275e4471f8960440233b86bc7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } health_report { overall_health: UNKNOWN } } }
W20260812 08:03:29.022224 15945 meta_cache.cc:302] tablet 0f9160eee4cc4be28bce822ec9b2fdc0: replica 1af245ab88fa4a69a4e94a41cfa1c947 (127.12.187.66:41261) has failed: Network error: Client connection negotiation failed: client connection to 127.12.187.66:41261: connect: Connection refused (error 111)
I20260812 08:03:29.043289 16370 raft_consensus.cc:1275] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 8 FOLLOWER]: Refusing update from remote peer 7e87a26275e4471f8960440233b86bc7: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260812 08:03:29.043823 16493 consensus_queue.cc:1048] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260812 08:03:29.045403 16481 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: New leader 7e87a26275e4471f8960440233b86bc7. Latest consensus state: current_term: 8 leader_uuid: "7e87a26275e4471f8960440233b86bc7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:29.045544 16481 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: FOLLOWER
W20260812 08:03:29.045836 15272 consensus_peers.cc:597] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 -> Peer 1af245ab88fa4a69a4e94a41cfa1c947 (127.12.187.66:41261): Couldn't send request to peer 1af245ab88fa4a69a4e94a41cfa1c947. Status: Network error: Client connection negotiation failed: client connection to 127.12.187.66:41261: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 08:03:29.047555 16481 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 8 leader_uuid: "7e87a26275e4471f8960440233b86bc7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:29.047652 16481 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 08:03:29.048563 16488 tablet_replica.cc:442] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 8 leader_uuid: "7e87a26275e4471f8960440233b86bc7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:29.048678 16488 tablet_replica.cc:445] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7: This TxnStatusTablet replica's current role is: LEADER
I20260812 08:03:29.048774 13037 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu
/tmp/dist-test-tasksRvS6i/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.187.66:41261
--local_ip_for_outbound_sockets=127.12.187.66
--tserver_master_addrs=127.12.187.126:36763
--webserver_port=43121
--webserver_interface=127.12.187.66
--builtin_ntp_servers=127.12.187.84:33799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--txn_keepalive_interval_ms=500
--txn_staleness_tracker_interval_ms=100
--txn_staleness_tracker_disabled_interval_ms=100
--raft_heartbeat_interval_ms=50
--leader_failure_max_missed_heartbeat_periods=1.25
--enable_txn_system_client_init=true
--txn_schedule_background_tasks=false with env {}
W20260812 08:03:29.158429 16515 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:29.158674 16515 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:29.158771 16515 flags.cc:432] Enabled unsafe flag: --txn_schedule_background_tasks=false
W20260812 08:03:29.158859 16515 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:03:29.162176 16515 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:29.162309 16515 flags.cc:432] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 08:03:29.162351 16515 flags.cc:432] Enabled experimental flag: --txn_staleness_tracker_interval_ms=100
W20260812 08:03:29.162384 16515 flags.cc:432] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 08:03:29.162456 16515 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.187.66
I20260812 08:03:29.166333 16515 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.187.84:33799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1.25
--raft_heartbeat_interval_ms=50
--fs_data_dirs=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.187.66:41261
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.187.66
--webserver_port=43121
--txn_keepalive_interval_ms=500
--txn_schedule_background_tasks=false
--txn_staleness_tracker_interval_ms=100
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.187.126:36763
--txn_staleness_tracker_disabled_interval_ms=100
--never_fsync=true
--heap_profile_path=/tmp/kudu.16515
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.187.66

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:29.167436 16515 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:29.168651 16515 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 08:03:29.171485 16515 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 08:03:29.176034 16526 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:29.175942 16528 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:29.175942 16522 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:29.176306 16515 server_base.cc:1061] running on GCE node
I20260812 08:03:29.176616 16515 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:29.177137 16515 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:29.178335 16515 hybrid_clock.cc:648] HybridClock initialized: now 1786521809178321 us; error 37 us; skew 500 ppm
I20260812 08:03:29.180075 16515 webserver.cc:533] Webserver started at http://127.12.187.66:43121/ using document root <none> and password file <none>
I20260812 08:03:29.180644 16515 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:29.180780 16515 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:29.184144 16515 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:03:29.186118 16537 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:29.187312 16515 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:03:29.187423 16515 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-1/wal
uuid: "1af245ab88fa4a69a4e94a41cfa1c947"
format_stamp: "Formatted at 2026-08-12 08:03:16 on dist-test-slave-8hhm"
I20260812 08:03:29.187956 16515 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:29.196823 16515 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:29.197446 16515 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:29.197624 16515 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:29.199365 16552 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260812 08:03:29.203404 16515 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 08:03:29.203469 16515 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.004s	user 0.001s	sys 0.000s
I20260812 08:03:29.203512 16515 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260812 08:03:29.205581 16515 ts_tablet_manager.cc:616] Registered 1 tablets
I20260812 08:03:29.205636 16515 ts_tablet_manager.cc:595] Time spent register tablets: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:03:29.205988 16552 tablet_bootstrap.cc:492] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947: Bootstrap starting.
I20260812 08:03:29.217099 16515 rpc_server.cc:307] RPC server started. Bound to: 127.12.187.66:41261
I20260812 08:03:29.217401 16751 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.187.66:41261 every 8 connection(s)
I20260812 08:03:29.218256 16515 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-1/data/info.pb
I20260812 08:03:29.219821 16754 heartbeater.cc:344] Connected to a master server at 127.12.187.126:36763
I20260812 08:03:29.219998 16754 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:29.220395 16754 heartbeater.cc:507] Master 127.12.187.126:36763 requested a full tablet report, sending...
I20260812 08:03:29.221966 15106 ts_manager.cc:194] Re-registered known tserver with Master: 1af245ab88fa4a69a4e94a41cfa1c947 (127.12.187.66:41261)
I20260812 08:03:29.222704 15106 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.12.187.66:35107
I20260812 08:03:29.224365 16552 log.cc:826] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947: Log is configured to *not* fsync() on all Append() calls
I20260812 08:03:29.225605 13037 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu as pid 16515
I20260812 08:03:29.230080 16552 tablet_bootstrap.cc:492] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=2 applied=8 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 08:03:29.230535 16552 tablet_bootstrap.cc:492] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947: Bootstrap complete.
I20260812 08:03:29.231784 16552 ts_tablet_manager.cc:1403] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.009s
I20260812 08:03:29.234284 16552 raft_consensus.cc:359] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 7 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } }
I20260812 08:03:29.234648 16552 raft_consensus.cc:740] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 7 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1af245ab88fa4a69a4e94a41cfa1c947, State: Initialized, Role: FOLLOWER
I20260812 08:03:29.235013 16552 consensus_queue.cc:260] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } }
I20260812 08:03:29.235571 16754 heartbeater.cc:499] Master 127.12.187.126:36763 was elected leader, sending a full tablet report...
I20260812 08:03:29.235540 16757 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 7 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:29.235707 16757 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 08:03:29.235733 16552 ts_tablet_manager.cc:1434] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947: Time spent starting tablet: real 0.004s	user 0.006s	sys 0.000s
I20260812 08:03:29.251034 16671 raft_consensus.cc:3060] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 7 FOLLOWER]: Advancing to term 8
I20260812 08:03:29.254386 16765 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 8 leader_uuid: "7e87a26275e4471f8960440233b86bc7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:29.254505 16765 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 08:03:29.254947 16757 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: New leader 7e87a26275e4471f8960440233b86bc7. Latest consensus state: current_term: 8 leader_uuid: "7e87a26275e4471f8960440233b86bc7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:29.255066 16757 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 08:03:29.305696 16493 tablet_replica.cc:442] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 8 leader_uuid: "7e87a26275e4471f8960440233b86bc7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:29.305866 16493 tablet_replica.cc:445] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7: This TxnStatusTablet replica's current role is: LEADER
I20260812 08:03:29.414028 16481 raft_consensus.cc:493] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e87a26275e4471f8960440233b86bc7)
I20260812 08:03:29.414186 16481 raft_consensus.cc:515] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } }
I20260812 08:03:29.414695 16481 leader_election.cc:290] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e87a26275e4471f8960440233b86bc7 (127.12.187.65:43717), 1af245ab88fa4a69a4e94a41cfa1c947 (127.12.187.66:41261)
I20260812 08:03:29.417722 15372 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9160eee4cc4be28bce822ec9b2fdc0" candidate_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "7e87a26275e4471f8960440233b86bc7" is_pre_election: true
I20260812 08:03:29.419718 16671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9160eee4cc4be28bce822ec9b2fdc0" candidate_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" is_pre_election: true
I20260812 08:03:29.420526 16258 leader_election.cc:304] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e34cdbd5bd04469e92a6e15e7ae007a8; no voters: 1af245ab88fa4a69a4e94a41cfa1c947, 7e87a26275e4471f8960440233b86bc7
I20260812 08:03:29.420799 16481 raft_consensus.cc:2749] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 08:03:30.227195 13037 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu with pid 15244
I20260812 08:03:30.250721 16768 raft_consensus.cc:493] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e87a26275e4471f8960440233b86bc7)
I20260812 08:03:30.250864 16768 raft_consensus.cc:515] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } }
I20260812 08:03:30.251408 16768 leader_election.cc:290] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e87a26275e4471f8960440233b86bc7 (127.12.187.65:43717), 1af245ab88fa4a69a4e94a41cfa1c947 (127.12.187.66:41261)
I20260812 08:03:30.252440 16671 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9160eee4cc4be28bce822ec9b2fdc0" candidate_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" is_pre_election: true
W20260812 08:03:30.252512 15945 meta_cache.cc:302] tablet 0f9160eee4cc4be28bce822ec9b2fdc0: replica 7e87a26275e4471f8960440233b86bc7 (127.12.187.65:43717) has failed: Network error: Client connection negotiation failed: client connection to 127.12.187.65:43717: connect: Connection refused (error 111)
W20260812 08:03:30.253122 16258 leader_election.cc:336] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7e87a26275e4471f8960440233b86bc7 (127.12.187.65:43717): Network error: Client connection negotiation failed: client connection to 127.12.187.65:43717: connect: Connection refused (error 111)
I20260812 08:03:30.253274 16258 leader_election.cc:304] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e34cdbd5bd04469e92a6e15e7ae007a8; no voters: 1af245ab88fa4a69a4e94a41cfa1c947, 7e87a26275e4471f8960440233b86bc7
I20260812 08:03:30.253448 16768 raft_consensus.cc:2749] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260812 08:03:30.280718 16785 raft_consensus.cc:493] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 7e87a26275e4471f8960440233b86bc7)
I20260812 08:03:30.280848 16785 raft_consensus.cc:515] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } }
I20260812 08:03:30.281810 16785 leader_election.cc:290] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 7e87a26275e4471f8960440233b86bc7 (127.12.187.65:43717), e34cdbd5bd04469e92a6e15e7ae007a8 (127.12.187.67:33175)
W20260812 08:03:30.282538 16541 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.187.65:43717: connect: Connection refused (error 111)
W20260812 08:03:30.283449 16541 leader_election.cc:336] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 7e87a26275e4471f8960440233b86bc7 (127.12.187.65:43717): Network error: Client connection negotiation failed: client connection to 127.12.187.65:43717: connect: Connection refused (error 111)
I20260812 08:03:30.285931 16370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9160eee4cc4be28bce822ec9b2fdc0" candidate_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" is_pre_election: true
I20260812 08:03:30.286103 16370 raft_consensus.cc:2468] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1af245ab88fa4a69a4e94a41cfa1c947 in term 8.
I20260812 08:03:30.286453 16543 leader_election.cc:304] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1af245ab88fa4a69a4e94a41cfa1c947, e34cdbd5bd04469e92a6e15e7ae007a8; no voters: 7e87a26275e4471f8960440233b86bc7
I20260812 08:03:30.286680 16785 raft_consensus.cc:2804] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260812 08:03:30.286772 16785 raft_consensus.cc:493] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 7e87a26275e4471f8960440233b86bc7)
I20260812 08:03:30.286827 16785 raft_consensus.cc:3060] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 8 FOLLOWER]: Advancing to term 9
I20260812 08:03:30.287678 16785 raft_consensus.cc:515] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } }
I20260812 08:03:30.288102 16785 leader_election.cc:290] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [CANDIDATE]: Term 9 election: Requested vote from peers 7e87a26275e4471f8960440233b86bc7 (127.12.187.65:43717), e34cdbd5bd04469e92a6e15e7ae007a8 (127.12.187.67:33175)
I20260812 08:03:30.288573 16370 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9160eee4cc4be28bce822ec9b2fdc0" candidate_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8"
I20260812 08:03:30.288698 16370 raft_consensus.cc:3060] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 8 FOLLOWER]: Advancing to term 9
I20260812 08:03:30.289744 16370 raft_consensus.cc:2468] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1af245ab88fa4a69a4e94a41cfa1c947 in term 9.
W20260812 08:03:30.289944 16541 leader_election.cc:336] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 7e87a26275e4471f8960440233b86bc7 (127.12.187.65:43717): Network error: Client connection negotiation failed: client connection to 127.12.187.65:43717: connect: Connection refused (error 111)
I20260812 08:03:30.290306 16543 leader_election.cc:304] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1af245ab88fa4a69a4e94a41cfa1c947, e34cdbd5bd04469e92a6e15e7ae007a8; no voters: 7e87a26275e4471f8960440233b86bc7
I20260812 08:03:30.290490 16785 raft_consensus.cc:2804] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 9 FOLLOWER]: Leader election won for term 9
I20260812 08:03:30.290745 16785 raft_consensus.cc:697] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 9 LEADER]: Becoming Leader. State: Replica: 1af245ab88fa4a69a4e94a41cfa1c947, State: Running, Role: LEADER
I20260812 08:03:30.291034 16785 consensus_queue.cc:237] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } }
I20260812 08:03:30.292393 16795 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: New leader 1af245ab88fa4a69a4e94a41cfa1c947. Latest consensus state: current_term: 9 leader_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:30.292492 16795 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: LEADER
I20260812 08:03:30.292733 16797 txn_status_manager.cc:874] Waiting until node catch up with all replicated operations in previous term...
I20260812 08:03:30.292870 16797 txn_status_manager.cc:930] Loading transaction status metadata into memory...
I20260812 08:03:30.293641 15107 catalog_manager.cc:5719] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 reported cstate change: term changed from 8 to 9, leader changed from 7e87a26275e4471f8960440233b86bc7 (127.12.187.65) to 1af245ab88fa4a69a4e94a41cfa1c947 (127.12.187.66). New cstate: current_term: 9 leader_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } health_report { overall_health: UNKNOWN } } }
W20260812 08:03:30.301532 16018 txn_status_manager-itest.cc:377] KeepTransactionAlive() returned non-OK status: Timed out: KeepTransactionAlive RPC to 127.12.187.126:36763 timed out after 0.050s (SENT)
W20260812 08:03:30.302871 15157 rpcz_store.cc:267] Call kudu.transactions.TxnManagerService.KeepTransactionAlive from 127.0.0.1:33028 (request call id 122) took 51 ms (client timeout 50 ms). Trace:
W20260812 08:03:30.302956 15157 rpcz_store.cc:269] 0812 08:03:30.251411 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:03:30.251487 (+    76us) service_pool.cc:224] Handling call
0812 08:03:30.302849 (+ 51362us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260812 08:03:30.339082 16363 raft_consensus.cc:1275] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 9 FOLLOWER]: Refusing update from remote peer 1af245ab88fa4a69a4e94a41cfa1c947: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260812 08:03:30.339651 16795 consensus_queue.cc:1048] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260812 08:03:30.341132 16768 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: New leader 1af245ab88fa4a69a4e94a41cfa1c947. Latest consensus state: current_term: 9 leader_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:30.341279 16768 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 08:03:30.342612 16795 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 9 leader_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:30.342733 16795 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: LEADER
I20260812 08:03:30.343643 16768 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 9 leader_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:30.343757 16768 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: FOLLOWER
W20260812 08:03:30.344497 16541 consensus_peers.cc:597] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 -> Peer 7e87a26275e4471f8960440233b86bc7 (127.12.187.65:43717): Couldn't send request to peer 7e87a26275e4471f8960440233b86bc7. Status: Network error: Client connection negotiation failed: client connection to 127.12.187.65:43717: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 08:03:30.351828 13037 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu
/tmp/dist-test-tasksRvS6i/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.187.65:43717
--local_ip_for_outbound_sockets=127.12.187.65
--tserver_master_addrs=127.12.187.126:36763
--webserver_port=34711
--webserver_interface=127.12.187.65
--builtin_ntp_servers=127.12.187.84:33799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--txn_keepalive_interval_ms=500
--txn_staleness_tracker_interval_ms=100
--txn_staleness_tracker_disabled_interval_ms=100
--raft_heartbeat_interval_ms=50
--leader_failure_max_missed_heartbeat_periods=1.25
--enable_txn_system_client_init=true
--txn_schedule_background_tasks=false with env {}
W20260812 08:03:30.461002 16817 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:30.461254 16817 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:30.461328 16817 flags.cc:432] Enabled unsafe flag: --txn_schedule_background_tasks=false
W20260812 08:03:30.461398 16817 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:03:30.464748 16817 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:30.464886 16817 flags.cc:432] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 08:03:30.464939 16817 flags.cc:432] Enabled experimental flag: --txn_staleness_tracker_interval_ms=100
W20260812 08:03:30.464977 16817 flags.cc:432] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 08:03:30.465080 16817 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.187.65
I20260812 08:03:30.469002 16817 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.187.84:33799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1.25
--raft_heartbeat_interval_ms=50
--fs_data_dirs=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.187.65:43717
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.187.65
--webserver_port=34711
--txn_keepalive_interval_ms=500
--txn_schedule_background_tasks=false
--txn_staleness_tracker_interval_ms=100
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.187.126:36763
--txn_staleness_tracker_disabled_interval_ms=100
--never_fsync=true
--heap_profile_path=/tmp/kudu.16817
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.187.65

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:30.470117 16817 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:30.471318 16817 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 08:03:30.474129 16817 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 08:03:30.477814 16827 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:30.477835 16823 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:30.477902 16830 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:30.478108 16817 server_base.cc:1061] running on GCE node
I20260812 08:03:30.478466 16817 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:30.479023 16817 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:30.480218 16817 hybrid_clock.cc:648] HybridClock initialized: now 1786521810480200 us; error 30 us; skew 500 ppm
I20260812 08:03:30.481957 16817 webserver.cc:533] Webserver started at http://127.12.187.65:34711/ using document root <none> and password file <none>
I20260812 08:03:30.482542 16817 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:30.482662 16817 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:30.485956 16817 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 08:03:30.487900 16836 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:30.488893 16817 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:03:30.489023 16817 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-0/wal
uuid: "7e87a26275e4471f8960440233b86bc7"
format_stamp: "Formatted at 2026-08-12 08:03:16 on dist-test-slave-8hhm"
I20260812 08:03:30.489509 16817 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:30.504894 16817 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:30.505652 16817 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:30.505838 16817 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:30.507757 16850 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260812 08:03:30.511345 16817 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 08:03:30.511399 16817 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.004s	user 0.000s	sys 0.000s
I20260812 08:03:30.511467 16817 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260812 08:03:30.513603 16817 ts_tablet_manager.cc:616] Registered 1 tablets
I20260812 08:03:30.513660 16817 ts_tablet_manager.cc:595] Time spent register tablets: real 0.002s	user 0.000s	sys 0.002s
I20260812 08:03:30.514021 16850 tablet_bootstrap.cc:492] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7: Bootstrap starting.
I20260812 08:03:30.525609 16817 rpc_server.cc:307] RPC server started. Bound to: 127.12.187.65:43717
I20260812 08:03:30.526695 16817 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-0/data/info.pb
I20260812 08:03:30.528095 17062 heartbeater.cc:344] Connected to a master server at 127.12.187.126:36763
I20260812 08:03:30.528252 17062 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:30.528635 17062 heartbeater.cc:507] Master 127.12.187.126:36763 requested a full tablet report, sending...
I20260812 08:03:30.528817 13037 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu as pid 16817
I20260812 08:03:30.530337 15107 ts_manager.cc:194] Re-registered known tserver with Master: 7e87a26275e4471f8960440233b86bc7 (127.12.187.65:43717)
I20260812 08:03:30.531098 15107 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.12.187.65:58377
I20260812 08:03:30.532195 16850 log.cc:826] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7: Log is configured to *not* fsync() on all Append() calls
I20260812 08:03:30.532648 17060 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.187.65:43717 every 8 connection(s)
I20260812 08:03:30.537777 16850 tablet_bootstrap.cc:492] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 08:03:30.538089 16850 tablet_bootstrap.cc:492] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7: Bootstrap complete.
I20260812 08:03:30.539171 16850 ts_tablet_manager.cc:1403] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.011s
I20260812 08:03:30.541471 16850 raft_consensus.cc:359] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 8 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } }
I20260812 08:03:30.541776 16850 raft_consensus.cc:740] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 8 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e87a26275e4471f8960440233b86bc7, State: Initialized, Role: FOLLOWER
I20260812 08:03:30.542201 16850 consensus_queue.cc:260] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } }
I20260812 08:03:30.542738 17062 heartbeater.cc:499] Master 127.12.187.126:36763 was elected leader, sending a full tablet report...
I20260812 08:03:30.542721 17071 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 8 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:30.542840 16850 ts_tablet_manager.cc:1434] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7: Time spent starting tablet: real 0.004s	user 0.005s	sys 0.001s
I20260812 08:03:30.542851 17071 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 08:03:30.562860 16979 raft_consensus.cc:3060] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 8 FOLLOWER]: Advancing to term 9
I20260812 08:03:30.567235 17071 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: New leader 1af245ab88fa4a69a4e94a41cfa1c947. Latest consensus state: current_term: 9 leader_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:30.567237 17077 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 9 leader_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:30.567435 17077 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 08:03:30.567386 17071 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 08:03:30.602746 16795 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 9 leader_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:30.602919 16795 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: LEADER
I20260812 08:03:31.539040 13037 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu with pid 16515
I20260812 08:03:31.561352 17082 raft_consensus.cc:493] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1af245ab88fa4a69a4e94a41cfa1c947)
I20260812 08:03:31.561494 17082 raft_consensus.cc:515] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } }
I20260812 08:03:31.561933 17082 leader_election.cc:290] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 7e87a26275e4471f8960440233b86bc7 (127.12.187.65:43717), 1af245ab88fa4a69a4e94a41cfa1c947 (127.12.187.66:41261)
W20260812 08:03:31.563594 16258 leader_election.cc:336] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1af245ab88fa4a69a4e94a41cfa1c947 (127.12.187.66:41261): Network error: Client connection negotiation failed: client connection to 127.12.187.66:41261: connect: Connection refused (error 111)
I20260812 08:03:31.565727 16979 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9160eee4cc4be28bce822ec9b2fdc0" candidate_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "7e87a26275e4471f8960440233b86bc7" is_pre_election: true
I20260812 08:03:31.566366 16258 leader_election.cc:304] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e34cdbd5bd04469e92a6e15e7ae007a8; no voters: 1af245ab88fa4a69a4e94a41cfa1c947, 7e87a26275e4471f8960440233b86bc7
I20260812 08:03:31.566617 17082 raft_consensus.cc:2749] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260812 08:03:31.590430 17089 raft_consensus.cc:493] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 1af245ab88fa4a69a4e94a41cfa1c947)
I20260812 08:03:31.590633 17089 raft_consensus.cc:515] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } }
I20260812 08:03:31.591948 17089 leader_election.cc:290] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 1af245ab88fa4a69a4e94a41cfa1c947 (127.12.187.66:41261), e34cdbd5bd04469e92a6e15e7ae007a8 (127.12.187.67:33175)
W20260812 08:03:31.592515 16841 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.187.66:41261: connect: Connection refused (error 111)
W20260812 08:03:31.593602 16841 leader_election.cc:336] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 1af245ab88fa4a69a4e94a41cfa1c947 (127.12.187.66:41261): Network error: Client connection negotiation failed: client connection to 127.12.187.66:41261: connect: Connection refused (error 111)
I20260812 08:03:31.595896 16363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9160eee4cc4be28bce822ec9b2fdc0" candidate_uuid: "7e87a26275e4471f8960440233b86bc7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" is_pre_election: true
I20260812 08:03:31.596112 16363 raft_consensus.cc:2468] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7e87a26275e4471f8960440233b86bc7 in term 9.
I20260812 08:03:31.596482 16842 leader_election.cc:304] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e87a26275e4471f8960440233b86bc7, e34cdbd5bd04469e92a6e15e7ae007a8; no voters: 1af245ab88fa4a69a4e94a41cfa1c947
I20260812 08:03:31.596714 17089 raft_consensus.cc:2804] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260812 08:03:31.596776 17089 raft_consensus.cc:493] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 1af245ab88fa4a69a4e94a41cfa1c947)
I20260812 08:03:31.596817 17089 raft_consensus.cc:3060] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 9 FOLLOWER]: Advancing to term 10
I20260812 08:03:31.597671 17089 raft_consensus.cc:515] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } }
I20260812 08:03:31.598048 17089 leader_election.cc:290] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [CANDIDATE]: Term 10 election: Requested vote from peers 1af245ab88fa4a69a4e94a41cfa1c947 (127.12.187.66:41261), e34cdbd5bd04469e92a6e15e7ae007a8 (127.12.187.67:33175)
I20260812 08:03:31.598470 16363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9160eee4cc4be28bce822ec9b2fdc0" candidate_uuid: "7e87a26275e4471f8960440233b86bc7" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8"
I20260812 08:03:31.598599 16363 raft_consensus.cc:3060] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 9 FOLLOWER]: Advancing to term 10
W20260812 08:03:31.599090 16841 leader_election.cc:336] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 1af245ab88fa4a69a4e94a41cfa1c947 (127.12.187.66:41261): Network error: Client connection negotiation failed: client connection to 127.12.187.66:41261: connect: Connection refused (error 111)
I20260812 08:03:31.599635 16363 raft_consensus.cc:2468] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7e87a26275e4471f8960440233b86bc7 in term 10.
I20260812 08:03:31.599907 16842 leader_election.cc:304] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7e87a26275e4471f8960440233b86bc7, e34cdbd5bd04469e92a6e15e7ae007a8; no voters: 1af245ab88fa4a69a4e94a41cfa1c947
I20260812 08:03:31.600097 17089 raft_consensus.cc:2804] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 10 FOLLOWER]: Leader election won for term 10
I20260812 08:03:31.600338 17089 raft_consensus.cc:697] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 10 LEADER]: Becoming Leader. State: Replica: 7e87a26275e4471f8960440233b86bc7, State: Running, Role: LEADER
I20260812 08:03:31.600630 17089 consensus_queue.cc:237] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } }
I20260812 08:03:31.601830 17096 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: New leader 7e87a26275e4471f8960440233b86bc7. Latest consensus state: current_term: 10 leader_uuid: "7e87a26275e4471f8960440233b86bc7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:31.601926 17096 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: LEADER
I20260812 08:03:31.602200 17103 txn_status_manager.cc:874] Waiting until node catch up with all replicated operations in previous term...
I20260812 08:03:31.602346 17103 txn_status_manager.cc:930] Loading transaction status metadata into memory...
I20260812 08:03:31.603245 15107 catalog_manager.cc:5719] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 reported cstate change: term changed from 9 to 10, leader changed from 1af245ab88fa4a69a4e94a41cfa1c947 (127.12.187.66) to 7e87a26275e4471f8960440233b86bc7 (127.12.187.65). New cstate: current_term: 10 leader_uuid: "7e87a26275e4471f8960440233b86bc7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } health_report { overall_health: UNKNOWN } } }
W20260812 08:03:31.630138 15945 meta_cache.cc:302] tablet 0f9160eee4cc4be28bce822ec9b2fdc0: replica 1af245ab88fa4a69a4e94a41cfa1c947 (127.12.187.66:41261) has failed: Network error: Client connection negotiation failed: client connection to 127.12.187.66:41261: connect: Connection refused (error 111)
I20260812 08:03:31.645579 16363 raft_consensus.cc:1275] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 10 FOLLOWER]: Refusing update from remote peer 7e87a26275e4471f8960440233b86bc7: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260812 08:03:31.646121 17096 consensus_queue.cc:1048] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260812 08:03:31.647526 17082 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: New leader 7e87a26275e4471f8960440233b86bc7. Latest consensus state: current_term: 10 leader_uuid: "7e87a26275e4471f8960440233b86bc7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:31.647651 17082 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 08:03:31.649072 17089 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 10 leader_uuid: "7e87a26275e4471f8960440233b86bc7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:31.649179 17089 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: LEADER
I20260812 08:03:31.649446 17082 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 10 leader_uuid: "7e87a26275e4471f8960440233b86bc7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:31.649544 17082 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: FOLLOWER
W20260812 08:03:31.651170 16841 consensus_peers.cc:597] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 -> Peer 1af245ab88fa4a69a4e94a41cfa1c947 (127.12.187.66:41261): Couldn't send request to peer 1af245ab88fa4a69a4e94a41cfa1c947. Status: Network error: Client connection negotiation failed: client connection to 127.12.187.66:41261: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 08:03:31.653272 13037 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu
/tmp/dist-test-tasksRvS6i/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.187.66:41261
--local_ip_for_outbound_sockets=127.12.187.66
--tserver_master_addrs=127.12.187.126:36763
--webserver_port=43121
--webserver_interface=127.12.187.66
--builtin_ntp_servers=127.12.187.84:33799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--txn_keepalive_interval_ms=500
--txn_staleness_tracker_interval_ms=100
--txn_staleness_tracker_disabled_interval_ms=100
--raft_heartbeat_interval_ms=50
--leader_failure_max_missed_heartbeat_periods=1.25
--enable_txn_system_client_init=true
--txn_schedule_background_tasks=false with env {}
W20260812 08:03:31.762420 17120 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:31.762665 17120 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:31.762773 17120 flags.cc:432] Enabled unsafe flag: --txn_schedule_background_tasks=false
W20260812 08:03:31.762844 17120 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:03:31.766196 17120 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:31.766319 17120 flags.cc:432] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 08:03:31.766381 17120 flags.cc:432] Enabled experimental flag: --txn_staleness_tracker_interval_ms=100
W20260812 08:03:31.766417 17120 flags.cc:432] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 08:03:31.766495 17120 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.187.66
I20260812 08:03:31.770391 17120 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.187.84:33799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1.25
--raft_heartbeat_interval_ms=50
--fs_data_dirs=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.187.66:41261
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.187.66
--webserver_port=43121
--txn_keepalive_interval_ms=500
--txn_schedule_background_tasks=false
--txn_staleness_tracker_interval_ms=100
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.187.126:36763
--txn_staleness_tracker_disabled_interval_ms=100
--never_fsync=true
--heap_profile_path=/tmp/kudu.17120
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.187.66

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:31.771416 17120 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:31.772660 17120 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 08:03:31.775305 17120 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 08:03:31.778779 17127 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:31.778882 17130 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:31.778803 17128 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:31.779488 17120 server_base.cc:1061] running on GCE node
I20260812 08:03:31.779855 17120 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:31.780409 17120 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:31.781589 17120 hybrid_clock.cc:648] HybridClock initialized: now 1786521811781563 us; error 40 us; skew 500 ppm
I20260812 08:03:31.783317 17120 webserver.cc:533] Webserver started at http://127.12.187.66:43121/ using document root <none> and password file <none>
I20260812 08:03:31.783881 17120 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:31.783969 17120 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:31.787492 17120 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.001s	sys 0.000s
I20260812 08:03:31.789566 17141 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:31.790576 17120 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.001s
I20260812 08:03:31.790714 17120 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-1/wal
uuid: "1af245ab88fa4a69a4e94a41cfa1c947"
format_stamp: "Formatted at 2026-08-12 08:03:16 on dist-test-slave-8hhm"
I20260812 08:03:31.791119 17120 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:31.804519 17120 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:31.805181 17120 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:31.805433 17120 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:31.807261 17152 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260812 08:03:31.810918 17120 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 08:03:31.810993 17120 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.004s	user 0.000s	sys 0.000s
I20260812 08:03:31.811053 17120 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260812 08:03:31.813290 17120 ts_tablet_manager.cc:616] Registered 1 tablets
I20260812 08:03:31.813360 17120 ts_tablet_manager.cc:595] Time spent register tablets: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:03:31.813741 17152 tablet_bootstrap.cc:492] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947: Bootstrap starting.
I20260812 08:03:31.826745 17120 rpc_server.cc:307] RPC server started. Bound to: 127.12.187.66:41261
I20260812 08:03:31.826761 17356 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.187.66:41261 every 8 connection(s)
I20260812 08:03:31.828043 17120 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-1/data/info.pb
I20260812 08:03:31.829743 17357 heartbeater.cc:344] Connected to a master server at 127.12.187.126:36763
I20260812 08:03:31.829921 17357 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:31.830323 17357 heartbeater.cc:507] Master 127.12.187.126:36763 requested a full tablet report, sending...
I20260812 08:03:31.830714 13037 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu as pid 17120
I20260812 08:03:31.832038 15107 ts_manager.cc:194] Re-registered known tserver with Master: 1af245ab88fa4a69a4e94a41cfa1c947 (127.12.187.66:41261)
I20260812 08:03:31.832808 15107 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.12.187.66:50415
I20260812 08:03:31.833024 17152 log.cc:826] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947: Log is configured to *not* fsync() on all Append() calls
I20260812 08:03:31.839771 17152 tablet_bootstrap.cc:492] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=2 applied=10 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 08:03:31.840133 17152 tablet_bootstrap.cc:492] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947: Bootstrap complete.
I20260812 08:03:31.841305 17152 ts_tablet_manager.cc:1403] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947: Time spent bootstrapping tablet: real 0.028s	user 0.021s	sys 0.005s
I20260812 08:03:31.843624 17152 raft_consensus.cc:359] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 9 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } }
I20260812 08:03:31.843957 17152 raft_consensus.cc:740] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 9 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1af245ab88fa4a69a4e94a41cfa1c947, State: Initialized, Role: FOLLOWER
I20260812 08:03:31.844439 17152 consensus_queue.cc:260] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } }
I20260812 08:03:31.845011 17361 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 9 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:31.845067 17357 heartbeater.cc:499] Master 127.12.187.126:36763 was elected leader, sending a full tablet report...
I20260812 08:03:31.845153 17361 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 08:03:31.845294 17152 ts_tablet_manager.cc:1434] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260812 08:03:31.856694 17282 raft_consensus.cc:3060] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 9 FOLLOWER]: Advancing to term 10
I20260812 08:03:31.860512 17361 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: New leader 7e87a26275e4471f8960440233b86bc7. Latest consensus state: current_term: 10 leader_uuid: "7e87a26275e4471f8960440233b86bc7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:31.860612 17361 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 08:03:31.859884 17367 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 10 leader_uuid: "7e87a26275e4471f8960440233b86bc7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:31.860762 17367 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 08:03:31.899747 17089 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 10 leader_uuid: "7e87a26275e4471f8960440233b86bc7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:31.899927 17089 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: LEADER
I20260812 08:03:32.832698 13037 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu with pid 16817
I20260812 08:03:32.843247 17369 raft_consensus.cc:493] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7e87a26275e4471f8960440233b86bc7)
I20260812 08:03:32.843464 17369 raft_consensus.cc:515] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } }
I20260812 08:03:32.844950 17369 leader_election.cc:290] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7e87a26275e4471f8960440233b86bc7 (127.12.187.65:43717), e34cdbd5bd04469e92a6e15e7ae007a8 (127.12.187.67:33175)
I20260812 08:03:32.848817 16363 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9160eee4cc4be28bce822ec9b2fdc0" candidate_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" is_pre_election: true
W20260812 08:03:32.851897 17373 negotiation.cc:336] Failed RPC negotiation. Trace:
0812 08:03:32.845287 (+     0us) reactor.cc:730] Submitting negotiation task for client connection to 127.12.187.65:43717 (local address 127.12.187.66:43157)
0812 08:03:32.845605 (+   318us) negotiation.cc:107] Waiting for socket to connect
0812 08:03:32.845618 (+    13us) client_negotiation.cc:175] Beginning negotiation
0812 08:03:32.845680 (+    62us) client_negotiation.cc:262] Sending NEGOTIATE NegotiatePB request
0812 08:03:32.851258 (+  5578us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.187.65:43717: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
Metrics: {"client-negotiator.queue_time_us":223,"thread_start_us":42,"threads_started":1}
W20260812 08:03:32.852113 17145 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.187.65:43717: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 08:03:32.853190 17145 leader_election.cc:336] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 7e87a26275e4471f8960440233b86bc7 (127.12.187.65:43717): Network error: Client connection negotiation failed: client connection to 127.12.187.65:43717: connect: Connection refused (error 111)
I20260812 08:03:32.853341 17145 leader_election.cc:304] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1af245ab88fa4a69a4e94a41cfa1c947; no voters: 7e87a26275e4471f8960440233b86bc7, e34cdbd5bd04469e92a6e15e7ae007a8
I20260812 08:03:32.853596 17369 raft_consensus.cc:2749] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260812 08:03:32.872010 15945 meta_cache.cc:302] tablet 0f9160eee4cc4be28bce822ec9b2fdc0: replica 7e87a26275e4471f8960440233b86bc7 (127.12.187.65:43717) has failed: Network error: Client connection negotiation failed: client connection to 127.12.187.65:43717: connect: Connection refused (error 111)
I20260812 08:03:32.874591 17388 raft_consensus.cc:493] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 7e87a26275e4471f8960440233b86bc7)
I20260812 08:03:32.874692 17388 raft_consensus.cc:515] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } }
I20260812 08:03:32.875195 17388 leader_election.cc:290] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 7e87a26275e4471f8960440233b86bc7 (127.12.187.65:43717), 1af245ab88fa4a69a4e94a41cfa1c947 (127.12.187.66:41261)
W20260812 08:03:32.876729 16258 leader_election.cc:336] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 7e87a26275e4471f8960440233b86bc7 (127.12.187.65:43717): Network error: Client connection negotiation failed: client connection to 127.12.187.65:43717: connect: Connection refused (error 111)
I20260812 08:03:32.879040 17282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9160eee4cc4be28bce822ec9b2fdc0" candidate_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" is_pre_election: true
I20260812 08:03:32.879268 17282 raft_consensus.cc:2468] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e34cdbd5bd04469e92a6e15e7ae007a8 in term 10.
I20260812 08:03:32.879623 16258 leader_election.cc:304] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1af245ab88fa4a69a4e94a41cfa1c947, e34cdbd5bd04469e92a6e15e7ae007a8; no voters: 7e87a26275e4471f8960440233b86bc7
I20260812 08:03:32.879803 17388 raft_consensus.cc:2804] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260812 08:03:32.879877 17388 raft_consensus.cc:493] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 7e87a26275e4471f8960440233b86bc7)
I20260812 08:03:32.879911 17388 raft_consensus.cc:3060] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 10 FOLLOWER]: Advancing to term 11
I20260812 08:03:32.880748 17388 raft_consensus.cc:515] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } }
I20260812 08:03:32.881318 17388 leader_election.cc:290] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [CANDIDATE]: Term 11 election: Requested vote from peers 7e87a26275e4471f8960440233b86bc7 (127.12.187.65:43717), 1af245ab88fa4a69a4e94a41cfa1c947 (127.12.187.66:41261)
I20260812 08:03:32.881922 17282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f9160eee4cc4be28bce822ec9b2fdc0" candidate_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "1af245ab88fa4a69a4e94a41cfa1c947"
I20260812 08:03:32.882040 17282 raft_consensus.cc:3060] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 10 FOLLOWER]: Advancing to term 11
I20260812 08:03:32.883186 17282 raft_consensus.cc:2468] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e34cdbd5bd04469e92a6e15e7ae007a8 in term 11.
I20260812 08:03:32.883651 16258 leader_election.cc:304] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1af245ab88fa4a69a4e94a41cfa1c947, e34cdbd5bd04469e92a6e15e7ae007a8; no voters: 
I20260812 08:03:32.883989 17388 raft_consensus.cc:2804] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 11 FOLLOWER]: Leader election won for term 11
I20260812 08:03:32.884220 17388 raft_consensus.cc:697] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [term 11 LEADER]: Becoming Leader. State: Replica: e34cdbd5bd04469e92a6e15e7ae007a8, State: Running, Role: LEADER
I20260812 08:03:32.884558 17388 consensus_queue.cc:237] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } }
W20260812 08:03:32.886595 16258 leader_election.cc:336] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 7e87a26275e4471f8960440233b86bc7 (127.12.187.65:43717): Network error: Client connection negotiation failed: client connection to 127.12.187.65:43717: connect: Connection refused (error 111)
I20260812 08:03:32.887871 15107 catalog_manager.cc:5719] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 reported cstate change: term changed from 10 to 11, leader changed from 7e87a26275e4471f8960440233b86bc7 (127.12.187.65) to e34cdbd5bd04469e92a6e15e7ae007a8 (127.12.187.67). New cstate: current_term: 11 leader_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } health_report { overall_health: HEALTHY } } }
I20260812 08:03:32.888736 17395 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: New leader e34cdbd5bd04469e92a6e15e7ae007a8. Latest consensus state: current_term: 11 leader_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:32.888880 17395 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: LEADER
I20260812 08:03:32.889842 17399 txn_status_manager.cc:874] Waiting until node catch up with all replicated operations in previous term...
I20260812 08:03:32.889997 17399 txn_status_manager.cc:930] Loading transaction status metadata into memory...
W20260812 08:03:32.918529 15157 rpcz_store.cc:267] Call kudu.transactions.TxnManagerService.KeepTransactionAlive from 127.0.0.1:33028 (request call id 147) took 47 ms (client timeout 50 ms). Trace:
W20260812 08:03:32.918639 15157 rpcz_store.cc:269] 0812 08:03:32.871111 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:03:32.871193 (+    82us) service_pool.cc:224] Handling call
0812 08:03:32.918499 (+ 47306us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260812 08:03:32.924486 17283 raft_consensus.cc:1275] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 1af245ab88fa4a69a4e94a41cfa1c947 [term 11 FOLLOWER]: Refusing update from remote peer e34cdbd5bd04469e92a6e15e7ae007a8: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260812 08:03:32.925119 17395 consensus_queue.cc:1048] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260812 08:03:32.926528 17369 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: New leader e34cdbd5bd04469e92a6e15e7ae007a8. Latest consensus state: current_term: 11 leader_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:32.926635 17369 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 08:03:32.928620 17395 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 11 leader_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:32.928726 17395 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: LEADER
I20260812 08:03:32.928853 17369 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 11 leader_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:32.928944 17369 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: FOLLOWER
W20260812 08:03:32.931299 16258 consensus_peers.cc:597] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 -> Peer 7e87a26275e4471f8960440233b86bc7 (127.12.187.65:43717): Couldn't send request to peer 7e87a26275e4471f8960440233b86bc7. Status: Network error: Client connection negotiation failed: client connection to 127.12.187.65:43717: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 08:03:32.937026 13037 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu
/tmp/dist-test-tasksRvS6i/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.187.65:43717
--local_ip_for_outbound_sockets=127.12.187.65
--tserver_master_addrs=127.12.187.126:36763
--webserver_port=34711
--webserver_interface=127.12.187.65
--builtin_ntp_servers=127.12.187.84:33799
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--txn_keepalive_interval_ms=500
--txn_staleness_tracker_interval_ms=100
--txn_staleness_tracker_disabled_interval_ms=100
--raft_heartbeat_interval_ms=50
--leader_failure_max_missed_heartbeat_periods=1.25
--enable_txn_system_client_init=true
--txn_schedule_background_tasks=false with env {}
W20260812 08:03:33.048470 17411 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:33.048733 17411 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:33.048811 17411 flags.cc:432] Enabled unsafe flag: --txn_schedule_background_tasks=false
W20260812 08:03:33.048887 17411 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:03:33.052254 17411 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:33.052392 17411 flags.cc:432] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 08:03:33.052455 17411 flags.cc:432] Enabled experimental flag: --txn_staleness_tracker_interval_ms=100
W20260812 08:03:33.052492 17411 flags.cc:432] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 08:03:33.052587 17411 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.187.65
I20260812 08:03:33.056635 17411 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.187.84:33799
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1.25
--raft_heartbeat_interval_ms=50
--fs_data_dirs=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.187.65:43717
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.187.65
--webserver_port=34711
--txn_keepalive_interval_ms=500
--txn_schedule_background_tasks=false
--txn_staleness_tracker_interval_ms=100
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.187.126:36763
--txn_staleness_tracker_disabled_interval_ms=100
--never_fsync=true
--heap_profile_path=/tmp/kudu.17411
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.187.65

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:33.057821 17411 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:33.058934 17411 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 08:03:33.061682 17411 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 08:03:33.065651 17425 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:33.065659 17423 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:33.065891 17411 server_base.cc:1061] running on GCE node
W20260812 08:03:33.065657 17429 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:33.066371 17411 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:33.066998 17411 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:33.068188 17411 hybrid_clock.cc:648] HybridClock initialized: now 1786521813068166 us; error 32 us; skew 500 ppm
I20260812 08:03:33.070034 17411 webserver.cc:533] Webserver started at http://127.12.187.65:34711/ using document root <none> and password file <none>
I20260812 08:03:33.070592 17411 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:33.070653 17411 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:33.074358 17411 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 08:03:33.076381 17438 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:33.077430 17411 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 08:03:33.077555 17411 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-0/wal
uuid: "7e87a26275e4471f8960440233b86bc7"
format_stamp: "Formatted at 2026-08-12 08:03:16 on dist-test-slave-8hhm"
I20260812 08:03:33.077975 17411 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:33.091074 17411 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:33.091703 17411 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:33.091913 17411 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:33.093950 17462 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260812 08:03:33.097713 17411 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 08:03:33.097798 17411 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.004s	user 0.001s	sys 0.000s
I20260812 08:03:33.097880 17411 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260812 08:03:33.100071 17411 ts_tablet_manager.cc:616] Registered 1 tablets
I20260812 08:03:33.100152 17411 ts_tablet_manager.cc:595] Time spent register tablets: real 0.002s	user 0.000s	sys 0.000s
I20260812 08:03:33.100505 17462 tablet_bootstrap.cc:492] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7: Bootstrap starting.
I20260812 08:03:33.112840 17411 rpc_server.cc:307] RPC server started. Bound to: 127.12.187.65:43717
I20260812 08:03:33.113647 17669 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.187.65:43717 every 8 connection(s)
I20260812 08:03:33.114154 17411 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances.1786521787214093-13037-0/minicluster-data/ts-0/data/info.pb
I20260812 08:03:33.115638 13037 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu as pid 17411
I20260812 08:03:33.116714 17670 heartbeater.cc:344] Connected to a master server at 127.12.187.126:36763
I20260812 08:03:33.117239 17670 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:33.117700 17670 heartbeater.cc:507] Master 127.12.187.126:36763 requested a full tablet report, sending...
I20260812 08:03:33.118521 17462 log.cc:826] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7: Log is configured to *not* fsync() on all Append() calls
I20260812 08:03:33.119470 15106 ts_manager.cc:194] Re-registered known tserver with Master: 7e87a26275e4471f8960440233b86bc7 (127.12.187.65:43717)
I20260812 08:03:33.120246 15106 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.12.187.65:54617
I20260812 08:03:33.125517 17462 tablet_bootstrap.cc:492] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 08:03:33.125900 17462 tablet_bootstrap.cc:492] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7: Bootstrap complete.
I20260812 08:03:33.127081 17462 ts_tablet_manager.cc:1403] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.011s
I20260812 08:03:33.129901 17462 raft_consensus.cc:359] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 10 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } }
I20260812 08:03:33.130281 17462 raft_consensus.cc:740] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 10 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7e87a26275e4471f8960440233b86bc7, State: Initialized, Role: FOLLOWER
I20260812 08:03:33.130784 17462 consensus_queue.cc:260] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } }
I20260812 08:03:33.131389 17674 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 10 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:33.131454 17670 heartbeater.cc:499] Master 127.12.187.126:36763 was elected leader, sending a full tablet report...
I20260812 08:03:33.131546 17674 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 08:03:33.131693 17462 ts_tablet_manager.cc:1434] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.001s
I20260812 08:03:33.145601 17592 raft_consensus.cc:3060] T 0f9160eee4cc4be28bce822ec9b2fdc0 P 7e87a26275e4471f8960440233b86bc7 [term 10 FOLLOWER]: Advancing to term 11
I20260812 08:03:33.148779 17678 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 11 leader_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:33.148967 17678 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 08:03:33.149318 17674 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: New leader e34cdbd5bd04469e92a6e15e7ae007a8. Latest consensus state: current_term: 11 leader_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:33.149452 17674 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 08:03:33.181188 17388 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 11 leader_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7e87a26275e4471f8960440233b86bc7" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 43717 } } peers { permanent_uuid: "1af245ab88fa4a69a4e94a41cfa1c947" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 41261 } } peers { permanent_uuid: "e34cdbd5bd04469e92a6e15e7ae007a8" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 33175 } } }
I20260812 08:03:33.181401 17388 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: LEADER
I20260812 08:03:34.625782 16266 txn_status_manager.cc:1391] automatically aborted stale txn (ID 0) past 0.575s from last keepalive heartbeat (effective timeout is 0.500s)
I20260812 08:03:34.651262 13037 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu with pid 17411
W20260812 08:03:34.668483 16258 connection.cc:573] client connection to 127.12.187.65:43717 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260812 08:03:34.668617 16258 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107) [suppressed 8 similar messages]
I20260812 08:03:34.668903 13037 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu with pid 17120
W20260812 08:03:34.675431 16258 consensus_peers.cc:597] T 0f9160eee4cc4be28bce822ec9b2fdc0 P e34cdbd5bd04469e92a6e15e7ae007a8 -> Peer 7e87a26275e4471f8960440233b86bc7 (127.12.187.65:43717): Couldn't send request to peer 7e87a26275e4471f8960440233b86bc7. Status: Network error: Client connection negotiation failed: client connection to 127.12.187.65:43717: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260812 08:03:34.680608 16258 connection.cc:573] client connection to 127.12.187.66:41261 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260812 08:03:34.681337 13037 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu with pid 16235
I20260812 08:03:34.693900 13037 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu with pid 15049
2026-08-12T08:03:34Z chronyd exiting
[       OK ] TxnStatusManagerITest.TxnKeepAliveMultiTxnStatusManagerInstances (18586 ms)
[ RUN      ] TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted
2026-08-12T08:03:34Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
2026-08-12T08:03:34Z Disabled control of system clock
I20260812 08:03:34.735628 13037 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu
/tmp/dist-test-tasksRvS6i/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.187.126:38357
--webserver_interface=127.12.187.126
--webserver_port=0
--builtin_ntp_servers=127.12.187.84:41599
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.187.126:38357
--txn_manager_enabled=true
--txn_manager_lazily_initialized=false with env {}
W20260812 08:03:34.838539 17710 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:34.838764 17710 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:34.838804 17710 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:03:34.842036 17710 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
W20260812 08:03:34.842092 17710 flags.cc:432] Enabled experimental flag: --txn_manager_enabled=true
W20260812 08:03:34.842109 17710 flags.cc:432] Enabled experimental flag: --txn_manager_lazily_initialized=false
W20260812 08:03:34.842125 17710 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:34.842144 17710 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260812 08:03:34.842160 17710 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
I20260812 08:03:34.845955 17710 master_runner.cc:387] Master server non-default flags:
--log_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.187.84:41599
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.187.126:38357
--txn_manager_enabled=true
--txn_manager_lazily_initialized=false
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.187.126:38357
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.187.126
--webserver_port=0
--never_fsync=true
--heap_profile_path=/tmp/kudu.17710
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false

Master server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:34.846971 17710 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:34.847998 17710 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:03:34.853489 17720 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:34.853678 17723 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:34.853489 17725 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:34.853797 17710 server_base.cc:1061] running on GCE node
I20260812 08:03:34.854382 17710 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:34.855235 17710 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:34.856419 17710 hybrid_clock.cc:648] HybridClock initialized: now 1786521814856400 us; error 43 us; skew 500 ppm
I20260812 08:03:34.858177 17710 webserver.cc:533] Webserver started at http://127.12.187.126:37565/ using document root <none> and password file <none>
I20260812 08:03:34.858776 17710 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:34.858860 17710 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:34.859078 17710 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:03:34.860561 17710 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/master-0/data/instance:
uuid: "68ee688481834a658e0e93b7976cd214"
format_stamp: "Formatted at 2026-08-12 08:03:34 on dist-test-slave-8hhm"
I20260812 08:03:34.861042 17710 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/master-0/wal/instance:
uuid: "68ee688481834a658e0e93b7976cd214"
format_stamp: "Formatted at 2026-08-12 08:03:34 on dist-test-slave-8hhm"
I20260812 08:03:34.864182 17710 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.001s	sys 0.001s
I20260812 08:03:34.866236 17734 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:34.867185 17710 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260812 08:03:34.867319 17710 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/master-0/data,/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/master-0/wal
uuid: "68ee688481834a658e0e93b7976cd214"
format_stamp: "Formatted at 2026-08-12 08:03:34 on dist-test-slave-8hhm"
I20260812 08:03:34.867417 17710 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:34.880970 17710 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:34.881832 17710 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:34.882023 17710 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:34.892309 17710 rpc_server.cc:307] RPC server started. Bound to: 127.12.187.126:38357
I20260812 08:03:34.892325 17851 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.187.126:38357 every 8 connection(s)
I20260812 08:03:34.893391 17710 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/master-0/data/info.pb
I20260812 08:03:34.896267 17852 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:03:34.901192 13037 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu as pid 17710
I20260812 08:03:34.901360 13037 external_mini_cluster.cc:1448] Reading /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/master-0/wal/instance
I20260812 08:03:34.902037 17852 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 68ee688481834a658e0e93b7976cd214: Bootstrap starting.
I20260812 08:03:34.904603 17852 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 68ee688481834a658e0e93b7976cd214: Neither blocks nor log segments found. Creating new log.
I20260812 08:03:34.905407 17852 log.cc:826] T 00000000000000000000000000000000 P 68ee688481834a658e0e93b7976cd214: Log is configured to *not* fsync() on all Append() calls
I20260812 08:03:34.907030 17852 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 68ee688481834a658e0e93b7976cd214: No bootstrap required, opened a new log
I20260812 08:03:34.910015 17852 raft_consensus.cc:359] T 00000000000000000000000000000000 P 68ee688481834a658e0e93b7976cd214 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68ee688481834a658e0e93b7976cd214" member_type: VOTER last_known_addr { host: "127.12.187.126" port: 38357 } }
I20260812 08:03:34.910220 17852 raft_consensus.cc:385] T 00000000000000000000000000000000 P 68ee688481834a658e0e93b7976cd214 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:03:34.910298 17852 raft_consensus.cc:740] T 00000000000000000000000000000000 P 68ee688481834a658e0e93b7976cd214 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68ee688481834a658e0e93b7976cd214, State: Initialized, Role: FOLLOWER
I20260812 08:03:34.910715 17852 consensus_queue.cc:260] T 00000000000000000000000000000000 P 68ee688481834a658e0e93b7976cd214 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68ee688481834a658e0e93b7976cd214" member_type: VOTER last_known_addr { host: "127.12.187.126" port: 38357 } }
I20260812 08:03:34.910876 17852 raft_consensus.cc:399] T 00000000000000000000000000000000 P 68ee688481834a658e0e93b7976cd214 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260812 08:03:34.910972 17852 raft_consensus.cc:493] T 00000000000000000000000000000000 P 68ee688481834a658e0e93b7976cd214 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260812 08:03:34.911105 17852 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 68ee688481834a658e0e93b7976cd214 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:03:34.911954 17852 raft_consensus.cc:515] T 00000000000000000000000000000000 P 68ee688481834a658e0e93b7976cd214 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68ee688481834a658e0e93b7976cd214" member_type: VOTER last_known_addr { host: "127.12.187.126" port: 38357 } }
I20260812 08:03:34.912299 17852 leader_election.cc:304] T 00000000000000000000000000000000 P 68ee688481834a658e0e93b7976cd214 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 68ee688481834a658e0e93b7976cd214; no voters: 
I20260812 08:03:34.912624 17852 leader_election.cc:290] T 00000000000000000000000000000000 P 68ee688481834a658e0e93b7976cd214 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260812 08:03:34.912719 17858 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 68ee688481834a658e0e93b7976cd214 [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:03:34.912931 17858 raft_consensus.cc:697] T 00000000000000000000000000000000 P 68ee688481834a658e0e93b7976cd214 [term 1 LEADER]: Becoming Leader. State: Replica: 68ee688481834a658e0e93b7976cd214, State: Running, Role: LEADER
I20260812 08:03:34.913303 17858 consensus_queue.cc:237] T 00000000000000000000000000000000 P 68ee688481834a658e0e93b7976cd214 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68ee688481834a658e0e93b7976cd214" member_type: VOTER last_known_addr { host: "127.12.187.126" port: 38357 } }
I20260812 08:03:34.913867 17852 sys_catalog.cc:565] T 00000000000000000000000000000000 P 68ee688481834a658e0e93b7976cd214 [sys.catalog]: configured and running, proceeding with master startup.
I20260812 08:03:34.915028 17859 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68ee688481834a658e0e93b7976cd214 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 68ee688481834a658e0e93b7976cd214. Latest consensus state: current_term: 1 leader_uuid: "68ee688481834a658e0e93b7976cd214" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68ee688481834a658e0e93b7976cd214" member_type: VOTER last_known_addr { host: "127.12.187.126" port: 38357 } } }
I20260812 08:03:34.915163 17859 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68ee688481834a658e0e93b7976cd214 [sys.catalog]: This master's current role is: LEADER
I20260812 08:03:34.915186 17860 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68ee688481834a658e0e93b7976cd214 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "68ee688481834a658e0e93b7976cd214" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68ee688481834a658e0e93b7976cd214" member_type: VOTER last_known_addr { host: "127.12.187.126" port: 38357 } } }
I20260812 08:03:34.915294 17860 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68ee688481834a658e0e93b7976cd214 [sys.catalog]: This master's current role is: LEADER
I20260812 08:03:34.916102 17876 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260812 08:03:34.918959 17876 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260812 08:03:34.924450 17876 catalog_manager.cc:1383] Generated new cluster ID: 2273b3c146d84f31a1df9dce65bd8737
I20260812 08:03:34.924535 17876 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260812 08:03:34.941805 17876 catalog_manager.cc:1406] Generated new certificate authority record
I20260812 08:03:34.942636 17876 catalog_manager.cc:1540] Loading token signing keys...
I20260812 08:03:34.948962 17876 catalog_manager.cc:6092] T 00000000000000000000000000000000 P 68ee688481834a658e0e93b7976cd214: Generated new TSK 0
I20260812 08:03:34.949575 17876 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260812 08:03:34.953747 13037 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu
/tmp/dist-test-tasksRvS6i/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.187.65:0
--local_ip_for_outbound_sockets=127.12.187.65
--webserver_interface=127.12.187.65
--webserver_port=0
--tserver_master_addrs=127.12.187.126:38357
--builtin_ntp_servers=127.12.187.84:41599
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--txn_keepalive_interval_ms=500
--txn_staleness_tracker_interval_ms=100
--txn_staleness_tracker_disabled_interval_ms=100
--raft_heartbeat_interval_ms=50
--leader_failure_max_missed_heartbeat_periods=1.25
--enable_txn_system_client_init=true
--txn_schedule_background_tasks=false with env {}
I20260812 08:03:34.957000 17757 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55398:
name: "kudu_system.kudu_transactions"
schema {
  columns {
    name: "txn_id"
    type: INT64
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "entry_type"
    type: INT8
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "identifier"
    type: STRING
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "metadata"
    type: STRING
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
  indirect_data: "<redacted>"""
}
partition_schema {
  range_schema {
    columns {
      name: "txn_id"
    }
  }
}
table_type: TXN_STATUS_TABLE
W20260812 08:03:34.963069 17852 master.cc:465] Invalid argument: unable to initialize TxnManager: Error creating table kudu_system.kudu_transactions on the master: not enough live tablet servers to create a table with the requested replication factor 3; 0 tablet servers are alive: unable to init TxnManager, will retry in 1.000s
W20260812 08:03:35.060070 17909 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:35.060322 17909 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:35.060392 17909 flags.cc:432] Enabled unsafe flag: --txn_schedule_background_tasks=false
W20260812 08:03:35.060469 17909 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:03:35.063854 17909 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:35.063985 17909 flags.cc:432] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 08:03:35.064049 17909 flags.cc:432] Enabled experimental flag: --txn_staleness_tracker_interval_ms=100
W20260812 08:03:35.064086 17909 flags.cc:432] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 08:03:35.064174 17909 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.187.65
I20260812 08:03:35.068130 17909 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.187.84:41599
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1.25
--raft_heartbeat_interval_ms=50
--fs_data_dirs=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.187.65:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.187.65
--webserver_port=0
--txn_keepalive_interval_ms=500
--txn_schedule_background_tasks=false
--txn_staleness_tracker_interval_ms=100
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.187.126:38357
--txn_staleness_tracker_disabled_interval_ms=100
--never_fsync=true
--heap_profile_path=/tmp/kudu.17909
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.187.65

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:35.069518 17909 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:35.070873 17909 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 08:03:35.073734 17909 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 08:03:35.077524 17925 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:35.077622 17929 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:35.077540 17932 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:35.077889 17909 server_base.cc:1061] running on GCE node
I20260812 08:03:35.078369 17909 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:35.078900 17909 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:35.080083 17909 hybrid_clock.cc:648] HybridClock initialized: now 1786521815080068 us; error 31 us; skew 500 ppm
I20260812 08:03:35.082062 17909 webserver.cc:533] Webserver started at http://127.12.187.65:44231/ using document root <none> and password file <none>
I20260812 08:03:35.082643 17909 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:35.082724 17909 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:35.082924 17909 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:03:35.084468 17909 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-0/data/instance:
uuid: "aed0136dfde34e368645c8cc3d6bd15b"
format_stamp: "Formatted at 2026-08-12 08:03:35 on dist-test-slave-8hhm"
I20260812 08:03:35.084970 17909 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-0/wal/instance:
uuid: "aed0136dfde34e368645c8cc3d6bd15b"
format_stamp: "Formatted at 2026-08-12 08:03:35 on dist-test-slave-8hhm"
I20260812 08:03:35.088476 17909 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.002s	sys 0.000s
I20260812 08:03:35.090731 17939 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:35.091641 17909 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260812 08:03:35.091784 17909 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-0/wal
uuid: "aed0136dfde34e368645c8cc3d6bd15b"
format_stamp: "Formatted at 2026-08-12 08:03:35 on dist-test-slave-8hhm"
I20260812 08:03:35.091883 17909 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:35.102332 17909 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:35.102927 17909 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:35.103114 17909 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:35.104661 17909 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:03:35.104738 17909 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:35.104789 17909 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:03:35.104809 17909 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:35.116438 17909 rpc_server.cc:307] RPC server started. Bound to: 127.12.187.65:32969
I20260812 08:03:35.116736 18174 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.187.65:32969 every 8 connection(s)
I20260812 08:03:35.117547 17909 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-0/data/info.pb
I20260812 08:03:35.118932 18175 heartbeater.cc:344] Connected to a master server at 127.12.187.126:38357
I20260812 08:03:35.119107 18175 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:35.119550 18175 heartbeater.cc:507] Master 127.12.187.126:38357 requested a full tablet report, sending...
I20260812 08:03:35.121033 17757 ts_manager.cc:194] Registered new tserver with Master: aed0136dfde34e368645c8cc3d6bd15b (127.12.187.65:32969)
I20260812 08:03:35.121196 13037 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu as pid 17909
I20260812 08:03:35.121341 13037 external_mini_cluster.cc:1448] Reading /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-0/wal/instance
I20260812 08:03:35.122536 17757 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.12.187.65:49245
I20260812 08:03:35.123589 13037 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu
/tmp/dist-test-tasksRvS6i/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.187.66:0
--local_ip_for_outbound_sockets=127.12.187.66
--webserver_interface=127.12.187.66
--webserver_port=0
--tserver_master_addrs=127.12.187.126:38357
--builtin_ntp_servers=127.12.187.84:41599
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--txn_keepalive_interval_ms=500
--txn_staleness_tracker_interval_ms=100
--txn_staleness_tracker_disabled_interval_ms=100
--raft_heartbeat_interval_ms=50
--leader_failure_max_missed_heartbeat_periods=1.25
--enable_txn_system_client_init=true
--txn_schedule_background_tasks=false with env {}
W20260812 08:03:35.231159 18179 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:35.231369 18179 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:35.231410 18179 flags.cc:432] Enabled unsafe flag: --txn_schedule_background_tasks=false
W20260812 08:03:35.231472 18179 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:03:35.234813 18179 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:35.234896 18179 flags.cc:432] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 08:03:35.234916 18179 flags.cc:432] Enabled experimental flag: --txn_staleness_tracker_interval_ms=100
W20260812 08:03:35.234932 18179 flags.cc:432] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 08:03:35.235060 18179 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.187.66
I20260812 08:03:35.238821 18179 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.187.84:41599
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1.25
--raft_heartbeat_interval_ms=50
--fs_data_dirs=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.187.66:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.187.66
--webserver_port=0
--txn_keepalive_interval_ms=500
--txn_schedule_background_tasks=false
--txn_staleness_tracker_interval_ms=100
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.187.126:38357
--txn_staleness_tracker_disabled_interval_ms=100
--never_fsync=true
--heap_profile_path=/tmp/kudu.18179
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.187.66

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:35.239916 18179 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:35.240985 18179 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 08:03:35.243620 18179 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 08:03:35.247313 18186 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:35.247339 18190 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:35.247310 18188 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:35.247645 18179 server_base.cc:1061] running on GCE node
I20260812 08:03:35.248075 18179 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:35.248649 18179 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:35.249823 18179 hybrid_clock.cc:648] HybridClock initialized: now 1786521815249809 us; error 36 us; skew 500 ppm
I20260812 08:03:35.251551 18179 webserver.cc:533] Webserver started at http://127.12.187.66:42347/ using document root <none> and password file <none>
I20260812 08:03:35.252153 18179 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:35.252241 18179 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:35.252485 18179 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:03:35.254078 18179 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-1/data/instance:
uuid: "a1b8378df7664117ab93c277ce1bbc83"
format_stamp: "Formatted at 2026-08-12 08:03:35 on dist-test-slave-8hhm"
I20260812 08:03:35.254516 18179 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-1/wal/instance:
uuid: "a1b8378df7664117ab93c277ce1bbc83"
format_stamp: "Formatted at 2026-08-12 08:03:35 on dist-test-slave-8hhm"
I20260812 08:03:35.257813 18179 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.001s
I20260812 08:03:35.260097 18201 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:35.261099 18179 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260812 08:03:35.261257 18179 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-1/wal
uuid: "a1b8378df7664117ab93c277ce1bbc83"
format_stamp: "Formatted at 2026-08-12 08:03:35 on dist-test-slave-8hhm"
I20260812 08:03:35.261363 18179 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:35.279291 18179 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:35.279964 18179 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:35.280156 18179 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:35.281855 18179 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:03:35.281929 18179 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:35.282012 18179 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:03:35.282055 18179 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:35.293076 18179 rpc_server.cc:307] RPC server started. Bound to: 127.12.187.66:46047
I20260812 08:03:35.293152 18411 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.187.66:46047 every 8 connection(s)
I20260812 08:03:35.294037 18179 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-1/data/info.pb
I20260812 08:03:35.295383 18412 heartbeater.cc:344] Connected to a master server at 127.12.187.126:38357
I20260812 08:03:35.295547 18412 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:35.296114 18412 heartbeater.cc:507] Master 127.12.187.126:38357 requested a full tablet report, sending...
I20260812 08:03:35.297109 17757 ts_manager.cc:194] Registered new tserver with Master: a1b8378df7664117ab93c277ce1bbc83 (127.12.187.66:46047)
I20260812 08:03:35.297678 17757 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.12.187.66:56559
I20260812 08:03:35.300333 13037 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu as pid 18179
I20260812 08:03:35.300416 13037 external_mini_cluster.cc:1448] Reading /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-1/wal/instance
I20260812 08:03:35.302434 13037 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu
/tmp/dist-test-tasksRvS6i/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.187.67:0
--local_ip_for_outbound_sockets=127.12.187.67
--webserver_interface=127.12.187.67
--webserver_port=0
--tserver_master_addrs=127.12.187.126:38357
--builtin_ntp_servers=127.12.187.84:41599
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--txn_keepalive_interval_ms=500
--txn_staleness_tracker_interval_ms=100
--txn_staleness_tracker_disabled_interval_ms=100
--raft_heartbeat_interval_ms=50
--leader_failure_max_missed_heartbeat_periods=1.25
--enable_txn_system_client_init=true
--txn_schedule_background_tasks=false with env {}
W20260812 08:03:35.408039 18415 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:35.408289 18415 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:35.408357 18415 flags.cc:432] Enabled unsafe flag: --txn_schedule_background_tasks=false
W20260812 08:03:35.408429 18415 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:03:35.411845 18415 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:35.411971 18415 flags.cc:432] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 08:03:35.412037 18415 flags.cc:432] Enabled experimental flag: --txn_staleness_tracker_interval_ms=100
W20260812 08:03:35.412075 18415 flags.cc:432] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 08:03:35.412147 18415 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.187.67
I20260812 08:03:35.416304 18415 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.187.84:41599
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1.25
--raft_heartbeat_interval_ms=50
--fs_data_dirs=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.187.67:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.187.67
--webserver_port=0
--txn_keepalive_interval_ms=500
--txn_schedule_background_tasks=false
--txn_staleness_tracker_interval_ms=100
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.187.126:38357
--txn_staleness_tracker_disabled_interval_ms=100
--never_fsync=true
--heap_profile_path=/tmp/kudu.18415
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.187.67

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:35.417469 18415 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:35.418650 18415 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 08:03:35.421407 18415 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 08:03:35.425081 18431 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:35.425140 18426 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:35.425143 18427 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:35.425392 18415 server_base.cc:1061] running on GCE node
I20260812 08:03:35.425779 18415 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:35.426317 18415 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:35.427500 18415 hybrid_clock.cc:648] HybridClock initialized: now 1786521815427487 us; error 35 us; skew 500 ppm
I20260812 08:03:35.429284 18415 webserver.cc:533] Webserver started at http://127.12.187.67:38117/ using document root <none> and password file <none>
I20260812 08:03:35.429836 18415 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:35.429922 18415 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:35.430128 18415 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260812 08:03:35.431644 18415 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-2/data/instance:
uuid: "1fc6cae0de0442baa4f119a7283fc75a"
format_stamp: "Formatted at 2026-08-12 08:03:35 on dist-test-slave-8hhm"
I20260812 08:03:35.432150 18415 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-2/wal/instance:
uuid: "1fc6cae0de0442baa4f119a7283fc75a"
format_stamp: "Formatted at 2026-08-12 08:03:35 on dist-test-slave-8hhm"
I20260812 08:03:35.435446 18415 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260812 08:03:35.437598 18442 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:35.438573 18415 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:03:35.438710 18415 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-2/wal
uuid: "1fc6cae0de0442baa4f119a7283fc75a"
format_stamp: "Formatted at 2026-08-12 08:03:35 on dist-test-slave-8hhm"
I20260812 08:03:35.438822 18415 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:35.457589 18415 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:35.458283 18415 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:35.458484 18415 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:35.460121 18415 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260812 08:03:35.460198 18415 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:35.460255 18415 ts_tablet_manager.cc:616] Registered 0 tablets
I20260812 08:03:35.460278 18415 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:35.472057 18415 rpc_server.cc:307] RPC server started. Bound to: 127.12.187.67:45099
I20260812 08:03:35.472095 18663 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.187.67:45099 every 8 connection(s)
I20260812 08:03:35.473366 18415 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-2/data/info.pb
I20260812 08:03:35.474852 18664 heartbeater.cc:344] Connected to a master server at 127.12.187.126:38357
I20260812 08:03:35.475032 18664 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:35.475545 18664 heartbeater.cc:507] Master 127.12.187.126:38357 requested a full tablet report, sending...
I20260812 08:03:35.476498 17752 ts_manager.cc:194] Registered new tserver with Master: 1fc6cae0de0442baa4f119a7283fc75a (127.12.187.67:45099)
I20260812 08:03:35.477124 17752 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.12.187.67:34641
I20260812 08:03:35.479195 13037 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu as pid 18415
I20260812 08:03:35.479280 13037 external_mini_cluster.cc:1448] Reading /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-2/wal/instance
I20260812 08:03:35.481367 13037 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
I20260812 08:03:35.975432 17752 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55408:
name: "kudu_system.kudu_transactions"
schema {
  columns {
    name: "txn_id"
    type: INT64
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "entry_type"
    type: INT8
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "identifier"
    type: STRING
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "metadata"
    type: STRING
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
  indirect_data: "<redacted>"""
}
partition_schema {
  range_schema {
    columns {
      name: "txn_id"
    }
  }
}
table_type: TXN_STATUS_TABLE
W20260812 08:03:35.976043 17752 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260812 08:03:35.991297 18036 tablet_service.cc:1511] Processing CreateTablet for tablet c711e39865444cbeb9a4e631731530eb (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=43489aa7f8d84748baaee659cd260407]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 08:03:35.991700 18286 tablet_service.cc:1511] Processing CreateTablet for tablet c711e39865444cbeb9a4e631731530eb (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=43489aa7f8d84748baaee659cd260407]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 08:03:35.991953 18540 tablet_service.cc:1511] Processing CreateTablet for tablet c711e39865444cbeb9a4e631731530eb (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=43489aa7f8d84748baaee659cd260407]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260812 08:03:35.992641 18036 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c711e39865444cbeb9a4e631731530eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:03:35.992846 18286 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c711e39865444cbeb9a4e631731530eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:03:35.993009 18540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c711e39865444cbeb9a4e631731530eb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260812 08:03:35.998502 18701 tablet_bootstrap.cc:492] T c711e39865444cbeb9a4e631731530eb P a1b8378df7664117ab93c277ce1bbc83: Bootstrap starting.
I20260812 08:03:35.999559 18705 tablet_bootstrap.cc:492] T c711e39865444cbeb9a4e631731530eb P aed0136dfde34e368645c8cc3d6bd15b: Bootstrap starting.
I20260812 08:03:35.999890 18702 tablet_bootstrap.cc:492] T c711e39865444cbeb9a4e631731530eb P 1fc6cae0de0442baa4f119a7283fc75a: Bootstrap starting.
I20260812 08:03:36.000905 18701 tablet_bootstrap.cc:654] T c711e39865444cbeb9a4e631731530eb P a1b8378df7664117ab93c277ce1bbc83: Neither blocks nor log segments found. Creating new log.
I20260812 08:03:36.001725 18705 tablet_bootstrap.cc:654] T c711e39865444cbeb9a4e631731530eb P aed0136dfde34e368645c8cc3d6bd15b: Neither blocks nor log segments found. Creating new log.
I20260812 08:03:36.001809 18702 tablet_bootstrap.cc:654] T c711e39865444cbeb9a4e631731530eb P 1fc6cae0de0442baa4f119a7283fc75a: Neither blocks nor log segments found. Creating new log.
I20260812 08:03:36.001818 18701 log.cc:826] T c711e39865444cbeb9a4e631731530eb P a1b8378df7664117ab93c277ce1bbc83: Log is configured to *not* fsync() on all Append() calls
I20260812 08:03:36.002502 18705 log.cc:826] T c711e39865444cbeb9a4e631731530eb P aed0136dfde34e368645c8cc3d6bd15b: Log is configured to *not* fsync() on all Append() calls
I20260812 08:03:36.002666 18702 log.cc:826] T c711e39865444cbeb9a4e631731530eb P 1fc6cae0de0442baa4f119a7283fc75a: Log is configured to *not* fsync() on all Append() calls
I20260812 08:03:36.004042 18705 tablet_bootstrap.cc:492] T c711e39865444cbeb9a4e631731530eb P aed0136dfde34e368645c8cc3d6bd15b: No bootstrap required, opened a new log
I20260812 08:03:36.004045 18701 tablet_bootstrap.cc:492] T c711e39865444cbeb9a4e631731530eb P a1b8378df7664117ab93c277ce1bbc83: No bootstrap required, opened a new log
I20260812 08:03:36.004264 18705 ts_tablet_manager.cc:1403] T c711e39865444cbeb9a4e631731530eb P aed0136dfde34e368645c8cc3d6bd15b: Time spent bootstrapping tablet: real 0.005s	user 0.003s	sys 0.000s
I20260812 08:03:36.004271 18701 ts_tablet_manager.cc:1403] T c711e39865444cbeb9a4e631731530eb P a1b8378df7664117ab93c277ce1bbc83: Time spent bootstrapping tablet: real 0.006s	user 0.004s	sys 0.000s
I20260812 08:03:36.007239 18701 raft_consensus.cc:359] T c711e39865444cbeb9a4e631731530eb P a1b8378df7664117ab93c277ce1bbc83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fc6cae0de0442baa4f119a7283fc75a" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 45099 } } peers { permanent_uuid: "aed0136dfde34e368645c8cc3d6bd15b" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 32969 } } peers { permanent_uuid: "a1b8378df7664117ab93c277ce1bbc83" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 46047 } }
I20260812 08:03:36.007416 18701 raft_consensus.cc:385] T c711e39865444cbeb9a4e631731530eb P a1b8378df7664117ab93c277ce1bbc83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:03:36.007448 18701 raft_consensus.cc:740] T c711e39865444cbeb9a4e631731530eb P a1b8378df7664117ab93c277ce1bbc83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1b8378df7664117ab93c277ce1bbc83, State: Initialized, Role: FOLLOWER
I20260812 08:03:36.007534 18705 raft_consensus.cc:359] T c711e39865444cbeb9a4e631731530eb P aed0136dfde34e368645c8cc3d6bd15b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fc6cae0de0442baa4f119a7283fc75a" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 45099 } } peers { permanent_uuid: "aed0136dfde34e368645c8cc3d6bd15b" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 32969 } } peers { permanent_uuid: "a1b8378df7664117ab93c277ce1bbc83" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 46047 } }
I20260812 08:03:36.007750 18705 raft_consensus.cc:385] T c711e39865444cbeb9a4e631731530eb P aed0136dfde34e368645c8cc3d6bd15b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:03:36.007812 18705 raft_consensus.cc:740] T c711e39865444cbeb9a4e631731530eb P aed0136dfde34e368645c8cc3d6bd15b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aed0136dfde34e368645c8cc3d6bd15b, State: Initialized, Role: FOLLOWER
I20260812 08:03:36.007881 18701 consensus_queue.cc:260] T c711e39865444cbeb9a4e631731530eb P a1b8378df7664117ab93c277ce1bbc83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fc6cae0de0442baa4f119a7283fc75a" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 45099 } } peers { permanent_uuid: "aed0136dfde34e368645c8cc3d6bd15b" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 32969 } } peers { permanent_uuid: "a1b8378df7664117ab93c277ce1bbc83" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 46047 } }
I20260812 08:03:36.008262 18705 consensus_queue.cc:260] T c711e39865444cbeb9a4e631731530eb P aed0136dfde34e368645c8cc3d6bd15b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fc6cae0de0442baa4f119a7283fc75a" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 45099 } } peers { permanent_uuid: "aed0136dfde34e368645c8cc3d6bd15b" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 32969 } } peers { permanent_uuid: "a1b8378df7664117ab93c277ce1bbc83" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 46047 } }
I20260812 08:03:36.008631 18711 tablet_replica.cc:442] T c711e39865444cbeb9a4e631731530eb P a1b8378df7664117ab93c277ce1bbc83: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fc6cae0de0442baa4f119a7283fc75a" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 45099 } } peers { permanent_uuid: "aed0136dfde34e368645c8cc3d6bd15b" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 32969 } } peers { permanent_uuid: "a1b8378df7664117ab93c277ce1bbc83" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 46047 } } }
I20260812 08:03:36.008680 18412 heartbeater.cc:499] Master 127.12.187.126:38357 was elected leader, sending a full tablet report...
I20260812 08:03:36.008746 18711 tablet_replica.cc:445] T c711e39865444cbeb9a4e631731530eb P a1b8378df7664117ab93c277ce1bbc83: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 08:03:36.008806 18701 ts_tablet_manager.cc:1434] T c711e39865444cbeb9a4e631731530eb P a1b8378df7664117ab93c277ce1bbc83: Time spent starting tablet: real 0.004s	user 0.005s	sys 0.000s
I20260812 08:03:36.009064 18705 ts_tablet_manager.cc:1434] T c711e39865444cbeb9a4e631731530eb P aed0136dfde34e368645c8cc3d6bd15b: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260812 08:03:36.009405 18175 heartbeater.cc:499] Master 127.12.187.126:38357 was elected leader, sending a full tablet report...
I20260812 08:03:36.010524 18702 tablet_bootstrap.cc:492] T c711e39865444cbeb9a4e631731530eb P 1fc6cae0de0442baa4f119a7283fc75a: No bootstrap required, opened a new log
I20260812 08:03:36.010733 18702 ts_tablet_manager.cc:1403] T c711e39865444cbeb9a4e631731530eb P 1fc6cae0de0442baa4f119a7283fc75a: Time spent bootstrapping tablet: real 0.011s	user 0.003s	sys 0.000s
I20260812 08:03:36.013540 18719 tablet_replica.cc:442] T c711e39865444cbeb9a4e631731530eb P aed0136dfde34e368645c8cc3d6bd15b: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fc6cae0de0442baa4f119a7283fc75a" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 45099 } } peers { permanent_uuid: "aed0136dfde34e368645c8cc3d6bd15b" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 32969 } } peers { permanent_uuid: "a1b8378df7664117ab93c277ce1bbc83" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 46047 } } }
I20260812 08:03:36.013672 18719 tablet_replica.cc:445] T c711e39865444cbeb9a4e631731530eb P aed0136dfde34e368645c8cc3d6bd15b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 08:03:36.013794 18719 raft_consensus.cc:493] T c711e39865444cbeb9a4e631731530eb P aed0136dfde34e368645c8cc3d6bd15b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:03:36.013950 18719 raft_consensus.cc:515] T c711e39865444cbeb9a4e631731530eb P aed0136dfde34e368645c8cc3d6bd15b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fc6cae0de0442baa4f119a7283fc75a" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 45099 } } peers { permanent_uuid: "aed0136dfde34e368645c8cc3d6bd15b" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 32969 } } peers { permanent_uuid: "a1b8378df7664117ab93c277ce1bbc83" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 46047 } }
I20260812 08:03:36.013942 18702 raft_consensus.cc:359] T c711e39865444cbeb9a4e631731530eb P 1fc6cae0de0442baa4f119a7283fc75a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fc6cae0de0442baa4f119a7283fc75a" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 45099 } } peers { permanent_uuid: "aed0136dfde34e368645c8cc3d6bd15b" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 32969 } } peers { permanent_uuid: "a1b8378df7664117ab93c277ce1bbc83" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 46047 } }
I20260812 08:03:36.014230 18702 raft_consensus.cc:385] T c711e39865444cbeb9a4e631731530eb P 1fc6cae0de0442baa4f119a7283fc75a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260812 08:03:36.014297 18702 raft_consensus.cc:740] T c711e39865444cbeb9a4e631731530eb P 1fc6cae0de0442baa4f119a7283fc75a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fc6cae0de0442baa4f119a7283fc75a, State: Initialized, Role: FOLLOWER
I20260812 08:03:36.014717 18702 consensus_queue.cc:260] T c711e39865444cbeb9a4e631731530eb P 1fc6cae0de0442baa4f119a7283fc75a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fc6cae0de0442baa4f119a7283fc75a" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 45099 } } peers { permanent_uuid: "aed0136dfde34e368645c8cc3d6bd15b" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 32969 } } peers { permanent_uuid: "a1b8378df7664117ab93c277ce1bbc83" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 46047 } }
I20260812 08:03:36.015319 18719 leader_election.cc:290] T c711e39865444cbeb9a4e631731530eb P aed0136dfde34e368645c8cc3d6bd15b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1fc6cae0de0442baa4f119a7283fc75a (127.12.187.67:45099), a1b8378df7664117ab93c277ce1bbc83 (127.12.187.66:46047)
I20260812 08:03:36.015569 18702 ts_tablet_manager.cc:1434] T c711e39865444cbeb9a4e631731530eb P 1fc6cae0de0442baa4f119a7283fc75a: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260812 08:03:36.015954 18720 tablet_replica.cc:442] T c711e39865444cbeb9a4e631731530eb P 1fc6cae0de0442baa4f119a7283fc75a: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fc6cae0de0442baa4f119a7283fc75a" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 45099 } } peers { permanent_uuid: "aed0136dfde34e368645c8cc3d6bd15b" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 32969 } } peers { permanent_uuid: "a1b8378df7664117ab93c277ce1bbc83" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 46047 } } }
I20260812 08:03:36.015982 18664 heartbeater.cc:499] Master 127.12.187.126:38357 was elected leader, sending a full tablet report...
I20260812 08:03:36.016999 18720 tablet_replica.cc:445] T c711e39865444cbeb9a4e631731530eb P 1fc6cae0de0442baa4f119a7283fc75a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 08:03:36.022198 18576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c711e39865444cbeb9a4e631731530eb" candidate_uuid: "aed0136dfde34e368645c8cc3d6bd15b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fc6cae0de0442baa4f119a7283fc75a" is_pre_election: true
I20260812 08:03:36.022497 18576 raft_consensus.cc:2468] T c711e39865444cbeb9a4e631731530eb P 1fc6cae0de0442baa4f119a7283fc75a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aed0136dfde34e368645c8cc3d6bd15b in term 0.
I20260812 08:03:36.023061 17943 leader_election.cc:304] T c711e39865444cbeb9a4e631731530eb P aed0136dfde34e368645c8cc3d6bd15b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fc6cae0de0442baa4f119a7283fc75a, aed0136dfde34e368645c8cc3d6bd15b; no voters: 
I20260812 08:03:36.023590 18714 raft_consensus.cc:2804] T c711e39865444cbeb9a4e631731530eb P aed0136dfde34e368645c8cc3d6bd15b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260812 08:03:36.023662 18714 raft_consensus.cc:493] T c711e39865444cbeb9a4e631731530eb P aed0136dfde34e368645c8cc3d6bd15b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 08:03:36.023705 18714 raft_consensus.cc:3060] T c711e39865444cbeb9a4e631731530eb P aed0136dfde34e368645c8cc3d6bd15b [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:03:36.024828 18714 raft_consensus.cc:515] T c711e39865444cbeb9a4e631731530eb P aed0136dfde34e368645c8cc3d6bd15b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fc6cae0de0442baa4f119a7283fc75a" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 45099 } } peers { permanent_uuid: "aed0136dfde34e368645c8cc3d6bd15b" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 32969 } } peers { permanent_uuid: "a1b8378df7664117ab93c277ce1bbc83" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 46047 } }
I20260812 08:03:36.025610 18576 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c711e39865444cbeb9a4e631731530eb" candidate_uuid: "aed0136dfde34e368645c8cc3d6bd15b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1fc6cae0de0442baa4f119a7283fc75a"
I20260812 08:03:36.025738 18576 raft_consensus.cc:3060] T c711e39865444cbeb9a4e631731530eb P 1fc6cae0de0442baa4f119a7283fc75a [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:03:36.026895 18576 raft_consensus.cc:2468] T c711e39865444cbeb9a4e631731530eb P 1fc6cae0de0442baa4f119a7283fc75a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aed0136dfde34e368645c8cc3d6bd15b in term 1.
I20260812 08:03:36.027175 18315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c711e39865444cbeb9a4e631731530eb" candidate_uuid: "aed0136dfde34e368645c8cc3d6bd15b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1b8378df7664117ab93c277ce1bbc83" is_pre_election: true
I20260812 08:03:36.027343 18714 leader_election.cc:290] T c711e39865444cbeb9a4e631731530eb P aed0136dfde34e368645c8cc3d6bd15b [CANDIDATE]: Term 1 election: Requested vote from peers 1fc6cae0de0442baa4f119a7283fc75a (127.12.187.67:45099), a1b8378df7664117ab93c277ce1bbc83 (127.12.187.66:46047)
I20260812 08:03:36.027374 17943 leader_election.cc:304] T c711e39865444cbeb9a4e631731530eb P aed0136dfde34e368645c8cc3d6bd15b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1fc6cae0de0442baa4f119a7283fc75a, aed0136dfde34e368645c8cc3d6bd15b; no voters: 
I20260812 08:03:36.027470 18315 raft_consensus.cc:2468] T c711e39865444cbeb9a4e631731530eb P a1b8378df7664117ab93c277ce1bbc83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aed0136dfde34e368645c8cc3d6bd15b in term 0.
I20260812 08:03:36.027554 18714 raft_consensus.cc:2804] T c711e39865444cbeb9a4e631731530eb P aed0136dfde34e368645c8cc3d6bd15b [term 1 FOLLOWER]: Leader election won for term 1
I20260812 08:03:36.027196 18326 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c711e39865444cbeb9a4e631731530eb" candidate_uuid: "aed0136dfde34e368645c8cc3d6bd15b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1b8378df7664117ab93c277ce1bbc83"
I20260812 08:03:36.027787 18326 raft_consensus.cc:3060] T c711e39865444cbeb9a4e631731530eb P a1b8378df7664117ab93c277ce1bbc83 [term 0 FOLLOWER]: Advancing to term 1
I20260812 08:03:36.027818 18714 raft_consensus.cc:697] T c711e39865444cbeb9a4e631731530eb P aed0136dfde34e368645c8cc3d6bd15b [term 1 LEADER]: Becoming Leader. State: Replica: aed0136dfde34e368645c8cc3d6bd15b, State: Running, Role: LEADER
I20260812 08:03:36.028347 18714 consensus_queue.cc:237] T c711e39865444cbeb9a4e631731530eb P aed0136dfde34e368645c8cc3d6bd15b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fc6cae0de0442baa4f119a7283fc75a" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 45099 } } peers { permanent_uuid: "aed0136dfde34e368645c8cc3d6bd15b" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 32969 } } peers { permanent_uuid: "a1b8378df7664117ab93c277ce1bbc83" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 46047 } }
I20260812 08:03:36.028808 18326 raft_consensus.cc:2468] T c711e39865444cbeb9a4e631731530eb P a1b8378df7664117ab93c277ce1bbc83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aed0136dfde34e368645c8cc3d6bd15b in term 1.
I20260812 08:03:36.033027 18719 tablet_replica.cc:442] T c711e39865444cbeb9a4e631731530eb P aed0136dfde34e368645c8cc3d6bd15b: TxnStatusTablet state changed. Reason: New leader aed0136dfde34e368645c8cc3d6bd15b. Latest consensus state: current_term: 1 leader_uuid: "aed0136dfde34e368645c8cc3d6bd15b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fc6cae0de0442baa4f119a7283fc75a" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 45099 } } peers { permanent_uuid: "aed0136dfde34e368645c8cc3d6bd15b" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 32969 } } peers { permanent_uuid: "a1b8378df7664117ab93c277ce1bbc83" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 46047 } } }
I20260812 08:03:36.033155 18719 tablet_replica.cc:445] T c711e39865444cbeb9a4e631731530eb P aed0136dfde34e368645c8cc3d6bd15b: This TxnStatusTablet replica's current role is: LEADER
I20260812 08:03:36.033485 18728 txn_status_manager.cc:874] Waiting until node catch up with all replicated operations in previous term...
I20260812 08:03:36.033720 18728 txn_status_manager.cc:930] Loading transaction status metadata into memory...
I20260812 08:03:36.034408 17752 catalog_manager.cc:5719] T c711e39865444cbeb9a4e631731530eb P aed0136dfde34e368645c8cc3d6bd15b reported cstate change: term changed from 0 to 1, leader changed from <none> to aed0136dfde34e368645c8cc3d6bd15b (127.12.187.65). New cstate: current_term: 1 leader_uuid: "aed0136dfde34e368645c8cc3d6bd15b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fc6cae0de0442baa4f119a7283fc75a" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 45099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aed0136dfde34e368645c8cc3d6bd15b" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 32969 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1b8378df7664117ab93c277ce1bbc83" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 46047 } health_report { overall_health: UNKNOWN } } }
W20260812 08:03:36.045430 18414 tablet.cc:2406] T c711e39865444cbeb9a4e631731530eb P a1b8378df7664117ab93c277ce1bbc83: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260812 08:03:36.049300 18738 txn_manager_proxy_rpc.cc:150] re-attempting BeginTransaction request to one of TxnManagers
I20260812 08:03:36.078614 18576 raft_consensus.cc:1275] T c711e39865444cbeb9a4e631731530eb P 1fc6cae0de0442baa4f119a7283fc75a [term 1 FOLLOWER]: Refusing update from remote peer aed0136dfde34e368645c8cc3d6bd15b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 08:03:36.079059 18326 raft_consensus.cc:1275] T c711e39865444cbeb9a4e631731530eb P a1b8378df7664117ab93c277ce1bbc83 [term 1 FOLLOWER]: Refusing update from remote peer aed0136dfde34e368645c8cc3d6bd15b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260812 08:03:36.079595 18719 consensus_queue.cc:1048] T c711e39865444cbeb9a4e631731530eb P aed0136dfde34e368645c8cc3d6bd15b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1fc6cae0de0442baa4f119a7283fc75a" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 45099 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:03:36.080250 18719 consensus_queue.cc:1048] T c711e39865444cbeb9a4e631731530eb P aed0136dfde34e368645c8cc3d6bd15b [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1b8378df7664117ab93c277ce1bbc83" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 46047 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260812 08:03:36.084182 18711 tablet_replica.cc:442] T c711e39865444cbeb9a4e631731530eb P a1b8378df7664117ab93c277ce1bbc83: TxnStatusTablet state changed. Reason: New leader aed0136dfde34e368645c8cc3d6bd15b. Latest consensus state: current_term: 1 leader_uuid: "aed0136dfde34e368645c8cc3d6bd15b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fc6cae0de0442baa4f119a7283fc75a" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 45099 } } peers { permanent_uuid: "aed0136dfde34e368645c8cc3d6bd15b" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 32969 } } peers { permanent_uuid: "a1b8378df7664117ab93c277ce1bbc83" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 46047 } } }
I20260812 08:03:36.084306 18711 tablet_replica.cc:445] T c711e39865444cbeb9a4e631731530eb P a1b8378df7664117ab93c277ce1bbc83: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 08:03:36.084285 18720 tablet_replica.cc:442] T c711e39865444cbeb9a4e631731530eb P 1fc6cae0de0442baa4f119a7283fc75a: TxnStatusTablet state changed. Reason: New leader aed0136dfde34e368645c8cc3d6bd15b. Latest consensus state: current_term: 1 leader_uuid: "aed0136dfde34e368645c8cc3d6bd15b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fc6cae0de0442baa4f119a7283fc75a" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 45099 } } peers { permanent_uuid: "aed0136dfde34e368645c8cc3d6bd15b" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 32969 } } peers { permanent_uuid: "a1b8378df7664117ab93c277ce1bbc83" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 46047 } } }
I20260812 08:03:36.084405 18720 tablet_replica.cc:445] T c711e39865444cbeb9a4e631731530eb P 1fc6cae0de0442baa4f119a7283fc75a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 08:03:36.089139 18719 tablet_replica.cc:442] T c711e39865444cbeb9a4e631731530eb P aed0136dfde34e368645c8cc3d6bd15b: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "aed0136dfde34e368645c8cc3d6bd15b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fc6cae0de0442baa4f119a7283fc75a" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 45099 } } peers { permanent_uuid: "aed0136dfde34e368645c8cc3d6bd15b" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 32969 } } peers { permanent_uuid: "a1b8378df7664117ab93c277ce1bbc83" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 46047 } } }
I20260812 08:03:36.089308 18719 tablet_replica.cc:445] T c711e39865444cbeb9a4e631731530eb P aed0136dfde34e368645c8cc3d6bd15b: This TxnStatusTablet replica's current role is: LEADER
I20260812 08:03:36.089450 18719 tablet_replica.cc:442] T c711e39865444cbeb9a4e631731530eb P aed0136dfde34e368645c8cc3d6bd15b: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "aed0136dfde34e368645c8cc3d6bd15b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fc6cae0de0442baa4f119a7283fc75a" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 45099 } } peers { permanent_uuid: "aed0136dfde34e368645c8cc3d6bd15b" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 32969 } } peers { permanent_uuid: "a1b8378df7664117ab93c277ce1bbc83" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 46047 } } }
I20260812 08:03:36.089514 18719 tablet_replica.cc:445] T c711e39865444cbeb9a4e631731530eb P aed0136dfde34e368645c8cc3d6bd15b: This TxnStatusTablet replica's current role is: LEADER
I20260812 08:03:36.090699 18720 tablet_replica.cc:442] T c711e39865444cbeb9a4e631731530eb P 1fc6cae0de0442baa4f119a7283fc75a: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "aed0136dfde34e368645c8cc3d6bd15b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fc6cae0de0442baa4f119a7283fc75a" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 45099 } } peers { permanent_uuid: "aed0136dfde34e368645c8cc3d6bd15b" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 32969 } } peers { permanent_uuid: "a1b8378df7664117ab93c277ce1bbc83" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 46047 } } }
I20260812 08:03:36.090802 18720 tablet_replica.cc:445] T c711e39865444cbeb9a4e631731530eb P 1fc6cae0de0442baa4f119a7283fc75a: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 08:03:36.091030 18711 tablet_replica.cc:442] T c711e39865444cbeb9a4e631731530eb P a1b8378df7664117ab93c277ce1bbc83: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "aed0136dfde34e368645c8cc3d6bd15b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fc6cae0de0442baa4f119a7283fc75a" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 45099 } } peers { permanent_uuid: "aed0136dfde34e368645c8cc3d6bd15b" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 32969 } } peers { permanent_uuid: "a1b8378df7664117ab93c277ce1bbc83" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 46047 } } }
I20260812 08:03:36.091120 18711 tablet_replica.cc:445] T c711e39865444cbeb9a4e631731530eb P a1b8378df7664117ab93c277ce1bbc83: This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 08:03:36.092832 13037 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu with pid 17909
I20260812 08:03:36.099331 18749 mvcc.cc:204] Tried to move back new op lower bound from 7317593358649774080 to 7317593358455644160. Current Snapshot: MvccSnapshot[applied={T|T < 7317593358649774080}]
I20260812 08:03:36.106541 18750 mvcc.cc:204] Tried to move back new op lower bound from 7317593358649774080 to 7317593358455644160. Current Snapshot: MvccSnapshot[applied={T|T < 7317593358649774080 or (T in {7317593358649774080})}]
I20260812 08:03:36.113287 13037 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu with pid 18179
I20260812 08:03:36.127218 13037 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu with pid 18415
W20260812 08:03:36.345448 18685 meta_cache.cc:302] tablet c711e39865444cbeb9a4e631731530eb: replica aed0136dfde34e368645c8cc3d6bd15b (127.12.187.65:32969) has failed: Network error: Client connection negotiation failed: client connection to 127.12.187.65:32969: connect: Connection refused (error 111)
W20260812 08:03:36.475914 17821 rpcz_store.cc:267] Call kudu.transactions.TxnManagerService.KeepTransactionAlive from 127.0.0.1:55412 (request call id 3) took 131 ms (client timeout 124 ms). Trace:
W20260812 08:03:36.476058 17821 rpcz_store.cc:269] 0812 08:03:36.344056 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:03:36.344156 (+   100us) service_pool.cc:224] Handling call
0812 08:03:36.475882 (+131726us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260812 08:03:36.606027 17820 rpcz_store.cc:267] Call kudu.transactions.TxnManagerService.KeepTransactionAlive from 127.0.0.1:55412 (request call id 4) took 135 ms (client timeout 124 ms). Trace:
W20260812 08:03:36.606113 17820 rpcz_store.cc:269] 0812 08:03:36.470960 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:03:36.471066 (+   106us) service_pool.cc:224] Handling call
0812 08:03:36.606002 (+134936us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260812 08:03:36.739636 17821 rpcz_store.cc:267] Call kudu.transactions.TxnManagerService.KeepTransactionAlive from 127.0.0.1:55412 (request call id 5) took 142 ms (client timeout 124 ms). Trace:
W20260812 08:03:36.739758 17821 rpcz_store.cc:269] 0812 08:03:36.597645 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:03:36.597726 (+    81us) service_pool.cc:224] Handling call
0812 08:03:36.739605 (+141879us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260812 08:03:36.852886 17820 rpcz_store.cc:267] Call kudu.transactions.TxnManagerService.KeepTransactionAlive from 127.0.0.1:55412 (request call id 6) took 128 ms (client timeout 124 ms). Trace:
W20260812 08:03:36.853000 17820 rpcz_store.cc:269] 0812 08:03:36.724190 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:03:36.724273 (+    83us) service_pool.cc:224] Handling call
0812 08:03:36.852866 (+128593us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260812 08:03:36.982914 17821 rpcz_store.cc:267] Call kudu.transactions.TxnManagerService.KeepTransactionAlive from 127.0.0.1:55412 (request call id 7) took 131 ms (client timeout 124 ms). Trace:
W20260812 08:03:36.983001 17821 rpcz_store.cc:269] 0812 08:03:36.851209 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:03:36.851296 (+    87us) service_pool.cc:224] Handling call
0812 08:03:36.982892 (+131596us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260812 08:03:37.114063 17820 rpcz_store.cc:267] Call kudu.transactions.TxnManagerService.KeepTransactionAlive from 127.0.0.1:55412 (request call id 8) took 135 ms (client timeout 124 ms). Trace:
W20260812 08:03:37.114151 17820 rpcz_store.cc:269] 0812 08:03:36.978321 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:03:36.978402 (+    81us) service_pool.cc:224] Handling call
0812 08:03:37.114040 (+135638us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260812 08:03:37.230279 17821 rpcz_store.cc:267] Call kudu.transactions.TxnManagerService.KeepTransactionAlive from 127.0.0.1:55412 (request call id 9) took 124 ms (client timeout 124 ms). Trace:
W20260812 08:03:37.230376 17821 rpcz_store.cc:269] 0812 08:03:37.105471 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:03:37.105545 (+    74us) service_pool.cc:224] Handling call
0812 08:03:37.230236 (+124691us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260812 08:03:37.352087 18685 meta_cache.cc:302] tablet c711e39865444cbeb9a4e631731530eb: replica aed0136dfde34e368645c8cc3d6bd15b (127.12.187.65:32969) has failed: Network error: Client connection negotiation failed: client connection to 127.12.187.65:32969: connect: Connection refused (error 111)
W20260812 08:03:37.367748 17821 rpcz_store.cc:267] Call kudu.transactions.TxnManagerService.KeepTransactionAlive from 127.0.0.1:55412 (request call id 10) took 135 ms (client timeout 124 ms). Trace:
W20260812 08:03:37.367833 17821 rpcz_store.cc:269] 0812 08:03:37.232483 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:03:37.232552 (+    69us) service_pool.cc:224] Handling call
0812 08:03:37.367726 (+135174us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260812 08:03:37.492415 17820 rpcz_store.cc:267] Call kudu.transactions.TxnManagerService.KeepTransactionAlive from 127.0.0.1:55412 (request call id 11) took 133 ms (client timeout 124 ms). Trace:
W20260812 08:03:37.492506 17820 rpcz_store.cc:269] 0812 08:03:37.359227 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:03:37.359318 (+    91us) service_pool.cc:224] Handling call
0812 08:03:37.492393 (+133075us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260812 08:03:37.614555 17821 rpcz_store.cc:267] Call kudu.transactions.TxnManagerService.KeepTransactionAlive from 127.0.0.1:55412 (request call id 12) took 128 ms (client timeout 124 ms). Trace:
W20260812 08:03:37.614660 17821 rpcz_store.cc:269] 0812 08:03:37.485929 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:03:37.486012 (+    83us) service_pool.cc:224] Handling call
0812 08:03:37.614532 (+128520us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260812 08:03:37.641893 13037 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu
/tmp/dist-test-tasksRvS6i/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.187.65:32969
--local_ip_for_outbound_sockets=127.12.187.65
--tserver_master_addrs=127.12.187.126:38357
--webserver_port=44231
--webserver_interface=127.12.187.65
--builtin_ntp_servers=127.12.187.84:41599
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--txn_keepalive_interval_ms=500
--txn_staleness_tracker_interval_ms=100
--txn_staleness_tracker_disabled_interval_ms=100
--raft_heartbeat_interval_ms=50
--leader_failure_max_missed_heartbeat_periods=1.25
--enable_txn_system_client_init=true
--txn_schedule_background_tasks=false with env {}
W20260812 08:03:37.737464 18680 meta_cache.cc:1015] Timed out: LookupRpc { table: 'kudu_system.kudu_transactions', partition-key: (RANGE (txn_id): <redacted>), attempt: 1 } failed: LookupRpc timed out after deadline expired: GetTableLocations RPC to 127.12.187.126:38357 timed out after 0.001s (SENT)
W20260812 08:03:37.737769 17820 rpcz_store.cc:267] Call kudu.transactions.TxnManagerService.KeepTransactionAlive from 127.0.0.1:55412 (request call id 13) took 125 ms (client timeout 124 ms). Trace:
W20260812 08:03:37.737876 17820 rpcz_store.cc:269] 0812 08:03:37.612735 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:03:37.612822 (+    87us) service_pool.cc:224] Handling call
0812 08:03:37.737739 (+124917us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260812 08:03:37.751338 18759 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:37.751562 18759 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:37.751606 18759 flags.cc:432] Enabled unsafe flag: --txn_schedule_background_tasks=false
W20260812 08:03:37.751731 18759 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:03:37.755401 18759 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:37.755493 18759 flags.cc:432] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 08:03:37.755512 18759 flags.cc:432] Enabled experimental flag: --txn_staleness_tracker_interval_ms=100
W20260812 08:03:37.755576 18759 flags.cc:432] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 08:03:37.755661 18759 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.187.65
I20260812 08:03:37.760003 18759 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.187.84:41599
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1.25
--raft_heartbeat_interval_ms=50
--fs_data_dirs=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-0/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.187.65:32969
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.187.65
--webserver_port=44231
--txn_keepalive_interval_ms=500
--txn_schedule_background_tasks=false
--txn_staleness_tracker_interval_ms=100
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.187.126:38357
--txn_staleness_tracker_disabled_interval_ms=100
--never_fsync=true
--heap_profile_path=/tmp/kudu.18759
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.187.65

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:37.761106 18759 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:37.762261 18759 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 08:03:37.765138 18759 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 08:03:37.769004 18764 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:37.769011 18765 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:37.769014 18767 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:37.769398 18759 server_base.cc:1061] running on GCE node
I20260812 08:03:37.769796 18759 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:37.770346 18759 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:37.771524 18759 hybrid_clock.cc:648] HybridClock initialized: now 1786521817771509 us; error 29 us; skew 500 ppm
I20260812 08:03:37.773515 18759 webserver.cc:533] Webserver started at http://127.12.187.65:44231/ using document root <none> and password file <none>
I20260812 08:03:37.774062 18759 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:37.774155 18759 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:37.777328 18759 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.004s	sys 0.000s
I20260812 08:03:37.779209 18777 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:37.780282 18759 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:03:37.780407 18759 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-0/data,/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-0/wal
uuid: "aed0136dfde34e368645c8cc3d6bd15b"
format_stamp: "Formatted at 2026-08-12 08:03:35 on dist-test-slave-8hhm"
I20260812 08:03:37.780897 18759 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:37.795673 18759 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:37.796212 18759 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:37.796353 18759 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:37.798171 18788 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260812 08:03:37.801743 18759 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 08:03:37.801808 18759 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.004s	user 0.001s	sys 0.000s
I20260812 08:03:37.801874 18759 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260812 08:03:37.803846 18759 ts_tablet_manager.cc:616] Registered 1 tablets
I20260812 08:03:37.803906 18759 ts_tablet_manager.cc:595] Time spent register tablets: real 0.002s	user 0.000s	sys 0.000s
I20260812 08:03:37.804241 18788 tablet_bootstrap.cc:492] T c711e39865444cbeb9a4e631731530eb P aed0136dfde34e368645c8cc3d6bd15b: Bootstrap starting.
I20260812 08:03:37.815548 18759 rpc_server.cc:307] RPC server started. Bound to: 127.12.187.65:32969
I20260812 08:03:37.816948 18759 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-0/data/info.pb
I20260812 08:03:37.817404 18987 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.187.65:32969 every 8 connection(s)
I20260812 08:03:37.818759 13037 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu as pid 18759
I20260812 08:03:37.819286 13037 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu
/tmp/dist-test-tasksRvS6i/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.187.66:46047
--local_ip_for_outbound_sockets=127.12.187.66
--tserver_master_addrs=127.12.187.126:38357
--webserver_port=42347
--webserver_interface=127.12.187.66
--builtin_ntp_servers=127.12.187.84:41599
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--txn_keepalive_interval_ms=500
--txn_staleness_tracker_interval_ms=100
--txn_staleness_tracker_disabled_interval_ms=100
--raft_heartbeat_interval_ms=50
--leader_failure_max_missed_heartbeat_periods=1.25
--enable_txn_system_client_init=true
--txn_schedule_background_tasks=false with env {}
I20260812 08:03:37.819698 18988 heartbeater.cc:344] Connected to a master server at 127.12.187.126:38357
I20260812 08:03:37.819864 18988 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:37.820247 18988 heartbeater.cc:507] Master 127.12.187.126:38357 requested a full tablet report, sending...
I20260812 08:03:37.822029 17752 ts_manager.cc:194] Re-registered known tserver with Master: aed0136dfde34e368645c8cc3d6bd15b (127.12.187.65:32969)
I20260812 08:03:37.822845 17752 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.12.187.65:57161
I20260812 08:03:37.824793 18788 log.cc:826] T c711e39865444cbeb9a4e631731530eb P aed0136dfde34e368645c8cc3d6bd15b: Log is configured to *not* fsync() on all Append() calls
I20260812 08:03:37.829923 18788 tablet_bootstrap.cc:492] T c711e39865444cbeb9a4e631731530eb P aed0136dfde34e368645c8cc3d6bd15b: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 08:03:37.830295 18788 tablet_bootstrap.cc:492] T c711e39865444cbeb9a4e631731530eb P aed0136dfde34e368645c8cc3d6bd15b: Bootstrap complete.
I20260812 08:03:37.831437 18788 ts_tablet_manager.cc:1403] T c711e39865444cbeb9a4e631731530eb P aed0136dfde34e368645c8cc3d6bd15b: Time spent bootstrapping tablet: real 0.027s	user 0.019s	sys 0.004s
I20260812 08:03:37.833745 18788 raft_consensus.cc:359] T c711e39865444cbeb9a4e631731530eb P aed0136dfde34e368645c8cc3d6bd15b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fc6cae0de0442baa4f119a7283fc75a" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 45099 } } peers { permanent_uuid: "aed0136dfde34e368645c8cc3d6bd15b" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 32969 } } peers { permanent_uuid: "a1b8378df7664117ab93c277ce1bbc83" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 46047 } }
I20260812 08:03:37.834074 18788 raft_consensus.cc:740] T c711e39865444cbeb9a4e631731530eb P aed0136dfde34e368645c8cc3d6bd15b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: aed0136dfde34e368645c8cc3d6bd15b, State: Initialized, Role: FOLLOWER
I20260812 08:03:37.834479 18788 consensus_queue.cc:260] T c711e39865444cbeb9a4e631731530eb P aed0136dfde34e368645c8cc3d6bd15b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fc6cae0de0442baa4f119a7283fc75a" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 45099 } } peers { permanent_uuid: "aed0136dfde34e368645c8cc3d6bd15b" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 32969 } } peers { permanent_uuid: "a1b8378df7664117ab93c277ce1bbc83" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 46047 } }
I20260812 08:03:37.835107 19000 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fc6cae0de0442baa4f119a7283fc75a" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 45099 } } peers { permanent_uuid: "aed0136dfde34e368645c8cc3d6bd15b" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 32969 } } peers { permanent_uuid: "a1b8378df7664117ab93c277ce1bbc83" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 46047 } } }
I20260812 08:03:37.835246 19000 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 08:03:37.835155 18988 heartbeater.cc:499] Master 127.12.187.126:38357 was elected leader, sending a full tablet report...
I20260812 08:03:37.835393 18788 ts_tablet_manager.cc:1434] T c711e39865444cbeb9a4e631731530eb P aed0136dfde34e368645c8cc3d6bd15b: Time spent starting tablet: real 0.004s	user 0.005s	sys 0.000s
W20260812 08:03:37.867605 17820 rpcz_store.cc:267] Call kudu.transactions.TxnManagerService.KeepTransactionAlive from 127.0.0.1:55412 (request call id 14) took 127 ms (client timeout 124 ms). Trace:
W20260812 08:03:37.867712 17820 rpcz_store.cc:269] 0812 08:03:37.739990 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:03:37.740052 (+    62us) service_pool.cc:224] Handling call
0812 08:03:37.867558 (+127506us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260812 08:03:37.895541 19000 raft_consensus.cc:493] T c711e39865444cbeb9a4e631731530eb P aed0136dfde34e368645c8cc3d6bd15b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:03:37.895738 19000 raft_consensus.cc:515] T c711e39865444cbeb9a4e631731530eb P aed0136dfde34e368645c8cc3d6bd15b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fc6cae0de0442baa4f119a7283fc75a" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 45099 } } peers { permanent_uuid: "aed0136dfde34e368645c8cc3d6bd15b" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 32969 } } peers { permanent_uuid: "a1b8378df7664117ab93c277ce1bbc83" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 46047 } }
W20260812 08:03:37.897436 18780 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.187.67:45099: connect: Connection refused (error 111)
I20260812 08:03:37.897420 19000 leader_election.cc:290] T c711e39865444cbeb9a4e631731530eb P aed0136dfde34e368645c8cc3d6bd15b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1fc6cae0de0442baa4f119a7283fc75a (127.12.187.67:45099), a1b8378df7664117ab93c277ce1bbc83 (127.12.187.66:46047)
W20260812 08:03:37.898643 18780 leader_election.cc:336] T c711e39865444cbeb9a4e631731530eb P aed0136dfde34e368645c8cc3d6bd15b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1fc6cae0de0442baa4f119a7283fc75a (127.12.187.67:45099): Network error: Client connection negotiation failed: client connection to 127.12.187.67:45099: connect: Connection refused (error 111)
W20260812 08:03:37.898741 18778 leader_election.cc:336] T c711e39865444cbeb9a4e631731530eb P aed0136dfde34e368645c8cc3d6bd15b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a1b8378df7664117ab93c277ce1bbc83 (127.12.187.66:46047): Network error: Client connection negotiation failed: client connection to 127.12.187.66:46047: connect: Connection refused (error 111)
I20260812 08:03:37.898823 18778 leader_election.cc:304] T c711e39865444cbeb9a4e631731530eb P aed0136dfde34e368645c8cc3d6bd15b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aed0136dfde34e368645c8cc3d6bd15b; no voters: 1fc6cae0de0442baa4f119a7283fc75a, a1b8378df7664117ab93c277ce1bbc83
I20260812 08:03:37.899073 19000 raft_consensus.cc:2749] T c711e39865444cbeb9a4e631731530eb P aed0136dfde34e368645c8cc3d6bd15b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260812 08:03:37.932093 18995 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:37.932322 18995 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:37.932401 18995 flags.cc:432] Enabled unsafe flag: --txn_schedule_background_tasks=false
W20260812 08:03:37.932471 18995 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:03:37.935757 18995 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:37.935886 18995 flags.cc:432] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 08:03:37.935949 18995 flags.cc:432] Enabled experimental flag: --txn_staleness_tracker_interval_ms=100
W20260812 08:03:37.935993 18995 flags.cc:432] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 08:03:37.936071 18995 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.187.66
I20260812 08:03:37.940042 18995 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.187.84:41599
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1.25
--raft_heartbeat_interval_ms=50
--fs_data_dirs=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-1/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.187.66:46047
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.187.66
--webserver_port=42347
--txn_keepalive_interval_ms=500
--txn_schedule_background_tasks=false
--txn_staleness_tracker_interval_ms=100
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.187.126:38357
--txn_staleness_tracker_disabled_interval_ms=100
--never_fsync=true
--heap_profile_path=/tmp/kudu.18995
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.187.66

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:37.941085 18995 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:37.942276 18995 file_cache.cc:504] Constructed file cache file cache with capacity 419430
E20260812 08:03:37.945161 18995 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 08:03:37.948902 19016 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:37.948959 19010 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:37.948971 19011 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:37.949241 18995 server_base.cc:1061] running on GCE node
I20260812 08:03:37.949573 18995 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:37.950106 18995 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:37.951285 18995 hybrid_clock.cc:648] HybridClock initialized: now 1786521817951271 us; error 32 us; skew 500 ppm
I20260812 08:03:37.952987 18995 webserver.cc:533] Webserver started at http://127.12.187.66:42347/ using document root <none> and password file <none>
I20260812 08:03:37.953586 18995 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:37.953696 18995 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:37.956939 18995 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.003s	sys 0.000s
I20260812 08:03:37.960457 19024 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:37.961828 18995 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.000s	sys 0.002s
I20260812 08:03:37.961948 18995 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-1/data,/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-1/wal
uuid: "a1b8378df7664117ab93c277ce1bbc83"
format_stamp: "Formatted at 2026-08-12 08:03:35 on dist-test-slave-8hhm"
I20260812 08:03:37.962360 18995 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:37.982954 18995 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:37.983618 18995 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:37.983821 18995 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:37.986032 19040 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260812 08:03:37.986763 19000 raft_consensus.cc:493] T c711e39865444cbeb9a4e631731530eb P aed0136dfde34e368645c8cc3d6bd15b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:03:37.986907 19000 raft_consensus.cc:515] T c711e39865444cbeb9a4e631731530eb P aed0136dfde34e368645c8cc3d6bd15b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fc6cae0de0442baa4f119a7283fc75a" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 45099 } } peers { permanent_uuid: "aed0136dfde34e368645c8cc3d6bd15b" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 32969 } } peers { permanent_uuid: "a1b8378df7664117ab93c277ce1bbc83" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 46047 } }
I20260812 08:03:37.987350 19000 leader_election.cc:290] T c711e39865444cbeb9a4e631731530eb P aed0136dfde34e368645c8cc3d6bd15b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1fc6cae0de0442baa4f119a7283fc75a (127.12.187.67:45099), a1b8378df7664117ab93c277ce1bbc83 (127.12.187.66:46047)
W20260812 08:03:37.988481 18780 leader_election.cc:336] T c711e39865444cbeb9a4e631731530eb P aed0136dfde34e368645c8cc3d6bd15b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1fc6cae0de0442baa4f119a7283fc75a (127.12.187.67:45099): Network error: Client connection negotiation failed: client connection to 127.12.187.67:45099: connect: Connection refused (error 111)
W20260812 08:03:37.988556 18778 leader_election.cc:336] T c711e39865444cbeb9a4e631731530eb P aed0136dfde34e368645c8cc3d6bd15b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer a1b8378df7664117ab93c277ce1bbc83 (127.12.187.66:46047): Network error: Client connection negotiation failed: client connection to 127.12.187.66:46047: connect: Connection refused (error 111)
I20260812 08:03:37.988597 18780 leader_election.cc:304] T c711e39865444cbeb9a4e631731530eb P aed0136dfde34e368645c8cc3d6bd15b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aed0136dfde34e368645c8cc3d6bd15b; no voters: 1fc6cae0de0442baa4f119a7283fc75a, a1b8378df7664117ab93c277ce1bbc83
I20260812 08:03:37.988899 19000 raft_consensus.cc:2749] T c711e39865444cbeb9a4e631731530eb P aed0136dfde34e368645c8cc3d6bd15b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260812 08:03:37.990111 18995 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 08:03:37.990185 18995 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.004s	user 0.001s	sys 0.000s
I20260812 08:03:37.990259 18995 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
W20260812 08:03:37.991894 17821 rpcz_store.cc:267] Call kudu.transactions.TxnManagerService.KeepTransactionAlive from 127.0.0.1:55412 (request call id 15) took 124 ms (client timeout 124 ms). Trace:
W20260812 08:03:37.991974 17821 rpcz_store.cc:269] 0812 08:03:37.867007 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:03:37.867077 (+    70us) service_pool.cc:224] Handling call
0812 08:03:37.991868 (+124791us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260812 08:03:37.992471 18995 ts_tablet_manager.cc:616] Registered 1 tablets
I20260812 08:03:37.992561 18995 ts_tablet_manager.cc:595] Time spent register tablets: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:03:37.992878 19040 tablet_bootstrap.cc:492] T c711e39865444cbeb9a4e631731530eb P a1b8378df7664117ab93c277ce1bbc83: Bootstrap starting.
I20260812 08:03:38.004566 18995 rpc_server.cc:307] RPC server started. Bound to: 127.12.187.66:46047
I20260812 08:03:38.004609 19248 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.187.66:46047 every 8 connection(s)
I20260812 08:03:38.005924 18995 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-1/data/info.pb
I20260812 08:03:38.007735 13037 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu as pid 18995
I20260812 08:03:38.008219 13037 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu
/tmp/dist-test-tasksRvS6i/build/debug/bin/kudu
--fs_wal_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.187.67:45099
--local_ip_for_outbound_sockets=127.12.187.67
--tserver_master_addrs=127.12.187.126:38357
--webserver_port=38117
--webserver_interface=127.12.187.67
--builtin_ntp_servers=127.12.187.84:41599
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--txn_keepalive_interval_ms=500
--txn_staleness_tracker_interval_ms=100
--txn_staleness_tracker_disabled_interval_ms=100
--raft_heartbeat_interval_ms=50
--leader_failure_max_missed_heartbeat_periods=1.25
--enable_txn_system_client_init=true
--txn_schedule_background_tasks=false with env {}
I20260812 08:03:38.008582 19249 heartbeater.cc:344] Connected to a master server at 127.12.187.126:38357
I20260812 08:03:38.008754 19249 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:38.009254 19249 heartbeater.cc:507] Master 127.12.187.126:38357 requested a full tablet report, sending...
I20260812 08:03:38.011107 17752 ts_manager.cc:194] Re-registered known tserver with Master: a1b8378df7664117ab93c277ce1bbc83 (127.12.187.66:46047)
I20260812 08:03:38.011891 17752 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.12.187.66:42865
I20260812 08:03:38.013070 19040 log.cc:826] T c711e39865444cbeb9a4e631731530eb P a1b8378df7664117ab93c277ce1bbc83: Log is configured to *not* fsync() on all Append() calls
I20260812 08:03:38.018270 19040 tablet_bootstrap.cc:492] T c711e39865444cbeb9a4e631731530eb P a1b8378df7664117ab93c277ce1bbc83: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 08:03:38.018648 19040 tablet_bootstrap.cc:492] T c711e39865444cbeb9a4e631731530eb P a1b8378df7664117ab93c277ce1bbc83: Bootstrap complete.
I20260812 08:03:38.019855 19040 ts_tablet_manager.cc:1403] T c711e39865444cbeb9a4e631731530eb P a1b8378df7664117ab93c277ce1bbc83: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.006s
I20260812 08:03:38.022249 19040 raft_consensus.cc:359] T c711e39865444cbeb9a4e631731530eb P a1b8378df7664117ab93c277ce1bbc83 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fc6cae0de0442baa4f119a7283fc75a" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 45099 } } peers { permanent_uuid: "aed0136dfde34e368645c8cc3d6bd15b" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 32969 } } peers { permanent_uuid: "a1b8378df7664117ab93c277ce1bbc83" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 46047 } }
I20260812 08:03:38.022615 19040 raft_consensus.cc:740] T c711e39865444cbeb9a4e631731530eb P a1b8378df7664117ab93c277ce1bbc83 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1b8378df7664117ab93c277ce1bbc83, State: Initialized, Role: FOLLOWER
I20260812 08:03:38.023069 19040 consensus_queue.cc:260] T c711e39865444cbeb9a4e631731530eb P a1b8378df7664117ab93c277ce1bbc83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fc6cae0de0442baa4f119a7283fc75a" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 45099 } } peers { permanent_uuid: "aed0136dfde34e368645c8cc3d6bd15b" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 32969 } } peers { permanent_uuid: "a1b8378df7664117ab93c277ce1bbc83" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 46047 } }
I20260812 08:03:38.023717 19249 heartbeater.cc:499] Master 127.12.187.126:38357 was elected leader, sending a full tablet report...
I20260812 08:03:38.023687 19258 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fc6cae0de0442baa4f119a7283fc75a" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 45099 } } peers { permanent_uuid: "aed0136dfde34e368645c8cc3d6bd15b" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 32969 } } peers { permanent_uuid: "a1b8378df7664117ab93c277ce1bbc83" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 46047 } } }
I20260812 08:03:38.023818 19258 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 08:03:38.023883 19040 ts_tablet_manager.cc:1434] T c711e39865444cbeb9a4e631731530eb P a1b8378df7664117ab93c277ce1bbc83: Time spent starting tablet: real 0.004s	user 0.005s	sys 0.001s
I20260812 08:03:38.084583 19258 raft_consensus.cc:493] T c711e39865444cbeb9a4e631731530eb P a1b8378df7664117ab93c277ce1bbc83 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260812 08:03:38.084831 19258 raft_consensus.cc:515] T c711e39865444cbeb9a4e631731530eb P a1b8378df7664117ab93c277ce1bbc83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fc6cae0de0442baa4f119a7283fc75a" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 45099 } } peers { permanent_uuid: "aed0136dfde34e368645c8cc3d6bd15b" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 32969 } } peers { permanent_uuid: "a1b8378df7664117ab93c277ce1bbc83" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 46047 } }
I20260812 08:03:38.086084 19258 leader_election.cc:290] T c711e39865444cbeb9a4e631731530eb P a1b8378df7664117ab93c277ce1bbc83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1fc6cae0de0442baa4f119a7283fc75a (127.12.187.67:45099), aed0136dfde34e368645c8cc3d6bd15b (127.12.187.65:32969)
W20260812 08:03:38.086544 19029 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.187.67:45099: connect: Connection refused (error 111)
W20260812 08:03:38.087678 19029 leader_election.cc:336] T c711e39865444cbeb9a4e631731530eb P a1b8378df7664117ab93c277ce1bbc83 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1fc6cae0de0442baa4f119a7283fc75a (127.12.187.67:45099): Network error: Client connection negotiation failed: client connection to 127.12.187.67:45099: connect: Connection refused (error 111)
I20260812 08:03:38.090725 18911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c711e39865444cbeb9a4e631731530eb" candidate_uuid: "a1b8378df7664117ab93c277ce1bbc83" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "aed0136dfde34e368645c8cc3d6bd15b" is_pre_election: true
I20260812 08:03:38.090956 18911 raft_consensus.cc:2468] T c711e39865444cbeb9a4e631731530eb P aed0136dfde34e368645c8cc3d6bd15b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1b8378df7664117ab93c277ce1bbc83 in term 1.
I20260812 08:03:38.091454 19035 leader_election.cc:304] T c711e39865444cbeb9a4e631731530eb P a1b8378df7664117ab93c277ce1bbc83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a1b8378df7664117ab93c277ce1bbc83, aed0136dfde34e368645c8cc3d6bd15b; no voters: 1fc6cae0de0442baa4f119a7283fc75a
I20260812 08:03:38.091725 19258 raft_consensus.cc:2804] T c711e39865444cbeb9a4e631731530eb P a1b8378df7664117ab93c277ce1bbc83 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260812 08:03:38.091797 19258 raft_consensus.cc:493] T c711e39865444cbeb9a4e631731530eb P a1b8378df7664117ab93c277ce1bbc83 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260812 08:03:38.091853 19258 raft_consensus.cc:3060] T c711e39865444cbeb9a4e631731530eb P a1b8378df7664117ab93c277ce1bbc83 [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:03:38.093458 19258 raft_consensus.cc:515] T c711e39865444cbeb9a4e631731530eb P a1b8378df7664117ab93c277ce1bbc83 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fc6cae0de0442baa4f119a7283fc75a" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 45099 } } peers { permanent_uuid: "aed0136dfde34e368645c8cc3d6bd15b" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 32969 } } peers { permanent_uuid: "a1b8378df7664117ab93c277ce1bbc83" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 46047 } }
I20260812 08:03:38.093869 19258 leader_election.cc:290] T c711e39865444cbeb9a4e631731530eb P a1b8378df7664117ab93c277ce1bbc83 [CANDIDATE]: Term 2 election: Requested vote from peers 1fc6cae0de0442baa4f119a7283fc75a (127.12.187.67:45099), aed0136dfde34e368645c8cc3d6bd15b (127.12.187.65:32969)
I20260812 08:03:38.094310 18911 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c711e39865444cbeb9a4e631731530eb" candidate_uuid: "a1b8378df7664117ab93c277ce1bbc83" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "aed0136dfde34e368645c8cc3d6bd15b"
I20260812 08:03:38.094455 18911 raft_consensus.cc:3060] T c711e39865444cbeb9a4e631731530eb P aed0136dfde34e368645c8cc3d6bd15b [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:03:38.095964 18911 raft_consensus.cc:2468] T c711e39865444cbeb9a4e631731530eb P aed0136dfde34e368645c8cc3d6bd15b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1b8378df7664117ab93c277ce1bbc83 in term 2.
I20260812 08:03:38.096323 19035 leader_election.cc:304] T c711e39865444cbeb9a4e631731530eb P a1b8378df7664117ab93c277ce1bbc83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a1b8378df7664117ab93c277ce1bbc83, aed0136dfde34e368645c8cc3d6bd15b; no voters: 
I20260812 08:03:38.096534 19258 raft_consensus.cc:2804] T c711e39865444cbeb9a4e631731530eb P a1b8378df7664117ab93c277ce1bbc83 [term 2 FOLLOWER]: Leader election won for term 2
I20260812 08:03:38.096793 19258 raft_consensus.cc:697] T c711e39865444cbeb9a4e631731530eb P a1b8378df7664117ab93c277ce1bbc83 [term 2 LEADER]: Becoming Leader. State: Replica: a1b8378df7664117ab93c277ce1bbc83, State: Running, Role: LEADER
W20260812 08:03:38.096874 19029 leader_election.cc:336] T c711e39865444cbeb9a4e631731530eb P a1b8378df7664117ab93c277ce1bbc83 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 1fc6cae0de0442baa4f119a7283fc75a (127.12.187.67:45099): Network error: Client connection negotiation failed: client connection to 127.12.187.67:45099: connect: Connection refused (error 111)
I20260812 08:03:38.097199 19258 consensus_queue.cc:237] T c711e39865444cbeb9a4e631731530eb P a1b8378df7664117ab93c277ce1bbc83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fc6cae0de0442baa4f119a7283fc75a" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 45099 } } peers { permanent_uuid: "aed0136dfde34e368645c8cc3d6bd15b" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 32969 } } peers { permanent_uuid: "a1b8378df7664117ab93c277ce1bbc83" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 46047 } }
I20260812 08:03:38.099195 19263 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: New leader a1b8378df7664117ab93c277ce1bbc83. Latest consensus state: current_term: 2 leader_uuid: "a1b8378df7664117ab93c277ce1bbc83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fc6cae0de0442baa4f119a7283fc75a" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 45099 } } peers { permanent_uuid: "aed0136dfde34e368645c8cc3d6bd15b" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 32969 } } peers { permanent_uuid: "a1b8378df7664117ab93c277ce1bbc83" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 46047 } } }
I20260812 08:03:38.099323 19263 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: LEADER
I20260812 08:03:38.099740 19271 txn_status_manager.cc:874] Waiting until node catch up with all replicated operations in previous term...
I20260812 08:03:38.099951 19271 txn_status_manager.cc:930] Loading transaction status metadata into memory...
I20260812 08:03:38.100922 17752 catalog_manager.cc:5719] T c711e39865444cbeb9a4e631731530eb P a1b8378df7664117ab93c277ce1bbc83 reported cstate change: term changed from 1 to 2, leader changed from aed0136dfde34e368645c8cc3d6bd15b (127.12.187.65) to a1b8378df7664117ab93c277ce1bbc83 (127.12.187.66). New cstate: current_term: 2 leader_uuid: "a1b8378df7664117ab93c277ce1bbc83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fc6cae0de0442baa4f119a7283fc75a" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 45099 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aed0136dfde34e368645c8cc3d6bd15b" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 32969 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1b8378df7664117ab93c277ce1bbc83" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 46047 } health_report { overall_health: HEALTHY } } }
W20260812 08:03:38.126850 17821 rpcz_store.cc:267] Call kudu.transactions.TxnManagerService.KeepTransactionAlive from 127.0.0.1:55412 (request call id 16) took 133 ms (client timeout 124 ms). Trace:
W20260812 08:03:38.127007 17821 rpcz_store.cc:269] 0812 08:03:37.993882 (+     0us) service_pool.cc:167] Inserting onto call queue
0812 08:03:37.993929 (+    47us) service_pool.cc:224] Handling call
0812 08:03:38.126828 (+132899us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260812 08:03:38.130700 19255 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
W20260812 08:03:38.130968 19255 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260812 08:03:38.131042 19255 flags.cc:432] Enabled unsafe flag: --txn_schedule_background_tasks=false
W20260812 08:03:38.131094 19255 flags.cc:432] Enabled unsafe flag: --never_fsync=true
W20260812 08:03:38.135789 19255 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
W20260812 08:03:38.135900 19255 flags.cc:432] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260812 08:03:38.135928 19255 flags.cc:432] Enabled experimental flag: --txn_staleness_tracker_interval_ms=100
W20260812 08:03:38.135955 19255 flags.cc:432] Enabled experimental flag: --enable_txn_system_client_init=true
W20260812 08:03:38.136022 19255 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.187.67
I20260812 08:03:38.137274 18911 raft_consensus.cc:1275] T c711e39865444cbeb9a4e631731530eb P aed0136dfde34e368645c8cc3d6bd15b [term 2 FOLLOWER]: Refusing update from remote peer a1b8378df7664117ab93c277ce1bbc83: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260812 08:03:38.137986 19263 consensus_queue.cc:1048] T c711e39865444cbeb9a4e631731530eb P a1b8378df7664117ab93c277ce1bbc83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aed0136dfde34e368645c8cc3d6bd15b" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 32969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260812 08:03:38.140691 19000 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: New leader a1b8378df7664117ab93c277ce1bbc83. Latest consensus state: current_term: 2 leader_uuid: "a1b8378df7664117ab93c277ce1bbc83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fc6cae0de0442baa4f119a7283fc75a" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 45099 } } peers { permanent_uuid: "aed0136dfde34e368645c8cc3d6bd15b" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 32969 } } peers { permanent_uuid: "a1b8378df7664117ab93c277ce1bbc83" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 46047 } } }
I20260812 08:03:38.140827 19000 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 08:03:38.141520 19255 tablet_server_runner.cc:78] Tablet server non-default flags:
--log_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.187.84:41599
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--leader_failure_max_missed_heartbeat_periods=1.25
--raft_heartbeat_interval_ms=50
--fs_data_dirs=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-2/wal
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.187.67:45099
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.187.67
--webserver_port=38117
--txn_keepalive_interval_ms=500
--txn_schedule_background_tasks=false
--txn_staleness_tracker_interval_ms=100
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.187.126:38357
--txn_staleness_tracker_disabled_interval_ms=100
--never_fsync=true
--heap_profile_path=/tmp/kudu.19255
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.187.67

Tablet server version:
kudu 1.19.0-SNAPSHOT
revision 70c51312f1186a8ae9f46647160b7730123f7601-dirty
build type DEBUG
built by None at 12 Aug 2026 06:06:26 UTC on 39be9dd7121a
I20260812 08:03:38.142779 19255 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260812 08:03:38.142757 19263 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "a1b8378df7664117ab93c277ce1bbc83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fc6cae0de0442baa4f119a7283fc75a" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 45099 } } peers { permanent_uuid: "aed0136dfde34e368645c8cc3d6bd15b" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 32969 } } peers { permanent_uuid: "a1b8378df7664117ab93c277ce1bbc83" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 46047 } } }
I20260812 08:03:38.142876 19263 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: LEADER
I20260812 08:03:38.144090 19255 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260812 08:03:38.144573 19029 consensus_peers.cc:597] T c711e39865444cbeb9a4e631731530eb P a1b8378df7664117ab93c277ce1bbc83 -> Peer 1fc6cae0de0442baa4f119a7283fc75a (127.12.187.67:45099): Couldn't send request to peer 1fc6cae0de0442baa4f119a7283fc75a. Status: Network error: Client connection negotiation failed: client connection to 127.12.187.67:45099: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260812 08:03:38.144668 19000 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "a1b8378df7664117ab93c277ce1bbc83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fc6cae0de0442baa4f119a7283fc75a" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 45099 } } peers { permanent_uuid: "aed0136dfde34e368645c8cc3d6bd15b" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 32969 } } peers { permanent_uuid: "a1b8378df7664117ab93c277ce1bbc83" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 46047 } } }
I20260812 08:03:38.144760 19000 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: FOLLOWER
E20260812 08:03:38.147393 19255 multi_raft_batcher.cc:235] multi_raft_heartbeat_window_ms should not be more than  raft_heartbeat_interval_ms / 2. , forcing multi_raft_heartbeat_window_ms = 25
W20260812 08:03:38.151400 19295 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:38.151413 19296 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260812 08:03:38.151543 19299 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260812 08:03:38.152447 19255 server_base.cc:1061] running on GCE node
I20260812 08:03:38.152813 19255 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260812 08:03:38.153437 19255 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260812 08:03:38.154628 19255 hybrid_clock.cc:648] HybridClock initialized: now 1786521818154603 us; error 38 us; skew 500 ppm
I20260812 08:03:38.156899 19255 webserver.cc:533] Webserver started at http://127.12.187.67:38117/ using document root <none> and password file <none>
I20260812 08:03:38.157622 19255 fs_manager.cc:362] Metadata directory not provided
I20260812 08:03:38.157719 19255 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260812 08:03:38.160965 19255 fs_manager.cc:714] Time spent opening directory manager: real 0.002s	user 0.000s	sys 0.002s
I20260812 08:03:38.162977 19311 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260812 08:03:38.163970 19255 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.001s
I20260812 08:03:38.164101 19255 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-2/data,/tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-2/wal
uuid: "1fc6cae0de0442baa4f119a7283fc75a"
format_stamp: "Formatted at 2026-08-12 08:03:35 on dist-test-slave-8hhm"
I20260812 08:03:38.164525 19255 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260812 08:03:38.174319 19255 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260812 08:03:38.174914 19255 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260812 08:03:38.175109 19255 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260812 08:03:38.177001 19320 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260812 08:03:38.181176 19255 ts_tablet_manager.cc:585] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260812 08:03:38.181267 19255 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.005s	user 0.001s	sys 0.000s
I20260812 08:03:38.181336 19255 ts_tablet_manager.cc:600] Registering tablets (0/1 complete)
I20260812 08:03:38.183568 19255 ts_tablet_manager.cc:616] Registered 1 tablets
I20260812 08:03:38.183626 19255 ts_tablet_manager.cc:595] Time spent register tablets: real 0.002s	user 0.002s	sys 0.000s
I20260812 08:03:38.184242 19320 tablet_bootstrap.cc:492] T c711e39865444cbeb9a4e631731530eb P 1fc6cae0de0442baa4f119a7283fc75a: Bootstrap starting.
I20260812 08:03:38.198858 19255 rpc_server.cc:307] RPC server started. Bound to: 127.12.187.67:45099
I20260812 08:03:38.200364 19255 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasksRvS6i/test-tmp/txn_status_manager-itest.0.TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted.1786521787214093-13037-0/minicluster-data/ts-2/data/info.pb
I20260812 08:03:38.202638 19523 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.187.67:45099 every 8 connection(s)
I20260812 08:03:38.204500 19320 log.cc:826] T c711e39865444cbeb9a4e631731530eb P 1fc6cae0de0442baa4f119a7283fc75a: Log is configured to *not* fsync() on all Append() calls
I20260812 08:03:38.205021 19524 heartbeater.cc:344] Connected to a master server at 127.12.187.126:38357
I20260812 08:03:38.205183 19524 heartbeater.cc:461] Registering TS with master...
I20260812 08:03:38.205653 19524 heartbeater.cc:507] Master 127.12.187.126:38357 requested a full tablet report, sending...
I20260812 08:03:38.207489 13037 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu as pid 19255
I20260812 08:03:38.207520 17752 ts_manager.cc:194] Re-registered known tserver with Master: 1fc6cae0de0442baa4f119a7283fc75a (127.12.187.67:45099)
I20260812 08:03:38.208689 17752 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.12.187.67:46213
I20260812 08:03:38.209867 19320 tablet_bootstrap.cc:492] T c711e39865444cbeb9a4e631731530eb P 1fc6cae0de0442baa4f119a7283fc75a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260812 08:03:38.210217 19320 tablet_bootstrap.cc:492] T c711e39865444cbeb9a4e631731530eb P 1fc6cae0de0442baa4f119a7283fc75a: Bootstrap complete.
I20260812 08:03:38.211364 19320 ts_tablet_manager.cc:1403] T c711e39865444cbeb9a4e631731530eb P 1fc6cae0de0442baa4f119a7283fc75a: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.009s
I20260812 08:03:38.213762 19320 raft_consensus.cc:359] T c711e39865444cbeb9a4e631731530eb P 1fc6cae0de0442baa4f119a7283fc75a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fc6cae0de0442baa4f119a7283fc75a" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 45099 } } peers { permanent_uuid: "aed0136dfde34e368645c8cc3d6bd15b" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 32969 } } peers { permanent_uuid: "a1b8378df7664117ab93c277ce1bbc83" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 46047 } }
I20260812 08:03:38.214087 19320 raft_consensus.cc:740] T c711e39865444cbeb9a4e631731530eb P 1fc6cae0de0442baa4f119a7283fc75a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fc6cae0de0442baa4f119a7283fc75a, State: Initialized, Role: FOLLOWER
I20260812 08:03:38.214499 19320 consensus_queue.cc:260] T c711e39865444cbeb9a4e631731530eb P 1fc6cae0de0442baa4f119a7283fc75a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fc6cae0de0442baa4f119a7283fc75a" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 45099 } } peers { permanent_uuid: "aed0136dfde34e368645c8cc3d6bd15b" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 32969 } } peers { permanent_uuid: "a1b8378df7664117ab93c277ce1bbc83" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 46047 } }
I20260812 08:03:38.215154 19524 heartbeater.cc:499] Master 127.12.187.126:38357 was elected leader, sending a full tablet report...
I20260812 08:03:38.215111 19529 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fc6cae0de0442baa4f119a7283fc75a" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 45099 } } peers { permanent_uuid: "aed0136dfde34e368645c8cc3d6bd15b" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 32969 } } peers { permanent_uuid: "a1b8378df7664117ab93c277ce1bbc83" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 46047 } } }
I20260812 08:03:38.215261 19529 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 08:03:38.215402 19320 ts_tablet_manager.cc:1434] T c711e39865444cbeb9a4e631731530eb P 1fc6cae0de0442baa4f119a7283fc75a: Time spent starting tablet: real 0.004s	user 0.006s	sys 0.000s
I20260812 08:03:38.249375 19422 raft_consensus.cc:3060] T c711e39865444cbeb9a4e631731530eb P 1fc6cae0de0442baa4f119a7283fc75a [term 1 FOLLOWER]: Advancing to term 2
I20260812 08:03:38.252552 19534 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "a1b8378df7664117ab93c277ce1bbc83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fc6cae0de0442baa4f119a7283fc75a" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 45099 } } peers { permanent_uuid: "aed0136dfde34e368645c8cc3d6bd15b" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 32969 } } peers { permanent_uuid: "a1b8378df7664117ab93c277ce1bbc83" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 46047 } } }
I20260812 08:03:38.252769 19534 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 08:03:38.253060 19529 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: New leader a1b8378df7664117ab93c277ce1bbc83. Latest consensus state: current_term: 2 leader_uuid: "a1b8378df7664117ab93c277ce1bbc83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fc6cae0de0442baa4f119a7283fc75a" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 45099 } } peers { permanent_uuid: "aed0136dfde34e368645c8cc3d6bd15b" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 32969 } } peers { permanent_uuid: "a1b8378df7664117ab93c277ce1bbc83" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 46047 } } }
I20260812 08:03:38.253156 19529 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: FOLLOWER
I20260812 08:03:38.292716 19258 tablet_replica.cc:442] TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "a1b8378df7664117ab93c277ce1bbc83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1fc6cae0de0442baa4f119a7283fc75a" member_type: VOTER last_known_addr { host: "127.12.187.67" port: 45099 } } peers { permanent_uuid: "aed0136dfde34e368645c8cc3d6bd15b" member_type: VOTER last_known_addr { host: "127.12.187.65" port: 32969 } } peers { permanent_uuid: "a1b8378df7664117ab93c277ce1bbc83" member_type: VOTER last_known_addr { host: "127.12.187.66" port: 46047 } } }
I20260812 08:03:38.292915 19258 tablet_replica.cc:445] This TxnStatusTablet replica's current role is: LEADER
I20260812 08:03:40.718426 13037 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu with pid 18759
I20260812 08:03:40.736545 13037 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu with pid 18995
I20260812 08:03:40.755980 13037 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu with pid 19255
I20260812 08:03:40.768630 13037 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasksRvS6i/build/debug/bin/kudu with pid 17710
2026-08-12T08:03:40Z chronyd exiting
[       OK ] TxnStatusManagerITest.TxnKeptAliveByClientIfStatusManagerRestarted (6075 ms)
[----------] 4 tests from TxnStatusManagerITest (33577 ms total)

[----------] Global test environment tear-down
[==========] 4 tests from 1 test suite ran. (33577 ms total)
[  PASSED  ] 4 tests.
