JUnit version 4.13.2
.14:21:55.611 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1779114115602
14:21:55.668 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
14:21:55.701 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
14:21:55.713 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskquUkVX/test-tmp
14:21:55.740 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
14:21:55.743 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskquUkVX/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
14:21:56.005 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

14:21:56.145 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
14:21:56.146 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

14:21:56.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:56.151553  1439 mini_oidc.cc:150] Starting JWKS server
14:21:56.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:56.155479  1439 webserver.cc:533] Webserver started at http://127.0.0.1:42195/ using document root <none> and password file <none>
14:21:56.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:56.156025  1439 mini_oidc.cc:186] Starting OIDC Discovery server
14:21:56.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:56.158520  1439 webserver.cc:533] Webserver started at http://127.0.0.1:33299/ using document root <none> and password file <none>
14:21:56.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T14:21:56Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
14:21:56.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T14:21:56Z Disabled control of system clock
14:21:56.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:56.223929  1439 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskquUkVX/build/tsan/bin/kudu
14:21:56.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskquUkVX/build/tsan/bin/kudu
14:21:56.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/master-0/wal
14:21:56.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/master-0/data
14:21:56.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:21:56.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:21:56.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:21:56.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:21:56.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:21:56.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:21:56.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/master-0/logs
14:21:56.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/master-0/data/info.pb
14:21:56.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:21:56.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:21:56.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:21:56.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:21:56.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:21:56.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:21:56.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:21:56.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:21:56.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
14:21:56.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:21:56.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:21:56.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:21:56.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.1.103.254:45279
14:21:56.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.1.103.254
14:21:56.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:21:56.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.1.103.212:37821
14:21:56.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:21:56.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:21:56.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:21:56.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:21:56.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.1.103.254:45279,127.1.103.253:34625,127.1.103.252:33585
14:21:56.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:21:56.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:42195/jwks.json with env {}
14:21:56.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:56.534026  1451 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:21:56.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:56.534600  1451 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:21:56.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:56.535246  1451 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:21:56.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:56.567360  1451 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
14:21:56.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:56.567656  1451 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:21:56.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:56.567849  1451 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
14:21:56.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:56.568032  1451 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
14:21:56.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:56.568224  1451 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
14:21:56.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:56.568470  1451 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:42195/jwks.json
14:21:56.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:56.605551  1451 master_runner.cc:387] Master server non-default flags:
14:21:56.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:21:56.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.1.103.212:37821
14:21:56.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:21:56.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:21:56.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/master-0/data
14:21:56.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/master-0/wal
14:21:56.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:21:56.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.1.103.254:45279,127.1.103.253:34625,127.1.103.252:33585
14:21:56.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:21:56.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:21:56.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:21:56.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.1.103.254:45279
14:21:56.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:21:56.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:21:56.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:21:56.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:42195/jwks.json
14:21:56.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:21:56.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:21:56.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/master-0/data/info.pb
14:21:56.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.1.103.254
14:21:56.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:21:56.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:21:56.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:21:56.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:21:56.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:21:56.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:21:56.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/master-0/logs
14:21:56.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:21:56.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:21:56.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:21:56.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
14:21:56.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:21:56.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:21:56.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:21:56.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:21:56.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:21:56.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:21:56.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:56.607214  1451 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:21:56.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:56.609337  1451 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:21:56.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:56.621969  1457 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:21:57.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:56.623855  1458 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:21:57.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:56.627014  1460 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:21:57.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:57.852486  1459 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1225 milliseconds
14:21:57.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:57.852618  1451 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:21:57.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:57.854053  1451 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:21:57.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:57.857025  1451 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:21:57.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:57.858394  1451 hybrid_clock.cc:648] HybridClock initialized: now 1779114117858363 us; error 76 us; skew 500 ppm
14:21:57.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:57.859277  1451 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:21:57.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:57.866237  1451 webserver.cc:533] Webserver started at http://127.1.103.254:41891/ using document root <none> and password file <none>
14:21:57.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:57.867312  1451 fs_manager.cc:362] Metadata directory not provided
14:21:57.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:57.867522  1451 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:21:57.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:57.867916  1451 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:21:57.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:57.872514  1451 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/master-0/data/instance:
14:21:57.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c79f51bdb25d47599c9a2588268d1997"
14:21:57.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:21:57 on dist-test-slave-psp9"
14:21:57.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:57.873754  1451 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/master-0/wal/instance:
14:21:57.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c79f51bdb25d47599c9a2588268d1997"
14:21:57.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:21:57 on dist-test-slave-psp9"
14:21:57.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:57.881537  1451 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.004s
14:21:57.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:57.887641  1467 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:21:57.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:57.889014  1451 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.002s
14:21:57.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:57.889328  1451 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/master-0/data,/tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/master-0/wal
14:21:57.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c79f51bdb25d47599c9a2588268d1997"
14:21:57.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:21:57 on dist-test-slave-psp9"
14:21:57.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:57.889667  1451 fs_report.cc:389] FS layout report
14:21:57.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:21:57.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/master-0/wal
14:21:57.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/master-0/wal
14:21:57.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/master-0/data/data
14:21:57.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:21:57.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:21:57.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:21:57.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:21:57.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:21:57.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:21:57.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:21:57.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:21:57.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:21:57.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:21:57.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:21:57.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:57.952881  1451 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:21:57.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:57.954538  1451 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:21:57.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:57.955062  1451 kserver.cc:163] Server-wide thread pool size limit: 3276
14:21:58.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:58.030514  1451 rpc_server.cc:307] RPC server started. Bound to: 127.1.103.254:45279
14:21:58.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:58.030587  1518 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.103.254:45279 every 8 connection(s)
14:21:58.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:58.033427  1451 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/master-0/data/info.pb
14:21:58.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:58.037007  1439 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskquUkVX/build/tsan/bin/kudu as pid 1451
14:21:58.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:58.037386  1439 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/master-0/wal/instance
14:21:58.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:58.040305  1519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
14:21:58.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:58.040773  1439 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskquUkVX/build/tsan/bin/kudu
14:21:58.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskquUkVX/build/tsan/bin/kudu
14:21:58.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/master-1/wal
14:21:58.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/master-1/data
14:21:58.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:21:58.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:21:58.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:21:58.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:21:58.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:21:58.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:21:58.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/master-1/logs
14:21:58.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/master-1/data/info.pb
14:21:58.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:21:58.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:21:58.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:21:58.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:21:58.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:21:58.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:21:58.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:21:58.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:21:58.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
14:21:58.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:21:58.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:21:58.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:21:58.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.1.103.253:34625
14:21:58.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.1.103.253
14:21:58.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:21:58.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.1.103.212:37821
14:21:58.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:21:58.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:21:58.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:21:58.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:21:58.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.1.103.254:45279,127.1.103.253:34625,127.1.103.252:33585
14:21:58.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:21:58.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:42195/jwks.json with env {}
14:21:58.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:58.053406  1519 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.103.254" port: 45279 } has no permanent_uuid. Determining permanent_uuid...
14:21:58.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:58.084106  1519 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.103.253" port: 34625 } has no permanent_uuid. Determining permanent_uuid...
14:21:58.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:58.086913  1470 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.103.253:34625: connect: Connection refused (error 111)
14:21:58.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:58.091216  1519 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.103.253:34625: Network error: Client connection negotiation failed: client connection to 127.1.103.253:34625: connect: Connection refused (error 111)
14:21:58.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:58.140794  1519 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.103.253" port: 34625 } attempt: 1
14:21:58.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:58.145563  1519 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.103.253:34625: Network error: Client connection negotiation failed: client connection to 127.1.103.253:34625: connect: Connection refused (error 111)
14:21:58.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:58.214046  1519 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.103.253" port: 34625 } attempt: 2
14:21:58.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:58.218266  1519 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.103.253:34625: Network error: Client connection negotiation failed: client connection to 127.1.103.253:34625: connect: Connection refused (error 111)
14:21:58.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:58.309773  1519 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.103.253" port: 34625 } attempt: 3
14:21:58.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:58.314776  1519 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.103.253:34625: Network error: Client connection negotiation failed: client connection to 127.1.103.253:34625: connect: Connection refused (error 111)
14:21:58.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:58.370317  1521 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:21:58.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:58.370971  1521 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:21:58.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:58.371423  1521 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:21:58.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:58.404845  1521 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
14:21:58.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:58.405153  1521 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:21:58.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:58.405366  1521 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
14:21:58.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:58.405550  1521 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
14:21:58.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:58.405769  1521 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
14:21:58.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:58.405915  1521 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:42195/jwks.json
14:21:58.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:58.453032  1521 master_runner.cc:387] Master server non-default flags:
14:21:58.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:21:58.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.1.103.212:37821
14:21:58.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:21:58.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:21:58.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/master-1/data
14:21:58.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/master-1/wal
14:21:58.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:21:58.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.1.103.254:45279,127.1.103.253:34625,127.1.103.252:33585
14:21:58.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:21:58.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:21:58.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:21:58.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.1.103.253:34625
14:21:58.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:21:58.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:21:58.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:21:58.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:42195/jwks.json
14:21:58.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:21:58.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:21:58.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/master-1/data/info.pb
14:21:58.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.1.103.253
14:21:58.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:21:58.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:21:58.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:21:58.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:21:58.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:21:58.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:21:58.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/master-1/logs
14:21:58.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:21:58.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:21:58.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:21:58.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
14:21:58.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:21:58.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:21:58.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:21:58.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:21:58.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:21:58.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:21:58.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:58.454703  1521 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:21:58.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:58.456805  1521 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:21:58.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:58.458256  1519 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.103.253" port: 34625 } attempt: 4
14:21:58.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:58.463294  1519 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.103.253:34625: Network error: Client connection negotiation failed: client connection to 127.1.103.253:34625: connect: Connection refused (error 111)
14:21:58.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:58.471138  1530 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:21:58.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:58.762761  1519 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.103.253" port: 34625 } attempt: 5
14:21:58.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:58.767961  1519 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.103.253:34625: Network error: Client connection negotiation failed: client connection to 127.1.103.253:34625: connect: Connection refused (error 111)
14:21:59.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:59.315408  1519 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.103.253" port: 34625 } attempt: 6
14:21:59.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:59.323689  1519 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.103.253:34625: Network error: Client connection negotiation failed: client connection to 127.1.103.253:34625: connect: Connection refused (error 111)
14:21:59.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:58.471596  1531 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:21:59.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:59.693976  1532 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
14:21:59.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:59.695832  1533 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:21:59.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:59.695936  1521 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:21:59.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:59.699527  1521 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:21:59.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:59.703137  1521 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:21:59.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:59.706735  1521 hybrid_clock.cc:648] HybridClock initialized: now 1779114119705632 us; error 1120 us; skew 500 ppm
14:21:59.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:59.707636  1521 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:21:59.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:59.714561  1521 webserver.cc:533] Webserver started at http://127.1.103.253:44773/ using document root <none> and password file <none>
14:21:59.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:59.715505  1521 fs_manager.cc:362] Metadata directory not provided
14:21:59.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:59.715710  1521 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:21:59.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:59.716125  1521 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:21:59.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:59.720618  1521 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/master-1/data/instance:
14:21:59.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1a277314146b44308f4d0e7002f91de0"
14:21:59.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:21:59 on dist-test-slave-psp9"
14:21:59.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:59.721962  1521 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/master-1/wal/instance:
14:21:59.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1a277314146b44308f4d0e7002f91de0"
14:21:59.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:21:59 on dist-test-slave-psp9"
14:21:59.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:59.729565  1521 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.000s
14:21:59.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:59.735373  1542 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:21:59.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:59.736622  1521 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.002s
14:21:59.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:59.736941  1521 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/master-1/data,/tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/master-1/wal
14:21:59.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1a277314146b44308f4d0e7002f91de0"
14:21:59.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:21:59 on dist-test-slave-psp9"
14:21:59.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:59.737327  1521 fs_report.cc:389] FS layout report
14:21:59.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:21:59.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/master-1/wal
14:21:59.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/master-1/wal
14:21:59.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/master-1/data/data
14:21:59.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:21:59.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:21:59.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:21:59.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:21:59.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:21:59.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:21:59.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:21:59.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:21:59.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:21:59.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:21:59.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:21:59.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:59.790674  1521 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:21:59.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:59.792229  1521 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:21:59.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:59.792659  1521 kserver.cc:163] Server-wide thread pool size limit: 3276
14:21:59.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:59.866479  1521 rpc_server.cc:307] RPC server started. Bound to: 127.1.103.253:34625
14:21:59.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:59.866561  1593 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.103.253:34625 every 8 connection(s)
14:21:59.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:59.869614  1521 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/master-1/data/info.pb
14:21:59.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:59.875607  1439 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskquUkVX/build/tsan/bin/kudu as pid 1521
14:21:59.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:59.875851  1594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
14:21:59.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:59.875945  1439 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/master-1/wal/instance
14:21:59.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:59.878885  1439 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskquUkVX/build/tsan/bin/kudu
14:21:59.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskquUkVX/build/tsan/bin/kudu
14:21:59.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/master-2/wal
14:21:59.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/master-2/data
14:21:59.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:21:59.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:21:59.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:21:59.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:21:59.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:21:59.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:21:59.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/master-2/logs
14:21:59.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/master-2/data/info.pb
14:21:59.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:21:59.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:21:59.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:21:59.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:21:59.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:21:59.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:21:59.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:21:59.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:21:59.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
14:21:59.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:21:59.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:21:59.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:21:59.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.1.103.252:33585
14:21:59.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.1.103.252
14:21:59.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:21:59.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.1.103.212:37821
14:21:59.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:21:59.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:21:59.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:21:59.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:21:59.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.1.103.254:45279,127.1.103.253:34625,127.1.103.252:33585
14:21:59.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:21:59.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:42195/jwks.json with env {}
14:21:59.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:59.892148  1594 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.103.254" port: 45279 } has no permanent_uuid. Determining permanent_uuid...
14:21:59.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:59.914579  1594 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.103.253" port: 34625 } has no permanent_uuid. Determining permanent_uuid...
14:21:59.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:59.929276  1594 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.103.252" port: 33585 } has no permanent_uuid. Determining permanent_uuid...
14:21:59.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:59.931963  1544 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.103.252:33585: connect: Connection refused (error 111)
14:21:59.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:59.936622  1594 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.103.252:33585: Network error: Client connection negotiation failed: client connection to 127.1.103.252:33585: connect: Connection refused (error 111)
14:21:59.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:21:59.986204  1594 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.103.252" port: 33585 } attempt: 1
14:21:59.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:21:59.991281  1594 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.103.252:33585: Network error: Client connection negotiation failed: client connection to 127.1.103.252:33585: connect: Connection refused (error 111)
14:22:00.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:00.059728  1594 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.103.252" port: 33585 } attempt: 2
14:22:00.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:00.063957  1594 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.103.252:33585: Network error: Client connection negotiation failed: client connection to 127.1.103.252:33585: connect: Connection refused (error 111)
14:22:00.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:00.155495  1594 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.103.252" port: 33585 } attempt: 3
14:22:00.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:00.159750  1594 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.103.252:33585: Network error: Client connection negotiation failed: client connection to 127.1.103.252:33585: connect: Connection refused (error 111)
14:22:00.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:00.203536  1596 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:22:00.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:00.204108  1596 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:22:00.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:00.204551  1596 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:22:00.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:00.238489  1596 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
14:22:00.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:00.238883  1596 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:22:00.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:00.239086  1596 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
14:22:00.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:00.239270  1596 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
14:22:00.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:00.239452  1596 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
14:22:00.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:00.239675  1596 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:42195/jwks.json
14:22:00.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:00.277022  1596 master_runner.cc:387] Master server non-default flags:
14:22:00.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:22:00.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.1.103.212:37821
14:22:00.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:22:00.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:22:00.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/master-2/data
14:22:00.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/master-2/wal
14:22:00.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:22:00.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.1.103.254:45279,127.1.103.253:34625,127.1.103.252:33585
14:22:00.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:22:00.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:22:00.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:22:00.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.1.103.252:33585
14:22:00.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:22:00.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:22:00.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:22:00.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:42195/jwks.json
14:22:00.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:22:00.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:22:00.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/master-2/data/info.pb
14:22:00.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.1.103.252
14:22:00.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:22:00.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:22:00.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:22:00.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:22:00.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:22:00.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:22:00.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/master-2/logs
14:22:00.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:22:00.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:22:00.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:22:00.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
14:22:00.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:22:00.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:22:00.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:22:00.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:22:00.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:22:00.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:22:00.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:00.278466  1596 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:22:00.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:00.280519  1596 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:22:00.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:00.293604  1606 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:22:00.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:00.303220  1594 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.103.252" port: 33585 } attempt: 4
14:22:00.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:00.307536  1594 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.103.252:33585: Network error: Client connection negotiation failed: client connection to 127.1.103.252:33585: connect: Connection refused (error 111)
14:22:00.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:00.384145  1519 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.103.253" port: 34625 } attempt: 7
14:22:00.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:00.397915  1519 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.103.252" port: 33585 } has no permanent_uuid. Determining permanent_uuid...
14:22:00.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:00.403707  1519 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.103.252:33585: Network error: Client connection negotiation failed: client connection to 127.1.103.252:33585: connect: Connection refused (error 111)
14:22:00.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:00.462443  1519 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.103.252" port: 33585 } attempt: 1
14:22:00.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:00.468886  1519 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.103.252:33585: Network error: Client connection negotiation failed: client connection to 127.1.103.252:33585: connect: Connection refused (error 111)
14:22:00.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:00.550444  1519 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.103.252" port: 33585 } attempt: 2
14:22:00.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:00.555522  1519 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.103.252:33585: Network error: Client connection negotiation failed: client connection to 127.1.103.252:33585: connect: Connection refused (error 111)
14:22:00.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:00.607000  1594 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.103.252" port: 33585 } attempt: 5
14:22:00.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:00.611537  1594 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.103.252:33585: Network error: Client connection negotiation failed: client connection to 127.1.103.252:33585: connect: Connection refused (error 111)
14:22:00.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:00.640983  1519 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.103.252" port: 33585 } attempt: 3
14:22:00.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:00.646842  1519 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.103.252:33585: Network error: Client connection negotiation failed: client connection to 127.1.103.252:33585: connect: Connection refused (error 111)
14:22:00.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:00.787353  1519 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.103.252" port: 33585 } attempt: 4
14:22:00.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:00.792912  1519 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.103.252:33585: Network error: Client connection negotiation failed: client connection to 127.1.103.252:33585: connect: Connection refused (error 111)
14:22:01.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.076587  1519 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.103.252" port: 33585 } attempt: 5
14:22:01.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:01.081483  1519 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.103.252:33585: Network error: Client connection negotiation failed: client connection to 127.1.103.252:33585: connect: Connection refused (error 111)
14:22:01.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.159251  1594 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.103.252" port: 33585 } attempt: 6
14:22:01.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:01.167515  1594 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.103.252:33585: Network error: Client connection negotiation failed: client connection to 127.1.103.252:33585: connect: Connection refused (error 111)
14:22:01.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:00.298528  1609 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:22:01.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:00.295215  1607 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:22:01.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:01.510177  1608 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
14:22:01.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.510324  1596 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:22:01.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.514287  1596 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:22:01.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.517084  1596 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:22:01.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.518539  1596 hybrid_clock.cc:648] HybridClock initialized: now 1779114121518507 us; error 42 us; skew 500 ppm
14:22:01.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.519538  1596 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:22:01.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.526207  1596 webserver.cc:533] Webserver started at http://127.1.103.252:46447/ using document root <none> and password file <none>
14:22:01.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.527560  1596 fs_manager.cc:362] Metadata directory not provided
14:22:01.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.527848  1596 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:22:01.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.528409  1596 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:22:01.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.532903  1596 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/master-2/data/instance:
14:22:01.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "8aabbe454c9b4d30b9bb00ebdf29eefd"
14:22:01.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:22:01 on dist-test-slave-psp9"
14:22:01.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.534217  1596 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/master-2/wal/instance:
14:22:01.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "8aabbe454c9b4d30b9bb00ebdf29eefd"
14:22:01.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:22:01 on dist-test-slave-psp9"
14:22:01.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.542737  1596 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.007s	sys 0.000s
14:22:01.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.548980  1620 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:22:01.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.550199  1596 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.006s	sys 0.000s
14:22:01.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.550505  1596 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/master-2/data,/tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/master-2/wal
14:22:01.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "8aabbe454c9b4d30b9bb00ebdf29eefd"
14:22:01.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:22:01 on dist-test-slave-psp9"
14:22:01.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.550904  1596 fs_report.cc:389] FS layout report
14:22:01.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:22:01.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/master-2/wal
14:22:01.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/master-2/wal
14:22:01.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/master-2/data/data
14:22:01.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:22:01.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:22:01.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:22:01.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:22:01.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:22:01.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:22:01.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:22:01.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:22:01.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:22:01.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:22:01.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:22:01.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.597844  1596 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:22:01.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.599468  1596 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:22:01.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.599895  1596 kserver.cc:163] Server-wide thread pool size limit: 3276
14:22:01.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.634109  1519 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.103.252" port: 33585 } attempt: 6
14:22:01.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:01.642099  1519 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.1.103.252:33585: Network error: Client connection negotiation failed: client connection to 127.1.103.252:33585: connect: Connection refused (error 111)
14:22:01.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.685482  1596 rpc_server.cc:307] RPC server started. Bound to: 127.1.103.252:33585
14:22:01.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.685608  1673 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.103.252:33585 every 8 connection(s)
14:22:01.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.688506  1596 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/master-2/data/info.pb
14:22:01.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.695111  1439 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskquUkVX/build/tsan/bin/kudu as pid 1596
14:22:01.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.695458  1439 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/master-2/wal/instance
14:22:01.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.696146  1674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
14:22:01.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.711853  1674 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.103.254" port: 45279 } has no permanent_uuid. Determining permanent_uuid...
14:22:01.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.739102  1674 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.103.253" port: 34625 } has no permanent_uuid. Determining permanent_uuid...
14:22:01.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.752266  1674 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.1.103.252" port: 33585 } has no permanent_uuid. Determining permanent_uuid...
14:22:01.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.769323  1674 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8aabbe454c9b4d30b9bb00ebdf29eefd: Bootstrap starting.
14:22:01.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.777383  1674 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8aabbe454c9b4d30b9bb00ebdf29eefd: Neither blocks nor log segments found. Creating new log.
14:22:01.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.779313  1674 log.cc:826] T 00000000000000000000000000000000 P 8aabbe454c9b4d30b9bb00ebdf29eefd: Log is configured to *not* fsync() on all Append() calls
14:22:01.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.785311  1674 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8aabbe454c9b4d30b9bb00ebdf29eefd: No bootstrap required, opened a new log
14:22:01.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.806910  1674 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8aabbe454c9b4d30b9bb00ebdf29eefd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c79f51bdb25d47599c9a2588268d1997" member_type: VOTER last_known_addr { host: "127.1.103.254" port: 45279 } } peers { permanent_uuid: "1a277314146b44308f4d0e7002f91de0" member_type: VOTER last_known_addr { host: "127.1.103.253" port: 34625 } } peers { permanent_uuid: "8aabbe454c9b4d30b9bb00ebdf29eefd" member_type: VOTER last_known_addr { host: "127.1.103.252" port: 33585 } }
14:22:01.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.807539  1674 raft_consensus.cc:385] T 00000000000000000000000000000000 P 8aabbe454c9b4d30b9bb00ebdf29eefd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:22:01.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.807726  1674 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8aabbe454c9b4d30b9bb00ebdf29eefd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8aabbe454c9b4d30b9bb00ebdf29eefd, State: Initialized, Role: FOLLOWER
14:22:01.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.808444  1674 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8aabbe454c9b4d30b9bb00ebdf29eefd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c79f51bdb25d47599c9a2588268d1997" member_type: VOTER last_known_addr { host: "127.1.103.254" port: 45279 } } peers { permanent_uuid: "1a277314146b44308f4d0e7002f91de0" member_type: VOTER last_known_addr { host: "127.1.103.253" port: 34625 } } peers { permanent_uuid: "8aabbe454c9b4d30b9bb00ebdf29eefd" member_type: VOTER last_known_addr { host: "127.1.103.252" port: 33585 } }
14:22:01.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.811100  1683 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8aabbe454c9b4d30b9bb00ebdf29eefd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c79f51bdb25d47599c9a2588268d1997" member_type: VOTER last_known_addr { host: "127.1.103.254" port: 45279 } } peers { permanent_uuid: "1a277314146b44308f4d0e7002f91de0" member_type: VOTER last_known_addr { host: "127.1.103.253" port: 34625 } } peers { permanent_uuid: "8aabbe454c9b4d30b9bb00ebdf29eefd" member_type: VOTER last_known_addr { host: "127.1.103.252" port: 33585 } } }
14:22:01.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.811688  1683 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8aabbe454c9b4d30b9bb00ebdf29eefd [sys.catalog]: This master's current role is: FOLLOWER
14:22:01.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.812448  1674 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8aabbe454c9b4d30b9bb00ebdf29eefd [sys.catalog]: configured and running, proceeding with master startup.
14:22:01.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:01.842662  1694 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 8aabbe454c9b4d30b9bb00ebdf29eefd: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
14:22:01.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:01.843077  1694 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
14:22:01.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:01.855434  1626 tablet.cc:2404] T 00000000000000000000000000000000 P 8aabbe454c9b4d30b9bb00ebdf29eefd: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:22:01.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.837793  1596 master_runner.cc:187] Error getting master registration for 127.1.103.254:45279: OK, instance_id { permanent_uuid: "c79f51bdb25d47599c9a2588268d1997" instance_seqno: 1779114118008971 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
14:22:01.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:01.875355  1596 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
14:22:02.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.228165  1594 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.103.252" port: 33585 } attempt: 7
14:22:02.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.234607  1683 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8aabbe454c9b4d30b9bb00ebdf29eefd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:22:02.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.235216  1683 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8aabbe454c9b4d30b9bb00ebdf29eefd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c79f51bdb25d47599c9a2588268d1997" member_type: VOTER last_known_addr { host: "127.1.103.254" port: 45279 } } peers { permanent_uuid: "1a277314146b44308f4d0e7002f91de0" member_type: VOTER last_known_addr { host: "127.1.103.253" port: 34625 } } peers { permanent_uuid: "8aabbe454c9b4d30b9bb00ebdf29eefd" member_type: VOTER last_known_addr { host: "127.1.103.252" port: 33585 } }
14:22:02.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.238951  1683 leader_election.cc:290] T 00000000000000000000000000000000 P 8aabbe454c9b4d30b9bb00ebdf29eefd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c79f51bdb25d47599c9a2588268d1997 (127.1.103.254:45279), 1a277314146b44308f4d0e7002f91de0 (127.1.103.253:34625)
14:22:02.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.252166  1594 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1a277314146b44308f4d0e7002f91de0: Bootstrap starting.
14:22:02.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.259856  1594 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1a277314146b44308f4d0e7002f91de0: Neither blocks nor log segments found. Creating new log.
14:22:02.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.262581  1594 log.cc:826] T 00000000000000000000000000000000 P 1a277314146b44308f4d0e7002f91de0: Log is configured to *not* fsync() on all Append() calls
14:22:02.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.268971  1594 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1a277314146b44308f4d0e7002f91de0: No bootstrap required, opened a new log
14:22:02.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.298720  1594 raft_consensus.cc:359] T 00000000000000000000000000000000 P 1a277314146b44308f4d0e7002f91de0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c79f51bdb25d47599c9a2588268d1997" member_type: VOTER last_known_addr { host: "127.1.103.254" port: 45279 } } peers { permanent_uuid: "1a277314146b44308f4d0e7002f91de0" member_type: VOTER last_known_addr { host: "127.1.103.253" port: 34625 } } peers { permanent_uuid: "8aabbe454c9b4d30b9bb00ebdf29eefd" member_type: VOTER last_known_addr { host: "127.1.103.252" port: 33585 } }
14:22:02.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.299654  1594 raft_consensus.cc:385] T 00000000000000000000000000000000 P 1a277314146b44308f4d0e7002f91de0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:22:02.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.300184  1594 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1a277314146b44308f4d0e7002f91de0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a277314146b44308f4d0e7002f91de0, State: Initialized, Role: FOLLOWER
14:22:02.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.301968  1594 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1a277314146b44308f4d0e7002f91de0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c79f51bdb25d47599c9a2588268d1997" member_type: VOTER last_known_addr { host: "127.1.103.254" port: 45279 } } peers { permanent_uuid: "1a277314146b44308f4d0e7002f91de0" member_type: VOTER last_known_addr { host: "127.1.103.253" port: 34625 } } peers { permanent_uuid: "8aabbe454c9b4d30b9bb00ebdf29eefd" member_type: VOTER last_known_addr { host: "127.1.103.252" port: 33585 } }
14:22:02.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.305166  1698 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a277314146b44308f4d0e7002f91de0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c79f51bdb25d47599c9a2588268d1997" member_type: VOTER last_known_addr { host: "127.1.103.254" port: 45279 } } peers { permanent_uuid: "1a277314146b44308f4d0e7002f91de0" member_type: VOTER last_known_addr { host: "127.1.103.253" port: 34625 } } peers { permanent_uuid: "8aabbe454c9b4d30b9bb00ebdf29eefd" member_type: VOTER last_known_addr { host: "127.1.103.252" port: 33585 } } }
14:22:02.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.305922  1698 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a277314146b44308f4d0e7002f91de0 [sys.catalog]: This master's current role is: FOLLOWER
14:22:02.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.308701  1594 sys_catalog.cc:565] T 00000000000000000000000000000000 P 1a277314146b44308f4d0e7002f91de0 [sys.catalog]: configured and running, proceeding with master startup.
14:22:02.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.308861  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8aabbe454c9b4d30b9bb00ebdf29eefd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a277314146b44308f4d0e7002f91de0" is_pre_election: true
14:22:02.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.309777  1569 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 1a277314146b44308f4d0e7002f91de0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8aabbe454c9b4d30b9bb00ebdf29eefd in term 0.
14:22:02.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.312573  1623 leader_election.cc:304] T 00000000000000000000000000000000 P 8aabbe454c9b4d30b9bb00ebdf29eefd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a277314146b44308f4d0e7002f91de0, 8aabbe454c9b4d30b9bb00ebdf29eefd; no voters: 
14:22:02.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.313490  1683 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8aabbe454c9b4d30b9bb00ebdf29eefd [term 0 FOLLOWER]: Leader pre-election won for term 1
14:22:02.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.313854  1683 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8aabbe454c9b4d30b9bb00ebdf29eefd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:22:02.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.314206  1683 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8aabbe454c9b4d30b9bb00ebdf29eefd [term 0 FOLLOWER]: Advancing to term 1
14:22:02.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.321004  1683 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8aabbe454c9b4d30b9bb00ebdf29eefd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c79f51bdb25d47599c9a2588268d1997" member_type: VOTER last_known_addr { host: "127.1.103.254" port: 45279 } } peers { permanent_uuid: "1a277314146b44308f4d0e7002f91de0" member_type: VOTER last_known_addr { host: "127.1.103.253" port: 34625 } } peers { permanent_uuid: "8aabbe454c9b4d30b9bb00ebdf29eefd" member_type: VOTER last_known_addr { host: "127.1.103.252" port: 33585 } }
14:22:02.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.325937  1683 leader_election.cc:290] T 00000000000000000000000000000000 P 8aabbe454c9b4d30b9bb00ebdf29eefd [CANDIDATE]: Term 1 election: Requested vote from peers c79f51bdb25d47599c9a2588268d1997 (127.1.103.254:45279), 1a277314146b44308f4d0e7002f91de0 (127.1.103.253:34625)
14:22:02.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.326757  1569 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8aabbe454c9b4d30b9bb00ebdf29eefd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a277314146b44308f4d0e7002f91de0"
14:22:02.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.327340  1569 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1a277314146b44308f4d0e7002f91de0 [term 0 FOLLOWER]: Advancing to term 1
14:22:02.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.334538  1569 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 1a277314146b44308f4d0e7002f91de0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aabbe454c9b4d30b9bb00ebdf29eefd in term 1.
14:22:02.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.337164  1623 leader_election.cc:304] T 00000000000000000000000000000000 P 8aabbe454c9b4d30b9bb00ebdf29eefd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a277314146b44308f4d0e7002f91de0, 8aabbe454c9b4d30b9bb00ebdf29eefd; no voters: 
14:22:02.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.339082  1683 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8aabbe454c9b4d30b9bb00ebdf29eefd [term 1 FOLLOWER]: Leader election won for term 1
14:22:02.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.344751  1683 raft_consensus.cc:697] T 00000000000000000000000000000000 P 8aabbe454c9b4d30b9bb00ebdf29eefd [term 1 LEADER]: Becoming Leader. State: Replica: 8aabbe454c9b4d30b9bb00ebdf29eefd, State: Running, Role: LEADER
14:22:02.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.346439  1683 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8aabbe454c9b4d30b9bb00ebdf29eefd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c79f51bdb25d47599c9a2588268d1997" member_type: VOTER last_known_addr { host: "127.1.103.254" port: 45279 } } peers { permanent_uuid: "1a277314146b44308f4d0e7002f91de0" member_type: VOTER last_known_addr { host: "127.1.103.253" port: 34625 } } peers { permanent_uuid: "8aabbe454c9b4d30b9bb00ebdf29eefd" member_type: VOTER last_known_addr { host: "127.1.103.252" port: 33585 } }
14:22:02.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.365948  1705 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8aabbe454c9b4d30b9bb00ebdf29eefd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8aabbe454c9b4d30b9bb00ebdf29eefd. Latest consensus state: current_term: 1 leader_uuid: "8aabbe454c9b4d30b9bb00ebdf29eefd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c79f51bdb25d47599c9a2588268d1997" member_type: VOTER last_known_addr { host: "127.1.103.254" port: 45279 } } peers { permanent_uuid: "1a277314146b44308f4d0e7002f91de0" member_type: VOTER last_known_addr { host: "127.1.103.253" port: 34625 } } peers { permanent_uuid: "8aabbe454c9b4d30b9bb00ebdf29eefd" member_type: VOTER last_known_addr { host: "127.1.103.252" port: 33585 } } }
14:22:02.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.367384  1705 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8aabbe454c9b4d30b9bb00ebdf29eefd [sys.catalog]: This master's current role is: LEADER
14:22:02.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.371861  1711 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
14:22:02.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.380064  1711 catalog_manager.cc:1520] Initializing Kudu cluster ID...
14:22:02.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:02.402981  1712 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 1a277314146b44308f4d0e7002f91de0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
14:22:02.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:02.403375  1712 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
14:22:02.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.411240  1569 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 1a277314146b44308f4d0e7002f91de0 [term 1 FOLLOWER]: Refusing update from remote peer 8aabbe454c9b4d30b9bb00ebdf29eefd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
14:22:02.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.413102  1683 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 8aabbe454c9b4d30b9bb00ebdf29eefd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1a277314146b44308f4d0e7002f91de0" member_type: VOTER last_known_addr { host: "127.1.103.253" port: 34625 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:22:02.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.377013  1521 master_runner.cc:187] Error getting master registration for 127.1.103.254:45279: OK, instance_id { permanent_uuid: "c79f51bdb25d47599c9a2588268d1997" instance_seqno: 1779114118008971 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
14:22:02.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.444466  1521 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
14:22:02.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.469110  1698 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a277314146b44308f4d0e7002f91de0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8aabbe454c9b4d30b9bb00ebdf29eefd. Latest consensus state: current_term: 1 leader_uuid: "8aabbe454c9b4d30b9bb00ebdf29eefd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c79f51bdb25d47599c9a2588268d1997" member_type: VOTER last_known_addr { host: "127.1.103.254" port: 45279 } } peers { permanent_uuid: "1a277314146b44308f4d0e7002f91de0" member_type: VOTER last_known_addr { host: "127.1.103.253" port: 34625 } } peers { permanent_uuid: "8aabbe454c9b4d30b9bb00ebdf29eefd" member_type: VOTER last_known_addr { host: "127.1.103.252" port: 33585 } } }
14:22:02.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.469944  1698 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a277314146b44308f4d0e7002f91de0 [sys.catalog]: This master's current role is: FOLLOWER
14:22:02.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.478921  1714 mvcc.cc:204] Tried to move back new op lower bound from 7287251445356060672 to 7287251445142515712. Current Snapshot: MvccSnapshot[applied={T|T < 7287251445356060672}]
14:22:02.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.491303  1715 mvcc.cc:204] Tried to move back new op lower bound from 7287251445356060672 to 7287251445142515712. Current Snapshot: MvccSnapshot[applied={T|T < 7287251445356060672}]
14:22:02.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.497135  1698 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1a277314146b44308f4d0e7002f91de0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8aabbe454c9b4d30b9bb00ebdf29eefd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c79f51bdb25d47599c9a2588268d1997" member_type: VOTER last_known_addr { host: "127.1.103.254" port: 45279 } } peers { permanent_uuid: "1a277314146b44308f4d0e7002f91de0" member_type: VOTER last_known_addr { host: "127.1.103.253" port: 34625 } } peers { permanent_uuid: "8aabbe454c9b4d30b9bb00ebdf29eefd" member_type: VOTER last_known_addr { host: "127.1.103.252" port: 33585 } } }
14:22:02.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.498080  1698 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1a277314146b44308f4d0e7002f91de0 [sys.catalog]: This master's current role is: FOLLOWER
14:22:02.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.506160  1683 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8aabbe454c9b4d30b9bb00ebdf29eefd [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8aabbe454c9b4d30b9bb00ebdf29eefd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c79f51bdb25d47599c9a2588268d1997" member_type: VOTER last_known_addr { host: "127.1.103.254" port: 45279 } } peers { permanent_uuid: "1a277314146b44308f4d0e7002f91de0" member_type: VOTER last_known_addr { host: "127.1.103.253" port: 34625 } } peers { permanent_uuid: "8aabbe454c9b4d30b9bb00ebdf29eefd" member_type: VOTER last_known_addr { host: "127.1.103.252" port: 33585 } } }
14:22:02.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.507098  1683 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8aabbe454c9b4d30b9bb00ebdf29eefd [sys.catalog]: This master's current role is: LEADER
14:22:02.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.509948  1711 catalog_manager.cc:1383] Generated new cluster ID: 611d3f7b82b74e6189737f5875664a59
14:22:02.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.510253  1711 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
14:22:02.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.569375  1711 catalog_manager.cc:1406] Generated new certificate authority record
14:22:02.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.571581  1711 catalog_manager.cc:1540] Loading token signing keys...
14:22:02.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.600355  1711 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 8aabbe454c9b4d30b9bb00ebdf29eefd: Generated new TSK 0
14:22:02.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.601534  1711 catalog_manager.cc:1550] Initializing in-progress tserver states...
14:22:02.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.645499  1439 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskquUkVX/build/tsan/bin/kudu
14:22:02.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskquUkVX/build/tsan/bin/kudu
14:22:02.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/ts-0/wal
14:22:02.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/ts-0/data
14:22:02.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:22:02.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:22:02.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:22:02.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:22:02.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:22:02.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:22:02.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/ts-0/logs
14:22:02.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/ts-0/data/info.pb
14:22:02.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:22:02.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:22:02.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:22:02.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:22:02.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:22:02.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:22:02.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:22:02.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:22:02.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
14:22:02.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:22:02.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.1.103.193:0
14:22:02.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.1.103.193
14:22:02.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.1.103.193
14:22:02.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:22:02.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.1.103.254:45279,127.1.103.253:34625,127.1.103.252:33585
14:22:02.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.1.103.212:37821
14:22:02.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:22:02.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:22:02.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
14:22:02.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.675956  1519 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.1.103.252" port: 33585 } attempt: 7
14:22:02.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.753003  1519 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c79f51bdb25d47599c9a2588268d1997: Bootstrap starting.
14:22:02.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.761998  1519 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c79f51bdb25d47599c9a2588268d1997: Neither blocks nor log segments found. Creating new log.
14:22:02.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.765442  1519 log.cc:826] T 00000000000000000000000000000000 P c79f51bdb25d47599c9a2588268d1997: Log is configured to *not* fsync() on all Append() calls
14:22:02.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.781170  1519 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c79f51bdb25d47599c9a2588268d1997: No bootstrap required, opened a new log
14:22:02.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.817587  1519 raft_consensus.cc:359] T 00000000000000000000000000000000 P c79f51bdb25d47599c9a2588268d1997 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c79f51bdb25d47599c9a2588268d1997" member_type: VOTER last_known_addr { host: "127.1.103.254" port: 45279 } } peers { permanent_uuid: "1a277314146b44308f4d0e7002f91de0" member_type: VOTER last_known_addr { host: "127.1.103.253" port: 34625 } } peers { permanent_uuid: "8aabbe454c9b4d30b9bb00ebdf29eefd" member_type: VOTER last_known_addr { host: "127.1.103.252" port: 33585 } }
14:22:02.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.821345  1519 raft_consensus.cc:385] T 00000000000000000000000000000000 P c79f51bdb25d47599c9a2588268d1997 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:22:02.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.822158  1519 raft_consensus.cc:740] T 00000000000000000000000000000000 P c79f51bdb25d47599c9a2588268d1997 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c79f51bdb25d47599c9a2588268d1997, State: Initialized, Role: FOLLOWER
14:22:02.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.823815  1519 consensus_queue.cc:260] T 00000000000000000000000000000000 P c79f51bdb25d47599c9a2588268d1997 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c79f51bdb25d47599c9a2588268d1997" member_type: VOTER last_known_addr { host: "127.1.103.254" port: 45279 } } peers { permanent_uuid: "1a277314146b44308f4d0e7002f91de0" member_type: VOTER last_known_addr { host: "127.1.103.253" port: 34625 } } peers { permanent_uuid: "8aabbe454c9b4d30b9bb00ebdf29eefd" member_type: VOTER last_known_addr { host: "127.1.103.252" port: 33585 } }
14:22:02.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.843818  1723 sys_catalog.cc:455] T 00000000000000000000000000000000 P c79f51bdb25d47599c9a2588268d1997 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c79f51bdb25d47599c9a2588268d1997" member_type: VOTER last_known_addr { host: "127.1.103.254" port: 45279 } } peers { permanent_uuid: "1a277314146b44308f4d0e7002f91de0" member_type: VOTER last_known_addr { host: "127.1.103.253" port: 34625 } } peers { permanent_uuid: "8aabbe454c9b4d30b9bb00ebdf29eefd" member_type: VOTER last_known_addr { host: "127.1.103.252" port: 33585 } } }
14:22:02.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.845862  1723 sys_catalog.cc:458] T 00000000000000000000000000000000 P c79f51bdb25d47599c9a2588268d1997 [sys.catalog]: This master's current role is: FOLLOWER
14:22:02.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.846112  1519 sys_catalog.cc:565] T 00000000000000000000000000000000 P c79f51bdb25d47599c9a2588268d1997 [sys.catalog]: configured and running, proceeding with master startup.
14:22:02.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.847318  1493 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8aabbe454c9b4d30b9bb00ebdf29eefd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c79f51bdb25d47599c9a2588268d1997"
14:22:02.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.848058  1493 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c79f51bdb25d47599c9a2588268d1997 [term 0 FOLLOWER]: Advancing to term 1
14:22:02.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.846283  1494 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8aabbe454c9b4d30b9bb00ebdf29eefd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c79f51bdb25d47599c9a2588268d1997" is_pre_election: true
14:22:02.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.858194  1493 raft_consensus.cc:2468] T 00000000000000000000000000000000 P c79f51bdb25d47599c9a2588268d1997 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8aabbe454c9b4d30b9bb00ebdf29eefd in term 1.
14:22:02.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.860347  1492 raft_consensus.cc:1275] T 00000000000000000000000000000000 P c79f51bdb25d47599c9a2588268d1997 [term 1 FOLLOWER]: Refusing update from remote peer 8aabbe454c9b4d30b9bb00ebdf29eefd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
14:22:02.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.868747  1719 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 8aabbe454c9b4d30b9bb00ebdf29eefd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c79f51bdb25d47599c9a2588268d1997" member_type: VOTER last_known_addr { host: "127.1.103.254" port: 45279 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
14:22:02.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.969442  1731 sys_catalog.cc:455] T 00000000000000000000000000000000 P c79f51bdb25d47599c9a2588268d1997 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8aabbe454c9b4d30b9bb00ebdf29eefd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c79f51bdb25d47599c9a2588268d1997" member_type: VOTER last_known_addr { host: "127.1.103.254" port: 45279 } } peers { permanent_uuid: "1a277314146b44308f4d0e7002f91de0" member_type: VOTER last_known_addr { host: "127.1.103.253" port: 34625 } } peers { permanent_uuid: "8aabbe454c9b4d30b9bb00ebdf29eefd" member_type: VOTER last_known_addr { host: "127.1.103.252" port: 33585 } } }
14:22:02.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.968732  1723 sys_catalog.cc:455] T 00000000000000000000000000000000 P c79f51bdb25d47599c9a2588268d1997 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8aabbe454c9b4d30b9bb00ebdf29eefd. Latest consensus state: current_term: 1 leader_uuid: "8aabbe454c9b4d30b9bb00ebdf29eefd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c79f51bdb25d47599c9a2588268d1997" member_type: VOTER last_known_addr { host: "127.1.103.254" port: 45279 } } peers { permanent_uuid: "1a277314146b44308f4d0e7002f91de0" member_type: VOTER last_known_addr { host: "127.1.103.253" port: 34625 } } peers { permanent_uuid: "8aabbe454c9b4d30b9bb00ebdf29eefd" member_type: VOTER last_known_addr { host: "127.1.103.252" port: 33585 } } }
14:22:02.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.979722  1723 sys_catalog.cc:458] T 00000000000000000000000000000000 P c79f51bdb25d47599c9a2588268d1997 [sys.catalog]: This master's current role is: FOLLOWER
14:22:02.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:02.975050  1731 sys_catalog.cc:458] T 00000000000000000000000000000000 P c79f51bdb25d47599c9a2588268d1997 [sys.catalog]: This master's current role is: FOLLOWER
14:22:03.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:03.031095  1739 catalog_manager.cc:1295] Loaded cluster ID: 611d3f7b82b74e6189737f5875664a59
14:22:03.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:03.031900  1739 catalog_manager.cc:1588] T 00000000000000000000000000000000 P c79f51bdb25d47599c9a2588268d1997: loading cluster ID for follower catalog manager: success
14:22:03.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:03.051991  1739 catalog_manager.cc:1610] T 00000000000000000000000000000000 P c79f51bdb25d47599c9a2588268d1997: acquiring CA information for follower catalog manager: success
14:22:03.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:03.068028  1739 catalog_manager.cc:1638] T 00000000000000000000000000000000 P c79f51bdb25d47599c9a2588268d1997: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
14:22:03.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:03.398437  1720 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:22:03.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:03.399624  1720 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:22:03.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:03.400650  1720 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:22:03.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:03.408947  1712 catalog_manager.cc:1295] Loaded cluster ID: 611d3f7b82b74e6189737f5875664a59
14:22:03.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:03.409258  1712 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 1a277314146b44308f4d0e7002f91de0: loading cluster ID for follower catalog manager: success
14:22:03.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:03.421976  1712 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 1a277314146b44308f4d0e7002f91de0: acquiring CA information for follower catalog manager: success
14:22:03.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:03.423830  1719 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8aabbe454c9b4d30b9bb00ebdf29eefd [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8aabbe454c9b4d30b9bb00ebdf29eefd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c79f51bdb25d47599c9a2588268d1997" member_type: VOTER last_known_addr { host: "127.1.103.254" port: 45279 } } peers { permanent_uuid: "1a277314146b44308f4d0e7002f91de0" member_type: VOTER last_known_addr { host: "127.1.103.253" port: 34625 } } peers { permanent_uuid: "8aabbe454c9b4d30b9bb00ebdf29eefd" member_type: VOTER last_known_addr { host: "127.1.103.252" port: 33585 } } }
14:22:03.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:03.425052  1719 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8aabbe454c9b4d30b9bb00ebdf29eefd [sys.catalog]: This master's current role is: LEADER
14:22:03.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:03.435263  1712 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 1a277314146b44308f4d0e7002f91de0: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
14:22:03.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:03.466868  1720 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:22:03.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:03.468750  1720 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.103.193
14:22:03.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:03.536389  1720 tablet_server_runner.cc:78] Tablet server non-default flags:
14:22:03.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:22:03.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.1.103.212:37821
14:22:03.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:22:03.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:22:03.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/ts-0/data
14:22:03.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/ts-0/wal
14:22:03.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:22:03.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:22:03.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.1.103.193:0
14:22:03.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:22:03.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:22:03.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:22:03.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/ts-0/data/info.pb
14:22:03.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.1.103.193
14:22:03.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:22:03.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.1.103.254:45279,127.1.103.253:34625,127.1.103.252:33585
14:22:03.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:22:03.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:22:03.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:22:03.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:22:03.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:22:03.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.1.103.193
14:22:03.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/ts-0/logs
14:22:03.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:22:03.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:22:03.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:22:03.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
14:22:03.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:22:03.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:22:03.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:22:03.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:22:03.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:22:03.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:22:03.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:03.541246  1720 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:22:03.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:03.543889  1720 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:22:03.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:03.587837  1749 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:22:06.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:04.972189  1747 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 1720
14:22:06.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:06.658123  1747 kernel_stack_watchdog.cc:198] Thread 1720 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 381ms:
14:22:06.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
14:22:06.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
14:22:06.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
14:22:06.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
14:22:06.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:03.591180  1748 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:22:06.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:06.659723  1720 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 3.070s	user 0.568s	sys 0.874s
14:22:06.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:06.660315  1720 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 3.071s	user 0.568s	sys 0.874s
14:22:06.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:06.661921  1750 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 3071 milliseconds
14:22:06.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:06.664825  1751 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:22:06.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:06.664893  1720 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:22:06.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:06.666399  1720 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:22:06.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:06.680526  1720 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:22:06.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:06.682420  1720 hybrid_clock.cc:648] HybridClock initialized: now 1779114126682380 us; error 58 us; skew 500 ppm
14:22:06.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:06.683947  1720 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:22:06.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:06.721092  1720 webserver.cc:533] Webserver started at http://127.1.103.193:46027/ using document root <none> and password file <none>
14:22:06.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:06.722944  1720 fs_manager.cc:362] Metadata directory not provided
14:22:06.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:06.723582  1720 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:22:06.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:06.724435  1720 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:22:06.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:06.732299  1720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/ts-0/data/instance:
14:22:06.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "bb356ef1ebde4ed68e3de07798e6e84b"
14:22:06.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:22:06 on dist-test-slave-psp9"
14:22:06.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:06.733891  1720 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/ts-0/wal/instance:
14:22:06.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "bb356ef1ebde4ed68e3de07798e6e84b"
14:22:06.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:22:06 on dist-test-slave-psp9"
14:22:06.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:06.744855  1720 fs_manager.cc:696] Time spent creating directory manager: real 0.010s	user 0.006s	sys 0.002s
14:22:06.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:06.753202  1760 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:22:06.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:06.754837  1720 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.005s	sys 0.002s
14:22:06.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:06.755237  1720 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/ts-0/data,/tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/ts-0/wal
14:22:06.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "bb356ef1ebde4ed68e3de07798e6e84b"
14:22:06.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:22:06 on dist-test-slave-psp9"
14:22:06.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:06.755676  1720 fs_report.cc:389] FS layout report
14:22:06.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:22:06.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/ts-0/wal
14:22:06.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/ts-0/wal
14:22:06.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/ts-0/data/data
14:22:06.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:22:06.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:22:06.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:22:06.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:22:06.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:22:06.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:22:06.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:22:06.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:22:06.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:22:06.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:22:06.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:22:06.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:06.846335  1720 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:22:06.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:06.848351  1720 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:22:06.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:06.848924  1720 kserver.cc:163] Server-wide thread pool size limit: 3276
14:22:06.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:06.852774  1720 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
14:22:06.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:06.858592  1720 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
14:22:06.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:06.859334  1720 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s	user 0.001s	sys 0.000s
14:22:06.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:06.859660  1720 ts_tablet_manager.cc:616] Registered 0 tablets
14:22:06.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:06.859871  1720 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
14:22:07.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:07.085023  1720 rpc_server.cc:307] RPC server started. Bound to: 127.1.103.193:42363
14:22:07.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:07.085055  1872 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.103.193:42363 every 8 connection(s)
14:22:07.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:07.088514  1720 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/ts-0/data/info.pb
14:22:07.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:07.095112  1439 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskquUkVX/build/tsan/bin/kudu as pid 1720
14:22:07.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:07.095754  1439 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/ts-0/wal/instance
14:22:07.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:07.110754  1439 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskquUkVX/build/tsan/bin/kudu
14:22:07.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskquUkVX/build/tsan/bin/kudu
14:22:07.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/ts-1/wal
14:22:07.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/ts-1/data
14:22:07.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:22:07.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:22:07.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:22:07.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:22:07.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:22:07.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:22:07.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/ts-1/logs
14:22:07.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/ts-1/data/info.pb
14:22:07.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:22:07.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:22:07.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:22:07.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:22:07.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:22:07.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:22:07.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:22:07.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:22:07.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
14:22:07.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:22:07.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.1.103.194:0
14:22:07.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.1.103.194
14:22:07.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.1.103.194
14:22:07.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:22:07.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.1.103.254:45279,127.1.103.253:34625,127.1.103.252:33585
14:22:07.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.1.103.212:37821
14:22:07.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:22:07.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:22:07.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
14:22:07.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:07.249480  1874 heartbeater.cc:344] Connected to a master server at 127.1.103.253:34625
14:22:07.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:07.250159  1874 heartbeater.cc:461] Registering TS with master...
14:22:07.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:07.252632  1874 heartbeater.cc:507] Master 127.1.103.253:34625 requested a full tablet report, sending...
14:22:07.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:07.257418  1559 ts_manager.cc:194] Registered new tserver with Master: bb356ef1ebde4ed68e3de07798e6e84b (127.1.103.193:42363)
14:22:07.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:07.261708  1873 heartbeater.cc:344] Connected to a master server at 127.1.103.252:33585
14:22:07.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:07.262101  1873 heartbeater.cc:461] Registering TS with master...
14:22:07.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:07.263149  1873 heartbeater.cc:507] Master 127.1.103.252:33585 requested a full tablet report, sending...
14:22:07.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:07.265873  1637 ts_manager.cc:194] Registered new tserver with Master: bb356ef1ebde4ed68e3de07798e6e84b (127.1.103.193:42363)
14:22:07.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:07.268296  1878 heartbeater.cc:344] Connected to a master server at 127.1.103.254:45279
14:22:07.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:07.268249  1637 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.1.103.193:41005
14:22:07.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:07.268667  1878 heartbeater.cc:461] Registering TS with master...
14:22:07.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:07.269614  1878 heartbeater.cc:507] Master 127.1.103.254:45279 requested a full tablet report, sending...
14:22:07.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:07.273518  1484 ts_manager.cc:194] Registered new tserver with Master: bb356ef1ebde4ed68e3de07798e6e84b (127.1.103.193:42363)
14:22:07.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:07.511520  1877 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:22:07.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:07.512017  1877 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:22:07.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:07.512418  1877 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:22:07.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:07.545150  1877 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:22:07.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:07.545939  1877 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.103.194
14:22:07.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:07.581678  1877 tablet_server_runner.cc:78] Tablet server non-default flags:
14:22:07.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:22:07.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.1.103.212:37821
14:22:07.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:22:07.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:22:07.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/ts-1/data
14:22:07.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/ts-1/wal
14:22:07.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:22:07.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:22:07.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.1.103.194:0
14:22:07.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:22:07.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:22:07.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:22:07.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/ts-1/data/info.pb
14:22:07.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.1.103.194
14:22:07.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:22:07.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.1.103.254:45279,127.1.103.253:34625,127.1.103.252:33585
14:22:07.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:22:07.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:22:07.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:22:07.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:22:07.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:22:07.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.1.103.194
14:22:07.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/ts-1/logs
14:22:07.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:22:07.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:22:07.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:22:07.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
14:22:07.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:22:07.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:22:07.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:22:07.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:22:07.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:22:07.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:22:07.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:07.582996  1877 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:22:07.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:07.585176  1877 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:22:07.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:07.601356  1890 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:22:08.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:08.272825  1873 heartbeater.cc:499] Master 127.1.103.252:33585 was elected leader, sending a full tablet report...
14:22:09.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:09.004544  1888 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 1877
14:22:09.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:09.358996  1888 kernel_stack_watchdog.cc:198] Thread 1877 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 400ms:
14:22:09.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
14:22:09.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
14:22:09.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
14:22:09.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
14:22:09.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:07.601347  1889 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:22:09.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:09.361131  1877 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.759s	user 0.655s	sys 1.064s
14:22:09.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:09.361593  1877 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.760s	user 0.655s	sys 1.064s
14:22:09.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:09.361860  1891 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1757 milliseconds
14:22:09.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:09.363180  1892 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:22:09.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.363139  1877 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:22:09.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.367714  1877 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:22:09.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.370002  1877 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:22:09.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.371381  1877 hybrid_clock.cc:648] HybridClock initialized: now 1779114129371362 us; error 59 us; skew 500 ppm
14:22:09.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.372246  1877 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:22:09.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.379051  1877 webserver.cc:533] Webserver started at http://127.1.103.194:46363/ using document root <none> and password file <none>
14:22:09.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.380045  1877 fs_manager.cc:362] Metadata directory not provided
14:22:09.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.380251  1877 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:22:09.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.380677  1877 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:22:09.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.385473  1877 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/ts-1/data/instance:
14:22:09.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "48d894fb9d2c4bf29da35ea457e92160"
14:22:09.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:22:09 on dist-test-slave-psp9"
14:22:09.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.386592  1877 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/ts-1/wal/instance:
14:22:09.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "48d894fb9d2c4bf29da35ea457e92160"
14:22:09.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:22:09 on dist-test-slave-psp9"
14:22:09.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.393699  1877 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.001s
14:22:09.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.399235  1900 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:22:09.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.400447  1877 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.002s
14:22:09.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.400765  1877 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/ts-1/data,/tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/ts-1/wal
14:22:09.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "48d894fb9d2c4bf29da35ea457e92160"
14:22:09.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:22:09 on dist-test-slave-psp9"
14:22:09.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.401072  1877 fs_report.cc:389] FS layout report
14:22:09.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:22:09.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/ts-1/wal
14:22:09.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/ts-1/wal
14:22:09.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/ts-1/data/data
14:22:09.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:22:09.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:22:09.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:22:09.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:22:09.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:22:09.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:22:09.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:22:09.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:22:09.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:22:09.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:22:09.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:22:09.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.450742  1877 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:22:09.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.452360  1877 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:22:09.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.452805  1877 kserver.cc:163] Server-wide thread pool size limit: 3276
14:22:09.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.455452  1877 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
14:22:09.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.459954  1877 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
14:22:09.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.460163  1877 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
14:22:09.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.460366  1877 ts_tablet_manager.cc:616] Registered 0 tablets
14:22:09.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.460502  1877 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
14:22:09.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.613082  1877 rpc_server.cc:307] RPC server started. Bound to: 127.1.103.194:33903
14:22:09.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.613196  2012 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.103.194:33903 every 8 connection(s)
14:22:09.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.615876  1877 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/ts-1/data/info.pb
14:22:09.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.617857  1439 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskquUkVX/build/tsan/bin/kudu as pid 1877
14:22:09.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.618817  1439 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/ts-1/wal/instance
14:22:09.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.633764  1439 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskquUkVX/build/tsan/bin/kudu
14:22:09.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskquUkVX/build/tsan/bin/kudu
14:22:09.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/ts-2/wal
14:22:09.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/ts-2/data
14:22:09.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:22:09.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:22:09.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:22:09.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:22:09.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:22:09.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:22:09.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/ts-2/logs
14:22:09.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/ts-2/data/info.pb
14:22:09.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:22:09.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:22:09.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:22:09.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:22:09.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:22:09.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:22:09.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:22:09.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:22:09.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
14:22:09.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:22:09.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.1.103.195:0
14:22:09.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.1.103.195
14:22:09.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.1.103.195
14:22:09.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:22:09.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.1.103.254:45279,127.1.103.253:34625,127.1.103.252:33585
14:22:09.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.1.103.212:37821
14:22:09.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:22:09.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:22:09.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
14:22:09.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.666154  2014 heartbeater.cc:344] Connected to a master server at 127.1.103.253:34625
14:22:09.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.666703  2014 heartbeater.cc:461] Registering TS with master...
14:22:09.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.667797  2015 heartbeater.cc:344] Connected to a master server at 127.1.103.254:45279
14:22:09.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.667987  2014 heartbeater.cc:507] Master 127.1.103.253:34625 requested a full tablet report, sending...
14:22:09.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.668162  2015 heartbeater.cc:461] Registering TS with master...
14:22:09.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.668967  2015 heartbeater.cc:507] Master 127.1.103.254:45279 requested a full tablet report, sending...
14:22:09.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.671080  1559 ts_manager.cc:194] Registered new tserver with Master: 48d894fb9d2c4bf29da35ea457e92160 (127.1.103.194:33903)
14:22:09.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.672145  2013 heartbeater.cc:344] Connected to a master server at 127.1.103.252:33585
14:22:09.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.672473  2013 heartbeater.cc:461] Registering TS with master...
14:22:09.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.673130  2013 heartbeater.cc:507] Master 127.1.103.252:33585 requested a full tablet report, sending...
14:22:09.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.673565  1484 ts_manager.cc:194] Registered new tserver with Master: 48d894fb9d2c4bf29da35ea457e92160 (127.1.103.194:33903)
14:22:09.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.674998  1637 ts_manager.cc:194] Registered new tserver with Master: 48d894fb9d2c4bf29da35ea457e92160 (127.1.103.194:33903)
14:22:09.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:09.676556  1637 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.1.103.194:48351
14:22:09.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:09.825284  1670 debug-util.cc:398] Leaking SignalData structure 0x7b08000b0b00 after lost signal to thread 1601
14:22:10.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:10.116626  2023 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:22:10.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:10.117131  2023 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:22:10.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:10.117537  2023 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:22:10.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:10.154156  2023 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:22:10.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:10.155048  2023 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.1.103.195
14:22:10.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:10.212478  2023 tablet_server_runner.cc:78] Tablet server non-default flags:
14:22:10.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:22:10.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.1.103.212:37821
14:22:10.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:22:10.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:22:10.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/ts-2/data
14:22:10.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/ts-2/wal
14:22:10.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:22:10.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:22:10.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.1.103.195:0
14:22:10.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:22:10.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:22:10.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:22:10.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/ts-2/data/info.pb
14:22:10.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.1.103.195
14:22:10.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:22:10.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.1.103.254:45279,127.1.103.253:34625,127.1.103.252:33585
14:22:10.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:22:10.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:22:10.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:22:10.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:22:10.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:22:10.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.1.103.195
14:22:10.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/ts-2/logs
14:22:10.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:22:10.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:22:10.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:22:10.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
14:22:10.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:22:10.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 6bee9a2d051767e07c70d440ae169cb7177a10f8
14:22:10.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:22:10.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 14:03:54 UTC on bdcb31816ec0
14:22:10.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 15854
14:22:10.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:22:10.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:10.213827  2023 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:22:10.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:10.215507  2023 file_cache.cc:492] Constructed file cache file cache with capacity 419430
14:22:10.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:10.234179  2030 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:22:10.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:10.680038  2013 heartbeater.cc:499] Master 127.1.103.252:33585 was elected leader, sending a full tablet report...
14:22:11.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:10.237529  2031 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:22:11.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:11.805691  2033 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:22:11.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:11.810441  2032 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1573 milliseconds
14:22:11.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:11.810545  2023 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:22:11.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:11.812033  2023 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:22:11.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:11.814492  2023 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:22:11.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:11.815937  2023 hybrid_clock.cc:648] HybridClock initialized: now 1779114131815891 us; error 61 us; skew 500 ppm
14:22:11.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:11.816793  2023 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:22:11.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:11.824357  2023 webserver.cc:533] Webserver started at http://127.1.103.195:42473/ using document root <none> and password file <none>
14:22:11.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:11.825392  2023 fs_manager.cc:362] Metadata directory not provided
14:22:11.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:11.825711  2023 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:22:11.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:11.826246  2023 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:22:11.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:11.830894  2023 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/ts-2/data/instance:
14:22:11.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d01a61f77a87460fa13dc7ce33d738c7"
14:22:11.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:22:11 on dist-test-slave-psp9"
14:22:11.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:11.832010  2023 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/ts-2/wal/instance:
14:22:11.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d01a61f77a87460fa13dc7ce33d738c7"
14:22:11.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:22:11 on dist-test-slave-psp9"
14:22:11.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:11.840219  2023 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.008s	sys 0.000s
14:22:11.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:11.846886  2040 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:22:11.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:11.848186  2023 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.004s	sys 0.000s
14:22:11.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:11.848564  2023 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/ts-2/data,/tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/ts-2/wal
14:22:11.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d01a61f77a87460fa13dc7ce33d738c7"
14:22:11.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 14:22:11 on dist-test-slave-psp9"
14:22:11.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:11.849037  2023 fs_report.cc:389] FS layout report
14:22:11.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:22:11.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/ts-2/wal
14:22:11.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/ts-2/wal
14:22:11.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/ts-2/data/data
14:22:11.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:22:11.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:22:11.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:22:11.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:22:11.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:22:11.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:22:11.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:22:11.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:22:11.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:22:11.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:22:11.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:22:12.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:12.005013  2023 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:22:12.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:12.007390  2023 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:22:12.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:12.007839  2023 kserver.cc:163] Server-wide thread pool size limit: 3276
14:22:12.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:12.013338  2023 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
14:22:12.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:12.020327  2023 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
14:22:12.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:12.020726  2023 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
14:22:12.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:12.021039  2023 ts_tablet_manager.cc:616] Registered 0 tablets
14:22:12.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:12.021276  2023 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
14:22:12.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:12.359678  2023 rpc_server.cc:307] RPC server started. Bound to: 127.1.103.195:40917
14:22:12.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:12.359724  2152 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.1.103.195:40917 every 8 connection(s)
14:22:12.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:12.363853  2023 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/ts-2/data/info.pb
14:22:12.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:12.368248  1439 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskquUkVX/build/tsan/bin/kudu as pid 2023
14:22:12.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:12.368779  1439 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskquUkVX/test-tmp/mini-kudu-cluster10648994644713197903/ts-2/wal/instance
14:22:12.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:12.443210  2154 heartbeater.cc:344] Connected to a master server at 127.1.103.253:34625
14:22:12.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:12.443868  2154 heartbeater.cc:461] Registering TS with master...
14:22:12.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:12.447562  2154 heartbeater.cc:507] Master 127.1.103.253:34625 requested a full tablet report, sending...
14:22:12.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:12.448470  2153 heartbeater.cc:344] Connected to a master server at 127.1.103.252:33585
14:22:12.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:12.448830  2153 heartbeater.cc:461] Registering TS with master...
14:22:12.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:12.449928  2153 heartbeater.cc:507] Master 127.1.103.252:33585 requested a full tablet report, sending...
14:22:12.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:12.454008  1637 ts_manager.cc:194] Registered new tserver with Master: d01a61f77a87460fa13dc7ce33d738c7 (127.1.103.195:40917)
14:22:12.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:12.455996  1558 ts_manager.cc:194] Registered new tserver with Master: d01a61f77a87460fa13dc7ce33d738c7 (127.1.103.195:40917)
14:22:12.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:12.458369  1637 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.1.103.195:41493
14:22:12.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:12.465698  2157 heartbeater.cc:344] Connected to a master server at 127.1.103.254:45279
14:22:12.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:12.466085  2157 heartbeater.cc:461] Registering TS with master...
14:22:12.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:12.466871  2157 heartbeater.cc:507] Master 127.1.103.254:45279 requested a full tablet report, sending...
14:22:12.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:12.469830  1484 ts_manager.cc:194] Registered new tserver with Master: d01a61f77a87460fa13dc7ce33d738c7 (127.1.103.195:40917)
14:22:12.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:12.488848  1439 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
14:22:12.503 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
14:22:12.505 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

14:22:12.518 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.1.103.254"
      port: 45279
    }
    bound_http_address {
      host: "127.1.103.254"
      port: 41891
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.1.103.253"
      port: 34625
    }
    bound_http_address {
      host: "127.1.103.253"
      port: 44773
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.1.103.252"
      port: 33585
    }
    bound_http_address {
      host: "127.1.103.252"
      port: 46447
    }
  }
}

14:22:12.522 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

14:22:12.525 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.1.103.193"
      port: 42363
    }
    bound_http_address {
      host: "127.1.103.193"
      port: 46027
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.1.103.194"
      port: 33903
    }
    bound_http_address {
      host: "127.1.103.194"
      port: 46363
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.1.103.195"
      port: 40917
    }
    bound_http_address {
      host: "127.1.103.195"
      port: 42473
    }
  }
}

14:22:12.526 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
14:22:12.758 [DEBUG - main] (CompositeStrategy.java:59) Unable to load modern Subject methods, relying only on legacy methods
java.lang.NoSuchMethodException: javax.security.auth.Subject.current()
	at java.base/java.lang.Class.getDeclaredMethod(Class.java:2677)
	at org.apache.kudu.client.internals.ModernStrategy.<init>(ModernStrategy.java:51)
	at org.apache.kudu.client.internals.CompositeStrategy.<init>(CompositeStrategy.java:52)
	at org.apache.kudu.client.internals.CompositeStrategy.<clinit>(CompositeStrategy.java:41)
	at org.apache.kudu.client.internals.SecurityManagerCompatibility.get(SecurityManagerCompatibility.java:43)
	at org.apache.kudu.client.SecurityContext.setupSubject(SecurityContext.java:155)
	at org.apache.kudu.client.SecurityContext.<init>(SecurityContext.java:138)
	at org.apache.kudu.client.AsyncKuduClient.<init>(AsyncKuduClient.java:431)
	at org.apache.kudu.client.AsyncKuduClient$AsyncKuduClientBuilder.build(AsyncKuduClient.java:3109)
	at org.apache.kudu.test.KuduTestHarness.before(KuduTestHarness.java:161)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:50)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.doOneAttempt(RetryRule.java:225)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.evaluate(RetryRule.java:246)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runners.Suite.runChild(Suite.java:128)
	at org.junit.runners.Suite.runChild(Suite.java:27)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
	at org.junit.runner.JUnitCore.runMain(JUnitCore.java:77)
	at org.junit.runner.JUnitCore.main(JUnitCore.java:36)
14:22:12.817 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:22:12.974 [DEBUG - main] (Connection.java:748) [peer master-127.1.103.253:34625(127.1.103.253:34625)] connecting to peer
14:22:13.028 [DEBUG - main] (Connection.java:748) [peer master-127.1.103.254:45279(127.1.103.254:45279)] connecting to peer
14:22:13.030 [DEBUG - main] (Connection.java:748) [peer master-127.1.103.252:33585(127.1.103.252:33585)] connecting to peer
14:22:13.049 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.1.103.254:45279(127.1.103.254:45279)] Successfully connected to peer
14:22:13.051 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.1.103.253:34625(127.1.103.253:34625)] Successfully connected to peer
14:22:13.051 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.1.103.252:33585(127.1.103.252:33585)] Successfully connected to peer
14:22:13.154 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.1.103.253
14:22:13.154 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.1.103.254
14:22:13.155 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.1.103.252
14:22:13.392 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x74e10067, L:/127.0.0.1:59086 - R:/127.1.103.252:33585] using SASL/PLAIN
14:22:13.392 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xa423e146, L:/127.0.0.1:36384 - R:/127.1.103.254:45279] using SASL/PLAIN
14:22:13.392 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x87b60bb1, L:/127.0.0.1:44252 - R:/127.1.103.253:34625] using SASL/PLAIN
14:22:13.431 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:22:13.432 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=496), Traces: [0ms] refreshing cache from master, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.103.253:34625, [89ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.103.254:45279, [91ms] Sub RPC ConnectToMaster: sending RPC to server master-127.1.103.252:33585, [468ms] Sub RPC ConnectToMaster: received response from server master-127.1.103.253:34625: OK, [468ms] Sub RPC ConnectToMaster: received response from server master-127.1.103.254:45279: OK, [469ms] Sub RPC ConnectToMaster: received response from server master-127.1.103.252:33585: OK, deferred=null) after lookup
14:22:13.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.463435  2153 heartbeater.cc:499] Master 127.1.103.252:33585 was elected leader, sending a full tablet report...
14:22:13.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.479127  1637 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59086:
14:22:13.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "org.apache.kudu.client.TestLeaderFailover-1779114114883"
14:22:13.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
14:22:13.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:22:13.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key"
14:22:13.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
14:22:13.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
14:22:13.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:22:13.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:22:13.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:22:13.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:22:13.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:22:13.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:22:13.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column1_i"
14:22:13.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
14:22:13.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:22:13.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:22:13.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:22:13.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:22:13.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:22:13.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:22:13.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:22:13.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column2_i"
14:22:13.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
14:22:13.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:22:13.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:22:13.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:22:13.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:22:13.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:22:13.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:22:13.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:22:13.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column3_s"
14:22:13.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
14:22:13.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:22:13.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: true
14:22:13.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: DICT_ENCODING
14:22:13.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: LZ4
14:22:13.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 4096
14:22:13.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:22:13.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:22:13.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:22:13.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:22:13.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column4_b"
14:22:13.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BOOL
14:22:13.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:22:13.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:22:13.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:22:13.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:22:13.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:22:13.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:22:13.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
14:22:13.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
14:22:13.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
14:22:13.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
14:22:13.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key"
14:22:13.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
14:22:13.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:22:13.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
14:22:13.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:13.482992  1637 catalog_manager.cc:7059] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table org.apache.kudu.client.TestLeaderFailover-1779114114883 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
14:22:13.546 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 52b4c9db5fe94017b4bd9b172b66fe1c
14:22:13.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.588562  1948 tablet_service.cc:1511] Processing CreateTablet for tablet b8130f9d2a6d487693f90a0a265c6c0c (DEFAULT_TABLE table=org.apache.kudu.client.TestLeaderFailover-1779114114883 [id=52b4c9db5fe94017b4bd9b172b66fe1c]), partition=RANGE (key) PARTITION UNBOUNDED
14:22:13.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.591506  1948 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8130f9d2a6d487693f90a0a265c6c0c. 1 dirs total, 0 dirs full, 0 dirs failed
14:22:13.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.596233  1808 tablet_service.cc:1511] Processing CreateTablet for tablet b8130f9d2a6d487693f90a0a265c6c0c (DEFAULT_TABLE table=org.apache.kudu.client.TestLeaderFailover-1779114114883 [id=52b4c9db5fe94017b4bd9b172b66fe1c]), partition=RANGE (key) PARTITION UNBOUNDED
14:22:13.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.600037  1808 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8130f9d2a6d487693f90a0a265c6c0c. 1 dirs total, 0 dirs full, 0 dirs failed
14:22:13.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.604085  2088 tablet_service.cc:1511] Processing CreateTablet for tablet b8130f9d2a6d487693f90a0a265c6c0c (DEFAULT_TABLE table=org.apache.kudu.client.TestLeaderFailover-1779114114883 [id=52b4c9db5fe94017b4bd9b172b66fe1c]), partition=RANGE (key) PARTITION UNBOUNDED
14:22:13.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.606436  2088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8130f9d2a6d487693f90a0a265c6c0c. 1 dirs total, 0 dirs full, 0 dirs failed
14:22:13.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.648238  2188 tablet_bootstrap.cc:492] T b8130f9d2a6d487693f90a0a265c6c0c P 48d894fb9d2c4bf29da35ea457e92160: Bootstrap starting.
14:22:13.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.652026  2189 tablet_bootstrap.cc:492] T b8130f9d2a6d487693f90a0a265c6c0c P d01a61f77a87460fa13dc7ce33d738c7: Bootstrap starting.
14:22:13.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.659530  2188 tablet_bootstrap.cc:654] T b8130f9d2a6d487693f90a0a265c6c0c P 48d894fb9d2c4bf29da35ea457e92160: Neither blocks nor log segments found. Creating new log.
14:22:13.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.659723  2189 tablet_bootstrap.cc:654] T b8130f9d2a6d487693f90a0a265c6c0c P d01a61f77a87460fa13dc7ce33d738c7: Neither blocks nor log segments found. Creating new log.
14:22:13.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.662573  2188 log.cc:826] T b8130f9d2a6d487693f90a0a265c6c0c P 48d894fb9d2c4bf29da35ea457e92160: Log is configured to *not* fsync() on all Append() calls
14:22:13.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.662668  2189 log.cc:826] T b8130f9d2a6d487693f90a0a265c6c0c P d01a61f77a87460fa13dc7ce33d738c7: Log is configured to *not* fsync() on all Append() calls
14:22:13.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.668740  2190 tablet_bootstrap.cc:492] T b8130f9d2a6d487693f90a0a265c6c0c P bb356ef1ebde4ed68e3de07798e6e84b: Bootstrap starting.
14:22:13.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.670707  2189 tablet_bootstrap.cc:492] T b8130f9d2a6d487693f90a0a265c6c0c P d01a61f77a87460fa13dc7ce33d738c7: No bootstrap required, opened a new log
14:22:13.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.671240  2189 ts_tablet_manager.cc:1403] T b8130f9d2a6d487693f90a0a265c6c0c P d01a61f77a87460fa13dc7ce33d738c7: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.008s
14:22:13.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.671370  2188 tablet_bootstrap.cc:492] T b8130f9d2a6d487693f90a0a265c6c0c P 48d894fb9d2c4bf29da35ea457e92160: No bootstrap required, opened a new log
14:22:13.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.671891  2188 ts_tablet_manager.cc:1403] T b8130f9d2a6d487693f90a0a265c6c0c P 48d894fb9d2c4bf29da35ea457e92160: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.012s
14:22:13.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.679456  2190 tablet_bootstrap.cc:654] T b8130f9d2a6d487693f90a0a265c6c0c P bb356ef1ebde4ed68e3de07798e6e84b: Neither blocks nor log segments found. Creating new log.
14:22:13.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.682359  2190 log.cc:826] T b8130f9d2a6d487693f90a0a265c6c0c P bb356ef1ebde4ed68e3de07798e6e84b: Log is configured to *not* fsync() on all Append() calls
14:22:13.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.702163  2189 raft_consensus.cc:359] T b8130f9d2a6d487693f90a0a265c6c0c P d01a61f77a87460fa13dc7ce33d738c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb356ef1ebde4ed68e3de07798e6e84b" member_type: VOTER last_known_addr { host: "127.1.103.193" port: 42363 } } peers { permanent_uuid: "d01a61f77a87460fa13dc7ce33d738c7" member_type: VOTER last_known_addr { host: "127.1.103.195" port: 40917 } } peers { permanent_uuid: "48d894fb9d2c4bf29da35ea457e92160" member_type: VOTER last_known_addr { host: "127.1.103.194" port: 33903 } }
14:22:13.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.703199  2189 raft_consensus.cc:385] T b8130f9d2a6d487693f90a0a265c6c0c P d01a61f77a87460fa13dc7ce33d738c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:22:13.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.703505  2189 raft_consensus.cc:740] T b8130f9d2a6d487693f90a0a265c6c0c P d01a61f77a87460fa13dc7ce33d738c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d01a61f77a87460fa13dc7ce33d738c7, State: Initialized, Role: FOLLOWER
14:22:13.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.704701  2189 consensus_queue.cc:260] T b8130f9d2a6d487693f90a0a265c6c0c P d01a61f77a87460fa13dc7ce33d738c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb356ef1ebde4ed68e3de07798e6e84b" member_type: VOTER last_known_addr { host: "127.1.103.193" port: 42363 } } peers { permanent_uuid: "d01a61f77a87460fa13dc7ce33d738c7" member_type: VOTER last_known_addr { host: "127.1.103.195" port: 40917 } } peers { permanent_uuid: "48d894fb9d2c4bf29da35ea457e92160" member_type: VOTER last_known_addr { host: "127.1.103.194" port: 33903 } }
14:22:13.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.708906  2190 tablet_bootstrap.cc:492] T b8130f9d2a6d487693f90a0a265c6c0c P bb356ef1ebde4ed68e3de07798e6e84b: No bootstrap required, opened a new log
14:22:13.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.709606  2190 ts_tablet_manager.cc:1403] T b8130f9d2a6d487693f90a0a265c6c0c P bb356ef1ebde4ed68e3de07798e6e84b: Time spent bootstrapping tablet: real 0.042s	user 0.017s	sys 0.019s
14:22:13.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.711084  2188 raft_consensus.cc:359] T b8130f9d2a6d487693f90a0a265c6c0c P 48d894fb9d2c4bf29da35ea457e92160 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb356ef1ebde4ed68e3de07798e6e84b" member_type: VOTER last_known_addr { host: "127.1.103.193" port: 42363 } } peers { permanent_uuid: "d01a61f77a87460fa13dc7ce33d738c7" member_type: VOTER last_known_addr { host: "127.1.103.195" port: 40917 } } peers { permanent_uuid: "48d894fb9d2c4bf29da35ea457e92160" member_type: VOTER last_known_addr { host: "127.1.103.194" port: 33903 } }
14:22:13.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.712019  2188 raft_consensus.cc:385] T b8130f9d2a6d487693f90a0a265c6c0c P 48d894fb9d2c4bf29da35ea457e92160 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:22:13.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.712337  2188 raft_consensus.cc:740] T b8130f9d2a6d487693f90a0a265c6c0c P 48d894fb9d2c4bf29da35ea457e92160 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48d894fb9d2c4bf29da35ea457e92160, State: Initialized, Role: FOLLOWER
14:22:13.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.713671  2188 consensus_queue.cc:260] T b8130f9d2a6d487693f90a0a265c6c0c P 48d894fb9d2c4bf29da35ea457e92160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb356ef1ebde4ed68e3de07798e6e84b" member_type: VOTER last_known_addr { host: "127.1.103.193" port: 42363 } } peers { permanent_uuid: "d01a61f77a87460fa13dc7ce33d738c7" member_type: VOTER last_known_addr { host: "127.1.103.195" port: 40917 } } peers { permanent_uuid: "48d894fb9d2c4bf29da35ea457e92160" member_type: VOTER last_known_addr { host: "127.1.103.194" port: 33903 } }
14:22:13.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.731794  2188 ts_tablet_manager.cc:1434] T b8130f9d2a6d487693f90a0a265c6c0c P 48d894fb9d2c4bf29da35ea457e92160: Time spent starting tablet: real 0.060s	user 0.038s	sys 0.013s
14:22:13.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.746878  2189 ts_tablet_manager.cc:1434] T b8130f9d2a6d487693f90a0a265c6c0c P d01a61f77a87460fa13dc7ce33d738c7: Time spent starting tablet: real 0.075s	user 0.060s	sys 0.008s
14:22:13.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.758750  2190 raft_consensus.cc:359] T b8130f9d2a6d487693f90a0a265c6c0c P bb356ef1ebde4ed68e3de07798e6e84b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb356ef1ebde4ed68e3de07798e6e84b" member_type: VOTER last_known_addr { host: "127.1.103.193" port: 42363 } } peers { permanent_uuid: "d01a61f77a87460fa13dc7ce33d738c7" member_type: VOTER last_known_addr { host: "127.1.103.195" port: 40917 } } peers { permanent_uuid: "48d894fb9d2c4bf29da35ea457e92160" member_type: VOTER last_known_addr { host: "127.1.103.194" port: 33903 } }
14:22:13.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.764992  2190 raft_consensus.cc:385] T b8130f9d2a6d487693f90a0a265c6c0c P bb356ef1ebde4ed68e3de07798e6e84b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:22:13.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.765378  2190 raft_consensus.cc:740] T b8130f9d2a6d487693f90a0a265c6c0c P bb356ef1ebde4ed68e3de07798e6e84b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb356ef1ebde4ed68e3de07798e6e84b, State: Initialized, Role: FOLLOWER
14:22:13.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.766414  2190 consensus_queue.cc:260] T b8130f9d2a6d487693f90a0a265c6c0c P bb356ef1ebde4ed68e3de07798e6e84b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb356ef1ebde4ed68e3de07798e6e84b" member_type: VOTER last_known_addr { host: "127.1.103.193" port: 42363 } } peers { permanent_uuid: "d01a61f77a87460fa13dc7ce33d738c7" member_type: VOTER last_known_addr { host: "127.1.103.195" port: 40917 } } peers { permanent_uuid: "48d894fb9d2c4bf29da35ea457e92160" member_type: VOTER last_known_addr { host: "127.1.103.194" port: 33903 } }
14:22:13.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.782382  2190 ts_tablet_manager.cc:1434] T b8130f9d2a6d487693f90a0a265c6c0c P bb356ef1ebde4ed68e3de07798e6e84b: Time spent starting tablet: real 0.072s	user 0.036s	sys 0.023s
14:22:13.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.883149  2195 raft_consensus.cc:493] T b8130f9d2a6d487693f90a0a265c6c0c P 48d894fb9d2c4bf29da35ea457e92160 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:22:13.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.883960  2195 raft_consensus.cc:515] T b8130f9d2a6d487693f90a0a265c6c0c P 48d894fb9d2c4bf29da35ea457e92160 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb356ef1ebde4ed68e3de07798e6e84b" member_type: VOTER last_known_addr { host: "127.1.103.193" port: 42363 } } peers { permanent_uuid: "d01a61f77a87460fa13dc7ce33d738c7" member_type: VOTER last_known_addr { host: "127.1.103.195" port: 40917 } } peers { permanent_uuid: "48d894fb9d2c4bf29da35ea457e92160" member_type: VOTER last_known_addr { host: "127.1.103.194" port: 33903 } }
14:22:13.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.887068  2195 leader_election.cc:290] T b8130f9d2a6d487693f90a0a265c6c0c P 48d894fb9d2c4bf29da35ea457e92160 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb356ef1ebde4ed68e3de07798e6e84b (127.1.103.193:42363), d01a61f77a87460fa13dc7ce33d738c7 (127.1.103.195:40917)
14:22:13.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.901446  2194 raft_consensus.cc:493] T b8130f9d2a6d487693f90a0a265c6c0c P d01a61f77a87460fa13dc7ce33d738c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:22:13.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.902108  2194 raft_consensus.cc:515] T b8130f9d2a6d487693f90a0a265c6c0c P d01a61f77a87460fa13dc7ce33d738c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb356ef1ebde4ed68e3de07798e6e84b" member_type: VOTER last_known_addr { host: "127.1.103.193" port: 42363 } } peers { permanent_uuid: "d01a61f77a87460fa13dc7ce33d738c7" member_type: VOTER last_known_addr { host: "127.1.103.195" port: 40917 } } peers { permanent_uuid: "48d894fb9d2c4bf29da35ea457e92160" member_type: VOTER last_known_addr { host: "127.1.103.194" port: 33903 } }
14:22:13.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:13.904500  2020 tablet.cc:2404] T b8130f9d2a6d487693f90a0a265c6c0c P 48d894fb9d2c4bf29da35ea457e92160: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:22:13.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.911708  1828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8130f9d2a6d487693f90a0a265c6c0c" candidate_uuid: "48d894fb9d2c4bf29da35ea457e92160" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb356ef1ebde4ed68e3de07798e6e84b" is_pre_election: true
14:22:13.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.912952  1828 raft_consensus.cc:2468] T b8130f9d2a6d487693f90a0a265c6c0c P bb356ef1ebde4ed68e3de07798e6e84b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48d894fb9d2c4bf29da35ea457e92160 in term 0.
14:22:13.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.917750  2194 leader_election.cc:290] T b8130f9d2a6d487693f90a0a265c6c0c P d01a61f77a87460fa13dc7ce33d738c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb356ef1ebde4ed68e3de07798e6e84b (127.1.103.193:42363), 48d894fb9d2c4bf29da35ea457e92160 (127.1.103.194:33903)
14:22:13.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.918031  1903 leader_election.cc:304] T b8130f9d2a6d487693f90a0a265c6c0c P 48d894fb9d2c4bf29da35ea457e92160 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48d894fb9d2c4bf29da35ea457e92160, bb356ef1ebde4ed68e3de07798e6e84b; no voters: 
14:22:13.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.919155  2195 raft_consensus.cc:2804] T b8130f9d2a6d487693f90a0a265c6c0c P 48d894fb9d2c4bf29da35ea457e92160 [term 0 FOLLOWER]: Leader pre-election won for term 1
14:22:13.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.919543  2195 raft_consensus.cc:493] T b8130f9d2a6d487693f90a0a265c6c0c P 48d894fb9d2c4bf29da35ea457e92160 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:22:13.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.919951  2195 raft_consensus.cc:3060] T b8130f9d2a6d487693f90a0a265c6c0c P 48d894fb9d2c4bf29da35ea457e92160 [term 0 FOLLOWER]: Advancing to term 1
14:22:13.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.920751  2108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8130f9d2a6d487693f90a0a265c6c0c" candidate_uuid: "48d894fb9d2c4bf29da35ea457e92160" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01a61f77a87460fa13dc7ce33d738c7" is_pre_election: true
14:22:13.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.922453  2108 raft_consensus.cc:2468] T b8130f9d2a6d487693f90a0a265c6c0c P d01a61f77a87460fa13dc7ce33d738c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 48d894fb9d2c4bf29da35ea457e92160 in term 0.
14:22:13.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:13.937211  2162 tablet.cc:2404] T b8130f9d2a6d487693f90a0a265c6c0c P d01a61f77a87460fa13dc7ce33d738c7: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:22:13.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.937314  2195 raft_consensus.cc:515] T b8130f9d2a6d487693f90a0a265c6c0c P 48d894fb9d2c4bf29da35ea457e92160 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb356ef1ebde4ed68e3de07798e6e84b" member_type: VOTER last_known_addr { host: "127.1.103.193" port: 42363 } } peers { permanent_uuid: "d01a61f77a87460fa13dc7ce33d738c7" member_type: VOTER last_known_addr { host: "127.1.103.195" port: 40917 } } peers { permanent_uuid: "48d894fb9d2c4bf29da35ea457e92160" member_type: VOTER last_known_addr { host: "127.1.103.194" port: 33903 } }
14:22:13.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.940392  2195 leader_election.cc:290] T b8130f9d2a6d487693f90a0a265c6c0c P 48d894fb9d2c4bf29da35ea457e92160 [CANDIDATE]: Term 1 election: Requested vote from peers bb356ef1ebde4ed68e3de07798e6e84b (127.1.103.193:42363), d01a61f77a87460fa13dc7ce33d738c7 (127.1.103.195:40917)
14:22:13.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.940505  1828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8130f9d2a6d487693f90a0a265c6c0c" candidate_uuid: "d01a61f77a87460fa13dc7ce33d738c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb356ef1ebde4ed68e3de07798e6e84b" is_pre_election: true
14:22:13.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.941216  1828 raft_consensus.cc:2468] T b8130f9d2a6d487693f90a0a265c6c0c P bb356ef1ebde4ed68e3de07798e6e84b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d01a61f77a87460fa13dc7ce33d738c7 in term 0.
14:22:13.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.944109  2108 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8130f9d2a6d487693f90a0a265c6c0c" candidate_uuid: "48d894fb9d2c4bf29da35ea457e92160" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d01a61f77a87460fa13dc7ce33d738c7"
14:22:13.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.944785  2108 raft_consensus.cc:3060] T b8130f9d2a6d487693f90a0a265c6c0c P d01a61f77a87460fa13dc7ce33d738c7 [term 0 FOLLOWER]: Advancing to term 1
14:22:13.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.944732  1828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8130f9d2a6d487693f90a0a265c6c0c" candidate_uuid: "48d894fb9d2c4bf29da35ea457e92160" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb356ef1ebde4ed68e3de07798e6e84b"
14:22:13.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.944629  2043 leader_election.cc:304] T b8130f9d2a6d487693f90a0a265c6c0c P d01a61f77a87460fa13dc7ce33d738c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bb356ef1ebde4ed68e3de07798e6e84b, d01a61f77a87460fa13dc7ce33d738c7; no voters: 
14:22:13.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.945349  1828 raft_consensus.cc:3060] T b8130f9d2a6d487693f90a0a265c6c0c P bb356ef1ebde4ed68e3de07798e6e84b [term 0 FOLLOWER]: Advancing to term 1
14:22:13.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.945437  1968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8130f9d2a6d487693f90a0a265c6c0c" candidate_uuid: "d01a61f77a87460fa13dc7ce33d738c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "48d894fb9d2c4bf29da35ea457e92160" is_pre_election: true
14:22:13.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.946779  1968 raft_consensus.cc:2393] T b8130f9d2a6d487693f90a0a265c6c0c P 48d894fb9d2c4bf29da35ea457e92160 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d01a61f77a87460fa13dc7ce33d738c7 in current term 1: Already voted for candidate 48d894fb9d2c4bf29da35ea457e92160 in this term.
14:22:13.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.951627  2108 raft_consensus.cc:2468] T b8130f9d2a6d487693f90a0a265c6c0c P d01a61f77a87460fa13dc7ce33d738c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48d894fb9d2c4bf29da35ea457e92160 in term 1.
14:22:13.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.952033  1828 raft_consensus.cc:2468] T b8130f9d2a6d487693f90a0a265c6c0c P bb356ef1ebde4ed68e3de07798e6e84b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 48d894fb9d2c4bf29da35ea457e92160 in term 1.
14:22:13.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.952067  2194 raft_consensus.cc:2764] T b8130f9d2a6d487693f90a0a265c6c0c P d01a61f77a87460fa13dc7ce33d738c7 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
14:22:13.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.952744  1903 leader_election.cc:304] T b8130f9d2a6d487693f90a0a265c6c0c P 48d894fb9d2c4bf29da35ea457e92160 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 48d894fb9d2c4bf29da35ea457e92160, d01a61f77a87460fa13dc7ce33d738c7; no voters: 
14:22:13.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.953678  2195 raft_consensus.cc:2804] T b8130f9d2a6d487693f90a0a265c6c0c P 48d894fb9d2c4bf29da35ea457e92160 [term 1 FOLLOWER]: Leader election won for term 1
14:22:13.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.955938  2195 raft_consensus.cc:697] T b8130f9d2a6d487693f90a0a265c6c0c P 48d894fb9d2c4bf29da35ea457e92160 [term 1 LEADER]: Becoming Leader. State: Replica: 48d894fb9d2c4bf29da35ea457e92160, State: Running, Role: LEADER
14:22:13.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.957468  2195 consensus_queue.cc:237] T b8130f9d2a6d487693f90a0a265c6c0c P 48d894fb9d2c4bf29da35ea457e92160 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb356ef1ebde4ed68e3de07798e6e84b" member_type: VOTER last_known_addr { host: "127.1.103.193" port: 42363 } } peers { permanent_uuid: "d01a61f77a87460fa13dc7ce33d738c7" member_type: VOTER last_known_addr { host: "127.1.103.195" port: 40917 } } peers { permanent_uuid: "48d894fb9d2c4bf29da35ea457e92160" member_type: VOTER last_known_addr { host: "127.1.103.194" port: 33903 } }
14:22:13.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:13.970033  1637 catalog_manager.cc:5697] T b8130f9d2a6d487693f90a0a265c6c0c P 48d894fb9d2c4bf29da35ea457e92160 reported cstate change: term changed from 0 to 1, leader changed from <none> to 48d894fb9d2c4bf29da35ea457e92160 (127.1.103.194). New cstate: current_term: 1 leader_uuid: "48d894fb9d2c4bf29da35ea457e92160" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb356ef1ebde4ed68e3de07798e6e84b" member_type: VOTER last_known_addr { host: "127.1.103.193" port: 42363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d01a61f77a87460fa13dc7ce33d738c7" member_type: VOTER last_known_addr { host: "127.1.103.195" port: 40917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "48d894fb9d2c4bf29da35ea457e92160" member_type: VOTER last_known_addr { host: "127.1.103.194" port: 33903 } health_report { overall_health: HEALTHY } } }
14:22:14.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:14.017341  1881 tablet.cc:2404] T b8130f9d2a6d487693f90a0a265c6c0c P bb356ef1ebde4ed68e3de07798e6e84b: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:22:14.497 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 52b4c9db5fe94017b4bd9b172b66fe1c
14:22:14.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:14.505290  2204 consensus_queue.cc:1048] T b8130f9d2a6d487693f90a0a265c6c0c P 48d894fb9d2c4bf29da35ea457e92160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb356ef1ebde4ed68e3de07798e6e84b" member_type: VOTER last_known_addr { host: "127.1.103.193" port: 42363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:22:14.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:14.508790  2204 consensus_queue.cc:1048] T b8130f9d2a6d487693f90a0a265c6c0c P 48d894fb9d2c4bf29da35ea457e92160 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d01a61f77a87460fa13dc7ce33d738c7" member_type: VOTER last_known_addr { host: "127.1.103.195" port: 40917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:22:14.528 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet b8130f9d2a6d487693f90a0a265c6c0c for table 'org.apache.kudu.client.TestLeaderFailover-1779114114883' with partition [<start>, <end>)
14:22:14.568 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299960, tablet=b8130f9d2a6d487693f90a0a265c6c0c@[48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903)[L],bb356ef1ebde4ed68e3de07798e6e84b(127.1.103.193:42363),d01a61f77a87460fa13dc7ce33d738c7(127.1.103.195:40917)]}]
14:22:14.571 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=60), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.103.252:33585, [15ms] Sub RPC GetTableLocations: received response from server master-127.1.103.252:33585: OK, deferred=null) after lookup
14:22:14.604 [DEBUG - kudu-nio-2] (Connection.java:748) [peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903)] connecting to peer
14:22:14.607 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903)] Successfully connected to peer
14:22:14.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:14.642912  1621 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.1.103.254:45279, user_credentials={real_user=slave}} blocked reactor thread for 46720.6us
14:22:14.706 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0xf00288a0, L:/127.0.0.1:38972 - R:/127.1.103.194:33903] using TOKEN/null
14:22:14.882 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=org.apache.kudu.client.TestLeaderFailover-1779114114883, tablet=b8130f9d2a6d487693f90a0a265c6c0c, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:22:14.884 [INFO - Time-limited test] (MiniKuduCluster.java:475) Killing tablet server 127.1.103.194:33903
14:22:14.888 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: stop_daemon {
  id {
    type: TSERVER
    index: 1
  }
}

14:22:14.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:14.888968  1439 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskquUkVX/build/tsan/bin/kudu with pid 1877
14:22:14.929 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903)] handling channelInactive
14:22:14.930 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903)] cleaning up while in state READY due to: connection closed
14:22:14.937 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
14:22:14.938 [DEBUG - Time-limited test] (Connection.java:748) [peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903)] connecting to peer
14:22:14.943 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903
14:22:14.943 [DEBUG - kudu-nio-4] (Connection.java:709) [peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903)] cleaning up while in state CONNECTING due to: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903
14:22:14.944 [INFO - kudu-nio-4] (AsyncKuduClient.java:2355) Invalidating location 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903) for tablet b8130f9d2a6d487693f90a0a265c6c0c: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903
14:22:14.962 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet b8130f9d2a6d487693f90a0a265c6c0c for table 'org.apache.kudu.client.TestLeaderFailover-1779114114883' with partition [<start>, <end>)
14:22:14.963 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=b8130f9d2a6d487693f90a0a265c6c0c@[48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903)[L],bb356ef1ebde4ed68e3de07798e6e84b(127.1.103.193:42363),d01a61f77a87460fa13dc7ce33d738c7(127.1.103.195:40917)]}]
14:22:14.963 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=b8130f9d2a6d487693f90a0a265c6c0c, attempt=2, sequence_id=4, TimeoutTracker(timeout=30000, elapsed=25), Traces: [0ms] sending RPC to server 48d894fb9d2c4bf29da35ea457e92160, [5ms] received response from server 48d894fb9d2c4bf29da35ea457e92160: Network error: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903, [6ms] delaying RPC due to: Network error: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903, [19ms] refreshing cache from master, [19ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.103.252:33585, [24ms] Sub RPC GetTableLocations: received response from server master-127.1.103.252:33585: OK, deferred=Deferred@683508309(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$232/0x00007f855436d1a8@624d6905 -> passthrough -> wakeup thread Time-limited test, errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@5e80dc52 -> wakeup thread Time-limited test)) after lookup
14:22:14.964 [DEBUG - kudu-nio-2] (Connection.java:748) [peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903)] connecting to peer
14:22:14.966 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903
14:22:14.967 [DEBUG - kudu-nio-5] (Connection.java:709) [peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903)] cleaning up while in state CONNECTING due to: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903
14:22:14.967 [INFO - kudu-nio-5] (AsyncKuduClient.java:2355) Invalidating location 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903) for tablet b8130f9d2a6d487693f90a0a265c6c0c: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903
14:22:14.982 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet b8130f9d2a6d487693f90a0a265c6c0c for table 'org.apache.kudu.client.TestLeaderFailover-1779114114883' with partition [<start>, <end>)
14:22:14.983 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=b8130f9d2a6d487693f90a0a265c6c0c@[48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903)[L],bb356ef1ebde4ed68e3de07798e6e84b(127.1.103.193:42363),d01a61f77a87460fa13dc7ce33d738c7(127.1.103.195:40917)]}]
14:22:14.983 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=b8130f9d2a6d487693f90a0a265c6c0c, attempt=4, sequence_id=4, TimeoutTracker(timeout=30000, elapsed=45), Traces: [0ms] sending RPC to server 48d894fb9d2c4bf29da35ea457e92160, [5ms] received response from server 48d894fb9d2c4bf29da35ea457e92160: Network error: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903, [6ms] delaying RPC due to: Network error: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903, [19ms] refreshing cache from master, [19ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.103.252:33585, [24ms] Sub RPC GetTableLocations: received response from server master-127.1.103.252:33585: OK, [26ms] sending RPC to server 48d894fb9d2c4bf29da35ea457e92160, [29ms] received response from server 48d894fb9d2c4bf29da35ea457e92160: Network error: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903, [29ms] delaying RPC due to: Network error: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903, [38ms] refreshing cache from master, [39ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.103.252:33585, [44ms] Sub RPC GetTableLocations: received response from server master-127.1.103.252:33585: OK, deferred=Deferred@683508309(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$232/0x00007f855436d1a8@624d6905 -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@1079905672 after retry RPC@173987382), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@5e80dc52 -> wakeup thread Time-limited test -> (continuation of Deferred@1079905672 after retry RPC@173987382))) after lookup
14:22:14.984 [DEBUG - kudu-nio-2] (Connection.java:748) [peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903)] connecting to peer
14:22:14.987 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903
14:22:14.987 [DEBUG - kudu-nio-6] (Connection.java:709) [peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903)] cleaning up while in state CONNECTING due to: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903
14:22:14.987 [INFO - kudu-nio-6] (AsyncKuduClient.java:2355) Invalidating location 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903) for tablet b8130f9d2a6d487693f90a0a265c6c0c: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903
14:22:15.022 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet b8130f9d2a6d487693f90a0a265c6c0c for table 'org.apache.kudu.client.TestLeaderFailover-1779114114883' with partition [<start>, <end>)
14:22:15.022 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=b8130f9d2a6d487693f90a0a265c6c0c@[48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903)[L],bb356ef1ebde4ed68e3de07798e6e84b(127.1.103.193:42363),d01a61f77a87460fa13dc7ce33d738c7(127.1.103.195:40917)]}]
14:22:15.023 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=b8130f9d2a6d487693f90a0a265c6c0c, attempt=6, sequence_id=4, TimeoutTracker(timeout=30000, elapsed=85), Traces: [0ms] sending RPC to server 48d894fb9d2c4bf29da35ea457e92160, [5ms] received response from server 48d894fb9d2c4bf29da35ea457e92160: Network error: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903, [6ms] delaying RPC due to: Network error: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903, [19ms] refreshing cache from master, [19ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.103.252:33585, [24ms] Sub RPC GetTableLocations: received response from server master-127.1.103.252:33585: OK, [26ms] sending RPC to server 48d894fb9d2c4bf29da35ea457e92160, [29ms] received response from server 48d894fb9d2c4bf29da35ea457e92160: Network error: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903, [29ms] delaying RPC due to: Network error: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903, [38ms] refreshing cache from master, [39ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.103.252:33585, [44ms] Sub RPC GetTableLocations: received response from server master-127.1.103.252:33585: OK, [46ms] sending RPC to server 48d894fb9d2c4bf29da35ea457e92160, [49ms] received response from server 48d894fb9d2c4bf29da35ea457e92160: Network error: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903, [49ms] delaying RPC due to: Network error: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903, [78ms] refreshing cache from master, [79ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.103.252:33585, [83ms] Sub RPC GetTableLocations: received response from server master-127.1.103.252:33585: OK, deferred=Deferred@683508309(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$232/0x00007f855436d1a8@624d6905 -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@1079905672 after retry RPC@173987382) -> (continuation of Deferred@765169029 after retry RPC@1857853984), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@5e80dc52 -> wakeup thread Time-limited test -> (continuation of Deferred@1079905672 after retry RPC@173987382) -> (continuation of Deferred@765169029 after retry RPC@1857853984))) after lookup
14:22:15.024 [DEBUG - kudu-nio-2] (Connection.java:748) [peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903)] connecting to peer
14:22:15.025 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903
14:22:15.026 [DEBUG - kudu-nio-7] (Connection.java:709) [peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903)] cleaning up while in state CONNECTING due to: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903
14:22:15.026 [INFO - kudu-nio-7] (AsyncKuduClient.java:2355) Invalidating location 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903) for tablet b8130f9d2a6d487693f90a0a265c6c0c: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903
14:22:15.160 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet b8130f9d2a6d487693f90a0a265c6c0c for table 'org.apache.kudu.client.TestLeaderFailover-1779114114883' with partition [<start>, <end>)
14:22:15.161 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=b8130f9d2a6d487693f90a0a265c6c0c@[48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903)[L],bb356ef1ebde4ed68e3de07798e6e84b(127.1.103.193:42363),d01a61f77a87460fa13dc7ce33d738c7(127.1.103.195:40917)]}]
14:22:15.161 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=b8130f9d2a6d487693f90a0a265c6c0c, attempt=8, sequence_id=4, TimeoutTracker(timeout=30000, elapsed=223), Traces: [0ms] sending RPC to server 48d894fb9d2c4bf29da35ea457e92160, [5ms] received response from server 48d894fb9d2c4bf29da35ea457e92160: Network error: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903, [6ms] delaying RPC due to: Network error: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903, [19ms] refreshing cache from master, [19ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.103.252:33585, [24ms] Sub RPC GetTableLocations: received response from server master-127.1.103.252:33585: OK, [26ms] sending RPC to server 48d894fb9d2c4bf29da35ea457e92160, [29ms] received response from server 48d894fb9d2c4bf29da35ea457e92160: Network error: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903, [29ms] delaying RPC due to: Network error: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903, [38ms] refreshing cache from master, [39ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.103.252:33585, [44ms] Sub RPC GetTableLocations: received response from server master-127.1.103.252:33585: OK, [46ms] sending RPC to server 48d894fb9d2c4bf29da35ea457e92160, [49ms] received response from server 48d894fb9d2c4bf29da35ea457e92160: Network error: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903, [49ms] delaying RPC due to: Network error: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903, [78ms] refreshing cache from master, [79ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.103.252:33585, [83ms] Sub RPC GetTableLocations: received response from server master-127.1.103.252:33585: OK, [85ms] sending RPC to server 48d894fb9d2c4bf29da35ea457e92160, [88ms] received response from server 48d894fb9d2c4bf29da35ea457e92160: Network error: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903, [88ms] delaying RPC due to: Network error: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903, [218ms] refreshing cache from master, [218ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.103.252:33585, [222ms] Sub RPC GetTableLocations: received response from server master-127.1.103.252:33585: OK, deferred=Deferred@683508309(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$232/0x00007f855436d1a8@624d6905 -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@1079905672 after retry RPC@173987382) -> (continuation of Deferred@765169029 after retry RPC@1857853984) -> (continuation of Deferred@920910199 after retry RPC@250814329), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@5e80dc52 -> wakeup thread Time-limited test -> (continuation of Deferred@1079905672 after retry RPC@173987382) -> (continuation of Deferred@765169029 after retry RPC@1857853984) -> (continuation of Deferred@920910199 after retry RPC@250814329))) after lookup
14:22:15.162 [DEBUG - kudu-nio-2] (Connection.java:748) [peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903)] connecting to peer
14:22:15.163 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903
14:22:15.163 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903)] cleaning up while in state CONNECTING due to: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903
14:22:15.163 [INFO - kudu-nio-0] (AsyncKuduClient.java:2355) Invalidating location 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903) for tablet b8130f9d2a6d487693f90a0a265c6c0c: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903
14:22:15.362 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet b8130f9d2a6d487693f90a0a265c6c0c for table 'org.apache.kudu.client.TestLeaderFailover-1779114114883' with partition [<start>, <end>)
14:22:15.362 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=b8130f9d2a6d487693f90a0a265c6c0c@[48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903)[L],bb356ef1ebde4ed68e3de07798e6e84b(127.1.103.193:42363),d01a61f77a87460fa13dc7ce33d738c7(127.1.103.195:40917)]}]
14:22:15.363 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=b8130f9d2a6d487693f90a0a265c6c0c, attempt=10, sequence_id=4, TimeoutTracker(timeout=30000, elapsed=425), Traces: [0ms] sending RPC to server 48d894fb9d2c4bf29da35ea457e92160, [5ms] received response from server 48d894fb9d2c4bf29da35ea457e92160: Network error: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903, [6ms] delaying RPC due to: Network error: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903, [19ms] refreshing cache from master, [19ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.103.252:33585, [24ms] Sub RPC GetTableLocations: received response from server master-127.1.103.252:33585: OK, [26ms] sending RPC to server 48d894fb9d2c4bf29da35ea457e92160, [29ms] received response from server 48d894fb9d2c4bf29da35ea457e92160: Network error: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903, [29ms] delaying RPC due to: Network error: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903, [38ms] refreshing cache from master, [39ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.103.252:33585, [44ms] Sub RPC GetTableLocations: received response from server master-127.1.103.252:33585: OK, [46ms] sending RPC to server 48d894fb9d2c4bf29da35ea457e92160, [49ms] received response from server 48d894fb9d2c4bf29da35ea457e92160: Network error: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903, [49ms] delaying RPC due to: Network error: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903, [78ms] refreshing cache from master, [79ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.103.252:33585, [83ms] Sub RPC GetTableLocations: received response from server master-127.1.103.252:33585: OK, [85ms] sending RPC to server 48d894fb9d2c4bf29da35ea457e92160, [88ms] received response from server 48d894fb9d2c4bf29da35ea457e92160: Network error: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903, [88ms] delaying RPC due to: Network error: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903, [218ms] refreshing cache from master, [218ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.103.252:33585, [222ms] Sub RPC GetTableLocations: received response from server master-127.1.103.252:33585: OK, [224ms] sending RPC to server 48d894fb9d2c4bf29da35ea457e92160, [225ms] received response from server 48d894fb9d2c4bf29da35ea457e92160: Network error: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903, [225ms] delaying RPC due to: Network error: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903, [418ms] refreshing cache from master, [418ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.103.252:33585, [423ms] Sub RPC GetTableLocations: received response from server master-127.1.103.252:33585: OK, deferred=Deferred@683508309(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$232/0x00007f855436d1a8@624d6905 -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@1079905672 after retry RPC@173987382) -> (continuation of Deferred@765169029 after retry RPC@1857853984) -> (continuation of Deferred@920910199 after retry RPC@250814329) -> (continuation of Deferred@1684759872 after retry RPC@1920312931), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@5e80dc52 -> wakeup thread Time-limited test -> (continuation of Deferred@1079905672 after retry RPC@173987382) -> (continuation of Deferred@765169029 after retry RPC@1857853984) -> (continuation of Deferred@920910199 after retry RPC@250814329) -> (continuation of Deferred@1684759872 after retry RPC@1920312931))) after lookup
14:22:15.364 [DEBUG - kudu-nio-2] (Connection.java:748) [peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903)] connecting to peer
14:22:15.365 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903
14:22:15.365 [DEBUG - kudu-nio-1] (Connection.java:709) [peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903)] cleaning up while in state CONNECTING due to: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903
14:22:15.365 [INFO - kudu-nio-1] (AsyncKuduClient.java:2355) Invalidating location 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903) for tablet b8130f9d2a6d487693f90a0a265c6c0c: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903
14:22:15.623 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet b8130f9d2a6d487693f90a0a265c6c0c for table 'org.apache.kudu.client.TestLeaderFailover-1779114114883' with partition [<start>, <end>)
14:22:15.623 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=b8130f9d2a6d487693f90a0a265c6c0c@[48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903)[L],bb356ef1ebde4ed68e3de07798e6e84b(127.1.103.193:42363),d01a61f77a87460fa13dc7ce33d738c7(127.1.103.195:40917)]}]
14:22:15.624 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=b8130f9d2a6d487693f90a0a265c6c0c, attempt=12, sequence_id=4, TimeoutTracker(timeout=30000, elapsed=686), Traces: [0ms] sending RPC to server 48d894fb9d2c4bf29da35ea457e92160, [5ms] received response from server 48d894fb9d2c4bf29da35ea457e92160: Network error: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903, [6ms] delaying RPC due to: Network error: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903, [19ms] refreshing cache from master, [19ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.103.252:33585, [24ms] Sub RPC GetTableLocations: received response from server master-127.1.103.252:33585: OK, [26ms] sending RPC to server 48d894fb9d2c4bf29da35ea457e92160, [29ms] received response from server 48d894fb9d2c4bf29da35ea457e92160: Network error: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903, [29ms] delaying RPC due to: Network error: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903, [38ms] refreshing cache from master, [39ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.103.252:33585, [44ms] Sub RPC GetTableLocations: received response from server master-127.1.103.252:33585: OK, [46ms] sending RPC to server 48d894fb9d2c4bf29da35ea457e92160, [49ms] received response from server 48d894fb9d2c4bf29da35ea457e92160: Network error: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903, [49ms] delaying RPC due to: Network error: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903, [78ms] refreshing cache from master, [79ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.103.252:33585, [83ms] Sub RPC GetTableLocations: received response from server master-127.1.103.252:33585: OK, [85ms] sending RPC to server 48d894fb9d2c4bf29da35ea457e92160, [88ms] received response from server 48d894fb9d2c4bf29da35ea457e92160: Network error: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903, [88ms] delaying RPC due to: Network error: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903, [218ms] refreshing cache from master, [218ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.103.252:33585, [222ms] Sub RPC GetTableLocations: received response from server master-127.1.103.252:33585: OK, [224ms] sending RPC to server 48d894fb9d2c4bf29da35ea457e92160, [225ms] received response from server 48d894fb9d2c4bf29da35ea457e92160: Network error: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903, [225ms] delaying RPC due to: Network error: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903, [418ms] refreshing cache from master, [418ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.103.252:33585, [423ms] Sub RPC GetTableLocations: received response from server master-127.1.103.252:33585: OK, [426ms] sending RPC to server 48d894fb9d2c4bf29da35ea457e92160, [427ms] received response from server 48d894fb9d2c4bf29da35ea457e92160: Network error: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903, [427ms] delaying RPC due to: Network error: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903, [678ms] refreshing cache from master, [678ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.103.252:33585, [685ms] Sub RPC GetTableLocations: received response from server master-127.1.103.252:33585: OK, deferred=Deferred@683508309(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$232/0x00007f855436d1a8@624d6905 -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@1079905672 after retry RPC@173987382) -> (continuation of Deferred@765169029 after retry RPC@1857853984) -> (continuation of Deferred@920910199 after retry RPC@250814329) -> (continuation of Deferred@1684759872 after retry RPC@1920312931) -> (continuation of Deferred@1148721365 after retry RPC@459401351), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@5e80dc52 -> wakeup thread Time-limited test -> (continuation of Deferred@1079905672 after retry RPC@173987382) -> (continuation of Deferred@765169029 after retry RPC@1857853984) -> (continuation of Deferred@920910199 after retry RPC@250814329) -> (continuation of Deferred@1684759872 after retry RPC@1920312931) -> (continuation of Deferred@1148721365 after retry RPC@459401351))) after lookup
14:22:15.625 [DEBUG - kudu-nio-2] (Connection.java:748) [peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903)] connecting to peer
14:22:15.626 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903
14:22:15.626 [DEBUG - kudu-nio-2] (Connection.java:709) [peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903)] cleaning up while in state CONNECTING due to: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903
14:22:15.626 [INFO - kudu-nio-2] (AsyncKuduClient.java:2355) Invalidating location 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903) for tablet b8130f9d2a6d487693f90a0a265c6c0c: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903
14:22:16.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.320700  2229 raft_consensus.cc:493] T b8130f9d2a6d487693f90a0a265c6c0c P d01a61f77a87460fa13dc7ce33d738c7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 48d894fb9d2c4bf29da35ea457e92160)
14:22:16.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.321177  2229 raft_consensus.cc:515] T b8130f9d2a6d487693f90a0a265c6c0c P d01a61f77a87460fa13dc7ce33d738c7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb356ef1ebde4ed68e3de07798e6e84b" member_type: VOTER last_known_addr { host: "127.1.103.193" port: 42363 } } peers { permanent_uuid: "d01a61f77a87460fa13dc7ce33d738c7" member_type: VOTER last_known_addr { host: "127.1.103.195" port: 40917 } } peers { permanent_uuid: "48d894fb9d2c4bf29da35ea457e92160" member_type: VOTER last_known_addr { host: "127.1.103.194" port: 33903 } }
14:22:16.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.321655  2230 raft_consensus.cc:493] T b8130f9d2a6d487693f90a0a265c6c0c P bb356ef1ebde4ed68e3de07798e6e84b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 48d894fb9d2c4bf29da35ea457e92160)
14:22:16.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.322016  2230 raft_consensus.cc:515] T b8130f9d2a6d487693f90a0a265c6c0c P bb356ef1ebde4ed68e3de07798e6e84b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb356ef1ebde4ed68e3de07798e6e84b" member_type: VOTER last_known_addr { host: "127.1.103.193" port: 42363 } } peers { permanent_uuid: "d01a61f77a87460fa13dc7ce33d738c7" member_type: VOTER last_known_addr { host: "127.1.103.195" port: 40917 } } peers { permanent_uuid: "48d894fb9d2c4bf29da35ea457e92160" member_type: VOTER last_known_addr { host: "127.1.103.194" port: 33903 } }
14:22:16.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.323189  2229 leader_election.cc:290] T b8130f9d2a6d487693f90a0a265c6c0c P d01a61f77a87460fa13dc7ce33d738c7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers bb356ef1ebde4ed68e3de07798e6e84b (127.1.103.193:42363), 48d894fb9d2c4bf29da35ea457e92160 (127.1.103.194:33903)
14:22:16.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.323962  1828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8130f9d2a6d487693f90a0a265c6c0c" candidate_uuid: "d01a61f77a87460fa13dc7ce33d738c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bb356ef1ebde4ed68e3de07798e6e84b" is_pre_election: true
14:22:16.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.324638  1828 raft_consensus.cc:2468] T b8130f9d2a6d487693f90a0a265c6c0c P bb356ef1ebde4ed68e3de07798e6e84b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d01a61f77a87460fa13dc7ce33d738c7 in term 1.
14:22:16.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.325521  2230 leader_election.cc:290] T b8130f9d2a6d487693f90a0a265c6c0c P bb356ef1ebde4ed68e3de07798e6e84b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d01a61f77a87460fa13dc7ce33d738c7 (127.1.103.195:40917), 48d894fb9d2c4bf29da35ea457e92160 (127.1.103.194:33903)
14:22:16.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:16.326159  2041 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.103.194:33903: connect: Connection refused (error 111)
14:22:16.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:16.330356  1761 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.103.194:33903: connect: Connection refused (error 111)
14:22:16.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.330693  2043 leader_election.cc:304] T b8130f9d2a6d487693f90a0a265c6c0c P d01a61f77a87460fa13dc7ce33d738c7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: bb356ef1ebde4ed68e3de07798e6e84b, d01a61f77a87460fa13dc7ce33d738c7; no voters: 
14:22:16.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.331596  2229 raft_consensus.cc:2804] T b8130f9d2a6d487693f90a0a265c6c0c P d01a61f77a87460fa13dc7ce33d738c7 [term 1 FOLLOWER]: Leader pre-election won for term 2
14:22:16.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.331954  2229 raft_consensus.cc:493] T b8130f9d2a6d487693f90a0a265c6c0c P d01a61f77a87460fa13dc7ce33d738c7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 48d894fb9d2c4bf29da35ea457e92160)
14:22:16.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.332314  2229 raft_consensus.cc:3060] T b8130f9d2a6d487693f90a0a265c6c0c P d01a61f77a87460fa13dc7ce33d738c7 [term 1 FOLLOWER]: Advancing to term 2
14:22:16.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:16.333237  2041 leader_election.cc:336] T b8130f9d2a6d487693f90a0a265c6c0c P d01a61f77a87460fa13dc7ce33d738c7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 48d894fb9d2c4bf29da35ea457e92160 (127.1.103.194:33903): Network error: Client connection negotiation failed: client connection to 127.1.103.194:33903: connect: Connection refused (error 111)
14:22:16.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:16.338456  1761 leader_election.cc:336] T b8130f9d2a6d487693f90a0a265c6c0c P bb356ef1ebde4ed68e3de07798e6e84b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 48d894fb9d2c4bf29da35ea457e92160 (127.1.103.194:33903): Network error: Client connection negotiation failed: client connection to 127.1.103.194:33903: connect: Connection refused (error 111)
14:22:16.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.339237  2229 raft_consensus.cc:515] T b8130f9d2a6d487693f90a0a265c6c0c P d01a61f77a87460fa13dc7ce33d738c7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb356ef1ebde4ed68e3de07798e6e84b" member_type: VOTER last_known_addr { host: "127.1.103.193" port: 42363 } } peers { permanent_uuid: "d01a61f77a87460fa13dc7ce33d738c7" member_type: VOTER last_known_addr { host: "127.1.103.195" port: 40917 } } peers { permanent_uuid: "48d894fb9d2c4bf29da35ea457e92160" member_type: VOTER last_known_addr { host: "127.1.103.194" port: 33903 } }
14:22:16.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.340579  2107 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8130f9d2a6d487693f90a0a265c6c0c" candidate_uuid: "bb356ef1ebde4ed68e3de07798e6e84b" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "d01a61f77a87460fa13dc7ce33d738c7" is_pre_election: true
14:22:16.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.340926  2229 leader_election.cc:290] T b8130f9d2a6d487693f90a0a265c6c0c P d01a61f77a87460fa13dc7ce33d738c7 [CANDIDATE]: Term 2 election: Requested vote from peers bb356ef1ebde4ed68e3de07798e6e84b (127.1.103.193:42363), 48d894fb9d2c4bf29da35ea457e92160 (127.1.103.194:33903)
14:22:16.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.341382  2107 raft_consensus.cc:2393] T b8130f9d2a6d487693f90a0a265c6c0c P d01a61f77a87460fa13dc7ce33d738c7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb356ef1ebde4ed68e3de07798e6e84b in current term 2: Already voted for candidate d01a61f77a87460fa13dc7ce33d738c7 in this term.
14:22:16.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.341810  1828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8130f9d2a6d487693f90a0a265c6c0c" candidate_uuid: "d01a61f77a87460fa13dc7ce33d738c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "bb356ef1ebde4ed68e3de07798e6e84b"
14:22:16.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.342375  1828 raft_consensus.cc:3060] T b8130f9d2a6d487693f90a0a265c6c0c P bb356ef1ebde4ed68e3de07798e6e84b [term 1 FOLLOWER]: Advancing to term 2
14:22:16.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.342639  1763 leader_election.cc:304] T b8130f9d2a6d487693f90a0a265c6c0c P bb356ef1ebde4ed68e3de07798e6e84b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb356ef1ebde4ed68e3de07798e6e84b; no voters: 48d894fb9d2c4bf29da35ea457e92160, d01a61f77a87460fa13dc7ce33d738c7
14:22:16.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:16.345799  2041 leader_election.cc:336] T b8130f9d2a6d487693f90a0a265c6c0c P d01a61f77a87460fa13dc7ce33d738c7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 48d894fb9d2c4bf29da35ea457e92160 (127.1.103.194:33903): Network error: Client connection negotiation failed: client connection to 127.1.103.194:33903: connect: Connection refused (error 111)
14:22:16.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.347564  1828 raft_consensus.cc:2468] T b8130f9d2a6d487693f90a0a265c6c0c P bb356ef1ebde4ed68e3de07798e6e84b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d01a61f77a87460fa13dc7ce33d738c7 in term 2.
14:22:16.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.348160  2230 raft_consensus.cc:2749] T b8130f9d2a6d487693f90a0a265c6c0c P bb356ef1ebde4ed68e3de07798e6e84b [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
14:22:16.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.348587  2043 leader_election.cc:304] T b8130f9d2a6d487693f90a0a265c6c0c P d01a61f77a87460fa13dc7ce33d738c7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: bb356ef1ebde4ed68e3de07798e6e84b, d01a61f77a87460fa13dc7ce33d738c7; no voters: 48d894fb9d2c4bf29da35ea457e92160
14:22:16.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.349239  2229 raft_consensus.cc:2804] T b8130f9d2a6d487693f90a0a265c6c0c P d01a61f77a87460fa13dc7ce33d738c7 [term 2 FOLLOWER]: Leader election won for term 2
14:22:16.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.350965  2229 raft_consensus.cc:697] T b8130f9d2a6d487693f90a0a265c6c0c P d01a61f77a87460fa13dc7ce33d738c7 [term 2 LEADER]: Becoming Leader. State: Replica: d01a61f77a87460fa13dc7ce33d738c7, State: Running, Role: LEADER
14:22:16.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.351923  2229 consensus_queue.cc:237] T b8130f9d2a6d487693f90a0a265c6c0c P d01a61f77a87460fa13dc7ce33d738c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb356ef1ebde4ed68e3de07798e6e84b" member_type: VOTER last_known_addr { host: "127.1.103.193" port: 42363 } } peers { permanent_uuid: "d01a61f77a87460fa13dc7ce33d738c7" member_type: VOTER last_known_addr { host: "127.1.103.195" port: 40917 } } peers { permanent_uuid: "48d894fb9d2c4bf29da35ea457e92160" member_type: VOTER last_known_addr { host: "127.1.103.194" port: 33903 } }
14:22:16.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.362355  1635 catalog_manager.cc:5697] T b8130f9d2a6d487693f90a0a265c6c0c P d01a61f77a87460fa13dc7ce33d738c7 reported cstate change: term changed from 1 to 2, leader changed from 48d894fb9d2c4bf29da35ea457e92160 (127.1.103.194) to d01a61f77a87460fa13dc7ce33d738c7 (127.1.103.195). New cstate: current_term: 2 leader_uuid: "d01a61f77a87460fa13dc7ce33d738c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "bb356ef1ebde4ed68e3de07798e6e84b" member_type: VOTER last_known_addr { host: "127.1.103.193" port: 42363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d01a61f77a87460fa13dc7ce33d738c7" member_type: VOTER last_known_addr { host: "127.1.103.195" port: 40917 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "48d894fb9d2c4bf29da35ea457e92160" member_type: VOTER last_known_addr { host: "127.1.103.194" port: 33903 } health_report { overall_health: UNKNOWN } } }
14:22:16.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:16.872628  2041 consensus_peers.cc:597] T b8130f9d2a6d487693f90a0a265c6c0c P d01a61f77a87460fa13dc7ce33d738c7 -> Peer 48d894fb9d2c4bf29da35ea457e92160 (127.1.103.194:33903): Couldn't send request to peer 48d894fb9d2c4bf29da35ea457e92160. Status: Network error: Client connection negotiation failed: client connection to 127.1.103.194:33903: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
14:22:16.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.945398  1828 raft_consensus.cc:1275] T b8130f9d2a6d487693f90a0a265c6c0c P bb356ef1ebde4ed68e3de07798e6e84b [term 2 FOLLOWER]: Refusing update from remote peer d01a61f77a87460fa13dc7ce33d738c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
14:22:16.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:16.946807  2251 consensus_queue.cc:1048] T b8130f9d2a6d487693f90a0a265c6c0c P d01a61f77a87460fa13dc7ce33d738c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb356ef1ebde4ed68e3de07798e6e84b" member_type: VOTER last_known_addr { host: "127.1.103.193" port: 42363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
14:22:18.861 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet b8130f9d2a6d487693f90a0a265c6c0c for table 'org.apache.kudu.client.TestLeaderFailover-1779114114883' with partition [<start>, <end>)
14:22:18.862 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=b8130f9d2a6d487693f90a0a265c6c0c@[48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903),bb356ef1ebde4ed68e3de07798e6e84b(127.1.103.193:42363),d01a61f77a87460fa13dc7ce33d738c7(127.1.103.195:40917)[L]]}]
14:22:18.864 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=b8130f9d2a6d487693f90a0a265c6c0c, attempt=14, sequence_id=4, TimeoutTracker(timeout=30000, elapsed=3926), Traces: [0ms] sending RPC to server 48d894fb9d2c4bf29da35ea457e92160, [5ms] received response from server 48d894fb9d2c4bf29da35ea457e92160: Network error: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903, [6ms] delaying RPC due to: Network error: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903, [19ms] refreshing cache from master, [19ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.103.252:33585, [24ms] Sub RPC GetTableLocations: received response from server master-127.1.103.252:33585: OK, [26ms] sending RPC to server 48d894fb9d2c4bf29da35ea457e92160, [29ms] received response from server 48d894fb9d2c4bf29da35ea457e92160: Network error: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903, [29ms] delaying RPC due to: Network error: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903, [38ms] refreshing cache from master, [39ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.103.252:33585, [44ms] Sub RPC GetTableLocations: received response from server master-127.1.103.252:33585: OK, [46ms] sending RPC to server 48d894fb9d2c4bf29da35ea457e92160, [49ms] received response from server 48d894fb9d2c4bf29da35ea457e92160: Network error: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903, [49ms] delaying RPC due to: Network error: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903, [78ms] refreshing cache from master, [79ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.103.252:33585, [83ms] Sub RPC GetTableLocations: received response from server master-127.1.103.252:33585: OK, [85ms] sending RPC to server 48d894fb9d2c4bf29da35ea457e92160, [88ms] received response from server 48d894fb9d2c4bf29da35ea457e92160: Network error: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903, [88ms] delaying RPC due to: Network error: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903, [218ms] refreshing cache from master, [218ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.103.252:33585, [222ms] Sub RPC GetTableLocations: received response from server master-127.1.103.252:33585: OK, [224ms] sending RPC to server 48d894fb9d2c4bf29da35ea457e92160, [225ms] received response from server 48d894fb9d2c4bf29da35ea457e92160: Network error: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903, [225ms] delaying RPC due to: Network error: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903, [418ms] refreshing cache from master, [418ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.103.252:33585, [423ms] Sub RPC GetTableLocations: received response from server master-127.1.103.252:33585: OK, [426ms] sending RPC to server 48d894fb9d2c4bf29da35ea457e92160, [427ms] received response from server 48d894fb9d2c4bf29da35ea457e92160: Network error: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903, [427ms] delaying RPC due to: Network error: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903, [678ms] refreshing cache from master, [678ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.103.252:33585, [685ms] Sub RPC GetTableLocations: received response from server master-127.1.103.252:33585: OK, [686ms] sending RPC to server 48d894fb9d2c4bf29da35ea457e92160, [688ms] received response from server 48d894fb9d2c4bf29da35ea457e92160: Network error: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903, [688ms] delaying RPC due to: Network error: Failed to connect to peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903): Connection refused: /127.1.103.194:33903, [3918ms] refreshing cache from master, [3918ms] Sub RPC GetTableLocations: sending RPC to server master-127.1.103.252:33585, [3923ms] Sub RPC GetTableLocations: received response from server master-127.1.103.252:33585: OK, deferred=Deferred@683508309(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$232/0x00007f855436d1a8@624d6905 -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@1079905672 after retry RPC@173987382) -> (continuation of Deferred@765169029 after retry RPC@1857853984) -> (continuation of Deferred@920910199 after retry RPC@250814329) -> (continuation of Deferred@1684759872 after retry RPC@1920312931) -> (continuation of Deferred@1148721365 after retry RPC@459401351) -> (continuation of Deferred@1073892693 after retry RPC@287224117), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@5e80dc52 -> wakeup thread Time-limited test -> (continuation of Deferred@1079905672 after retry RPC@173987382) -> (continuation of Deferred@765169029 after retry RPC@1857853984) -> (continuation of Deferred@920910199 after retry RPC@250814329) -> (continuation of Deferred@1684759872 after retry RPC@1920312931) -> (continuation of Deferred@1148721365 after retry RPC@459401351) -> (continuation of Deferred@1073892693 after retry RPC@287224117))) after lookup
14:22:18.865 [DEBUG - kudu-nio-2] (Connection.java:748) [peer d01a61f77a87460fa13dc7ce33d738c7(127.1.103.195:40917)] connecting to peer
14:22:18.866 [DEBUG - kudu-nio-3] (Connection.java:757) [peer d01a61f77a87460fa13dc7ce33d738c7(127.1.103.195:40917)] Successfully connected to peer
14:22:18.898 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x4d87a296, L:/127.0.0.1:58466 - R:/127.1.103.195:40917] using TOKEN/null
14:22:18.968 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 6 rows, more = false) for scanner KuduScanner(table=org.apache.kudu.client.TestLeaderFailover-1779114114883, tablet=b8130f9d2a6d487693f90a0a265c6c0c, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:22:18.981 [DEBUG - main] (Connection.java:575) [peer 48d894fb9d2c4bf29da35ea457e92160(127.1.103.194:33903)] disconnecting while in state TERMINATED
14:22:18.984 [DEBUG - main] (Connection.java:575) [peer d01a61f77a87460fa13dc7ce33d738c7(127.1.103.195:40917)] disconnecting while in state READY
14:22:18.985 [DEBUG - main] (Connection.java:575) [peer master-127.1.103.252:33585(127.1.103.252:33585)] disconnecting while in state READY
14:22:18.985 [DEBUG - main] (Connection.java:575) [peer master-127.1.103.253:34625(127.1.103.253:34625)] disconnecting while in state READY
14:22:18.985 [DEBUG - main] (Connection.java:575) [peer master-127.1.103.254:45279(127.1.103.254:45279)] disconnecting while in state READY
14:22:18.990 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.1.103.254:45279(127.1.103.254:45279)] handling channelInactive
14:22:18.990 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.1.103.252:33585(127.1.103.252:33585)] handling channelInactive
14:22:18.990 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.1.103.253:34625(127.1.103.253:34625)] handling channelInactive
14:22:18.990 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.1.103.253:34625(127.1.103.253:34625)] cleaning up while in state READY due to: connection closed
14:22:18.990 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.1.103.254:45279(127.1.103.254:45279)] cleaning up while in state READY due to: connection closed
14:22:18.990 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:22:18.991 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.1.103.252:33585(127.1.103.252:33585)] cleaning up while in state READY due to: connection closed
14:22:18.992 [DEBUG - kudu-nio-3] (Connection.java:239) [peer d01a61f77a87460fa13dc7ce33d738c7(127.1.103.195:40917)] handling channelInactive
14:22:18.992 [DEBUG - kudu-nio-3] (Connection.java:709) [peer d01a61f77a87460fa13dc7ce33d738c7(127.1.103.195:40917)] cleaning up while in state READY due to: connection closed
14:22:18.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:18.993490  1439 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskquUkVX/build/tsan/bin/kudu with pid 1720
14:22:19.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:19.022733  1439 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskquUkVX/build/tsan/bin/kudu with pid 2023
14:22:19.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:19.057369  1439 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskquUkVX/build/tsan/bin/kudu with pid 1451
14:22:19.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:19.083914  1439 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskquUkVX/build/tsan/bin/kudu with pid 1521
14:22:19.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:19.097961  1621 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.1.103.254:45279: connect: Connection refused (error 111)
14:22:19.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 14:22:19.101184  1621 consensus_peers.cc:597] T 00000000000000000000000000000000 P 8aabbe454c9b4d30b9bb00ebdf29eefd -> Peer c79f51bdb25d47599c9a2588268d1997 (127.1.103.254:45279): Couldn't send request to peer c79f51bdb25d47599c9a2588268d1997. Status: Network error: Client connection negotiation failed: client connection to 127.1.103.254:45279: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
14:22:19.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 14:22:19.110883  1439 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskquUkVX/build/tsan/bin/kudu with pid 1596
14:22:20.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T14:22:20Z chronyd exiting

Time: 26.262

OK (1 test)

