JUnit version 4.13.2
.16:11:06.321 [INFO - main] (RandomUtils.java:49) Using random seed: 1786464666316
16:11:06.359 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
16:11:06.412 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
16:11:06.420 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskvrVe1g/test-tmp
16:11:06.422 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
16:11:06.425 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskvrVe1g/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
16:11:06.621 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

16:11:06.805 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
16:11:06.806 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

16:11:06.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:06.810573  9930 mini_oidc.cc:152] Starting JWKS server
16:11:06.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:06.813963  9930 webserver.cc:460] Webserver started at http://127.0.0.1:41587/ using document root <none> and password file <none>
16:11:06.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:06.814443  9930 mini_oidc.cc:189] Starting OIDC Discovery server
16:11:06.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:06.816344  9930 webserver.cc:460] Webserver started at http://127.0.0.1:38711/ using document root <none> and password file <none>
16:11:06.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-08-11T16:11:06Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
16:11:06.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-08-11T16:11:06Z Disabled control of system clock
16:11:06.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:06.863373  9930 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvrVe1g/build/tsan/bin/kudu
16:11:06.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskvrVe1g/build/tsan/bin/kudu
16:11:06.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/master-0/wal
16:11:06.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/master-0/data
16:11:06.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
16:11:06.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
16:11:06.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
16:11:06.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
16:11:06.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
16:11:06.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
16:11:06.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/master-0/logs
16:11:06.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/master-0/data/info.pb
16:11:06.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
16:11:06.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
16:11:06.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
16:11:06.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
16:11:06.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
16:11:06.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
16:11:06.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
16:11:06.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
16:11:06.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
16:11:06.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
16:11:06.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
16:11:06.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
16:11:06.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.178.190:45893
16:11:06.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.178.190
16:11:06.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
16:11:06.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.178.148:35031
16:11:06.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
16:11:06.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
16:11:06.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
16:11:06.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
16:11:06.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025
16:11:06.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
16:11:06.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:41587/jwks.json with env {}
16:11:07.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:07.158783  9947 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
16:11:07.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:07.159332  9947 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
16:11:07.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:07.159917  9947 flags.cc:425] Enabled unsafe flag: --never_fsync=true
16:11:07.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:07.189894  9947 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
16:11:07.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:07.190155  9947 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
16:11:07.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:07.190340  9947 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
16:11:07.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:07.190569  9947 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
16:11:07.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:07.190876  9947 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
16:11:07.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:07.191116  9947 flags.cc:425] Enabled experimental flag: --jwks_url=http://localhost:41587/jwks.json
16:11:07.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:07.224614  9947 master_runner.cc:386] Master server non-default flags:
16:11:07.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
16:11:07.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.178.148:35031
16:11:07.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
16:11:07.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
16:11:07.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/master-0/data
16:11:07.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/master-0/wal
16:11:07.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
16:11:07.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025
16:11:07.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
16:11:07.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
16:11:07.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
16:11:07.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.178.190:45893
16:11:07.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
16:11:07.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
16:11:07.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
16:11:07.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:41587/jwks.json
16:11:07.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
16:11:07.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
16:11:07.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/master-0/data/info.pb
16:11:07.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.178.190
16:11:07.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
16:11:07.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
16:11:07.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
16:11:07.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
16:11:07.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
16:11:07.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
16:11:07.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/master-0/logs
16:11:07.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
16:11:07.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
16:11:07.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
16:11:07.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
16:11:07.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.18.0-SNAPSHOT
16:11:07.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
16:11:07.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
16:11:07.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by systest at 11 Aug 2026 15:12:52 UTC on ccycloud.quasar-tzrfpd.root.comops.site
16:11:07.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 4580143
16:11:07.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
16:11:07.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:07.225878  9947 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
16:11:07.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:07.227903  9947 file_cache.cc:493] Constructed file cache file cache with capacity 419430
16:11:08.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:07.246739  9955 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
16:11:08.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:07.246804  9956 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
16:11:08.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:07.248317  9947 server_base.cc:1034] running on GCE node
16:11:08.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:07.246726  9959 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
16:11:08.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:08.344658  9947 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
16:11:08.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:08.347147  9947 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
16:11:08.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:08.348489  9947 hybrid_clock.cc:648] HybridClock initialized: now 1786464668348417 us; error 77 us; skew 500 ppm
16:11:08.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:08.349385  9947 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
16:11:08.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:08.355482  9947 webserver.cc:460] Webserver started at http://127.9.178.190:39833/ using document root <none> and password file <none>
16:11:08.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:08.356451  9947 fs_manager.cc:359] Metadata directory not provided
16:11:08.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:08.356657  9947 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
16:11:08.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:08.357182  9947 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
16:11:08.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:08.362025  9947 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/master-0/data/instance:
16:11:08.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "47b27270b60a4fe2af1876eb689f7771"
16:11:08.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-11 16:11:08 on dist-test-slave-nj21"
16:11:08.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:08.363272  9947 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/master-0/wal/instance:
16:11:08.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "47b27270b60a4fe2af1876eb689f7771"
16:11:08.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-11 16:11:08 on dist-test-slave-nj21"
16:11:08.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:08.370311  9947 fs_manager.cc:691] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.000s
16:11:08.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:08.375696  9969 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
16:11:08.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:08.376678  9947 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
16:11:08.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:08.377019  9947 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/master-0/data,/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/master-0/wal
16:11:08.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "47b27270b60a4fe2af1876eb689f7771"
16:11:08.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-11 16:11:08 on dist-test-slave-nj21"
16:11:08.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:08.377377  9947 fs_report.cc:383] FS layout report
16:11:08.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
16:11:08.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/master-0/wal
16:11:08.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/master-0/wal
16:11:08.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/master-0/data/data
16:11:08.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
16:11:08.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
16:11:08.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
16:11:08.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
16:11:08.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
16:11:08.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
16:11:08.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
16:11:08.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
16:11:08.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
16:11:08.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
16:11:08.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
16:11:08.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:08.428769  9947 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
16:11:08.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:08.430346  9947 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
16:11:08.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:08.430830  9947 kserver.cc:163] Server-wide thread pool size limit: 3276
16:11:08.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:08.499441  9947 rpc_server.cc:307] RPC server started. Bound to: 127.9.178.190:45893
16:11:08.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:08.499532 10070 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.178.190:45893 every 8 connection(s)
16:11:08.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:08.502197  9947 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/master-0/data/info.pb
16:11:08.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:08.505399  9930 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvrVe1g/build/tsan/bin/kudu as pid 9947
16:11:08.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:08.505919  9930 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/master-0/wal/instance
16:11:08.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:08.508152 10072 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
16:11:08.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:08.510814  9930 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvrVe1g/build/tsan/bin/kudu
16:11:08.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskvrVe1g/build/tsan/bin/kudu
16:11:08.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/master-1/wal
16:11:08.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/master-1/data
16:11:08.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
16:11:08.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
16:11:08.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
16:11:08.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
16:11:08.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
16:11:08.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
16:11:08.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/master-1/logs
16:11:08.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/master-1/data/info.pb
16:11:08.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
16:11:08.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
16:11:08.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
16:11:08.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
16:11:08.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
16:11:08.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
16:11:08.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
16:11:08.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
16:11:08.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
16:11:08.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
16:11:08.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
16:11:08.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
16:11:08.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.178.189:44571
16:11:08.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.178.189
16:11:08.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
16:11:08.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.178.148:35031
16:11:08.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
16:11:08.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
16:11:08.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
16:11:08.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
16:11:08.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025
16:11:08.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
16:11:08.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:41587/jwks.json with env {}
16:11:08.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:08.521533 10072 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.178.190" port: 45893 } has no permanent_uuid. Determining permanent_uuid...
16:11:08.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:08.551153 10072 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.178.189" port: 44571 } has no permanent_uuid. Determining permanent_uuid...
16:11:08.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:08.553512  9977 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.178.189:44571: connect: Connection refused (error 111)
16:11:08.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:08.557471 10072 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.178.189:44571: Network error: Client connection negotiation failed: client connection to 127.9.178.189:44571: connect: Connection refused (error 111)
16:11:08.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:08.606902 10072 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.178.189" port: 44571 } attempt: 1
16:11:08.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:08.610586 10072 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.178.189:44571: Network error: Client connection negotiation failed: client connection to 127.9.178.189:44571: connect: Connection refused (error 111)
16:11:08.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:08.678952 10072 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.178.189" port: 44571 } attempt: 2
16:11:08.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:08.683046 10072 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.178.189:44571: Network error: Client connection negotiation failed: client connection to 127.9.178.189:44571: connect: Connection refused (error 111)
16:11:08.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:08.774461 10072 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.178.189" port: 44571 } attempt: 3
16:11:08.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:08.779712 10072 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.178.189:44571: Network error: Client connection negotiation failed: client connection to 127.9.178.189:44571: connect: Connection refused (error 111)
16:11:08.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:08.812661 10075 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
16:11:08.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:08.813179 10075 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
16:11:08.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:08.813627 10075 flags.cc:425] Enabled unsafe flag: --never_fsync=true
16:11:08.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:08.843211 10075 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
16:11:08.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:08.843474 10075 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
16:11:08.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:08.843660 10075 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
16:11:08.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:08.843968 10075 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
16:11:08.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:08.844184 10075 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
16:11:08.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:08.844323 10075 flags.cc:425] Enabled experimental flag: --jwks_url=http://localhost:41587/jwks.json
16:11:08.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:08.877542 10075 master_runner.cc:386] Master server non-default flags:
16:11:08.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
16:11:08.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.178.148:35031
16:11:08.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
16:11:08.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
16:11:08.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/master-1/data
16:11:08.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/master-1/wal
16:11:08.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
16:11:08.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025
16:11:08.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
16:11:08.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
16:11:08.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
16:11:08.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.178.189:44571
16:11:08.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
16:11:08.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
16:11:08.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
16:11:08.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:41587/jwks.json
16:11:08.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
16:11:08.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
16:11:08.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/master-1/data/info.pb
16:11:08.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.178.189
16:11:08.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
16:11:08.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
16:11:08.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
16:11:08.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
16:11:08.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
16:11:08.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
16:11:08.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/master-1/logs
16:11:08.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
16:11:08.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
16:11:08.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
16:11:08.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
16:11:08.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.18.0-SNAPSHOT
16:11:08.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
16:11:08.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
16:11:08.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by systest at 11 Aug 2026 15:12:52 UTC on ccycloud.quasar-tzrfpd.root.comops.site
16:11:08.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 4580143
16:11:08.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
16:11:08.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:08.878754 10075 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
16:11:08.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:08.880838 10075 file_cache.cc:493] Constructed file cache file cache with capacity 419430
16:11:08.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:08.896314 10097 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
16:11:08.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:08.923121 10072 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.178.189" port: 44571 } attempt: 4
16:11:08.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:08.926440 10072 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.178.189:44571: Network error: Client connection negotiation failed: client connection to 127.9.178.189:44571: connect: Connection refused (error 111)
16:11:09.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:09.225925 10072 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.178.189" port: 44571 } attempt: 5
16:11:09.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:09.229808 10072 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.178.189:44571: Network error: Client connection negotiation failed: client connection to 127.9.178.189:44571: connect: Connection refused (error 111)
16:11:09.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:09.777289 10072 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.178.189" port: 44571 } attempt: 6
16:11:09.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:09.783479 10072 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.178.189:44571: Network error: Client connection negotiation failed: client connection to 127.9.178.189:44571: connect: Connection refused (error 111)
16:11:09.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:08.896797 10090 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
16:11:09.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:08.896483 10095 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
16:11:09.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:09.982059 10096 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
16:11:09.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:09.982594 10075 server_base.cc:1029] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
16:11:09.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:09.986238 10075 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
16:11:09.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:09.988853 10075 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
16:11:09.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:09.990212 10075 hybrid_clock.cc:648] HybridClock initialized: now 1786464669990138 us; error 87 us; skew 500 ppm
16:11:09.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:09.991336 10075 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
16:11:10.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:10.001600 10075 webserver.cc:460] Webserver started at http://127.9.178.189:44653/ using document root <none> and password file <none>
16:11:10.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:10.002652 10075 fs_manager.cc:359] Metadata directory not provided
16:11:10.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:10.002919 10075 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
16:11:10.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:10.003337 10075 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
16:11:10.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:10.008057 10075 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/master-1/data/instance:
16:11:10.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1935cf4b9a704251a6b255b7bf2dfd36"
16:11:10.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-11 16:11:09 on dist-test-slave-nj21"
16:11:10.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:10.009307 10075 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/master-1/wal/instance:
16:11:10.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1935cf4b9a704251a6b255b7bf2dfd36"
16:11:10.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-11 16:11:09 on dist-test-slave-nj21"
16:11:10.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:10.016381 10075 fs_manager.cc:691] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.001s
16:11:10.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:10.021631 10111 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
16:11:10.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:10.022634 10075 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.001s
16:11:10.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:10.022908 10075 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/master-1/data,/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/master-1/wal
16:11:10.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1935cf4b9a704251a6b255b7bf2dfd36"
16:11:10.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-11 16:11:09 on dist-test-slave-nj21"
16:11:10.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:10.023191 10075 fs_report.cc:383] FS layout report
16:11:10.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
16:11:10.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/master-1/wal
16:11:10.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/master-1/wal
16:11:10.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/master-1/data/data
16:11:10.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
16:11:10.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
16:11:10.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
16:11:10.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
16:11:10.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
16:11:10.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
16:11:10.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
16:11:10.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
16:11:10.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
16:11:10.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
16:11:10.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
16:11:10.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:10.060961 10075 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
16:11:10.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:10.062480 10075 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
16:11:10.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:10.062930 10075 kserver.cc:163] Server-wide thread pool size limit: 3276
16:11:10.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:10.134362 10075 rpc_server.cc:307] RPC server started. Bound to: 127.9.178.189:44571
16:11:10.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:10.134490 10198 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.178.189:44571 every 8 connection(s)
16:11:10.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:10.137781 10075 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/master-1/data/info.pb
16:11:10.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:10.142993 10199 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
16:11:10.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:10.143294  9930 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvrVe1g/build/tsan/bin/kudu as pid 10075
16:11:10.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:10.143616  9930 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/master-1/wal/instance
16:11:10.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:10.145612  9930 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvrVe1g/build/tsan/bin/kudu
16:11:10.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskvrVe1g/build/tsan/bin/kudu
16:11:10.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/master-2/wal
16:11:10.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/master-2/data
16:11:10.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
16:11:10.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
16:11:10.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
16:11:10.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
16:11:10.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
16:11:10.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
16:11:10.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/master-2/logs
16:11:10.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/master-2/data/info.pb
16:11:10.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
16:11:10.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
16:11:10.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
16:11:10.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
16:11:10.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
16:11:10.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
16:11:10.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
16:11:10.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
16:11:10.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
16:11:10.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
16:11:10.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
16:11:10.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
16:11:10.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.178.188:43025
16:11:10.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.178.188
16:11:10.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
16:11:10.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.178.148:35031
16:11:10.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
16:11:10.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
16:11:10.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
16:11:10.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
16:11:10.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025
16:11:10.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
16:11:10.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:41587/jwks.json with env {}
16:11:10.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:10.155145 10199 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.178.190" port: 45893 } has no permanent_uuid. Determining permanent_uuid...
16:11:10.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:10.180461 10199 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.178.189" port: 44571 } has no permanent_uuid. Determining permanent_uuid...
16:11:10.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:10.196768 10199 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.178.188" port: 43025 } has no permanent_uuid. Determining permanent_uuid...
16:11:10.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:10.199101 10116 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.178.188:43025: connect: Connection refused (error 111)
16:11:10.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:10.202888 10199 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.178.188:43025: Network error: Client connection negotiation failed: client connection to 127.9.178.188:43025: connect: Connection refused (error 111)
16:11:10.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:10.252408 10199 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.178.188" port: 43025 } attempt: 1
16:11:10.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:10.256942 10199 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.178.188:43025: Network error: Client connection negotiation failed: client connection to 127.9.178.188:43025: connect: Connection refused (error 111)
16:11:10.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:10.325335 10199 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.178.188" port: 43025 } attempt: 2
16:11:10.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:10.329077 10199 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.178.188:43025: Network error: Client connection negotiation failed: client connection to 127.9.178.188:43025: connect: Connection refused (error 111)
16:11:10.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:10.420435 10199 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.178.188" port: 43025 } attempt: 3
16:11:10.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:10.424057 10199 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.178.188:43025: Network error: Client connection negotiation failed: client connection to 127.9.178.188:43025: connect: Connection refused (error 111)
16:11:10.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:10.447024 10203 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
16:11:10.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:10.447660 10203 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
16:11:10.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:10.448304 10203 flags.cc:425] Enabled unsafe flag: --never_fsync=true
16:11:10.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:10.478096 10203 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
16:11:10.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:10.478423 10203 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
16:11:10.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:10.478767 10203 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
16:11:10.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:10.479058 10203 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
16:11:10.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:10.479395 10203 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
16:11:10.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:10.479606 10203 flags.cc:425] Enabled experimental flag: --jwks_url=http://localhost:41587/jwks.json
16:11:10.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:10.512964 10203 master_runner.cc:386] Master server non-default flags:
16:11:10.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
16:11:10.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.178.148:35031
16:11:10.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
16:11:10.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
16:11:10.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/master-2/data
16:11:10.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/master-2/wal
16:11:10.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
16:11:10.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025
16:11:10.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
16:11:10.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
16:11:10.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
16:11:10.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.178.188:43025
16:11:10.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
16:11:10.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
16:11:10.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
16:11:10.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:41587/jwks.json
16:11:10.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
16:11:10.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
16:11:10.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/master-2/data/info.pb
16:11:10.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.178.188
16:11:10.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
16:11:10.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
16:11:10.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
16:11:10.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
16:11:10.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
16:11:10.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
16:11:10.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/master-2/logs
16:11:10.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
16:11:10.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
16:11:10.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
16:11:10.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
16:11:10.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.18.0-SNAPSHOT
16:11:10.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
16:11:10.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
16:11:10.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by systest at 11 Aug 2026 15:12:52 UTC on ccycloud.quasar-tzrfpd.root.comops.site
16:11:10.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 4580143
16:11:10.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
16:11:10.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:10.514448 10203 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
16:11:10.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:10.516675 10203 file_cache.cc:493] Constructed file cache file cache with capacity 419430
16:11:10.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:10.532562 10228 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
16:11:10.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:10.567435 10199 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.178.188" port: 43025 } attempt: 4
16:11:10.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:10.571563 10199 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.178.188:43025: Network error: Client connection negotiation failed: client connection to 127.9.178.188:43025: connect: Connection refused (error 111)
16:11:10.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:10.843890 10072 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.178.189" port: 44571 } attempt: 7
16:11:10.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:10.857677 10072 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.178.188" port: 43025 } has no permanent_uuid. Determining permanent_uuid...
16:11:10.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:10.862900 10072 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.178.188:43025: Network error: Client connection negotiation failed: client connection to 127.9.178.188:43025: connect: Connection refused (error 111)
16:11:10.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:10.870992 10199 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.178.188" port: 43025 } attempt: 5
16:11:10.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:10.874267 10199 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.178.188:43025: Network error: Client connection negotiation failed: client connection to 127.9.178.188:43025: connect: Connection refused (error 111)
16:11:10.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:10.921272 10072 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.178.188" port: 43025 } attempt: 1
16:11:10.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:10.924925 10072 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.178.188:43025: Network error: Client connection negotiation failed: client connection to 127.9.178.188:43025: connect: Connection refused (error 111)
16:11:11.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:11.006282 10072 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.178.188" port: 43025 } attempt: 2
16:11:11.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:11.010090 10072 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.178.188:43025: Network error: Client connection negotiation failed: client connection to 127.9.178.188:43025: connect: Connection refused (error 111)
16:11:11.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:11.095444 10072 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.178.188" port: 43025 } attempt: 3
16:11:11.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:11.099399 10072 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.178.188:43025: Network error: Client connection negotiation failed: client connection to 127.9.178.188:43025: connect: Connection refused (error 111)
16:11:11.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:11.239753 10072 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.178.188" port: 43025 } attempt: 4
16:11:11.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:11.243477 10072 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.178.188:43025: Network error: Client connection negotiation failed: client connection to 127.9.178.188:43025: connect: Connection refused (error 111)
16:11:11.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:11.421752 10199 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.178.188" port: 43025 } attempt: 6
16:11:11.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:11.428473 10199 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.178.188:43025: Network error: Client connection negotiation failed: client connection to 127.9.178.188:43025: connect: Connection refused (error 111)
16:11:11.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:11.526998 10072 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.178.188" port: 43025 } attempt: 5
16:11:11.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:11.530571 10072 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.9.178.188:43025: Network error: Client connection negotiation failed: client connection to 127.9.178.188:43025: connect: Connection refused (error 111)
16:11:11.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:10.532716 10225 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
16:11:11.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:10.533046 10223 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
16:11:11.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:10.534849 10203 server_base.cc:1034] running on GCE node
16:11:11.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:11.626729 10203 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
16:11:11.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:11.629725 10203 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
16:11:11.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:11.631136 10203 hybrid_clock.cc:648] HybridClock initialized: now 1786464671631097 us; error 57 us; skew 500 ppm
16:11:11.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:11.632001 10203 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
16:11:11.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:11.638338 10203 webserver.cc:460] Webserver started at http://127.9.178.188:38517/ using document root <none> and password file <none>
16:11:11.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:11.639202 10203 fs_manager.cc:359] Metadata directory not provided
16:11:11.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:11.639382 10203 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
16:11:11.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:11.639811 10203 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
16:11:11.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:11.644757 10203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/master-2/data/instance:
16:11:11.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "62642e355e904e4e888e2e0981b717cf"
16:11:11.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-11 16:11:11 on dist-test-slave-nj21"
16:11:11.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:11.645792 10203 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/master-2/wal/instance:
16:11:11.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "62642e355e904e4e888e2e0981b717cf"
16:11:11.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-11 16:11:11 on dist-test-slave-nj21"
16:11:11.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:11.652706 10203 fs_manager.cc:691] Time spent creating directory manager: real 0.006s	user 0.008s	sys 0.000s
16:11:11.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:11.657857 10254 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
16:11:11.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:11.658830 10203 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.004s
16:11:11.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:11.659116 10203 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/master-2/data,/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/master-2/wal
16:11:11.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "62642e355e904e4e888e2e0981b717cf"
16:11:11.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-11 16:11:11 on dist-test-slave-nj21"
16:11:11.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:11.659399 10203 fs_report.cc:383] FS layout report
16:11:11.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
16:11:11.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/master-2/wal
16:11:11.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/master-2/wal
16:11:11.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/master-2/data/data
16:11:11.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
16:11:11.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
16:11:11.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
16:11:11.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
16:11:11.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
16:11:11.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
16:11:11.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
16:11:11.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
16:11:11.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
16:11:11.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
16:11:11.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
16:11:11.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:11.699942 10203 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
16:11:11.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:11.701361 10203 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
16:11:11.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:11.701767 10203 kserver.cc:163] Server-wide thread pool size limit: 3276
16:11:11.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:11.770112 10203 rpc_server.cc:307] RPC server started. Bound to: 127.9.178.188:43025
16:11:11.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:11.770205 10349 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.178.188:43025 every 8 connection(s)
16:11:11.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:11.772631 10203 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/master-2/data/info.pb
16:11:11.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:11.778366  9930 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvrVe1g/build/tsan/bin/kudu as pid 10203
16:11:11.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:11.778497 10350 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
16:11:11.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:11.778856  9930 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/master-2/wal/instance
16:11:11.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:11.794452 10350 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.178.190" port: 45893 } has no permanent_uuid. Determining permanent_uuid...
16:11:11.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:11.823254 10350 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.178.189" port: 44571 } has no permanent_uuid. Determining permanent_uuid...
16:11:11.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:11.834317 10350 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.9.178.188" port: 43025 } has no permanent_uuid. Determining permanent_uuid...
16:11:11.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:11.850466 10350 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62642e355e904e4e888e2e0981b717cf: Bootstrap starting.
16:11:11.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:11.856112 10350 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 62642e355e904e4e888e2e0981b717cf: Neither blocks nor log segments found. Creating new log.
16:11:11.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:11.858301 10350 log.cc:824] T 00000000000000000000000000000000 P 62642e355e904e4e888e2e0981b717cf: Log is configured to *not* fsync() on all Append() calls
16:11:11.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:11.862531 10350 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 62642e355e904e4e888e2e0981b717cf: No bootstrap required, opened a new log
16:11:11.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:11.882428 10350 raft_consensus.cc:348] T 00000000000000000000000000000000 P 62642e355e904e4e888e2e0981b717cf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47b27270b60a4fe2af1876eb689f7771" member_type: VOTER last_known_addr { host: "127.9.178.190" port: 45893 } } peers { permanent_uuid: "1935cf4b9a704251a6b255b7bf2dfd36" member_type: VOTER last_known_addr { host: "127.9.178.189" port: 44571 } } peers { permanent_uuid: "62642e355e904e4e888e2e0981b717cf" member_type: VOTER last_known_addr { host: "127.9.178.188" port: 43025 } }
16:11:11.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:11.882994 10350 raft_consensus.cc:374] T 00000000000000000000000000000000 P 62642e355e904e4e888e2e0981b717cf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
16:11:11.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:11.883176 10350 raft_consensus.cc:729] T 00000000000000000000000000000000 P 62642e355e904e4e888e2e0981b717cf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 62642e355e904e4e888e2e0981b717cf, State: Initialized, Role: FOLLOWER
16:11:11.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:11.883816 10350 consensus_queue.cc:260] T 00000000000000000000000000000000 P 62642e355e904e4e888e2e0981b717cf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47b27270b60a4fe2af1876eb689f7771" member_type: VOTER last_known_addr { host: "127.9.178.190" port: 45893 } } peers { permanent_uuid: "1935cf4b9a704251a6b255b7bf2dfd36" member_type: VOTER last_known_addr { host: "127.9.178.189" port: 44571 } } peers { permanent_uuid: "62642e355e904e4e888e2e0981b717cf" member_type: VOTER last_known_addr { host: "127.9.178.188" port: 43025 } }
16:11:11.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:11.886287 10367 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62642e355e904e4e888e2e0981b717cf [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47b27270b60a4fe2af1876eb689f7771" member_type: VOTER last_known_addr { host: "127.9.178.190" port: 45893 } } peers { permanent_uuid: "1935cf4b9a704251a6b255b7bf2dfd36" member_type: VOTER last_known_addr { host: "127.9.178.189" port: 44571 } } peers { permanent_uuid: "62642e355e904e4e888e2e0981b717cf" member_type: VOTER last_known_addr { host: "127.9.178.188" port: 43025 } } }
16:11:11.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:11.887342 10367 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62642e355e904e4e888e2e0981b717cf [sys.catalog]: This master's current role is: FOLLOWER
16:11:11.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:11.887854 10350 sys_catalog.cc:564] T 00000000000000000000000000000000 P 62642e355e904e4e888e2e0981b717cf [sys.catalog]: configured and running, proceeding with master startup.
16:11:11.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:11.911921 10384 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 62642e355e904e4e888e2e0981b717cf: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
16:11:11.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:11.912243 10384 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
16:11:11.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:11.907435 10203 master_runner.cc:186] Error getting master registration for 127.9.178.190:45893: OK, instance_id { permanent_uuid: "47b27270b60a4fe2af1876eb689f7771" instance_seqno: 1786464668480718 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
16:11:11.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:11.931643 10203 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
16:11:11.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:11.956736 10262 tablet.cc:2369] T 00000000000000000000000000000000 P 62642e355e904e4e888e2e0981b717cf: Can't schedule compaction. Clean time has not been advanced past its initial value.
16:11:12.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.082954 10072 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.178.188" port: 43025 } attempt: 6
16:11:12.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.104281 10072 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 47b27270b60a4fe2af1876eb689f7771: Bootstrap starting.
16:11:12.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.111352 10072 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 47b27270b60a4fe2af1876eb689f7771: Neither blocks nor log segments found. Creating new log.
16:11:12.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.113729 10072 log.cc:824] T 00000000000000000000000000000000 P 47b27270b60a4fe2af1876eb689f7771: Log is configured to *not* fsync() on all Append() calls
16:11:12.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.118585 10072 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 47b27270b60a4fe2af1876eb689f7771: No bootstrap required, opened a new log
16:11:12.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.138800 10367 raft_consensus.cc:482] T 00000000000000000000000000000000 P 62642e355e904e4e888e2e0981b717cf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
16:11:12.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.140192 10367 raft_consensus.cc:504] T 00000000000000000000000000000000 P 62642e355e904e4e888e2e0981b717cf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47b27270b60a4fe2af1876eb689f7771" member_type: VOTER last_known_addr { host: "127.9.178.190" port: 45893 } } peers { permanent_uuid: "1935cf4b9a704251a6b255b7bf2dfd36" member_type: VOTER last_known_addr { host: "127.9.178.189" port: 44571 } } peers { permanent_uuid: "62642e355e904e4e888e2e0981b717cf" member_type: VOTER last_known_addr { host: "127.9.178.188" port: 43025 } }
16:11:12.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.140836 10072 raft_consensus.cc:348] T 00000000000000000000000000000000 P 47b27270b60a4fe2af1876eb689f7771 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47b27270b60a4fe2af1876eb689f7771" member_type: VOTER last_known_addr { host: "127.9.178.190" port: 45893 } } peers { permanent_uuid: "1935cf4b9a704251a6b255b7bf2dfd36" member_type: VOTER last_known_addr { host: "127.9.178.189" port: 44571 } } peers { permanent_uuid: "62642e355e904e4e888e2e0981b717cf" member_type: VOTER last_known_addr { host: "127.9.178.188" port: 43025 } }
16:11:12.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.141819 10072 raft_consensus.cc:374] T 00000000000000000000000000000000 P 47b27270b60a4fe2af1876eb689f7771 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
16:11:12.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.142082 10072 raft_consensus.cc:729] T 00000000000000000000000000000000 P 47b27270b60a4fe2af1876eb689f7771 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47b27270b60a4fe2af1876eb689f7771, State: Initialized, Role: FOLLOWER
16:11:12.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.143041 10072 consensus_queue.cc:260] T 00000000000000000000000000000000 P 47b27270b60a4fe2af1876eb689f7771 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47b27270b60a4fe2af1876eb689f7771" member_type: VOTER last_known_addr { host: "127.9.178.190" port: 45893 } } peers { permanent_uuid: "1935cf4b9a704251a6b255b7bf2dfd36" member_type: VOTER last_known_addr { host: "127.9.178.189" port: 44571 } } peers { permanent_uuid: "62642e355e904e4e888e2e0981b717cf" member_type: VOTER last_known_addr { host: "127.9.178.188" port: 43025 } }
16:11:12.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.149304 10367 leader_election.cc:288] T 00000000000000000000000000000000 P 62642e355e904e4e888e2e0981b717cf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47b27270b60a4fe2af1876eb689f7771 (127.9.178.190:45893), 1935cf4b9a704251a6b255b7bf2dfd36 (127.9.178.189:44571)
16:11:12.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.157140 10390 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47b27270b60a4fe2af1876eb689f7771 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47b27270b60a4fe2af1876eb689f7771" member_type: VOTER last_known_addr { host: "127.9.178.190" port: 45893 } } peers { permanent_uuid: "1935cf4b9a704251a6b255b7bf2dfd36" member_type: VOTER last_known_addr { host: "127.9.178.189" port: 44571 } } peers { permanent_uuid: "62642e355e904e4e888e2e0981b717cf" member_type: VOTER last_known_addr { host: "127.9.178.188" port: 43025 } } }
16:11:12.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.158818 10072 sys_catalog.cc:564] T 00000000000000000000000000000000 P 47b27270b60a4fe2af1876eb689f7771 [sys.catalog]: configured and running, proceeding with master startup.
16:11:12.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.159018 10017 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "62642e355e904e4e888e2e0981b717cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b27270b60a4fe2af1876eb689f7771" is_pre_election: true
16:11:12.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.159874 10017 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 47b27270b60a4fe2af1876eb689f7771 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 62642e355e904e4e888e2e0981b717cf in term 0.
16:11:12.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.158689 10390 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47b27270b60a4fe2af1876eb689f7771 [sys.catalog]: This master's current role is: FOLLOWER
16:11:12.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.161212 10256 leader_election.cc:302] T 00000000000000000000000000000000 P 62642e355e904e4e888e2e0981b717cf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b27270b60a4fe2af1876eb689f7771, 62642e355e904e4e888e2e0981b717cf; no voters: 
16:11:12.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.162154 10367 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 62642e355e904e4e888e2e0981b717cf [term 0 FOLLOWER]: Leader pre-election won for term 1
16:11:12.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.162473 10367 raft_consensus.cc:482] T 00000000000000000000000000000000 P 62642e355e904e4e888e2e0981b717cf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
16:11:12.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.162771 10367 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 62642e355e904e4e888e2e0981b717cf [term 0 FOLLOWER]: Advancing to term 1
16:11:12.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.169634 10367 raft_consensus.cc:504] T 00000000000000000000000000000000 P 62642e355e904e4e888e2e0981b717cf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47b27270b60a4fe2af1876eb689f7771" member_type: VOTER last_known_addr { host: "127.9.178.190" port: 45893 } } peers { permanent_uuid: "1935cf4b9a704251a6b255b7bf2dfd36" member_type: VOTER last_known_addr { host: "127.9.178.189" port: 44571 } } peers { permanent_uuid: "62642e355e904e4e888e2e0981b717cf" member_type: VOTER last_known_addr { host: "127.9.178.188" port: 43025 } }
16:11:12.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.172225 10017 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "62642e355e904e4e888e2e0981b717cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b27270b60a4fe2af1876eb689f7771"
16:11:12.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.172727 10017 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 47b27270b60a4fe2af1876eb689f7771 [term 0 FOLLOWER]: Advancing to term 1
16:11:12.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.173327 10367 leader_election.cc:288] T 00000000000000000000000000000000 P 62642e355e904e4e888e2e0981b717cf [CANDIDATE]: Term 1 election: Requested vote from peers 47b27270b60a4fe2af1876eb689f7771 (127.9.178.190:45893), 1935cf4b9a704251a6b255b7bf2dfd36 (127.9.178.189:44571)
16:11:12.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.184295 10017 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 47b27270b60a4fe2af1876eb689f7771 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62642e355e904e4e888e2e0981b717cf in term 1.
16:11:12.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.185977 10256 leader_election.cc:302] T 00000000000000000000000000000000 P 62642e355e904e4e888e2e0981b717cf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47b27270b60a4fe2af1876eb689f7771, 62642e355e904e4e888e2e0981b717cf; no voters: 
16:11:12.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.186978 10367 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 62642e355e904e4e888e2e0981b717cf [term 1 FOLLOWER]: Leader election won for term 1
16:11:12.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:12.189200  9981 tablet.cc:2369] T 00000000000000000000000000000000 P 47b27270b60a4fe2af1876eb689f7771: Can't schedule compaction. Clean time has not been advanced past its initial value.
16:11:12.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.204427 10367 raft_consensus.cc:686] T 00000000000000000000000000000000 P 62642e355e904e4e888e2e0981b717cf [term 1 LEADER]: Becoming Leader. State: Replica: 62642e355e904e4e888e2e0981b717cf, State: Running, Role: LEADER
16:11:12.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.206054 10367 consensus_queue.cc:237] T 00000000000000000000000000000000 P 62642e355e904e4e888e2e0981b717cf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47b27270b60a4fe2af1876eb689f7771" member_type: VOTER last_known_addr { host: "127.9.178.190" port: 45893 } } peers { permanent_uuid: "1935cf4b9a704251a6b255b7bf2dfd36" member_type: VOTER last_known_addr { host: "127.9.178.189" port: 44571 } } peers { permanent_uuid: "62642e355e904e4e888e2e0981b717cf" member_type: VOTER last_known_addr { host: "127.9.178.188" port: 43025 } }
16:11:12.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.221823 10402 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62642e355e904e4e888e2e0981b717cf [sys.catalog]: SysCatalogTable state changed. Reason: New leader 62642e355e904e4e888e2e0981b717cf. Latest consensus state: current_term: 1 leader_uuid: "62642e355e904e4e888e2e0981b717cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47b27270b60a4fe2af1876eb689f7771" member_type: VOTER last_known_addr { host: "127.9.178.190" port: 45893 } } peers { permanent_uuid: "1935cf4b9a704251a6b255b7bf2dfd36" member_type: VOTER last_known_addr { host: "127.9.178.189" port: 44571 } } peers { permanent_uuid: "62642e355e904e4e888e2e0981b717cf" member_type: VOTER last_known_addr { host: "127.9.178.188" port: 43025 } } }
16:11:12.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.226419 10402 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62642e355e904e4e888e2e0981b717cf [sys.catalog]: This master's current role is: LEADER
16:11:12.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.232018 10415 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
16:11:12.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.240027 10415 catalog_manager.cc:1484] Initializing Kudu cluster ID...
16:11:12.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.274159 10017 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 47b27270b60a4fe2af1876eb689f7771 [term 1 FOLLOWER]: Refusing update from remote peer 62642e355e904e4e888e2e0981b717cf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
16:11:12.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.275960 10402 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 62642e355e904e4e888e2e0981b717cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "47b27270b60a4fe2af1876eb689f7771" member_type: VOTER last_known_addr { host: "127.9.178.190" port: 45893 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
16:11:12.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:12.277076 10416 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 47b27270b60a4fe2af1876eb689f7771: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
16:11:12.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:12.277412 10416 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
16:11:12.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.261647  9947 master_runner.cc:186] Error getting master registration for 127.9.178.189:44571: OK, instance_id { permanent_uuid: "1935cf4b9a704251a6b255b7bf2dfd36" instance_seqno: 1786464670114547 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
16:11:12.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.320354  9947 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
16:11:12.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.340006 10390 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47b27270b60a4fe2af1876eb689f7771 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 62642e355e904e4e888e2e0981b717cf. Latest consensus state: current_term: 1 leader_uuid: "62642e355e904e4e888e2e0981b717cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47b27270b60a4fe2af1876eb689f7771" member_type: VOTER last_known_addr { host: "127.9.178.190" port: 45893 } } peers { permanent_uuid: "1935cf4b9a704251a6b255b7bf2dfd36" member_type: VOTER last_known_addr { host: "127.9.178.189" port: 44571 } } peers { permanent_uuid: "62642e355e904e4e888e2e0981b717cf" member_type: VOTER last_known_addr { host: "127.9.178.188" port: 43025 } } }
16:11:12.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.340739 10390 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47b27270b60a4fe2af1876eb689f7771 [sys.catalog]: This master's current role is: FOLLOWER
16:11:12.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.342701 10417 mvcc.cc:205] Tried to move back new op lower bound from 7317359297616842752 to 7317359297399074816. Current Snapshot: MvccSnapshot[applied={T|T < 7317359297616842752}]
16:11:12.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.355078 10367 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62642e355e904e4e888e2e0981b717cf [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "62642e355e904e4e888e2e0981b717cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47b27270b60a4fe2af1876eb689f7771" member_type: VOTER last_known_addr { host: "127.9.178.190" port: 45893 } } peers { permanent_uuid: "1935cf4b9a704251a6b255b7bf2dfd36" member_type: VOTER last_known_addr { host: "127.9.178.189" port: 44571 } } peers { permanent_uuid: "62642e355e904e4e888e2e0981b717cf" member_type: VOTER last_known_addr { host: "127.9.178.188" port: 43025 } } }
16:11:12.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.355814 10367 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62642e355e904e4e888e2e0981b717cf [sys.catalog]: This master's current role is: LEADER
16:11:12.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.357141 10415 catalog_manager.cc:1347] Generated new cluster ID: ce2d498cb21746ef90b844f88851ce47
16:11:12.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.357411 10415 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
16:11:12.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.377113 10390 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47b27270b60a4fe2af1876eb689f7771 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "62642e355e904e4e888e2e0981b717cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47b27270b60a4fe2af1876eb689f7771" member_type: VOTER last_known_addr { host: "127.9.178.190" port: 45893 } } peers { permanent_uuid: "1935cf4b9a704251a6b255b7bf2dfd36" member_type: VOTER last_known_addr { host: "127.9.178.189" port: 44571 } } peers { permanent_uuid: "62642e355e904e4e888e2e0981b717cf" member_type: VOTER last_known_addr { host: "127.9.178.188" port: 43025 } } }
16:11:12.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.377801 10390 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47b27270b60a4fe2af1876eb689f7771 [sys.catalog]: This master's current role is: FOLLOWER
16:11:12.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.432189 10415 catalog_manager.cc:1370] Generated new certificate authority record
16:11:12.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.436625 10415 catalog_manager.cc:1504] Loading token signing keys...
16:11:12.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.471305 10415 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 62642e355e904e4e888e2e0981b717cf: Generated new TSK 0
16:11:12.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.472522 10415 catalog_manager.cc:1514] Initializing in-progress tserver states...
16:11:12.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.487026  9930 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvrVe1g/build/tsan/bin/kudu
16:11:12.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskvrVe1g/build/tsan/bin/kudu
16:11:12.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/ts-0/wal
16:11:12.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/ts-0/data
16:11:12.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
16:11:12.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
16:11:12.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
16:11:12.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
16:11:12.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
16:11:12.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
16:11:12.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/ts-0/logs
16:11:12.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/ts-0/data/info.pb
16:11:12.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
16:11:12.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
16:11:12.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
16:11:12.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
16:11:12.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
16:11:12.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
16:11:12.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
16:11:12.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
16:11:12.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
16:11:12.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
16:11:12.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.178.129:0
16:11:12.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.9.178.129
16:11:12.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.178.129
16:11:12.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
16:11:12.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025
16:11:12.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.178.148:35031
16:11:12.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
16:11:12.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
16:11:12.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
16:11:12.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.488870 10199 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.9.178.188" port: 43025 } attempt: 7
16:11:12.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.527429 10199 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1935cf4b9a704251a6b255b7bf2dfd36: Bootstrap starting.
16:11:12.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.545207 10199 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1935cf4b9a704251a6b255b7bf2dfd36: Neither blocks nor log segments found. Creating new log.
16:11:12.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.550837 10199 log.cc:824] T 00000000000000000000000000000000 P 1935cf4b9a704251a6b255b7bf2dfd36: Log is configured to *not* fsync() on all Append() calls
16:11:12.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.571941 10199 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1935cf4b9a704251a6b255b7bf2dfd36: No bootstrap required, opened a new log
16:11:12.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.645334 10199 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1935cf4b9a704251a6b255b7bf2dfd36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47b27270b60a4fe2af1876eb689f7771" member_type: VOTER last_known_addr { host: "127.9.178.190" port: 45893 } } peers { permanent_uuid: "1935cf4b9a704251a6b255b7bf2dfd36" member_type: VOTER last_known_addr { host: "127.9.178.189" port: 44571 } } peers { permanent_uuid: "62642e355e904e4e888e2e0981b717cf" member_type: VOTER last_known_addr { host: "127.9.178.188" port: 43025 } }
16:11:12.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.647796 10199 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1935cf4b9a704251a6b255b7bf2dfd36 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
16:11:12.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.648806 10199 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1935cf4b9a704251a6b255b7bf2dfd36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1935cf4b9a704251a6b255b7bf2dfd36, State: Initialized, Role: FOLLOWER
16:11:12.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.651458 10199 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1935cf4b9a704251a6b255b7bf2dfd36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47b27270b60a4fe2af1876eb689f7771" member_type: VOTER last_known_addr { host: "127.9.178.190" port: 45893 } } peers { permanent_uuid: "1935cf4b9a704251a6b255b7bf2dfd36" member_type: VOTER last_known_addr { host: "127.9.178.189" port: 44571 } } peers { permanent_uuid: "62642e355e904e4e888e2e0981b717cf" member_type: VOTER last_known_addr { host: "127.9.178.188" port: 43025 } }
16:11:12.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.675134 10156 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "62642e355e904e4e888e2e0981b717cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1935cf4b9a704251a6b255b7bf2dfd36"
16:11:12.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.676254 10160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "62642e355e904e4e888e2e0981b717cf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1935cf4b9a704251a6b255b7bf2dfd36" is_pre_election: true
16:11:12.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.680564 10199 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1935cf4b9a704251a6b255b7bf2dfd36 [sys.catalog]: configured and running, proceeding with master startup.
16:11:12.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.681146 10156 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1935cf4b9a704251a6b255b7bf2dfd36 [term 0 FOLLOWER]: Advancing to term 1
16:11:12.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.694907 10156 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 1935cf4b9a704251a6b255b7bf2dfd36 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 62642e355e904e4e888e2e0981b717cf in term 1.
16:11:12.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.687858 10432 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1935cf4b9a704251a6b255b7bf2dfd36 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47b27270b60a4fe2af1876eb689f7771" member_type: VOTER last_known_addr { host: "127.9.178.190" port: 45893 } } peers { permanent_uuid: "1935cf4b9a704251a6b255b7bf2dfd36" member_type: VOTER last_known_addr { host: "127.9.178.189" port: 44571 } } peers { permanent_uuid: "62642e355e904e4e888e2e0981b717cf" member_type: VOTER last_known_addr { host: "127.9.178.188" port: 43025 } } }
16:11:12.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.703496 10432 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1935cf4b9a704251a6b255b7bf2dfd36 [sys.catalog]: This master's current role is: FOLLOWER
16:11:12.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.705390 10432 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1935cf4b9a704251a6b255b7bf2dfd36 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
16:11:12.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.706396 10432 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1935cf4b9a704251a6b255b7bf2dfd36 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47b27270b60a4fe2af1876eb689f7771" member_type: VOTER last_known_addr { host: "127.9.178.190" port: 45893 } } peers { permanent_uuid: "1935cf4b9a704251a6b255b7bf2dfd36" member_type: VOTER last_known_addr { host: "127.9.178.189" port: 44571 } } peers { permanent_uuid: "62642e355e904e4e888e2e0981b717cf" member_type: VOTER last_known_addr { host: "127.9.178.188" port: 43025 } }
16:11:12.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.711702 10017 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1935cf4b9a704251a6b255b7bf2dfd36" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47b27270b60a4fe2af1876eb689f7771" is_pre_election: true
16:11:12.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.713219 10306 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1935cf4b9a704251a6b255b7bf2dfd36" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "62642e355e904e4e888e2e0981b717cf" is_pre_election: true
16:11:12.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.715307 10116 leader_election.cc:302] T 00000000000000000000000000000000 P 1935cf4b9a704251a6b255b7bf2dfd36 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1935cf4b9a704251a6b255b7bf2dfd36; no voters: 47b27270b60a4fe2af1876eb689f7771, 62642e355e904e4e888e2e0981b717cf
16:11:12.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.718098 10154 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 1935cf4b9a704251a6b255b7bf2dfd36 [term 1 FOLLOWER]: Refusing update from remote peer 62642e355e904e4e888e2e0981b717cf: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
16:11:12.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.721035 10402 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 62642e355e904e4e888e2e0981b717cf [LEADER]: Connected to new peer: Peer: permanent_uuid: "1935cf4b9a704251a6b255b7bf2dfd36" member_type: VOTER last_known_addr { host: "127.9.178.189" port: 44571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
16:11:12.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.745581 10432 leader_election.cc:288] T 00000000000000000000000000000000 P 1935cf4b9a704251a6b255b7bf2dfd36 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 47b27270b60a4fe2af1876eb689f7771 (127.9.178.190:45893), 62642e355e904e4e888e2e0981b717cf (127.9.178.188:43025)
16:11:12.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.788106 10433 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 1935cf4b9a704251a6b255b7bf2dfd36 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
16:11:12.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.790477 10432 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1935cf4b9a704251a6b255b7bf2dfd36 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "62642e355e904e4e888e2e0981b717cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47b27270b60a4fe2af1876eb689f7771" member_type: VOTER last_known_addr { host: "127.9.178.190" port: 45893 } } peers { permanent_uuid: "1935cf4b9a704251a6b255b7bf2dfd36" member_type: VOTER last_known_addr { host: "127.9.178.189" port: 44571 } } peers { permanent_uuid: "62642e355e904e4e888e2e0981b717cf" member_type: VOTER last_known_addr { host: "127.9.178.188" port: 43025 } } }
16:11:12.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.791195 10432 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1935cf4b9a704251a6b255b7bf2dfd36 [sys.catalog]: This master's current role is: FOLLOWER
16:11:12.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.792220 10438 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1935cf4b9a704251a6b255b7bf2dfd36 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 62642e355e904e4e888e2e0981b717cf. Latest consensus state: current_term: 1 leader_uuid: "62642e355e904e4e888e2e0981b717cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47b27270b60a4fe2af1876eb689f7771" member_type: VOTER last_known_addr { host: "127.9.178.190" port: 45893 } } peers { permanent_uuid: "1935cf4b9a704251a6b255b7bf2dfd36" member_type: VOTER last_known_addr { host: "127.9.178.189" port: 44571 } } peers { permanent_uuid: "62642e355e904e4e888e2e0981b717cf" member_type: VOTER last_known_addr { host: "127.9.178.188" port: 43025 } } }
16:11:12.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.792997 10438 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1935cf4b9a704251a6b255b7bf2dfd36 [sys.catalog]: This master's current role is: FOLLOWER
16:11:12.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:12.851576 10461 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
16:11:12.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:12.983788 10430 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
16:11:12.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:12.984375 10430 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
16:11:12.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:12.985080 10430 flags.cc:425] Enabled unsafe flag: --never_fsync=true
16:11:13.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:13.017076 10430 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
16:11:13.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:13.018389 10430 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.178.129
16:11:13.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:13.053797 10430 tablet_server_runner.cc:78] Tablet server non-default flags:
16:11:13.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
16:11:13.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.178.148:35031
16:11:13.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
16:11:13.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
16:11:13.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/ts-0/data
16:11:13.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/ts-0/wal
16:11:13.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
16:11:13.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
16:11:13.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.178.129:0
16:11:13.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
16:11:13.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
16:11:13.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
16:11:13.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/ts-0/data/info.pb
16:11:13.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.178.129
16:11:13.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
16:11:13.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025
16:11:13.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
16:11:13.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
16:11:13.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
16:11:13.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
16:11:13.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
16:11:13.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.9.178.129
16:11:13.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/ts-0/logs
16:11:13.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
16:11:13.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
16:11:13.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
16:11:13.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
16:11:13.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.18.0-SNAPSHOT
16:11:13.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
16:11:13.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
16:11:13.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by systest at 11 Aug 2026 15:12:52 UTC on ccycloud.quasar-tzrfpd.root.comops.site
16:11:13.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 4580143
16:11:13.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
16:11:13.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:13.055315 10430 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
16:11:13.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:13.057060 10430 file_cache.cc:493] Constructed file cache file cache with capacity 419430
16:11:13.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:13.080873 10468 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
16:11:13.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:13.259337 10475 sys_catalog.cc:455] T 00000000000000000000000000000000 P 62642e355e904e4e888e2e0981b717cf [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "62642e355e904e4e888e2e0981b717cf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47b27270b60a4fe2af1876eb689f7771" member_type: VOTER last_known_addr { host: "127.9.178.190" port: 45893 } } peers { permanent_uuid: "1935cf4b9a704251a6b255b7bf2dfd36" member_type: VOTER last_known_addr { host: "127.9.178.189" port: 44571 } } peers { permanent_uuid: "62642e355e904e4e888e2e0981b717cf" member_type: VOTER last_known_addr { host: "127.9.178.188" port: 43025 } } }
16:11:13.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:13.264401 10475 sys_catalog.cc:458] T 00000000000000000000000000000000 P 62642e355e904e4e888e2e0981b717cf [sys.catalog]: This master's current role is: LEADER
16:11:13.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:13.282936 10416 catalog_manager.cc:1259] Loaded cluster ID: ce2d498cb21746ef90b844f88851ce47
16:11:13.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:13.283234 10416 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 47b27270b60a4fe2af1876eb689f7771: loading cluster ID for follower catalog manager: success
16:11:13.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:13.290632 10416 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 47b27270b60a4fe2af1876eb689f7771: acquiring CA information for follower catalog manager: success
16:11:13.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:13.296373 10416 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 47b27270b60a4fe2af1876eb689f7771: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
16:11:13.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:13.872527 10461 catalog_manager.cc:1259] Loaded cluster ID: ce2d498cb21746ef90b844f88851ce47
16:11:13.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:13.873420 10461 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 1935cf4b9a704251a6b255b7bf2dfd36: loading cluster ID for follower catalog manager: success
16:11:13.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:13.889781 10461 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 1935cf4b9a704251a6b255b7bf2dfd36: acquiring CA information for follower catalog manager: success
16:11:13.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:13.902531 10461 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 1935cf4b9a704251a6b255b7bf2dfd36: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
16:11:15.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:14.472818 10467 debug-util.cc:398] Leaking SignalData structure 0x7b0800014860 after lost signal to thread 10430
16:11:15.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:15.003508 10467 kernel_stack_watchdog.cc:198] Thread 10430 stuck at /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/thread.cc:637 for 392ms:
16:11:15.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
16:11:15.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
16:11:15.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
16:11:15.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
16:11:15.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:13.088727 10469 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
16:11:15.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:15.006229 10471 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
16:11:15.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:15.006297 10430 thread.cc:636] OpenStack (cloud detector) Time spent creating pthread: real 1.928s	user 0.613s	sys 1.078s
16:11:15.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:15.006695 10430 thread.cc:602] OpenStack (cloud detector) Time spent starting thread: real 1.929s	user 0.613s	sys 1.078s
16:11:15.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:15.006953 10430 server_base.cc:1034] running on GCE node
16:11:15.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:15.008424 10430 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
16:11:15.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:15.012756 10430 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
16:11:15.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:15.014328 10430 hybrid_clock.cc:648] HybridClock initialized: now 1786464675014287 us; error 41 us; skew 500 ppm
16:11:15.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:15.015460 10430 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
16:11:15.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:15.028026 10430 webserver.cc:460] Webserver started at http://127.9.178.129:44059/ using document root <none> and password file <none>
16:11:15.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:15.029187 10430 fs_manager.cc:359] Metadata directory not provided
16:11:15.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:15.029455 10430 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
16:11:15.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:15.030021 10430 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
16:11:15.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:15.039319 10430 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/ts-0/data/instance:
16:11:15.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e257bad618b34cb98a4da61a671d08f2"
16:11:15.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-11 16:11:15 on dist-test-slave-nj21"
16:11:15.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:15.040735 10430 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/ts-0/wal/instance:
16:11:15.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e257bad618b34cb98a4da61a671d08f2"
16:11:15.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-11 16:11:15 on dist-test-slave-nj21"
16:11:15.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:15.049795 10430 fs_manager.cc:691] Time spent creating directory manager: real 0.008s	user 0.006s	sys 0.003s
16:11:15.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:15.057211 10488 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
16:11:15.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:15.058457 10430 fs_manager.cc:725] Time spent opening block manager: real 0.004s	user 0.000s	sys 0.004s
16:11:15.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:15.058821 10430 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/ts-0/data,/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/ts-0/wal
16:11:15.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e257bad618b34cb98a4da61a671d08f2"
16:11:15.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-11 16:11:15 on dist-test-slave-nj21"
16:11:15.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:15.059213 10430 fs_report.cc:383] FS layout report
16:11:15.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
16:11:15.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/ts-0/wal
16:11:15.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/ts-0/wal
16:11:15.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/ts-0/data/data
16:11:15.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
16:11:15.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
16:11:15.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
16:11:15.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
16:11:15.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
16:11:15.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
16:11:15.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
16:11:15.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
16:11:15.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
16:11:15.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
16:11:15.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
16:11:15.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:15.121546 10430 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
16:11:15.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:15.123413 10430 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
16:11:15.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:15.123982 10430 kserver.cc:163] Server-wide thread pool size limit: 3276
16:11:15.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:15.127307 10430 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
16:11:15.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:15.145805 10430 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
16:11:15.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:15.146072 10430 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
16:11:15.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:15.146358 10430 ts_tablet_manager.cc:610] Registered 0 tablets
16:11:15.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:15.146546 10430 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
16:11:15.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:15.337108 10430 rpc_server.cc:307] RPC server started. Bound to: 127.9.178.129:38963
16:11:15.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:15.337209 10691 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.178.129:38963 every 8 connection(s)
16:11:15.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:15.339819 10430 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/ts-0/data/info.pb
16:11:15.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:15.349355  9930 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvrVe1g/build/tsan/bin/kudu as pid 10430
16:11:15.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:15.349865  9930 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/ts-0/wal/instance
16:11:15.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:15.364331  9930 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvrVe1g/build/tsan/bin/kudu
16:11:15.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskvrVe1g/build/tsan/bin/kudu
16:11:15.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/ts-1/wal
16:11:15.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/ts-1/data
16:11:15.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
16:11:15.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
16:11:15.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
16:11:15.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
16:11:15.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
16:11:15.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
16:11:15.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/ts-1/logs
16:11:15.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/ts-1/data/info.pb
16:11:15.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
16:11:15.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
16:11:15.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
16:11:15.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
16:11:15.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
16:11:15.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
16:11:15.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
16:11:15.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
16:11:15.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
16:11:15.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
16:11:15.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.178.130:0
16:11:15.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.9.178.130
16:11:15.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.178.130
16:11:15.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
16:11:15.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025
16:11:15.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.178.148:35031
16:11:15.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
16:11:15.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
16:11:15.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
16:11:15.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:15.389788 10692 heartbeater.cc:347] Connected to a master server at 127.9.178.188:43025
16:11:15.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:15.390275 10692 heartbeater.cc:464] Registering TS with master...
16:11:15.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:15.391479 10692 heartbeater.cc:511] Master 127.9.178.188:43025 requested a full tablet report, sending...
16:11:15.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:15.392109 10696 heartbeater.cc:347] Connected to a master server at 127.9.178.189:44571
16:11:15.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:15.392398 10696 heartbeater.cc:464] Registering TS with master...
16:11:15.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:15.393141 10696 heartbeater.cc:511] Master 127.9.178.189:44571 requested a full tablet report, sending...
16:11:15.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:15.394557 10280 ts_manager.cc:194] Registered new tserver with Master: e257bad618b34cb98a4da61a671d08f2 (127.9.178.129:38963)
16:11:15.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:15.396083 10140 ts_manager.cc:194] Registered new tserver with Master: e257bad618b34cb98a4da61a671d08f2 (127.9.178.129:38963)
16:11:15.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:15.397379 10280 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.178.129:59969
16:11:15.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:15.402314 10697 heartbeater.cc:347] Connected to a master server at 127.9.178.190:45893
16:11:15.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:15.402653 10697 heartbeater.cc:464] Registering TS with master...
16:11:15.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:15.403340 10697 heartbeater.cc:511] Master 127.9.178.190:45893 requested a full tablet report, sending...
16:11:15.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:15.406045 10002 ts_manager.cc:194] Registered new tserver with Master: e257bad618b34cb98a4da61a671d08f2 (127.9.178.129:38963)
16:11:15.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:15.707588 10707 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
16:11:15.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:15.708110 10707 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
16:11:15.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:15.708662 10707 flags.cc:425] Enabled unsafe flag: --never_fsync=true
16:11:15.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:15.738590 10707 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
16:11:15.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:15.739519 10707 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.178.130
16:11:15.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:15.774068 10707 tablet_server_runner.cc:78] Tablet server non-default flags:
16:11:15.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
16:11:15.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.178.148:35031
16:11:15.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
16:11:15.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
16:11:15.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/ts-1/data
16:11:15.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/ts-1/wal
16:11:15.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
16:11:15.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
16:11:15.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.178.130:0
16:11:15.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
16:11:15.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
16:11:15.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
16:11:15.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/ts-1/data/info.pb
16:11:15.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.178.130
16:11:15.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
16:11:15.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025
16:11:15.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
16:11:15.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
16:11:15.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
16:11:15.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
16:11:15.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
16:11:15.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.9.178.130
16:11:15.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/ts-1/logs
16:11:15.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
16:11:15.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
16:11:15.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
16:11:15.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
16:11:15.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.18.0-SNAPSHOT
16:11:15.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
16:11:15.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
16:11:15.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by systest at 11 Aug 2026 15:12:52 UTC on ccycloud.quasar-tzrfpd.root.comops.site
16:11:15.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 4580143
16:11:15.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
16:11:15.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:15.775545 10707 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
16:11:15.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:15.777619 10707 file_cache.cc:493] Constructed file cache file cache with capacity 419430
16:11:15.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:15.804961 10714 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
16:11:16.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:16.403277 10692 heartbeater.cc:503] Master 127.9.178.188:43025 was elected leader, sending a full tablet report...
16:11:16.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:15.806483 10716 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
16:11:16.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:16.991976 10718 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
16:11:16.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:16.993360 10707 thread.cc:636] OpenStack (cloud detector) Time spent creating pthread: real 1.185s	user 0.002s	sys 0.007s
16:11:16.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:16.993603 10707 thread.cc:602] OpenStack (cloud detector) Time spent starting thread: real 1.185s	user 0.002s	sys 0.007s
16:11:16.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:16.993754 10707 server_base.cc:1034] running on GCE node
16:11:16.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:16.994724 10707 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
16:11:16.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:16.997318 10707 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
16:11:16.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:16.998728 10707 hybrid_clock.cc:648] HybridClock initialized: now 1786464676998694 us; error 34 us; skew 500 ppm
16:11:16.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:16.999497 10707 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
16:11:17.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:17.007396 10707 webserver.cc:460] Webserver started at http://127.9.178.130:35877/ using document root <none> and password file <none>
16:11:17.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:17.008250 10707 fs_manager.cc:359] Metadata directory not provided
16:11:17.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:17.008441 10707 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
16:11:17.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:17.008819 10707 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
16:11:17.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:17.013419 10707 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/ts-1/data/instance:
16:11:17.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "cc5521ba6549457fa94b2fd31d34260e"
16:11:17.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-11 16:11:17 on dist-test-slave-nj21"
16:11:17.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:17.014530 10707 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/ts-1/wal/instance:
16:11:17.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "cc5521ba6549457fa94b2fd31d34260e"
16:11:17.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-11 16:11:17 on dist-test-slave-nj21"
16:11:17.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:17.021929 10707 fs_manager.cc:691] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.004s
16:11:17.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:17.027745 10734 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
16:11:17.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:17.030279 10707 fs_manager.cc:725] Time spent opening block manager: real 0.005s	user 0.001s	sys 0.002s
16:11:17.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:17.030561 10707 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/ts-1/data,/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/ts-1/wal
16:11:17.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "cc5521ba6549457fa94b2fd31d34260e"
16:11:17.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-11 16:11:17 on dist-test-slave-nj21"
16:11:17.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:17.030843 10707 fs_report.cc:383] FS layout report
16:11:17.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
16:11:17.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/ts-1/wal
16:11:17.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/ts-1/wal
16:11:17.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/ts-1/data/data
16:11:17.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
16:11:17.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
16:11:17.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
16:11:17.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
16:11:17.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
16:11:17.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
16:11:17.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
16:11:17.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
16:11:17.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
16:11:17.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
16:11:17.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
16:11:17.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:17.070971 10707 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
16:11:17.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:17.072420 10707 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
16:11:17.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:17.072839 10707 kserver.cc:163] Server-wide thread pool size limit: 3276
16:11:17.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:17.075718 10707 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
16:11:17.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:17.080101 10707 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
16:11:17.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:17.080283 10707 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
16:11:17.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:17.080549 10707 ts_tablet_manager.cc:610] Registered 0 tablets
16:11:17.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:17.080690 10707 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
16:11:17.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:17.225982 10707 rpc_server.cc:307] RPC server started. Bound to: 127.9.178.130:42743
16:11:17.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:17.226079 10915 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.178.130:42743 every 8 connection(s)
16:11:17.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:17.228488 10707 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/ts-1/data/info.pb
16:11:17.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:17.235152  9930 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvrVe1g/build/tsan/bin/kudu as pid 10707
16:11:17.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:17.235837  9930 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/ts-1/wal/instance
16:11:17.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:17.249403  9930 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvrVe1g/build/tsan/bin/kudu
16:11:17.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskvrVe1g/build/tsan/bin/kudu
16:11:17.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/ts-2/wal
16:11:17.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/ts-2/data
16:11:17.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
16:11:17.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
16:11:17.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
16:11:17.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
16:11:17.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
16:11:17.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
16:11:17.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/ts-2/logs
16:11:17.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/ts-2/data/info.pb
16:11:17.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
16:11:17.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
16:11:17.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
16:11:17.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
16:11:17.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
16:11:17.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
16:11:17.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
16:11:17.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
16:11:17.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
16:11:17.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
16:11:17.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.178.131:0
16:11:17.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.9.178.131
16:11:17.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.178.131
16:11:17.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
16:11:17.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025
16:11:17.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.178.148:35031
16:11:17.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
16:11:17.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
16:11:17.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
16:11:17.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:17.286770 10917 heartbeater.cc:347] Connected to a master server at 127.9.178.188:43025
16:11:17.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:17.287221 10917 heartbeater.cc:464] Registering TS with master...
16:11:17.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:17.288472 10917 heartbeater.cc:511] Master 127.9.178.188:43025 requested a full tablet report, sending...
16:11:17.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:17.291126 10280 ts_manager.cc:194] Registered new tserver with Master: cc5521ba6549457fa94b2fd31d34260e (127.9.178.130:42743)
16:11:17.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:17.292949 10918 heartbeater.cc:347] Connected to a master server at 127.9.178.189:44571
16:11:17.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:17.293133 10280 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.178.130:38189
16:11:17.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:17.293299 10918 heartbeater.cc:464] Registering TS with master...
16:11:17.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:17.294209 10918 heartbeater.cc:511] Master 127.9.178.189:44571 requested a full tablet report, sending...
16:11:17.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:17.297290 10140 ts_manager.cc:194] Registered new tserver with Master: cc5521ba6549457fa94b2fd31d34260e (127.9.178.130:42743)
16:11:17.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:17.299388 10919 heartbeater.cc:347] Connected to a master server at 127.9.178.190:45893
16:11:17.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:17.299697 10919 heartbeater.cc:464] Registering TS with master...
16:11:17.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:17.300472 10919 heartbeater.cc:511] Master 127.9.178.190:45893 requested a full tablet report, sending...
16:11:17.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:17.302826 10002 ts_manager.cc:194] Registered new tserver with Master: cc5521ba6549457fa94b2fd31d34260e (127.9.178.130:42743)
16:11:17.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:17.581707 10926 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
16:11:17.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:17.582223 10926 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
16:11:17.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:17.582794 10926 flags.cc:425] Enabled unsafe flag: --never_fsync=true
16:11:17.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:17.613165 10926 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
16:11:17.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:17.614084 10926 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.9.178.131
16:11:17.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:17.647560 10926 tablet_server_runner.cc:78] Tablet server non-default flags:
16:11:17.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
16:11:17.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.9.178.148:35031
16:11:17.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
16:11:17.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
16:11:17.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/ts-2/data
16:11:17.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/ts-2/wal
16:11:17.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
16:11:17.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
16:11:17.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.9.178.131:0
16:11:17.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
16:11:17.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
16:11:17.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
16:11:17.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/ts-2/data/info.pb
16:11:17.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.9.178.131
16:11:17.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
16:11:17.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025
16:11:17.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
16:11:17.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
16:11:17.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
16:11:17.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
16:11:17.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
16:11:17.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.9.178.131
16:11:17.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/ts-2/logs
16:11:17.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
16:11:17.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
16:11:17.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
16:11:17.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
16:11:17.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.18.0-SNAPSHOT
16:11:17.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
16:11:17.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
16:11:17.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by systest at 11 Aug 2026 15:12:52 UTC on ccycloud.quasar-tzrfpd.root.comops.site
16:11:17.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 4580143
16:11:17.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
16:11:17.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:17.649106 10926 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
16:11:17.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:17.650837 10926 file_cache.cc:493] Constructed file cache file cache with capacity 419430
16:11:17.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:17.668671 10946 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
16:11:18.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:18.298092 10917 heartbeater.cc:503] Master 127.9.178.188:43025 was elected leader, sending a full tablet report...
16:11:18.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:17.668777 10939 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
16:11:18.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:17.670758 10926 server_base.cc:1034] running on GCE node
16:11:18.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:17.669234 10938 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
16:11:18.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:18.776247 10926 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
16:11:18.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:18.778889 10926 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
16:11:18.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:18.780295 10926 hybrid_clock.cc:648] HybridClock initialized: now 1786464678780276 us; error 41 us; skew 500 ppm
16:11:18.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:18.781055 10926 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
16:11:18.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:18.787791 10926 webserver.cc:460] Webserver started at http://127.9.178.131:33817/ using document root <none> and password file <none>
16:11:18.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:18.788697 10926 fs_manager.cc:359] Metadata directory not provided
16:11:18.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:18.788878 10926 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
16:11:18.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:18.789311 10926 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
16:11:18.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:18.794557 10926 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/ts-2/data/instance:
16:11:18.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f25e4fe0a11444a4a244162e2a6044cb"
16:11:18.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-11 16:11:18 on dist-test-slave-nj21"
16:11:18.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:18.795653 10926 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/ts-2/wal/instance:
16:11:18.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f25e4fe0a11444a4a244162e2a6044cb"
16:11:18.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-11 16:11:18 on dist-test-slave-nj21"
16:11:18.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:18.803309 10926 fs_manager.cc:691] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.001s
16:11:18.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:18.809070 10959 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
16:11:18.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:18.810052 10926 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.005s	sys 0.000s
16:11:18.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:18.810322 10926 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/ts-2/data,/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/ts-2/wal
16:11:18.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f25e4fe0a11444a4a244162e2a6044cb"
16:11:18.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-11 16:11:18 on dist-test-slave-nj21"
16:11:18.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:18.810623 10926 fs_report.cc:383] FS layout report
16:11:18.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
16:11:18.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/ts-2/wal
16:11:18.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/ts-2/wal
16:11:18.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/ts-2/data/data
16:11:18.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
16:11:18.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
16:11:18.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
16:11:18.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
16:11:18.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
16:11:18.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
16:11:18.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
16:11:18.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
16:11:18.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
16:11:18.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
16:11:18.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
16:11:18.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:18.874656 10926 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
16:11:18.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:18.876116 10926 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
16:11:18.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:18.876541 10926 kserver.cc:163] Server-wide thread pool size limit: 3276
16:11:18.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:18.879161 10926 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
16:11:18.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:18.883183 10926 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
16:11:18.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:18.883365 10926 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
16:11:18.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:18.883581 10926 ts_tablet_manager.cc:610] Registered 0 tablets
16:11:18.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:18.883750 10926 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
16:11:19.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:19.021333 10926 rpc_server.cc:307] RPC server started. Bound to: 127.9.178.131:37543
16:11:19.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:19.021503 11144 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.9.178.131:37543 every 8 connection(s)
16:11:19.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:19.023939 10926 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/ts-2/data/info.pb
16:11:19.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:19.033028  9930 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvrVe1g/build/tsan/bin/kudu as pid 10926
16:11:19.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:19.033475  9930 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/ts-2/wal/instance
16:11:19.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:19.064719 11153 heartbeater.cc:347] Connected to a master server at 127.9.178.190:45893
16:11:19.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:19.065202 11153 heartbeater.cc:464] Registering TS with master...
16:11:19.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:19.066112 11153 heartbeater.cc:511] Master 127.9.178.190:45893 requested a full tablet report, sending...
16:11:19.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:19.066143 11148 heartbeater.cc:347] Connected to a master server at 127.9.178.188:43025
16:11:19.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:19.066519 11148 heartbeater.cc:464] Registering TS with master...
16:11:19.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:19.067227 11148 heartbeater.cc:511] Master 127.9.178.188:43025 requested a full tablet report, sending...
16:11:19.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:19.069176 10002 ts_manager.cc:194] Registered new tserver with Master: f25e4fe0a11444a4a244162e2a6044cb (127.9.178.131:37543)
16:11:19.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:19.069572 11150 heartbeater.cc:347] Connected to a master server at 127.9.178.189:44571
16:11:19.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:19.069861 11150 heartbeater.cc:464] Registering TS with master...
16:11:19.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:19.069877 10280 ts_manager.cc:194] Registered new tserver with Master: f25e4fe0a11444a4a244162e2a6044cb (127.9.178.131:37543)
16:11:19.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:19.070655 11150 heartbeater.cc:511] Master 127.9.178.189:44571 requested a full tablet report, sending...
16:11:19.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:19.071722 10280 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.9.178.131:49959
16:11:19.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:19.073155 10140 ts_manager.cc:194] Registered new tserver with Master: f25e4fe0a11444a4a244162e2a6044cb (127.9.178.131:37543)
16:11:19.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:19.081382  9930 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
16:11:19.092 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
16:11:19.093 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

16:11:19.102 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.9.178.190"
      port: 45893
    }
    bound_http_address {
      host: "127.9.178.190"
      port: 39833
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.9.178.189"
      port: 44571
    }
    bound_http_address {
      host: "127.9.178.189"
      port: 44653
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.9.178.188"
      port: 43025
    }
    bound_http_address {
      host: "127.9.178.188"
      port: 38517
    }
  }
}

16:11:19.106 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

16:11:19.108 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.9.178.129"
      port: 38963
    }
    bound_http_address {
      host: "127.9.178.129"
      port: 44059
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.9.178.130"
      port: 42743
    }
    bound_http_address {
      host: "127.9.178.130"
      port: 35877
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.9.178.131"
      port: 37543
    }
    bound_http_address {
      host: "127.9.178.131"
      port: 33817
    }
  }
}

16:11:19.108 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
16:11:19.281 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
16:11:19.451 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.9.178.190:45893(127.9.178.190:45893)] connecting to peer
16:11:19.506 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.9.178.189:44571(127.9.178.189:44571)] connecting to peer
16:11:19.513 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.9.178.188:43025(127.9.178.188:43025)] connecting to peer
16:11:19.539 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.9.178.189:44571(127.9.178.189:44571)] Successfully connected to peer
16:11:19.541 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.9.178.190:45893(127.9.178.190:45893)] Successfully connected to peer
16:11:19.606 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.9.178.188:43025(127.9.178.188:43025)] Successfully connected to peer
16:11:19.630 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.9.178.190
16:11:19.630 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.9.178.189
16:11:19.820 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.9.178.188
16:11:19.848 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xe14d5d8b, L:/127.0.0.1:36364 - R:/127.9.178.189:44571] using SASL/PLAIN
16:11:19.848 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xc0a3c963, L:/127.0.0.1:53676 - R:/127.9.178.190:45893] using SASL/PLAIN
16:11:19.864 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xe267298a, L:/127.0.0.1:44098 - R:/127.9.178.188:43025] using SASL/PLAIN
16:11:19.894 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
16:11:19.895 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=487), Traces: [0ms] refreshing cache from master, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.190:45893, [95ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.189:44571, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.188:43025, [451ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.190:45893: OK, [451ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.189:44571: OK, [458ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.188:43025: OK, deferred=null) after lookup
16:11:19.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:19.956321 10280 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44098:
16:11:19.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "org.apache.kudu.client.TestClientFailoverSupport-KILL"
16:11:19.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
16:11:19.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
16:11:19.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key"
16:11:19.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
16:11:19.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
16:11:19.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
16:11:19.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
16:11:19.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
16:11:19.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
16:11:19.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
16:11:19.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
16:11:19.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column1_i"
16:11:19.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
16:11:19.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
16:11:19.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
16:11:19.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
16:11:19.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
16:11:19.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
16:11:19.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
16:11:19.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
16:11:19.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column2_i"
16:11:19.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
16:11:19.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
16:11:19.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
16:11:19.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
16:11:19.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
16:11:19.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
16:11:19.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
16:11:19.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
16:11:19.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column3_s"
16:11:19.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
16:11:19.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
16:11:19.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: true
16:11:19.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: DICT_ENCODING
16:11:19.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: LZ4
16:11:19.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 4096
16:11:19.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
16:11:19.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
16:11:19.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
16:11:19.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
16:11:19.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column4_b"
16:11:19.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BOOL
16:11:19.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
16:11:19.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
16:11:19.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
16:11:19.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
16:11:19.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
16:11:19.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
16:11:19.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
16:11:19.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
16:11:19.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
16:11:19.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
16:11:19.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key"
16:11:19.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
16:11:19.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
16:11:19.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
16:11:19.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:19.960261 10280 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table org.apache.kudu.client.TestClientFailoverSupport-KILL in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
16:11:20.021 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table d686692d2b174868911afdafc5f7407d
16:11:20.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:20.057456 10579 tablet_service.cc:1467] Processing CreateTablet for tablet 574390c2aab3431a99507b85e30e1b7b (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-KILL [id=d686692d2b174868911afdafc5f7407d]), partition=RANGE (key) PARTITION UNBOUNDED
16:11:20.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:20.059383 10579 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 574390c2aab3431a99507b85e30e1b7b. 1 dirs total, 0 dirs full, 0 dirs failed
16:11:20.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:20.061550 10813 tablet_service.cc:1467] Processing CreateTablet for tablet 574390c2aab3431a99507b85e30e1b7b (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-KILL [id=d686692d2b174868911afdafc5f7407d]), partition=RANGE (key) PARTITION UNBOUNDED
16:11:20.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:20.063205 10813 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 574390c2aab3431a99507b85e30e1b7b. 1 dirs total, 0 dirs full, 0 dirs failed
16:11:20.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:20.066056 11043 tablet_service.cc:1467] Processing CreateTablet for tablet 574390c2aab3431a99507b85e30e1b7b (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-KILL [id=d686692d2b174868911afdafc5f7407d]), partition=RANGE (key) PARTITION UNBOUNDED
16:11:20.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:20.067975 11043 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 574390c2aab3431a99507b85e30e1b7b. 1 dirs total, 0 dirs full, 0 dirs failed
16:11:20.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:20.076117 11148 heartbeater.cc:503] Master 127.9.178.188:43025 was elected leader, sending a full tablet report...
16:11:20.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:20.088500 11196 tablet_bootstrap.cc:492] T 574390c2aab3431a99507b85e30e1b7b P cc5521ba6549457fa94b2fd31d34260e: Bootstrap starting.
16:11:20.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:20.094134 11197 tablet_bootstrap.cc:492] T 574390c2aab3431a99507b85e30e1b7b P e257bad618b34cb98a4da61a671d08f2: Bootstrap starting.
16:11:20.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:20.097025 11196 tablet_bootstrap.cc:654] T 574390c2aab3431a99507b85e30e1b7b P cc5521ba6549457fa94b2fd31d34260e: Neither blocks nor log segments found. Creating new log.
16:11:20.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:20.099267 11196 log.cc:824] T 574390c2aab3431a99507b85e30e1b7b P cc5521ba6549457fa94b2fd31d34260e: Log is configured to *not* fsync() on all Append() calls
16:11:20.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:20.099364 11198 tablet_bootstrap.cc:492] T 574390c2aab3431a99507b85e30e1b7b P f25e4fe0a11444a4a244162e2a6044cb: Bootstrap starting.
16:11:20.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:20.102140 11197 tablet_bootstrap.cc:654] T 574390c2aab3431a99507b85e30e1b7b P e257bad618b34cb98a4da61a671d08f2: Neither blocks nor log segments found. Creating new log.
16:11:20.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:20.104414 11197 log.cc:824] T 574390c2aab3431a99507b85e30e1b7b P e257bad618b34cb98a4da61a671d08f2: Log is configured to *not* fsync() on all Append() calls
16:11:20.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:20.104902 11196 tablet_bootstrap.cc:492] T 574390c2aab3431a99507b85e30e1b7b P cc5521ba6549457fa94b2fd31d34260e: No bootstrap required, opened a new log
16:11:20.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:20.105376 11196 ts_tablet_manager.cc:1397] T 574390c2aab3431a99507b85e30e1b7b P cc5521ba6549457fa94b2fd31d34260e: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.003s
16:11:20.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:20.105718 11198 tablet_bootstrap.cc:654] T 574390c2aab3431a99507b85e30e1b7b P f25e4fe0a11444a4a244162e2a6044cb: Neither blocks nor log segments found. Creating new log.
16:11:20.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:20.107662 11198 log.cc:824] T 574390c2aab3431a99507b85e30e1b7b P f25e4fe0a11444a4a244162e2a6044cb: Log is configured to *not* fsync() on all Append() calls
16:11:20.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:20.111627 11197 tablet_bootstrap.cc:492] T 574390c2aab3431a99507b85e30e1b7b P e257bad618b34cb98a4da61a671d08f2: No bootstrap required, opened a new log
16:11:20.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:20.113351 11197 ts_tablet_manager.cc:1397] T 574390c2aab3431a99507b85e30e1b7b P e257bad618b34cb98a4da61a671d08f2: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.008s
16:11:20.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:20.118304 11198 tablet_bootstrap.cc:492] T 574390c2aab3431a99507b85e30e1b7b P f25e4fe0a11444a4a244162e2a6044cb: No bootstrap required, opened a new log
16:11:20.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:20.118703 11198 ts_tablet_manager.cc:1397] T 574390c2aab3431a99507b85e30e1b7b P f25e4fe0a11444a4a244162e2a6044cb: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.007s
16:11:20.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:20.135079 11196 raft_consensus.cc:348] T 574390c2aab3431a99507b85e30e1b7b P cc5521ba6549457fa94b2fd31d34260e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e257bad618b34cb98a4da61a671d08f2" member_type: VOTER last_known_addr { host: "127.9.178.129" port: 38963 } } peers { permanent_uuid: "cc5521ba6549457fa94b2fd31d34260e" member_type: VOTER last_known_addr { host: "127.9.178.130" port: 42743 } } peers { permanent_uuid: "f25e4fe0a11444a4a244162e2a6044cb" member_type: VOTER last_known_addr { host: "127.9.178.131" port: 37543 } }
16:11:20.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:20.135775 11196 raft_consensus.cc:374] T 574390c2aab3431a99507b85e30e1b7b P cc5521ba6549457fa94b2fd31d34260e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
16:11:20.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:20.136053 11196 raft_consensus.cc:729] T 574390c2aab3431a99507b85e30e1b7b P cc5521ba6549457fa94b2fd31d34260e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cc5521ba6549457fa94b2fd31d34260e, State: Initialized, Role: FOLLOWER
16:11:20.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:20.136971 11196 consensus_queue.cc:260] T 574390c2aab3431a99507b85e30e1b7b P cc5521ba6549457fa94b2fd31d34260e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e257bad618b34cb98a4da61a671d08f2" member_type: VOTER last_known_addr { host: "127.9.178.129" port: 38963 } } peers { permanent_uuid: "cc5521ba6549457fa94b2fd31d34260e" member_type: VOTER last_known_addr { host: "127.9.178.130" port: 42743 } } peers { permanent_uuid: "f25e4fe0a11444a4a244162e2a6044cb" member_type: VOTER last_known_addr { host: "127.9.178.131" port: 37543 } }
16:11:20.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:20.141453 11196 ts_tablet_manager.cc:1428] T 574390c2aab3431a99507b85e30e1b7b P cc5521ba6549457fa94b2fd31d34260e: Time spent starting tablet: real 0.036s	user 0.030s	sys 0.003s
16:11:20.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:20.145226 11197 raft_consensus.cc:348] T 574390c2aab3431a99507b85e30e1b7b P e257bad618b34cb98a4da61a671d08f2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e257bad618b34cb98a4da61a671d08f2" member_type: VOTER last_known_addr { host: "127.9.178.129" port: 38963 } } peers { permanent_uuid: "cc5521ba6549457fa94b2fd31d34260e" member_type: VOTER last_known_addr { host: "127.9.178.130" port: 42743 } } peers { permanent_uuid: "f25e4fe0a11444a4a244162e2a6044cb" member_type: VOTER last_known_addr { host: "127.9.178.131" port: 37543 } }
16:11:20.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:20.146106 11197 raft_consensus.cc:374] T 574390c2aab3431a99507b85e30e1b7b P e257bad618b34cb98a4da61a671d08f2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
16:11:20.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:20.146421 11197 raft_consensus.cc:729] T 574390c2aab3431a99507b85e30e1b7b P e257bad618b34cb98a4da61a671d08f2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e257bad618b34cb98a4da61a671d08f2, State: Initialized, Role: FOLLOWER
16:11:20.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:20.147248 11197 consensus_queue.cc:260] T 574390c2aab3431a99507b85e30e1b7b P e257bad618b34cb98a4da61a671d08f2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e257bad618b34cb98a4da61a671d08f2" member_type: VOTER last_known_addr { host: "127.9.178.129" port: 38963 } } peers { permanent_uuid: "cc5521ba6549457fa94b2fd31d34260e" member_type: VOTER last_known_addr { host: "127.9.178.130" port: 42743 } } peers { permanent_uuid: "f25e4fe0a11444a4a244162e2a6044cb" member_type: VOTER last_known_addr { host: "127.9.178.131" port: 37543 } }
16:11:20.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:20.157435 11198 raft_consensus.cc:348] T 574390c2aab3431a99507b85e30e1b7b P f25e4fe0a11444a4a244162e2a6044cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e257bad618b34cb98a4da61a671d08f2" member_type: VOTER last_known_addr { host: "127.9.178.129" port: 38963 } } peers { permanent_uuid: "cc5521ba6549457fa94b2fd31d34260e" member_type: VOTER last_known_addr { host: "127.9.178.130" port: 42743 } } peers { permanent_uuid: "f25e4fe0a11444a4a244162e2a6044cb" member_type: VOTER last_known_addr { host: "127.9.178.131" port: 37543 } }
16:11:20.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:20.158510 11198 raft_consensus.cc:374] T 574390c2aab3431a99507b85e30e1b7b P f25e4fe0a11444a4a244162e2a6044cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
16:11:20.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:20.158914 11198 raft_consensus.cc:729] T 574390c2aab3431a99507b85e30e1b7b P f25e4fe0a11444a4a244162e2a6044cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f25e4fe0a11444a4a244162e2a6044cb, State: Initialized, Role: FOLLOWER
16:11:20.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:20.159962 11198 consensus_queue.cc:260] T 574390c2aab3431a99507b85e30e1b7b P f25e4fe0a11444a4a244162e2a6044cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e257bad618b34cb98a4da61a671d08f2" member_type: VOTER last_known_addr { host: "127.9.178.129" port: 38963 } } peers { permanent_uuid: "cc5521ba6549457fa94b2fd31d34260e" member_type: VOTER last_known_addr { host: "127.9.178.130" port: 42743 } } peers { permanent_uuid: "f25e4fe0a11444a4a244162e2a6044cb" member_type: VOTER last_known_addr { host: "127.9.178.131" port: 37543 } }
16:11:20.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:20.166659 11197 ts_tablet_manager.cc:1428] T 574390c2aab3431a99507b85e30e1b7b P e257bad618b34cb98a4da61a671d08f2: Time spent starting tablet: real 0.053s	user 0.039s	sys 0.008s
16:11:20.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:20.178407 11198 ts_tablet_manager.cc:1428] T 574390c2aab3431a99507b85e30e1b7b P f25e4fe0a11444a4a244162e2a6044cb: Time spent starting tablet: real 0.059s	user 0.037s	sys 0.004s
16:11:20.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:20.247102 11210 raft_consensus.cc:482] T 574390c2aab3431a99507b85e30e1b7b P f25e4fe0a11444a4a244162e2a6044cb [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
16:11:20.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:20.247553 11210 raft_consensus.cc:504] T 574390c2aab3431a99507b85e30e1b7b P f25e4fe0a11444a4a244162e2a6044cb [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e257bad618b34cb98a4da61a671d08f2" member_type: VOTER last_known_addr { host: "127.9.178.129" port: 38963 } } peers { permanent_uuid: "cc5521ba6549457fa94b2fd31d34260e" member_type: VOTER last_known_addr { host: "127.9.178.130" port: 42743 } } peers { permanent_uuid: "f25e4fe0a11444a4a244162e2a6044cb" member_type: VOTER last_known_addr { host: "127.9.178.131" port: 37543 } }
16:11:20.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:20.249950 11210 leader_election.cc:288] T 574390c2aab3431a99507b85e30e1b7b P f25e4fe0a11444a4a244162e2a6044cb [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e257bad618b34cb98a4da61a671d08f2 (127.9.178.129:38963), cc5521ba6549457fa94b2fd31d34260e (127.9.178.130:42743)
16:11:20.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:20.263363 10609 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "574390c2aab3431a99507b85e30e1b7b" candidate_uuid: "f25e4fe0a11444a4a244162e2a6044cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e257bad618b34cb98a4da61a671d08f2" is_pre_election: true
16:11:20.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:20.263746 10845 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "574390c2aab3431a99507b85e30e1b7b" candidate_uuid: "f25e4fe0a11444a4a244162e2a6044cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc5521ba6549457fa94b2fd31d34260e" is_pre_election: true
16:11:20.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:20.264317 10609 raft_consensus.cc:2454] T 574390c2aab3431a99507b85e30e1b7b P e257bad618b34cb98a4da61a671d08f2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f25e4fe0a11444a4a244162e2a6044cb in term 0.
16:11:20.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:20.264577 10845 raft_consensus.cc:2454] T 574390c2aab3431a99507b85e30e1b7b P cc5521ba6549457fa94b2fd31d34260e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f25e4fe0a11444a4a244162e2a6044cb in term 0.
16:11:20.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:20.265590 10963 leader_election.cc:302] T 574390c2aab3431a99507b85e30e1b7b P f25e4fe0a11444a4a244162e2a6044cb [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: e257bad618b34cb98a4da61a671d08f2, f25e4fe0a11444a4a244162e2a6044cb; no voters: 
16:11:20.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:20.266259 11210 raft_consensus.cc:2781] T 574390c2aab3431a99507b85e30e1b7b P f25e4fe0a11444a4a244162e2a6044cb [term 0 FOLLOWER]: Leader pre-election won for term 1
16:11:20.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:20.266597 11210 raft_consensus.cc:482] T 574390c2aab3431a99507b85e30e1b7b P f25e4fe0a11444a4a244162e2a6044cb [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
16:11:20.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:20.266849 11210 raft_consensus.cc:3037] T 574390c2aab3431a99507b85e30e1b7b P f25e4fe0a11444a4a244162e2a6044cb [term 0 FOLLOWER]: Advancing to term 1
16:11:20.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:20.271522 11210 raft_consensus.cc:504] T 574390c2aab3431a99507b85e30e1b7b P f25e4fe0a11444a4a244162e2a6044cb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e257bad618b34cb98a4da61a671d08f2" member_type: VOTER last_known_addr { host: "127.9.178.129" port: 38963 } } peers { permanent_uuid: "cc5521ba6549457fa94b2fd31d34260e" member_type: VOTER last_known_addr { host: "127.9.178.130" port: 42743 } } peers { permanent_uuid: "f25e4fe0a11444a4a244162e2a6044cb" member_type: VOTER last_known_addr { host: "127.9.178.131" port: 37543 } }
16:11:20.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:20.273006 11210 leader_election.cc:288] T 574390c2aab3431a99507b85e30e1b7b P f25e4fe0a11444a4a244162e2a6044cb [CANDIDATE]: Term 1 election: Requested vote from peers e257bad618b34cb98a4da61a671d08f2 (127.9.178.129:38963), cc5521ba6549457fa94b2fd31d34260e (127.9.178.130:42743)
16:11:20.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:20.273711 10609 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "574390c2aab3431a99507b85e30e1b7b" candidate_uuid: "f25e4fe0a11444a4a244162e2a6044cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e257bad618b34cb98a4da61a671d08f2"
16:11:20.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:20.273978 10845 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "574390c2aab3431a99507b85e30e1b7b" candidate_uuid: "f25e4fe0a11444a4a244162e2a6044cb" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cc5521ba6549457fa94b2fd31d34260e"
16:11:20.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:20.274158 10609 raft_consensus.cc:3037] T 574390c2aab3431a99507b85e30e1b7b P e257bad618b34cb98a4da61a671d08f2 [term 0 FOLLOWER]: Advancing to term 1
16:11:20.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:20.274507 10845 raft_consensus.cc:3037] T 574390c2aab3431a99507b85e30e1b7b P cc5521ba6549457fa94b2fd31d34260e [term 0 FOLLOWER]: Advancing to term 1
16:11:20.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:20.277591 10924 tablet.cc:2369] T 574390c2aab3431a99507b85e30e1b7b P cc5521ba6549457fa94b2fd31d34260e: Can't schedule compaction. Clean time has not been advanced past its initial value.
16:11:20.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:20.279037 10845 raft_consensus.cc:2454] T 574390c2aab3431a99507b85e30e1b7b P cc5521ba6549457fa94b2fd31d34260e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f25e4fe0a11444a4a244162e2a6044cb in term 1.
16:11:20.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:20.279096 10609 raft_consensus.cc:2454] T 574390c2aab3431a99507b85e30e1b7b P e257bad618b34cb98a4da61a671d08f2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f25e4fe0a11444a4a244162e2a6044cb in term 1.
16:11:20.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:20.279872 10963 leader_election.cc:302] T 574390c2aab3431a99507b85e30e1b7b P f25e4fe0a11444a4a244162e2a6044cb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cc5521ba6549457fa94b2fd31d34260e, f25e4fe0a11444a4a244162e2a6044cb; no voters: 
16:11:20.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:20.280413 11210 raft_consensus.cc:2781] T 574390c2aab3431a99507b85e30e1b7b P f25e4fe0a11444a4a244162e2a6044cb [term 1 FOLLOWER]: Leader election won for term 1
16:11:20.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:20.282207 11210 raft_consensus.cc:686] T 574390c2aab3431a99507b85e30e1b7b P f25e4fe0a11444a4a244162e2a6044cb [term 1 LEADER]: Becoming Leader. State: Replica: f25e4fe0a11444a4a244162e2a6044cb, State: Running, Role: LEADER
16:11:20.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:20.283041 11210 consensus_queue.cc:237] T 574390c2aab3431a99507b85e30e1b7b P f25e4fe0a11444a4a244162e2a6044cb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e257bad618b34cb98a4da61a671d08f2" member_type: VOTER last_known_addr { host: "127.9.178.129" port: 38963 } } peers { permanent_uuid: "cc5521ba6549457fa94b2fd31d34260e" member_type: VOTER last_known_addr { host: "127.9.178.130" port: 42743 } } peers { permanent_uuid: "f25e4fe0a11444a4a244162e2a6044cb" member_type: VOTER last_known_addr { host: "127.9.178.131" port: 37543 } }
16:11:20.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:20.291945 11160 tablet.cc:2369] T 574390c2aab3431a99507b85e30e1b7b P f25e4fe0a11444a4a244162e2a6044cb: Can't schedule compaction. Clean time has not been advanced past its initial value.
16:11:20.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:20.292357 10280 catalog_manager.cc:5495] T 574390c2aab3431a99507b85e30e1b7b P f25e4fe0a11444a4a244162e2a6044cb reported cstate change: term changed from 0 to 1, leader changed from <none> to f25e4fe0a11444a4a244162e2a6044cb (127.9.178.131). New cstate: current_term: 1 leader_uuid: "f25e4fe0a11444a4a244162e2a6044cb" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e257bad618b34cb98a4da61a671d08f2" member_type: VOTER last_known_addr { host: "127.9.178.129" port: 38963 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cc5521ba6549457fa94b2fd31d34260e" member_type: VOTER last_known_addr { host: "127.9.178.130" port: 42743 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f25e4fe0a11444a4a244162e2a6044cb" member_type: VOTER last_known_addr { host: "127.9.178.131" port: 37543 } health_report { overall_health: HEALTHY } } }
16:11:20.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:20.386233 10706 tablet.cc:2369] T 574390c2aab3431a99507b85e30e1b7b P e257bad618b34cb98a4da61a671d08f2: Can't schedule compaction. Clean time has not been advanced past its initial value.
16:11:20.395 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table d686692d2b174868911afdafc5f7407d
16:11:20.414 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 574390c2aab3431a99507b85e30e1b7b for table 'org.apache.kudu.client.TestClientFailoverSupport-KILL' with partition [<start>, <end>)
16:11:20.422 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299991, tablet=574390c2aab3431a99507b85e30e1b7b@[cc5521ba6549457fa94b2fd31d34260e(127.9.178.130:42743),e257bad618b34cb98a4da61a671d08f2(127.9.178.129:38963),f25e4fe0a11444a4a244162e2a6044cb(127.9.178.131:37543)[L]]}]
16:11:20.425 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=21), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.9.178.188:43025, [8ms] Sub RPC GetTableLocations: received response from server master-127.9.178.188:43025: OK, deferred=null) after lookup
16:11:20.437 [DEBUG - kudu-nio-0] (Connection.java:748) [peer f25e4fe0a11444a4a244162e2a6044cb(127.9.178.131:37543)] connecting to peer
16:11:20.439 [DEBUG - kudu-nio-1] (Connection.java:757) [peer f25e4fe0a11444a4a244162e2a6044cb(127.9.178.131:37543)] Successfully connected to peer
16:11:20.492 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xd0338b0e, L:/127.0.0.1:43652 - R:/127.9.178.131:37543] using TOKEN/null
16:11:20.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:20.508508 10845 raft_consensus.cc:1261] T 574390c2aab3431a99507b85e30e1b7b P cc5521ba6549457fa94b2fd31d34260e [term 1 FOLLOWER]: Refusing update from remote peer f25e4fe0a11444a4a244162e2a6044cb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
16:11:20.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:20.508782 10609 raft_consensus.cc:1261] T 574390c2aab3431a99507b85e30e1b7b P e257bad618b34cb98a4da61a671d08f2 [term 1 FOLLOWER]: Refusing update from remote peer f25e4fe0a11444a4a244162e2a6044cb: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
16:11:20.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:20.510519 11210 consensus_queue.cc:1035] T 574390c2aab3431a99507b85e30e1b7b P f25e4fe0a11444a4a244162e2a6044cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc5521ba6549457fa94b2fd31d34260e" member_type: VOTER last_known_addr { host: "127.9.178.130" port: 42743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
16:11:20.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:20.511312 11216 consensus_queue.cc:1035] T 574390c2aab3431a99507b85e30e1b7b P f25e4fe0a11444a4a244162e2a6044cb [LEADER]: Connected to new peer: Peer: permanent_uuid: "e257bad618b34cb98a4da61a671d08f2" member_type: VOTER last_known_addr { host: "127.9.178.129" port: 38963 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
16:11:20.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:20.550734 11220 mvcc.cc:205] Tried to move back new op lower bound from 7317359331345797120 to 7317359330446409728. Current Snapshot: MvccSnapshot[applied={T|T < 7317359331345797120 or (T in {7317359331345797120})}]
16:11:20.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:20.552026 11221 mvcc.cc:205] Tried to move back new op lower bound from 7317359331345797120 to 7317359330446409728. Current Snapshot: MvccSnapshot[applied={T|T < 7317359331345797120}]
16:11:20.796 [DEBUG - kudu-nio-1] (AsyncKuduScanner.java:1374) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 10 rows, more = false) for scanner KuduScanner(table=org.apache.kudu.client.TestClientFailoverSupport-KILL, tablet=574390c2aab3431a99507b85e30e1b7b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
16:11:20.799 [INFO - Time-limited test] (MiniKuduCluster.java:399) Killing master server 127.9.178.188:43025
16:11:20.801 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: stop_daemon {
  id {
    type: MASTER
    index: 2
  }
}

16:11:20.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:20.802255  9930 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvrVe1g/build/tsan/bin/kudu with pid 10203
16:11:20.837 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
16:11:20.839 [INFO - Time-limited test] (MiniKuduCluster.java:475) Killing tablet server 127.9.178.131:37543
16:11:20.839 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.9.178.188:43025(127.9.178.188:43025)] handling channelInactive
16:11:20.839 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: stop_daemon {
  id {
    type: TSERVER
    index: 2
  }
}

16:11:20.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:20.839635  9930 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvrVe1g/build/tsan/bin/kudu with pid 10926
16:11:20.842 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.178.188:43025(127.9.178.188:43025)] cleaning up while in state READY due to: connection closed
16:11:20.870 [DEBUG - kudu-nio-1] (Connection.java:239) [peer f25e4fe0a11444a4a244162e2a6044cb(127.9.178.131:37543)] handling channelInactive
16:11:20.870 [DEBUG - kudu-nio-1] (Connection.java:709) [peer f25e4fe0a11444a4a244162e2a6044cb(127.9.178.131:37543)] cleaning up while in state READY due to: connection closed
16:11:20.871 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
16:11:20.872 [DEBUG - Time-limited test] (Connection.java:748) [peer f25e4fe0a11444a4a244162e2a6044cb(127.9.178.131:37543)] connecting to peer
16:11:20.873 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer f25e4fe0a11444a4a244162e2a6044cb(127.9.178.131:37543): Connection refused: /127.9.178.131:37543
16:11:20.874 [DEBUG - kudu-nio-0] (Connection.java:709) [peer f25e4fe0a11444a4a244162e2a6044cb(127.9.178.131:37543)] cleaning up while in state CONNECTING due to: Failed to connect to peer f25e4fe0a11444a4a244162e2a6044cb(127.9.178.131:37543): Connection refused: /127.9.178.131:37543
16:11:20.874 [INFO - kudu-nio-0] (AsyncKuduClient.java:2355) Invalidating location f25e4fe0a11444a4a244162e2a6044cb(127.9.178.131:37543) for tablet 574390c2aab3431a99507b85e30e1b7b: Failed to connect to peer f25e4fe0a11444a4a244162e2a6044cb(127.9.178.131:37543): Connection refused: /127.9.178.131:37543
16:11:20.888 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.9.178.188:43025(127.9.178.188:43025)] connecting to peer
16:11:20.891 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025
16:11:20.891 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.178.188:43025(127.9.178.188:43025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025
16:11:20.891 [INFO - kudu-nio-1] (AsyncKuduClient.java:2355) Invalidating location master-127.9.178.188:43025(127.9.178.188:43025) for tablet Kudu Master: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025
16:11:20.908 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.9.178.188:43025(127.9.178.188:43025)] connecting to peer
16:11:20.913 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025
16:11:20.913 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.178.188:43025(127.9.178.188:43025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025
16:11:20.913 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.178.188:43025: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025
16:11:20.916 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025; will retry
16:11:20.929 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.9.178.188:43025(127.9.178.188:43025)] connecting to peer
16:11:20.930 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025
16:11:20.931 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.178.188:43025(127.9.178.188:43025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025
16:11:20.931 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.178.188:43025: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025
16:11:20.933 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025; will retry
16:11:20.949 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.9.178.188:43025(127.9.178.188:43025)] connecting to peer
16:11:20.951 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025
16:11:20.951 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.178.188:43025(127.9.178.188:43025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025
16:11:20.951 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.178.188:43025: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025
16:11:20.953 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025; will retry
16:11:20.969 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.9.178.188:43025(127.9.178.188:43025)] connecting to peer
16:11:20.973 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025
16:11:20.973 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.178.188:43025(127.9.178.188:43025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025
16:11:20.973 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.178.188:43025: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025
16:11:20.973 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025; will retry
16:11:20.989 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.9.178.188:43025(127.9.178.188:43025)] connecting to peer
16:11:20.991 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025
16:11:20.991 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.178.188:43025(127.9.178.188:43025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025
16:11:20.992 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.178.188:43025: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025
16:11:20.992 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025; will retry
16:11:21.069 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.9.178.188:43025(127.9.178.188:43025)] connecting to peer
16:11:21.072 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025
16:11:21.072 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.178.188:43025(127.9.178.188:43025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025
16:11:21.072 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.178.188:43025: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025
16:11:21.073 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025; will retry
16:11:21.108 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.9.178.188:43025(127.9.178.188:43025)] connecting to peer
16:11:21.110 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025
16:11:21.111 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.178.188:43025(127.9.178.188:43025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025
16:11:21.111 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.178.188:43025: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025
16:11:21.112 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025; will retry
16:11:21.230 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.9.178.188:43025(127.9.178.188:43025)] connecting to peer
16:11:21.234 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025
16:11:21.234 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.178.188:43025(127.9.178.188:43025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025
16:11:21.234 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.178.188:43025: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025
16:11:21.234 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025; will retry
16:11:21.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:21.580610 10692 heartbeater.cc:644] Failed to heartbeat to 127.9.178.188:43025 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.9.178.188:43025: connect: Connection refused (error 111)
16:11:21.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:21.587723 10917 heartbeater.cc:644] Failed to heartbeat to 127.9.178.188:43025 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.9.178.188:43025: connect: Connection refused (error 111)
16:11:21.749 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.9.178.188:43025(127.9.178.188:43025)] connecting to peer
16:11:21.750 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025
16:11:21.750 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.178.188:43025(127.9.178.188:43025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025
16:11:21.751 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.9.178.188:43025: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025
16:11:21.752 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025; will retry
16:11:22.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.242393 11239 raft_consensus.cc:482] T 574390c2aab3431a99507b85e30e1b7b P e257bad618b34cb98a4da61a671d08f2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f25e4fe0a11444a4a244162e2a6044cb)
16:11:22.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.242774 11239 raft_consensus.cc:504] T 574390c2aab3431a99507b85e30e1b7b P e257bad618b34cb98a4da61a671d08f2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e257bad618b34cb98a4da61a671d08f2" member_type: VOTER last_known_addr { host: "127.9.178.129" port: 38963 } } peers { permanent_uuid: "cc5521ba6549457fa94b2fd31d34260e" member_type: VOTER last_known_addr { host: "127.9.178.130" port: 42743 } } peers { permanent_uuid: "f25e4fe0a11444a4a244162e2a6044cb" member_type: VOTER last_known_addr { host: "127.9.178.131" port: 37543 } }
16:11:22.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.243709 11242 raft_consensus.cc:482] T 574390c2aab3431a99507b85e30e1b7b P cc5521ba6549457fa94b2fd31d34260e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f25e4fe0a11444a4a244162e2a6044cb)
16:11:22.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.244064 11242 raft_consensus.cc:504] T 574390c2aab3431a99507b85e30e1b7b P cc5521ba6549457fa94b2fd31d34260e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e257bad618b34cb98a4da61a671d08f2" member_type: VOTER last_known_addr { host: "127.9.178.129" port: 38963 } } peers { permanent_uuid: "cc5521ba6549457fa94b2fd31d34260e" member_type: VOTER last_known_addr { host: "127.9.178.130" port: 42743 } } peers { permanent_uuid: "f25e4fe0a11444a4a244162e2a6044cb" member_type: VOTER last_known_addr { host: "127.9.178.131" port: 37543 } }
16:11:22.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.245210 11239 leader_election.cc:288] T 574390c2aab3431a99507b85e30e1b7b P e257bad618b34cb98a4da61a671d08f2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cc5521ba6549457fa94b2fd31d34260e (127.9.178.130:42743), f25e4fe0a11444a4a244162e2a6044cb (127.9.178.131:37543)
16:11:22.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.246179 11242 leader_election.cc:288] T 574390c2aab3431a99507b85e30e1b7b P cc5521ba6549457fa94b2fd31d34260e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e257bad618b34cb98a4da61a671d08f2 (127.9.178.129:38963), f25e4fe0a11444a4a244162e2a6044cb (127.9.178.131:37543)
16:11:22.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:22.250352 10500 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.178.131:37543: connect: Connection refused (error 111)
16:11:22.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:22.256033 10741 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.178.131:37543: connect: Connection refused (error 111)
16:11:22.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:22.261979 10500 leader_election.cc:334] T 574390c2aab3431a99507b85e30e1b7b P e257bad618b34cb98a4da61a671d08f2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f25e4fe0a11444a4a244162e2a6044cb (127.9.178.131:37543): Network error: Client connection negotiation failed: client connection to 127.9.178.131:37543: connect: Connection refused (error 111)
16:11:22.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:22.263222 10741 leader_election.cc:334] T 574390c2aab3431a99507b85e30e1b7b P cc5521ba6549457fa94b2fd31d34260e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f25e4fe0a11444a4a244162e2a6044cb (127.9.178.131:37543): Network error: Client connection negotiation failed: client connection to 127.9.178.131:37543: connect: Connection refused (error 111)
16:11:22.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.263422 10845 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "574390c2aab3431a99507b85e30e1b7b" candidate_uuid: "e257bad618b34cb98a4da61a671d08f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "cc5521ba6549457fa94b2fd31d34260e" is_pre_election: true
16:11:22.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.264063 10845 raft_consensus.cc:2454] T 574390c2aab3431a99507b85e30e1b7b P cc5521ba6549457fa94b2fd31d34260e [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e257bad618b34cb98a4da61a671d08f2 in term 1.
16:11:22.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.264120 11257 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1935cf4b9a704251a6b255b7bf2dfd36 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 62642e355e904e4e888e2e0981b717cf)
16:11:22.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.264621 11257 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1935cf4b9a704251a6b255b7bf2dfd36 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47b27270b60a4fe2af1876eb689f7771" member_type: VOTER last_known_addr { host: "127.9.178.190" port: 45893 } } peers { permanent_uuid: "1935cf4b9a704251a6b255b7bf2dfd36" member_type: VOTER last_known_addr { host: "127.9.178.189" port: 44571 } } peers { permanent_uuid: "62642e355e904e4e888e2e0981b717cf" member_type: VOTER last_known_addr { host: "127.9.178.188" port: 43025 } }
16:11:22.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.265165 10500 leader_election.cc:302] T 574390c2aab3431a99507b85e30e1b7b P e257bad618b34cb98a4da61a671d08f2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc5521ba6549457fa94b2fd31d34260e, e257bad618b34cb98a4da61a671d08f2; no voters: f25e4fe0a11444a4a244162e2a6044cb
16:11:22.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.266036 11239 raft_consensus.cc:2781] T 574390c2aab3431a99507b85e30e1b7b P e257bad618b34cb98a4da61a671d08f2 [term 1 FOLLOWER]: Leader pre-election won for term 2
16:11:22.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.266355 11239 raft_consensus.cc:482] T 574390c2aab3431a99507b85e30e1b7b P e257bad618b34cb98a4da61a671d08f2 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f25e4fe0a11444a4a244162e2a6044cb)
16:11:22.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.266716 11239 raft_consensus.cc:3037] T 574390c2aab3431a99507b85e30e1b7b P e257bad618b34cb98a4da61a671d08f2 [term 1 FOLLOWER]: Advancing to term 2
16:11:22.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.266885 10609 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "574390c2aab3431a99507b85e30e1b7b" candidate_uuid: "cc5521ba6549457fa94b2fd31d34260e" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "e257bad618b34cb98a4da61a671d08f2" is_pre_election: true
16:11:22.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.267560 10017 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1935cf4b9a704251a6b255b7bf2dfd36" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "47b27270b60a4fe2af1876eb689f7771" is_pre_election: true
16:11:22.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.269873 11257 leader_election.cc:288] T 00000000000000000000000000000000 P 1935cf4b9a704251a6b255b7bf2dfd36 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 47b27270b60a4fe2af1876eb689f7771 (127.9.178.190:45893), 62642e355e904e4e888e2e0981b717cf (127.9.178.188:43025)
16:11:22.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:22.270483 10116 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.178.188:43025: connect: Connection refused (error 111) [suppressed 6 similar messages]
16:11:22.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.272289 11239 raft_consensus.cc:504] T 574390c2aab3431a99507b85e30e1b7b P e257bad618b34cb98a4da61a671d08f2 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e257bad618b34cb98a4da61a671d08f2" member_type: VOTER last_known_addr { host: "127.9.178.129" port: 38963 } } peers { permanent_uuid: "cc5521ba6549457fa94b2fd31d34260e" member_type: VOTER last_known_addr { host: "127.9.178.130" port: 42743 } } peers { permanent_uuid: "f25e4fe0a11444a4a244162e2a6044cb" member_type: VOTER last_known_addr { host: "127.9.178.131" port: 37543 } }
16:11:22.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.273263 10609 raft_consensus.cc:2379] T 574390c2aab3431a99507b85e30e1b7b P e257bad618b34cb98a4da61a671d08f2 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cc5521ba6549457fa94b2fd31d34260e in current term 2: Already voted for candidate e257bad618b34cb98a4da61a671d08f2 in this term.
16:11:22.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.273952 11239 leader_election.cc:288] T 574390c2aab3431a99507b85e30e1b7b P e257bad618b34cb98a4da61a671d08f2 [CANDIDATE]: Term 2 election: Requested vote from peers cc5521ba6549457fa94b2fd31d34260e (127.9.178.130:42743), f25e4fe0a11444a4a244162e2a6044cb (127.9.178.131:37543)
16:11:22.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:22.274572 10116 leader_election.cc:334] T 00000000000000000000000000000000 P 1935cf4b9a704251a6b255b7bf2dfd36 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 62642e355e904e4e888e2e0981b717cf (127.9.178.188:43025): Network error: Client connection negotiation failed: client connection to 127.9.178.188:43025: connect: Connection refused (error 111)
16:11:22.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.274641 10845 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "574390c2aab3431a99507b85e30e1b7b" candidate_uuid: "e257bad618b34cb98a4da61a671d08f2" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "cc5521ba6549457fa94b2fd31d34260e"
16:11:22.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.275174 10845 raft_consensus.cc:3037] T 574390c2aab3431a99507b85e30e1b7b P cc5521ba6549457fa94b2fd31d34260e [term 1 FOLLOWER]: Advancing to term 2
16:11:22.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.275216 10116 leader_election.cc:302] T 00000000000000000000000000000000 P 1935cf4b9a704251a6b255b7bf2dfd36 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1935cf4b9a704251a6b255b7bf2dfd36; no voters: 47b27270b60a4fe2af1876eb689f7771, 62642e355e904e4e888e2e0981b717cf
16:11:22.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.276293 11257 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 1935cf4b9a704251a6b255b7bf2dfd36 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
16:11:22.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:22.277781 10500 leader_election.cc:334] T 574390c2aab3431a99507b85e30e1b7b P e257bad618b34cb98a4da61a671d08f2 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f25e4fe0a11444a4a244162e2a6044cb (127.9.178.131:37543): Network error: Client connection negotiation failed: client connection to 127.9.178.131:37543: connect: Connection refused (error 111)
16:11:22.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.277839 10741 leader_election.cc:302] T 574390c2aab3431a99507b85e30e1b7b P cc5521ba6549457fa94b2fd31d34260e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cc5521ba6549457fa94b2fd31d34260e; no voters: e257bad618b34cb98a4da61a671d08f2, f25e4fe0a11444a4a244162e2a6044cb
16:11:22.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.280436 10845 raft_consensus.cc:2454] T 574390c2aab3431a99507b85e30e1b7b P cc5521ba6549457fa94b2fd31d34260e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e257bad618b34cb98a4da61a671d08f2 in term 2.
16:11:22.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.280786 11242 raft_consensus.cc:2726] T 574390c2aab3431a99507b85e30e1b7b P cc5521ba6549457fa94b2fd31d34260e [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
16:11:22.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.281227 10500 leader_election.cc:302] T 574390c2aab3431a99507b85e30e1b7b P e257bad618b34cb98a4da61a671d08f2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cc5521ba6549457fa94b2fd31d34260e, e257bad618b34cb98a4da61a671d08f2; no voters: f25e4fe0a11444a4a244162e2a6044cb
16:11:22.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.281921 11239 raft_consensus.cc:2781] T 574390c2aab3431a99507b85e30e1b7b P e257bad618b34cb98a4da61a671d08f2 [term 2 FOLLOWER]: Leader election won for term 2
16:11:22.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.283543 11239 raft_consensus.cc:686] T 574390c2aab3431a99507b85e30e1b7b P e257bad618b34cb98a4da61a671d08f2 [term 2 LEADER]: Becoming Leader. State: Replica: e257bad618b34cb98a4da61a671d08f2, State: Running, Role: LEADER
16:11:22.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.285454 11239 consensus_queue.cc:237] T 574390c2aab3431a99507b85e30e1b7b P e257bad618b34cb98a4da61a671d08f2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 1.11, Last appended by leader: 11, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e257bad618b34cb98a4da61a671d08f2" member_type: VOTER last_known_addr { host: "127.9.178.129" port: 38963 } } peers { permanent_uuid: "cc5521ba6549457fa94b2fd31d34260e" member_type: VOTER last_known_addr { host: "127.9.178.130" port: 42743 } } peers { permanent_uuid: "f25e4fe0a11444a4a244162e2a6044cb" member_type: VOTER last_known_addr { host: "127.9.178.131" port: 37543 } }
16:11:22.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.292233 11269 raft_consensus.cc:482] T 00000000000000000000000000000000 P 47b27270b60a4fe2af1876eb689f7771 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 62642e355e904e4e888e2e0981b717cf)
16:11:22.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.292651 11269 raft_consensus.cc:504] T 00000000000000000000000000000000 P 47b27270b60a4fe2af1876eb689f7771 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47b27270b60a4fe2af1876eb689f7771" member_type: VOTER last_known_addr { host: "127.9.178.190" port: 45893 } } peers { permanent_uuid: "1935cf4b9a704251a6b255b7bf2dfd36" member_type: VOTER last_known_addr { host: "127.9.178.189" port: 44571 } } peers { permanent_uuid: "62642e355e904e4e888e2e0981b717cf" member_type: VOTER last_known_addr { host: "127.9.178.188" port: 43025 } }
16:11:22.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.295367 11269 leader_election.cc:288] T 00000000000000000000000000000000 P 47b27270b60a4fe2af1876eb689f7771 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1935cf4b9a704251a6b255b7bf2dfd36 (127.9.178.189:44571), 62642e355e904e4e888e2e0981b717cf (127.9.178.188:43025)
16:11:22.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.296147 10154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "47b27270b60a4fe2af1876eb689f7771" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "1935cf4b9a704251a6b255b7bf2dfd36" is_pre_election: true
16:11:22.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.296779 10154 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 1935cf4b9a704251a6b255b7bf2dfd36 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47b27270b60a4fe2af1876eb689f7771 in term 1.
16:11:22.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:22.297573  9974 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.9.178.188:43025: connect: Connection refused (error 111) [suppressed 12 similar messages]
16:11:22.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.297789  9977 leader_election.cc:302] T 00000000000000000000000000000000 P 47b27270b60a4fe2af1876eb689f7771 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1935cf4b9a704251a6b255b7bf2dfd36, 47b27270b60a4fe2af1876eb689f7771; no voters: 
16:11:22.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.298486 11269 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 47b27270b60a4fe2af1876eb689f7771 [term 1 FOLLOWER]: Leader pre-election won for term 2
16:11:22.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.298724 11269 raft_consensus.cc:482] T 00000000000000000000000000000000 P 47b27270b60a4fe2af1876eb689f7771 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 62642e355e904e4e888e2e0981b717cf)
16:11:22.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.299021 11269 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 47b27270b60a4fe2af1876eb689f7771 [term 1 FOLLOWER]: Advancing to term 2
16:11:22.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:22.300379  9974 leader_election.cc:334] T 00000000000000000000000000000000 P 47b27270b60a4fe2af1876eb689f7771 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 62642e355e904e4e888e2e0981b717cf (127.9.178.188:43025): Network error: Client connection negotiation failed: client connection to 127.9.178.188:43025: connect: Connection refused (error 111)
16:11:22.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.305652 11269 raft_consensus.cc:504] T 00000000000000000000000000000000 P 47b27270b60a4fe2af1876eb689f7771 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47b27270b60a4fe2af1876eb689f7771" member_type: VOTER last_known_addr { host: "127.9.178.190" port: 45893 } } peers { permanent_uuid: "1935cf4b9a704251a6b255b7bf2dfd36" member_type: VOTER last_known_addr { host: "127.9.178.189" port: 44571 } } peers { permanent_uuid: "62642e355e904e4e888e2e0981b717cf" member_type: VOTER last_known_addr { host: "127.9.178.188" port: 43025 } }
16:11:22.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.307890 10154 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "47b27270b60a4fe2af1876eb689f7771" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "1935cf4b9a704251a6b255b7bf2dfd36"
16:11:22.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.308310 11269 leader_election.cc:288] T 00000000000000000000000000000000 P 47b27270b60a4fe2af1876eb689f7771 [CANDIDATE]: Term 2 election: Requested vote from peers 1935cf4b9a704251a6b255b7bf2dfd36 (127.9.178.189:44571), 62642e355e904e4e888e2e0981b717cf (127.9.178.188:43025)
16:11:22.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.308346 10154 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1935cf4b9a704251a6b255b7bf2dfd36 [term 1 FOLLOWER]: Advancing to term 2
16:11:22.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:22.310586  9974 leader_election.cc:334] T 00000000000000000000000000000000 P 47b27270b60a4fe2af1876eb689f7771 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 62642e355e904e4e888e2e0981b717cf (127.9.178.188:43025): Network error: Client connection negotiation failed: client connection to 127.9.178.188:43025: connect: Connection refused (error 111)
16:11:22.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.314075 10154 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 1935cf4b9a704251a6b255b7bf2dfd36 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47b27270b60a4fe2af1876eb689f7771 in term 2.
16:11:22.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.314852  9977 leader_election.cc:302] T 00000000000000000000000000000000 P 47b27270b60a4fe2af1876eb689f7771 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1935cf4b9a704251a6b255b7bf2dfd36, 47b27270b60a4fe2af1876eb689f7771; no voters: 62642e355e904e4e888e2e0981b717cf
16:11:22.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.315379 11269 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 47b27270b60a4fe2af1876eb689f7771 [term 2 FOLLOWER]: Leader election won for term 2
16:11:22.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.316192 11269 raft_consensus.cc:686] T 00000000000000000000000000000000 P 47b27270b60a4fe2af1876eb689f7771 [term 2 LEADER]: Becoming Leader. State: Replica: 47b27270b60a4fe2af1876eb689f7771, State: Running, Role: LEADER
16:11:22.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.316960 11269 consensus_queue.cc:237] T 00000000000000000000000000000000 P 47b27270b60a4fe2af1876eb689f7771 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47b27270b60a4fe2af1876eb689f7771" member_type: VOTER last_known_addr { host: "127.9.178.190" port: 45893 } } peers { permanent_uuid: "1935cf4b9a704251a6b255b7bf2dfd36" member_type: VOTER last_known_addr { host: "127.9.178.189" port: 44571 } } peers { permanent_uuid: "62642e355e904e4e888e2e0981b717cf" member_type: VOTER last_known_addr { host: "127.9.178.188" port: 43025 } }
16:11:22.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.320305 11273 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47b27270b60a4fe2af1876eb689f7771 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 47b27270b60a4fe2af1876eb689f7771. Latest consensus state: current_term: 2 leader_uuid: "47b27270b60a4fe2af1876eb689f7771" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47b27270b60a4fe2af1876eb689f7771" member_type: VOTER last_known_addr { host: "127.9.178.190" port: 45893 } } peers { permanent_uuid: "1935cf4b9a704251a6b255b7bf2dfd36" member_type: VOTER last_known_addr { host: "127.9.178.189" port: 44571 } } peers { permanent_uuid: "62642e355e904e4e888e2e0981b717cf" member_type: VOTER last_known_addr { host: "127.9.178.188" port: 43025 } } }
16:11:22.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.320891 11273 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47b27270b60a4fe2af1876eb689f7771 [sys.catalog]: This master's current role is: LEADER
16:11:22.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.322404 11276 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
16:11:22.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.328783 11276 catalog_manager.cc:669] Loaded metadata for table org.apache.kudu.client.TestClientFailoverSupport-KILL [id=d686692d2b174868911afdafc5f7407d]
16:11:22.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.333048 11276 tablet_loader.cc:96] loaded metadata for tablet 574390c2aab3431a99507b85e30e1b7b (table org.apache.kudu.client.TestClientFailoverSupport-KILL [id=d686692d2b174868911afdafc5f7407d])
16:11:22.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.334199 11276 catalog_manager.cc:1484] Initializing Kudu cluster ID...
16:11:22.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.338009 11276 catalog_manager.cc:1259] Loaded cluster ID: ce2d498cb21746ef90b844f88851ce47
16:11:22.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.338227 11276 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
16:11:22.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.343029 11276 catalog_manager.cc:1504] Loading token signing keys...
16:11:22.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.346915 11276 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 47b27270b60a4fe2af1876eb689f7771: Loaded TSK: 0
16:11:22.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.348403 11276 catalog_manager.cc:1514] Initializing in-progress tserver states...
16:11:22.629 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.9.178.188:43025(127.9.178.188:43025)] connecting to peer
16:11:22.633 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025
16:11:22.633 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.178.188:43025(127.9.178.188:43025)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025
16:11:22.634 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.9.178.188:43025: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025
16:11:22.634 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
16:11:22.637 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableLocations, tablet=Kudu Master, attempt=11, TimeoutTracker(timeout=29983, elapsed=1746), Traces: [0ms] sending RPC to server master-127.9.178.188:43025, [3ms] received response from server master-127.9.178.188:43025: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [3ms] delaying RPC due to: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.190:45893, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.189:44571, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.188:43025, [24ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.189:44571: OK, [24ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.190:45893: OK, [25ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.188:43025: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [28ms] delaying RPC due to: Service unavailable: Master config (127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.190:45893, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.189:44571, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.188:43025, [43ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.188:43025: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [44ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.190:45893: OK, [44ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.189:44571: OK, [45ms] delaying RPC due to: Service unavailable: Master config (127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.190:45893, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.189:44571, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.188:43025, [63ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.188:43025: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [64ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.189:44571: OK, [64ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.190:45893: OK, [65ms] delaying RPC due to: Service unavailable: Master config (127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.190:45893, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.189:44571, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.188:43025, [84ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.190:45893: OK, [84ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.189:44571: OK, [85ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.188:43025: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [85ms] delaying RPC due to: Service unavailable: Master config (127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [100ms] refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.190:45893, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.189:44571, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.188:43025, [103ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.188:43025: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [104ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.189:44571: OK, [104ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.190:45893: OK, [104ms] delaying RPC due to: Service unavailable: Master config (127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.190:45893, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.189:44571, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.188:43025, [184ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.190:45893: OK, [184ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.188:43025: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [185ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.189:44571: OK, [185ms] delaying RPC due to: Service unavailable: Master config (127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [220ms] refreshing cache from master, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.190:45893, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.189:44571, [220ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.188:43025, [223ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.188:43025: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [223ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.189:44571: OK, [224ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.190:45893: OK, [224ms] delaying RPC due to: Service unavailable: Master config (127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [341ms] refreshing cache from master, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.190:45893, [341ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.189:44571, [342ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.188:43025, [345ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.189:44571: OK, [346ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.188:43025: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [346ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.190:45893: OK, [347ms] delaying RPC due to: Service unavailable: Master config (127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [860ms] refreshing cache from master, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.190:45893, [860ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.189:44571, [861ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.188:43025, [863ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.188:43025: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [864ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.190:45893: OK, [864ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.189:44571: OK, [864ms] delaying RPC due to: Service unavailable: Master config (127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [1740ms] refreshing cache from master, [1740ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.190:45893, [1741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.189:44571, [1741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.188:43025, [1745ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.189:44571: OK, [1745ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.190:45893: OK, [1746ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.188:43025: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, deferred=Deferred@650588713(state=PENDING, result=null, callback=get tablet locations from the master for table org.apache.kudu.client.TestClientFailoverSupport-KILL -> release master lookup permit -> retry RPC -> (continuation of Deferred@498731413 after retry RPC after error@1726698224) -> (continuation of Deferred@417468789 after retry RPC after error@128663098) -> (continuation of Deferred@1250978299 after retry RPC after error@1993399947) -> (continuation of Deferred@2125533341 after retry RPC after error@548780959) -> (continuation of Deferred@1763951043 after retry RPC after error@427261674) -> (continuation of Deferred@1865719969 after retry RPC after error@1649448859) -> (continuation of Deferred@361398219 after retry RPC after error@925422526) -> (continuation of Deferred@2102611026 after retry RPC after error@467263532) -> (continuation of Deferred@1575727291 after retry RPC after error@741289371), errback=passthrough -> release master lookup permit -> retry RPC after error -> (continuation of Deferred@498731413 after retry RPC after error@1726698224) -> (continuation of Deferred@417468789 after retry RPC after error@128663098) -> (continuation of Deferred@1250978299 after retry RPC after error@1993399947) -> (continuation of Deferred@2125533341 after retry RPC after error@548780959) -> (continuation of Deferred@1763951043 after retry RPC after error@427261674) -> (continuation of Deferred@1865719969 after retry RPC after error@1649448859) -> (continuation of Deferred@361398219 after retry RPC after error@925422526) -> (continuation of Deferred@2102611026 after retry RPC after error@467263532) -> (continuation of Deferred@1575727291 after retry RPC after error@741289371))) after lookup
16:11:22.644 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 574390c2aab3431a99507b85e30e1b7b for table 'org.apache.kudu.client.TestClientFailoverSupport-KILL' with partition [<start>, <end>)
16:11:22.644 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=574390c2aab3431a99507b85e30e1b7b@[cc5521ba6549457fa94b2fd31d34260e(127.9.178.130:42743),e257bad618b34cb98a4da61a671d08f2(127.9.178.129:38963),f25e4fe0a11444a4a244162e2a6044cb(127.9.178.131:37543)[L]]}]
16:11:22.648 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=574390c2aab3431a99507b85e30e1b7b, attempt=2, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=1774), Traces: [0ms] sending RPC to server f25e4fe0a11444a4a244162e2a6044cb, [3ms] received response from server f25e4fe0a11444a4a244162e2a6044cb: Network error: Failed to connect to peer f25e4fe0a11444a4a244162e2a6044cb(127.9.178.131:37543): Connection refused: /127.9.178.131:37543, [3ms] delaying RPC due to: Network error: Failed to connect to peer f25e4fe0a11444a4a244162e2a6044cb(127.9.178.131:37543): Connection refused: /127.9.178.131:37543, [17ms] refreshing cache from master, [17ms] Sub RPC GetTableLocations: sending RPC to server master-127.9.178.188:43025, [20ms] Sub RPC GetTableLocations: received response from server master-127.9.178.188:43025: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [20ms] Sub RPC GetTableLocations: delaying RPC due to: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [37ms] Sub RPC GetTableLocations: refreshing cache from master, [37ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.190:45893, [37ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.189:44571, [37ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.188:43025, [41ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.189:44571: OK, [41ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.190:45893: OK, [42ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.188:43025: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [45ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [57ms] Sub RPC GetTableLocations: refreshing cache from master, [57ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.190:45893, [57ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.189:44571, [57ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.188:43025, [60ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.188:43025: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [61ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.190:45893: OK, [61ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.189:44571: OK, [62ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [77ms] Sub RPC GetTableLocations: refreshing cache from master, [77ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.190:45893, [77ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.189:44571, [78ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.188:43025, [80ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.188:43025: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [81ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.189:44571: OK, [81ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.190:45893: OK, [82ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [97ms] Sub RPC GetTableLocations: refreshing cache from master, [97ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.190:45893, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.189:44571, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.188:43025, [101ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.190:45893: OK, [101ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.189:44571: OK, [102ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.188:43025: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [102ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [117ms] Sub RPC GetTableLocations: refreshing cache from master, [118ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.190:45893, [118ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.189:44571, [118ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.188:43025, [120ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.188:43025: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [121ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.189:44571: OK, [121ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.190:45893: OK, [121ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [197ms] Sub RPC GetTableLocations: refreshing cache from master, [197ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.190:45893, [198ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.189:44571, [198ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.188:43025, [201ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.190:45893: OK, [201ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.188:43025: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [202ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.189:44571: OK, [202ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [237ms] Sub RPC GetTableLocations: refreshing cache from master, [237ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.190:45893, [237ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.189:44571, [237ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.188:43025, [240ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.188:43025: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [240ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.189:44571: OK, [241ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.190:45893: OK, [241ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [358ms] Sub RPC GetTableLocations: refreshing cache from master, [358ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.190:45893, [358ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.189:44571, [359ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.188:43025, [362ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.189:44571: OK, [363ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.188:43025: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [363ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.190:45893: OK, [364ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [877ms] Sub RPC GetTableLocations: refreshing cache from master, [877ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.190:45893, [877ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.189:44571, [878ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.188:43025, [880ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.188:43025: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [881ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.190:45893: OK, [881ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.189:44571: OK, [881ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [1757ms] Sub RPC GetTableLocations: refreshing cache from master, [1757ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.190:45893, [1758ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.189:44571, [1758ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.188:43025, [1762ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.189:44571: OK, [1762ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.190:45893: OK, [1763ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.188:43025: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [1767ms] Sub RPC GetTableLocations: sending RPC to server master-127.9.178.190:45893, [1772ms] Sub RPC GetTableLocations: received response from server master-127.9.178.190:45893: OK, deferred=Deferred@536183875(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$82/142867575@1f9b816e -> passthrough -> wakeup thread Time-limited test, errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@4a8d34f3 -> wakeup thread Time-limited test)) after lookup
16:11:22.649 [DEBUG - kudu-nio-0] (Connection.java:748) [peer f25e4fe0a11444a4a244162e2a6044cb(127.9.178.131:37543)] connecting to peer
16:11:22.650 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer f25e4fe0a11444a4a244162e2a6044cb(127.9.178.131:37543): Connection refused: /127.9.178.131:37543
16:11:22.650 [DEBUG - kudu-nio-0] (Connection.java:709) [peer f25e4fe0a11444a4a244162e2a6044cb(127.9.178.131:37543)] cleaning up while in state CONNECTING due to: Failed to connect to peer f25e4fe0a11444a4a244162e2a6044cb(127.9.178.131:37543): Connection refused: /127.9.178.131:37543
16:11:22.650 [INFO - kudu-nio-0] (AsyncKuduClient.java:2355) Invalidating location f25e4fe0a11444a4a244162e2a6044cb(127.9.178.131:37543) for tablet 574390c2aab3431a99507b85e30e1b7b: Failed to connect to peer f25e4fe0a11444a4a244162e2a6044cb(127.9.178.131:37543): Connection refused: /127.9.178.131:37543
16:11:22.672 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 574390c2aab3431a99507b85e30e1b7b for table 'org.apache.kudu.client.TestClientFailoverSupport-KILL' with partition [<start>, <end>)
16:11:22.672 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=574390c2aab3431a99507b85e30e1b7b@[cc5521ba6549457fa94b2fd31d34260e(127.9.178.130:42743),e257bad618b34cb98a4da61a671d08f2(127.9.178.129:38963),f25e4fe0a11444a4a244162e2a6044cb(127.9.178.131:37543)[L]]}]
16:11:22.674 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=574390c2aab3431a99507b85e30e1b7b, attempt=4, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=1801), Traces: [0ms] sending RPC to server f25e4fe0a11444a4a244162e2a6044cb, [3ms] received response from server f25e4fe0a11444a4a244162e2a6044cb: Network error: Failed to connect to peer f25e4fe0a11444a4a244162e2a6044cb(127.9.178.131:37543): Connection refused: /127.9.178.131:37543, [3ms] delaying RPC due to: Network error: Failed to connect to peer f25e4fe0a11444a4a244162e2a6044cb(127.9.178.131:37543): Connection refused: /127.9.178.131:37543, [17ms] refreshing cache from master, [17ms] Sub RPC GetTableLocations: sending RPC to server master-127.9.178.188:43025, [20ms] Sub RPC GetTableLocations: received response from server master-127.9.178.188:43025: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [20ms] Sub RPC GetTableLocations: delaying RPC due to: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [37ms] Sub RPC GetTableLocations: refreshing cache from master, [37ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.190:45893, [37ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.189:44571, [37ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.188:43025, [41ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.189:44571: OK, [41ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.190:45893: OK, [42ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.188:43025: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [45ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [57ms] Sub RPC GetTableLocations: refreshing cache from master, [57ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.190:45893, [57ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.189:44571, [57ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.188:43025, [60ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.188:43025: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [61ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.190:45893: OK, [61ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.189:44571: OK, [62ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [77ms] Sub RPC GetTableLocations: refreshing cache from master, [77ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.190:45893, [77ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.189:44571, [78ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.188:43025, [80ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.188:43025: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [81ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.189:44571: OK, [81ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.190:45893: OK, [82ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [97ms] Sub RPC GetTableLocations: refreshing cache from master, [97ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.190:45893, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.189:44571, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.188:43025, [101ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.190:45893: OK, [101ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.189:44571: OK, [102ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.188:43025: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [102ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [117ms] Sub RPC GetTableLocations: refreshing cache from master, [118ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.190:45893, [118ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.189:44571, [118ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.188:43025, [120ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.188:43025: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [121ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.189:44571: OK, [121ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.190:45893: OK, [121ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [197ms] Sub RPC GetTableLocations: refreshing cache from master, [197ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.190:45893, [198ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.189:44571, [198ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.188:43025, [201ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.190:45893: OK, [201ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.188:43025: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [202ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.189:44571: OK, [202ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [237ms] Sub RPC GetTableLocations: refreshing cache from master, [237ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.190:45893, [237ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.189:44571, [237ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.188:43025, [240ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.188:43025: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [240ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.189:44571: OK, [241ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.190:45893: OK, [241ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [358ms] Sub RPC GetTableLocations: refreshing cache from master, [358ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.190:45893, [358ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.189:44571, [359ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.188:43025, [362ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.189:44571: OK, [363ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.188:43025: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [363ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.190:45893: OK, [364ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [877ms] Sub RPC GetTableLocations: refreshing cache from master, [877ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.190:45893, [877ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.189:44571, [878ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.188:43025, [880ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.188:43025: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [881ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.190:45893: OK, [881ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.189:44571: OK, [881ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [1757ms] Sub RPC GetTableLocations: refreshing cache from master, [1757ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.190:45893, [1758ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.189:44571, [1758ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.188:43025, [1762ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.189:44571: OK, [1762ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.190:45893: OK, [1763ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.188:43025: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [1767ms] Sub RPC GetTableLocations: sending RPC to server master-127.9.178.190:45893, [1772ms] Sub RPC GetTableLocations: received response from server master-127.9.178.190:45893: OK, [1778ms] sending RPC to server f25e4fe0a11444a4a244162e2a6044cb, [1779ms] received response from server f25e4fe0a11444a4a244162e2a6044cb: Network error: Failed to connect to peer f25e4fe0a11444a4a244162e2a6044cb(127.9.178.131:37543): Connection refused: /127.9.178.131:37543, [1779ms] delaying RPC due to: Network error: Failed to connect to peer f25e4fe0a11444a4a244162e2a6044cb(127.9.178.131:37543): Connection refused: /127.9.178.131:37543, [1797ms] refreshing cache from master, [1798ms] Sub RPC GetTableLocations: sending RPC to server master-127.9.178.190:45893, [1801ms] Sub RPC GetTableLocations: received response from server master-127.9.178.190:45893: OK, deferred=Deferred@536183875(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$82/142867575@1f9b816e -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@650588713 after retry RPC@1056387079), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@4a8d34f3 -> wakeup thread Time-limited test -> (continuation of Deferred@650588713 after retry RPC@1056387079))) after lookup
16:11:22.675 [DEBUG - kudu-nio-0] (Connection.java:748) [peer f25e4fe0a11444a4a244162e2a6044cb(127.9.178.131:37543)] connecting to peer
16:11:22.676 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer f25e4fe0a11444a4a244162e2a6044cb(127.9.178.131:37543): Connection refused: /127.9.178.131:37543
16:11:22.676 [DEBUG - kudu-nio-1] (Connection.java:709) [peer f25e4fe0a11444a4a244162e2a6044cb(127.9.178.131:37543)] cleaning up while in state CONNECTING due to: Failed to connect to peer f25e4fe0a11444a4a244162e2a6044cb(127.9.178.131:37543): Connection refused: /127.9.178.131:37543
16:11:22.676 [INFO - kudu-nio-1] (AsyncKuduClient.java:2355) Invalidating location f25e4fe0a11444a4a244162e2a6044cb(127.9.178.131:37543) for tablet 574390c2aab3431a99507b85e30e1b7b: Failed to connect to peer f25e4fe0a11444a4a244162e2a6044cb(127.9.178.131:37543): Connection refused: /127.9.178.131:37543
16:11:22.692 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 574390c2aab3431a99507b85e30e1b7b for table 'org.apache.kudu.client.TestClientFailoverSupport-KILL' with partition [<start>, <end>)
16:11:22.692 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=574390c2aab3431a99507b85e30e1b7b@[cc5521ba6549457fa94b2fd31d34260e(127.9.178.130:42743),e257bad618b34cb98a4da61a671d08f2(127.9.178.129:38963),f25e4fe0a11444a4a244162e2a6044cb(127.9.178.131:37543)[L]]}]
16:11:22.694 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=574390c2aab3431a99507b85e30e1b7b, attempt=6, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=1821), Traces: [0ms] sending RPC to server f25e4fe0a11444a4a244162e2a6044cb, [3ms] received response from server f25e4fe0a11444a4a244162e2a6044cb: Network error: Failed to connect to peer f25e4fe0a11444a4a244162e2a6044cb(127.9.178.131:37543): Connection refused: /127.9.178.131:37543, [3ms] delaying RPC due to: Network error: Failed to connect to peer f25e4fe0a11444a4a244162e2a6044cb(127.9.178.131:37543): Connection refused: /127.9.178.131:37543, [17ms] refreshing cache from master, [17ms] Sub RPC GetTableLocations: sending RPC to server master-127.9.178.188:43025, [20ms] Sub RPC GetTableLocations: received response from server master-127.9.178.188:43025: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [20ms] Sub RPC GetTableLocations: delaying RPC due to: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [37ms] Sub RPC GetTableLocations: refreshing cache from master, [37ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.190:45893, [37ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.189:44571, [37ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.188:43025, [41ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.189:44571: OK, [41ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.190:45893: OK, [42ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.188:43025: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [45ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [57ms] Sub RPC GetTableLocations: refreshing cache from master, [57ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.190:45893, [57ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.189:44571, [57ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.188:43025, [60ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.188:43025: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [61ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.190:45893: OK, [61ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.189:44571: OK, [62ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [77ms] Sub RPC GetTableLocations: refreshing cache from master, [77ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.190:45893, [77ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.189:44571, [78ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.188:43025, [80ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.188:43025: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [81ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.189:44571: OK, [81ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.190:45893: OK, [82ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [97ms] Sub RPC GetTableLocations: refreshing cache from master, [97ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.190:45893, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.189:44571, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.188:43025, [101ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.190:45893: OK, [101ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.189:44571: OK, [102ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.188:43025: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [102ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [117ms] Sub RPC GetTableLocations: refreshing cache from master, [118ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.190:45893, [118ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.189:44571, [118ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.188:43025, [120ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.188:43025: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [121ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.189:44571: OK, [121ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.190:45893: OK, [121ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [197ms] Sub RPC GetTableLocations: refreshing cache from master, [197ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.190:45893, [198ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.189:44571, [198ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.188:43025, [201ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.190:45893: OK, [201ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.188:43025: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [202ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.189:44571: OK, [202ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [237ms] Sub RPC GetTableLocations: refreshing cache from master, [237ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.190:45893, [237ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.189:44571, [237ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.188:43025, [240ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.188:43025: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [240ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.189:44571: OK, [241ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.190:45893: OK, [241ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [358ms] Sub RPC GetTableLocations: refreshing cache from master, [358ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.190:45893, [358ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.189:44571, [359ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.188:43025, [362ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.189:44571: OK, [363ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.188:43025: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [363ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.190:45893: OK, [364ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [877ms] Sub RPC GetTableLocations: refreshing cache from master, [877ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.190:45893, [877ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.189:44571, [878ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.188:43025, [880ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.188:43025: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [881ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.190:45893: OK, [881ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.189:44571: OK, [881ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [1757ms] Sub RPC GetTableLocations: refreshing cache from master, [1757ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.190:45893, [1758ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.189:44571, [1758ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.188:43025, [1762ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.189:44571: OK, [1762ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.190:45893: OK, [1763ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.188:43025: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [1767ms] Sub RPC GetTableLocations: sending RPC to server master-127.9.178.190:45893, [1772ms] Sub RPC GetTableLocations: received response from server master-127.9.178.190:45893: OK, [1778ms] sending RPC to server f25e4fe0a11444a4a244162e2a6044cb, [1779ms] received response from server f25e4fe0a11444a4a244162e2a6044cb: Network error: Failed to connect to peer f25e4fe0a11444a4a244162e2a6044cb(127.9.178.131:37543): Connection refused: /127.9.178.131:37543, [1779ms] delaying RPC due to: Network error: Failed to connect to peer f25e4fe0a11444a4a244162e2a6044cb(127.9.178.131:37543): Connection refused: /127.9.178.131:37543, [1797ms] refreshing cache from master, [1798ms] Sub RPC GetTableLocations: sending RPC to server master-127.9.178.190:45893, [1801ms] Sub RPC GetTableLocations: received response from server master-127.9.178.190:45893: OK, [1803ms] sending RPC to server f25e4fe0a11444a4a244162e2a6044cb, [1805ms] received response from server f25e4fe0a11444a4a244162e2a6044cb: Network error: Failed to connect to peer f25e4fe0a11444a4a244162e2a6044cb(127.9.178.131:37543): Connection refused: /127.9.178.131:37543, [1806ms] delaying RPC due to: Network error: Failed to connect to peer f25e4fe0a11444a4a244162e2a6044cb(127.9.178.131:37543): Connection refused: /127.9.178.131:37543, [1817ms] refreshing cache from master, [1817ms] Sub RPC GetTableLocations: sending RPC to server master-127.9.178.190:45893, [1820ms] Sub RPC GetTableLocations: received response from server master-127.9.178.190:45893: OK, deferred=Deferred@536183875(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$82/142867575@1f9b816e -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@650588713 after retry RPC@1056387079) -> (continuation of Deferred@1659669439 after retry RPC@1704782061), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@4a8d34f3 -> wakeup thread Time-limited test -> (continuation of Deferred@650588713 after retry RPC@1056387079) -> (continuation of Deferred@1659669439 after retry RPC@1704782061))) after lookup
16:11:22.696 [DEBUG - kudu-nio-0] (Connection.java:748) [peer f25e4fe0a11444a4a244162e2a6044cb(127.9.178.131:37543)] connecting to peer
16:11:22.697 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer f25e4fe0a11444a4a244162e2a6044cb(127.9.178.131:37543): Connection refused: /127.9.178.131:37543
16:11:22.697 [DEBUG - kudu-nio-0] (Connection.java:709) [peer f25e4fe0a11444a4a244162e2a6044cb(127.9.178.131:37543)] cleaning up while in state CONNECTING due to: Failed to connect to peer f25e4fe0a11444a4a244162e2a6044cb(127.9.178.131:37543): Connection refused: /127.9.178.131:37543
16:11:22.697 [INFO - kudu-nio-0] (AsyncKuduClient.java:2355) Invalidating location f25e4fe0a11444a4a244162e2a6044cb(127.9.178.131:37543) for tablet 574390c2aab3431a99507b85e30e1b7b: Failed to connect to peer f25e4fe0a11444a4a244162e2a6044cb(127.9.178.131:37543): Connection refused: /127.9.178.131:37543
16:11:22.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:22.701294  9974 consensus_peers.cc:487] T 00000000000000000000000000000000 P 47b27270b60a4fe2af1876eb689f7771 -> Peer 62642e355e904e4e888e2e0981b717cf (127.9.178.188:43025): Couldn't send request to peer 62642e355e904e4e888e2e0981b717cf. Status: Network error: Client connection negotiation failed: client connection to 127.9.178.188:43025: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
16:11:22.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.720553 10154 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 1935cf4b9a704251a6b255b7bf2dfd36 [term 2 FOLLOWER]: Refusing update from remote peer 47b27270b60a4fe2af1876eb689f7771: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 2 index: 8. (index mismatch)
16:11:22.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.721699 11273 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 47b27270b60a4fe2af1876eb689f7771 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1935cf4b9a704251a6b255b7bf2dfd36" member_type: VOTER last_known_addr { host: "127.9.178.189" port: 44571 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
16:11:22.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.725346 11257 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1935cf4b9a704251a6b255b7bf2dfd36 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 47b27270b60a4fe2af1876eb689f7771. Latest consensus state: current_term: 2 leader_uuid: "47b27270b60a4fe2af1876eb689f7771" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47b27270b60a4fe2af1876eb689f7771" member_type: VOTER last_known_addr { host: "127.9.178.190" port: 45893 } } peers { permanent_uuid: "1935cf4b9a704251a6b255b7bf2dfd36" member_type: VOTER last_known_addr { host: "127.9.178.189" port: 44571 } } peers { permanent_uuid: "62642e355e904e4e888e2e0981b717cf" member_type: VOTER last_known_addr { host: "127.9.178.188" port: 43025 } } }
16:11:22.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.725948 11257 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1935cf4b9a704251a6b255b7bf2dfd36 [sys.catalog]: This master's current role is: FOLLOWER
16:11:22.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.728705 11269 sys_catalog.cc:455] T 00000000000000000000000000000000 P 47b27270b60a4fe2af1876eb689f7771 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "47b27270b60a4fe2af1876eb689f7771" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47b27270b60a4fe2af1876eb689f7771" member_type: VOTER last_known_addr { host: "127.9.178.190" port: 45893 } } peers { permanent_uuid: "1935cf4b9a704251a6b255b7bf2dfd36" member_type: VOTER last_known_addr { host: "127.9.178.189" port: 44571 } } peers { permanent_uuid: "62642e355e904e4e888e2e0981b717cf" member_type: VOTER last_known_addr { host: "127.9.178.188" port: 43025 } } }
16:11:22.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.729447 11269 sys_catalog.cc:458] T 00000000000000000000000000000000 P 47b27270b60a4fe2af1876eb689f7771 [sys.catalog]: This master's current role is: LEADER
16:11:22.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.730037 11257 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1935cf4b9a704251a6b255b7bf2dfd36 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "47b27270b60a4fe2af1876eb689f7771" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47b27270b60a4fe2af1876eb689f7771" member_type: VOTER last_known_addr { host: "127.9.178.190" port: 45893 } } peers { permanent_uuid: "1935cf4b9a704251a6b255b7bf2dfd36" member_type: VOTER last_known_addr { host: "127.9.178.189" port: 44571 } } peers { permanent_uuid: "62642e355e904e4e888e2e0981b717cf" member_type: VOTER last_known_addr { host: "127.9.178.188" port: 43025 } } }
16:11:22.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.730576 11257 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1935cf4b9a704251a6b255b7bf2dfd36 [sys.catalog]: This master's current role is: FOLLOWER
16:11:22.772 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 574390c2aab3431a99507b85e30e1b7b for table 'org.apache.kudu.client.TestClientFailoverSupport-KILL' with partition [<start>, <end>)
16:11:22.773 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=574390c2aab3431a99507b85e30e1b7b@[cc5521ba6549457fa94b2fd31d34260e(127.9.178.130:42743),e257bad618b34cb98a4da61a671d08f2(127.9.178.129:38963),f25e4fe0a11444a4a244162e2a6044cb(127.9.178.131:37543)[L]]}]
16:11:22.774 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=574390c2aab3431a99507b85e30e1b7b, attempt=8, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=1901), Traces: [0ms] sending RPC to server f25e4fe0a11444a4a244162e2a6044cb, [3ms] received response from server f25e4fe0a11444a4a244162e2a6044cb: Network error: Failed to connect to peer f25e4fe0a11444a4a244162e2a6044cb(127.9.178.131:37543): Connection refused: /127.9.178.131:37543, [3ms] delaying RPC due to: Network error: Failed to connect to peer f25e4fe0a11444a4a244162e2a6044cb(127.9.178.131:37543): Connection refused: /127.9.178.131:37543, [17ms] refreshing cache from master, [17ms] Sub RPC GetTableLocations: sending RPC to server master-127.9.178.188:43025, [20ms] Sub RPC GetTableLocations: received response from server master-127.9.178.188:43025: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [20ms] Sub RPC GetTableLocations: delaying RPC due to: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [37ms] Sub RPC GetTableLocations: refreshing cache from master, [37ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.190:45893, [37ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.189:44571, [37ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.188:43025, [41ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.189:44571: OK, [41ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.190:45893: OK, [42ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.188:43025: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [45ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [57ms] Sub RPC GetTableLocations: refreshing cache from master, [57ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.190:45893, [57ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.189:44571, [57ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.188:43025, [60ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.188:43025: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [61ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.190:45893: OK, [61ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.189:44571: OK, [62ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [77ms] Sub RPC GetTableLocations: refreshing cache from master, [77ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.190:45893, [77ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.189:44571, [78ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.188:43025, [80ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.188:43025: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [81ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.189:44571: OK, [81ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.190:45893: OK, [82ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [97ms] Sub RPC GetTableLocations: refreshing cache from master, [97ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.190:45893, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.189:44571, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.188:43025, [101ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.190:45893: OK, [101ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.189:44571: OK, [102ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.188:43025: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [102ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [117ms] Sub RPC GetTableLocations: refreshing cache from master, [118ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.190:45893, [118ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.189:44571, [118ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.188:43025, [120ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.188:43025: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [121ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.189:44571: OK, [121ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.190:45893: OK, [121ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [197ms] Sub RPC GetTableLocations: refreshing cache from master, [197ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.190:45893, [198ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.189:44571, [198ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.188:43025, [201ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.190:45893: OK, [201ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.188:43025: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [202ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.189:44571: OK, [202ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [237ms] Sub RPC GetTableLocations: refreshing cache from master, [237ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.190:45893, [237ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.189:44571, [237ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.188:43025, [240ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.188:43025: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [240ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.189:44571: OK, [241ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.190:45893: OK, [241ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [358ms] Sub RPC GetTableLocations: refreshing cache from master, [358ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.190:45893, [358ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.189:44571, [359ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.188:43025, [362ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.189:44571: OK, [363ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.188:43025: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [363ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.190:45893: OK, [364ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [877ms] Sub RPC GetTableLocations: refreshing cache from master, [877ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.190:45893, [877ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.189:44571, [878ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.188:43025, [880ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.188:43025: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [881ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.190:45893: OK, [881ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.189:44571: OK, [881ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [1757ms] Sub RPC GetTableLocations: refreshing cache from master, [1757ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.190:45893, [1758ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.189:44571, [1758ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.188:43025, [1762ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.189:44571: OK, [1762ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.190:45893: OK, [1763ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.188:43025: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [1767ms] Sub RPC GetTableLocations: sending RPC to server master-127.9.178.190:45893, [1772ms] Sub RPC GetTableLocations: received response from server master-127.9.178.190:45893: OK, [1778ms] sending RPC to server f25e4fe0a11444a4a244162e2a6044cb, [1779ms] received response from server f25e4fe0a11444a4a244162e2a6044cb: Network error: Failed to connect to peer f25e4fe0a11444a4a244162e2a6044cb(127.9.178.131:37543): Connection refused: /127.9.178.131:37543, [1779ms] delaying RPC due to: Network error: Failed to connect to peer f25e4fe0a11444a4a244162e2a6044cb(127.9.178.131:37543): Connection refused: /127.9.178.131:37543, [1797ms] refreshing cache from master, [1798ms] Sub RPC GetTableLocations: sending RPC to server master-127.9.178.190:45893, [1801ms] Sub RPC GetTableLocations: received response from server master-127.9.178.190:45893: OK, [1803ms] sending RPC to server f25e4fe0a11444a4a244162e2a6044cb, [1805ms] received response from server f25e4fe0a11444a4a244162e2a6044cb: Network error: Failed to connect to peer f25e4fe0a11444a4a244162e2a6044cb(127.9.178.131:37543): Connection refused: /127.9.178.131:37543, [1806ms] delaying RPC due to: Network error: Failed to connect to peer f25e4fe0a11444a4a244162e2a6044cb(127.9.178.131:37543): Connection refused: /127.9.178.131:37543, [1817ms] refreshing cache from master, [1817ms] Sub RPC GetTableLocations: sending RPC to server master-127.9.178.190:45893, [1820ms] Sub RPC GetTableLocations: received response from server master-127.9.178.190:45893: OK, [1824ms] too many traces: truncated at 100 traces, deferred=Deferred@536183875(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$82/142867575@1f9b816e -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@650588713 after retry RPC@1056387079) -> (continuation of Deferred@1659669439 after retry RPC@1704782061) -> (continuation of Deferred@192505807 after retry RPC@2024332538), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@4a8d34f3 -> wakeup thread Time-limited test -> (continuation of Deferred@650588713 after retry RPC@1056387079) -> (continuation of Deferred@1659669439 after retry RPC@1704782061) -> (continuation of Deferred@192505807 after retry RPC@2024332538))) after lookup
16:11:22.775 [DEBUG - kudu-nio-0] (Connection.java:748) [peer f25e4fe0a11444a4a244162e2a6044cb(127.9.178.131:37543)] connecting to peer
16:11:22.777 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer f25e4fe0a11444a4a244162e2a6044cb(127.9.178.131:37543): Connection refused: /127.9.178.131:37543
16:11:22.777 [DEBUG - kudu-nio-1] (Connection.java:709) [peer f25e4fe0a11444a4a244162e2a6044cb(127.9.178.131:37543)] cleaning up while in state CONNECTING due to: Failed to connect to peer f25e4fe0a11444a4a244162e2a6044cb(127.9.178.131:37543): Connection refused: /127.9.178.131:37543
16:11:22.777 [INFO - kudu-nio-1] (AsyncKuduClient.java:2355) Invalidating location f25e4fe0a11444a4a244162e2a6044cb(127.9.178.131:37543) for tablet 574390c2aab3431a99507b85e30e1b7b: Failed to connect to peer f25e4fe0a11444a4a244162e2a6044cb(127.9.178.131:37543): Connection refused: /127.9.178.131:37543
16:11:22.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.790288 10845 raft_consensus.cc:1261] T 574390c2aab3431a99507b85e30e1b7b P cc5521ba6549457fa94b2fd31d34260e [term 2 FOLLOWER]: Refusing update from remote peer e257bad618b34cb98a4da61a671d08f2: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 2 index: 12. (index mismatch)
16:11:22.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.791451 11239 consensus_queue.cc:1035] T 574390c2aab3431a99507b85e30e1b7b P e257bad618b34cb98a4da61a671d08f2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cc5521ba6549457fa94b2fd31d34260e" member_type: VOTER last_known_addr { host: "127.9.178.130" port: 42743 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
16:11:22.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.794432 10919 heartbeater.cc:503] Master 127.9.178.190:45893 was elected leader, sending a full tablet report...
16:11:22.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:22.801555 10002 catalog_manager.cc:5495] T 574390c2aab3431a99507b85e30e1b7b P cc5521ba6549457fa94b2fd31d34260e reported cstate change: term changed from 1 to 2, leader changed from f25e4fe0a11444a4a244162e2a6044cb (127.9.178.131) to e257bad618b34cb98a4da61a671d08f2 (127.9.178.129). New cstate: current_term: 2 leader_uuid: "e257bad618b34cb98a4da61a671d08f2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e257bad618b34cb98a4da61a671d08f2" member_type: VOTER last_known_addr { host: "127.9.178.129" port: 38963 } } peers { permanent_uuid: "cc5521ba6549457fa94b2fd31d34260e" member_type: VOTER last_known_addr { host: "127.9.178.130" port: 42743 } } peers { permanent_uuid: "f25e4fe0a11444a4a244162e2a6044cb" member_type: VOTER last_known_addr { host: "127.9.178.131" port: 37543 } } }
16:11:22.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:22.812346 10500 consensus_peers.cc:487] T 574390c2aab3431a99507b85e30e1b7b P e257bad618b34cb98a4da61a671d08f2 -> Peer f25e4fe0a11444a4a244162e2a6044cb (127.9.178.131:37543): Couldn't send request to peer f25e4fe0a11444a4a244162e2a6044cb. Status: Network error: Client connection negotiation failed: client connection to 127.9.178.131:37543: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
16:11:23.132 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 574390c2aab3431a99507b85e30e1b7b for table 'org.apache.kudu.client.TestClientFailoverSupport-KILL' with partition [<start>, <end>)
16:11:23.133 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=574390c2aab3431a99507b85e30e1b7b@[cc5521ba6549457fa94b2fd31d34260e(127.9.178.130:42743),e257bad618b34cb98a4da61a671d08f2(127.9.178.129:38963)[L],f25e4fe0a11444a4a244162e2a6044cb(127.9.178.131:37543)]}]
16:11:23.134 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=574390c2aab3431a99507b85e30e1b7b, attempt=10, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=2262), Traces: [0ms] sending RPC to server f25e4fe0a11444a4a244162e2a6044cb, [3ms] received response from server f25e4fe0a11444a4a244162e2a6044cb: Network error: Failed to connect to peer f25e4fe0a11444a4a244162e2a6044cb(127.9.178.131:37543): Connection refused: /127.9.178.131:37543, [3ms] delaying RPC due to: Network error: Failed to connect to peer f25e4fe0a11444a4a244162e2a6044cb(127.9.178.131:37543): Connection refused: /127.9.178.131:37543, [17ms] refreshing cache from master, [17ms] Sub RPC GetTableLocations: sending RPC to server master-127.9.178.188:43025, [20ms] Sub RPC GetTableLocations: received response from server master-127.9.178.188:43025: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [20ms] Sub RPC GetTableLocations: delaying RPC due to: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [37ms] Sub RPC GetTableLocations: refreshing cache from master, [37ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.190:45893, [37ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.189:44571, [37ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.188:43025, [41ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.189:44571: OK, [41ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.190:45893: OK, [42ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.188:43025: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [45ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [57ms] Sub RPC GetTableLocations: refreshing cache from master, [57ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.190:45893, [57ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.189:44571, [57ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.188:43025, [60ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.188:43025: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [61ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.190:45893: OK, [61ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.189:44571: OK, [62ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [77ms] Sub RPC GetTableLocations: refreshing cache from master, [77ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.190:45893, [77ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.189:44571, [78ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.188:43025, [80ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.188:43025: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [81ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.189:44571: OK, [81ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.190:45893: OK, [82ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [97ms] Sub RPC GetTableLocations: refreshing cache from master, [97ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.190:45893, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.189:44571, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.188:43025, [101ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.190:45893: OK, [101ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.189:44571: OK, [102ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.188:43025: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [102ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [117ms] Sub RPC GetTableLocations: refreshing cache from master, [118ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.190:45893, [118ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.189:44571, [118ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.188:43025, [120ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.188:43025: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [121ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.189:44571: OK, [121ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.190:45893: OK, [121ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [197ms] Sub RPC GetTableLocations: refreshing cache from master, [197ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.190:45893, [198ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.189:44571, [198ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.188:43025, [201ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.190:45893: OK, [201ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.188:43025: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [202ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.189:44571: OK, [202ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [237ms] Sub RPC GetTableLocations: refreshing cache from master, [237ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.190:45893, [237ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.189:44571, [237ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.188:43025, [240ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.188:43025: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [240ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.189:44571: OK, [241ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.190:45893: OK, [241ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [358ms] Sub RPC GetTableLocations: refreshing cache from master, [358ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.190:45893, [358ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.189:44571, [359ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.188:43025, [362ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.189:44571: OK, [363ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.188:43025: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [363ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.190:45893: OK, [364ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [877ms] Sub RPC GetTableLocations: refreshing cache from master, [877ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.190:45893, [877ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.189:44571, [878ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.188:43025, [880ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.188:43025: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [881ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.190:45893: OK, [881ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.189:44571: OK, [881ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.9.178.190:45893,127.9.178.189:44571,127.9.178.188:43025) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [1757ms] Sub RPC GetTableLocations: refreshing cache from master, [1757ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.190:45893, [1758ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.189:44571, [1758ms] Sub RPC ConnectToMaster: sending RPC to server master-127.9.178.188:43025, [1762ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.189:44571: OK, [1762ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.190:45893: OK, [1763ms] Sub RPC ConnectToMaster: received response from server master-127.9.178.188:43025: Network error: Failed to connect to peer master-127.9.178.188:43025(127.9.178.188:43025): Connection refused: /127.9.178.188:43025, [1767ms] Sub RPC GetTableLocations: sending RPC to server master-127.9.178.190:45893, [1772ms] Sub RPC GetTableLocations: received response from server master-127.9.178.190:45893: OK, [1778ms] sending RPC to server f25e4fe0a11444a4a244162e2a6044cb, [1779ms] received response from server f25e4fe0a11444a4a244162e2a6044cb: Network error: Failed to connect to peer f25e4fe0a11444a4a244162e2a6044cb(127.9.178.131:37543): Connection refused: /127.9.178.131:37543, [1779ms] delaying RPC due to: Network error: Failed to connect to peer f25e4fe0a11444a4a244162e2a6044cb(127.9.178.131:37543): Connection refused: /127.9.178.131:37543, [1797ms] refreshing cache from master, [1798ms] Sub RPC GetTableLocations: sending RPC to server master-127.9.178.190:45893, [1801ms] Sub RPC GetTableLocations: received response from server master-127.9.178.190:45893: OK, [1803ms] sending RPC to server f25e4fe0a11444a4a244162e2a6044cb, [1805ms] received response from server f25e4fe0a11444a4a244162e2a6044cb: Network error: Failed to connect to peer f25e4fe0a11444a4a244162e2a6044cb(127.9.178.131:37543): Connection refused: /127.9.178.131:37543, [1806ms] delaying RPC due to: Network error: Failed to connect to peer f25e4fe0a11444a4a244162e2a6044cb(127.9.178.131:37543): Connection refused: /127.9.178.131:37543, [1817ms] refreshing cache from master, [1817ms] Sub RPC GetTableLocations: sending RPC to server master-127.9.178.190:45893, [1820ms] Sub RPC GetTableLocations: received response from server master-127.9.178.190:45893: OK, [1824ms] too many traces: truncated at 100 traces, deferred=Deferred@536183875(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$82/142867575@1f9b816e -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@650588713 after retry RPC@1056387079) -> (continuation of Deferred@1659669439 after retry RPC@1704782061) -> (continuation of Deferred@192505807 after retry RPC@2024332538) -> (continuation of Deferred@1882207601 after retry RPC@1312909441), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@4a8d34f3 -> wakeup thread Time-limited test -> (continuation of Deferred@650588713 after retry RPC@1056387079) -> (continuation of Deferred@1659669439 after retry RPC@1704782061) -> (continuation of Deferred@192505807 after retry RPC@2024332538) -> (continuation of Deferred@1882207601 after retry RPC@1312909441))) after lookup
16:11:23.136 [DEBUG - kudu-nio-0] (Connection.java:748) [peer e257bad618b34cb98a4da61a671d08f2(127.9.178.129:38963)] connecting to peer
16:11:23.137 [DEBUG - kudu-nio-0] (Connection.java:757) [peer e257bad618b34cb98a4da61a671d08f2(127.9.178.129:38963)] Successfully connected to peer
16:11:23.165 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x50f3c3c0, L:/127.0.0.1:46746 - R:/127.9.178.129:38963] using TOKEN/null
16:11:23.323 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1374) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 20 rows, more = false) for scanner KuduScanner(table=org.apache.kudu.client.TestClientFailoverSupport-KILL, tablet=574390c2aab3431a99507b85e30e1b7b, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
16:11:23.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:23.329159 10001 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:53676:
16:11:23.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "org.apache.kudu.client.TestClientFailoverSupport-KILL" }
16:11:23.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:23.329914 10001 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:53676:
16:11:23.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "org.apache.kudu.client.TestClientFailoverSupport-KILL" }
16:11:23.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:23.359434 10001 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 47b27270b60a4fe2af1876eb689f7771: Sending DeleteTablet for 3 replicas of tablet 574390c2aab3431a99507b85e30e1b7b
16:11:23.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:23.390691 10579 tablet_service.cc:1514] Processing DeleteTablet for tablet 574390c2aab3431a99507b85e30e1b7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:11:23 UTC) from {username='slave'} at 127.0.0.1:46750
16:11:23.393 [DEBUG - main] (Connection.java:575) [peer f25e4fe0a11444a4a244162e2a6044cb(127.9.178.131:37543)] disconnecting while in state TERMINATED
16:11:23.395 [DEBUG - main] (Connection.java:575) [peer master-127.9.178.189:44571(127.9.178.189:44571)] disconnecting while in state READY
16:11:23.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:23.400866  9977 catalog_manager.cc:4584] TS f25e4fe0a11444a4a244162e2a6044cb (127.9.178.131:37543): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 574390c2aab3431a99507b85e30e1b7b: Network error: Client connection negotiation failed: client connection to 127.9.178.131:37543: connect: Connection refused (error 111)
16:11:23.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:23.407016 10813 tablet_service.cc:1514] Processing DeleteTablet for tablet 574390c2aab3431a99507b85e30e1b7b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:11:23 UTC) from {username='slave'} at 127.0.0.1:43710
16:11:23.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:23.410171 11329 tablet_replica.cc:330] T 574390c2aab3431a99507b85e30e1b7b P e257bad618b34cb98a4da61a671d08f2: stopping tablet replica
16:11:23.437 [DEBUG - main] (Connection.java:575) [peer master-127.9.178.188:43025(127.9.178.188:43025)] disconnecting while in state TERMINATED
16:11:23.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:23.411077 11329 raft_consensus.cc:2229] T 574390c2aab3431a99507b85e30e1b7b P e257bad618b34cb98a4da61a671d08f2 [term 2 LEADER]: Raft consensus shutting down.
16:11:23.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:23.417186 11329 raft_consensus.cc:2258] T 574390c2aab3431a99507b85e30e1b7b P e257bad618b34cb98a4da61a671d08f2 [term 2 FOLLOWER]: Raft consensus is shut down!
16:11:23.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:23.418465 11331 tablet_replica.cc:330] T 574390c2aab3431a99507b85e30e1b7b P cc5521ba6549457fa94b2fd31d34260e: stopping tablet replica
16:11:23.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:23.419193 11331 raft_consensus.cc:2229] T 574390c2aab3431a99507b85e30e1b7b P cc5521ba6549457fa94b2fd31d34260e [term 2 FOLLOWER]: Raft consensus shutting down.
16:11:23.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:23.420192 11331 raft_consensus.cc:2258] T 574390c2aab3431a99507b85e30e1b7b P cc5521ba6549457fa94b2fd31d34260e [term 2 FOLLOWER]: Raft consensus is shut down!
16:11:23.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:23.420706 11329 ts_tablet_manager.cc:1905] T 574390c2aab3431a99507b85e30e1b7b P e257bad618b34cb98a4da61a671d08f2: Deleting tablet data with delete state TABLET_DATA_DELETED
16:11:23.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:23.423100 11331 ts_tablet_manager.cc:1905] T 574390c2aab3431a99507b85e30e1b7b P cc5521ba6549457fa94b2fd31d34260e: Deleting tablet data with delete state TABLET_DATA_DELETED
16:11:23.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:23.436299 11331 ts_tablet_manager.cc:1918] T 574390c2aab3431a99507b85e30e1b7b P cc5521ba6549457fa94b2fd31d34260e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.22
16:11:23.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:23.436655 11331 log.cc:1196] T 574390c2aab3431a99507b85e30e1b7b P cc5521ba6549457fa94b2fd31d34260e: Deleting WAL directory at /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/ts-1/wal/wals/574390c2aab3431a99507b85e30e1b7b
16:11:23.437 [DEBUG - main] (Connection.java:575) [peer master-127.9.178.190:45893(127.9.178.190:45893)] disconnecting while in state READY
16:11:23.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:23.437410 11331 ts_tablet_manager.cc:1939] T 574390c2aab3431a99507b85e30e1b7b P cc5521ba6549457fa94b2fd31d34260e: Deleting consensus metadata
16:11:23.438 [DEBUG - main] (Connection.java:575) [peer e257bad618b34cb98a4da61a671d08f2(127.9.178.129:38963)] disconnecting while in state READY
16:11:23.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:23.440455  9977 catalog_manager.cc:4841] TS cc5521ba6549457fa94b2fd31d34260e (127.9.178.130:42743): tablet 574390c2aab3431a99507b85e30e1b7b (table org.apache.kudu.client.TestClientFailoverSupport-KILL [id=d686692d2b174868911afdafc5f7407d]) successfully deleted
16:11:23.445 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.9.178.189:44571(127.9.178.189:44571)] handling channelInactive
16:11:23.446 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.9.178.189:44571(127.9.178.189:44571)] cleaning up while in state READY due to: connection closed
16:11:23.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:23.445928 11329 ts_tablet_manager.cc:1918] T 574390c2aab3431a99507b85e30e1b7b P e257bad618b34cb98a4da61a671d08f2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.22
16:11:23.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:23.446381 11329 log.cc:1196] T 574390c2aab3431a99507b85e30e1b7b P e257bad618b34cb98a4da61a671d08f2: Deleting WAL directory at /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster3171090096361236812/ts-0/wal/wals/574390c2aab3431a99507b85e30e1b7b
16:11:23.447 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
16:11:23.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:23.447309 11329 ts_tablet_manager.cc:1939] T 574390c2aab3431a99507b85e30e1b7b P e257bad618b34cb98a4da61a671d08f2: Deleting consensus metadata
16:11:23.448 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.9.178.190:45893(127.9.178.190:45893)] handling channelInactive
16:11:23.448 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.9.178.190:45893(127.9.178.190:45893)] cleaning up while in state READY due to: connection closed
16:11:23.449 [DEBUG - kudu-nio-0] (Connection.java:239) [peer e257bad618b34cb98a4da61a671d08f2(127.9.178.129:38963)] handling channelInactive
16:11:23.449 [DEBUG - kudu-nio-0] (Connection.java:709) [peer e257bad618b34cb98a4da61a671d08f2(127.9.178.129:38963)] cleaning up while in state READY due to: connection closed
16:11:23.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:23.450551  9930 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvrVe1g/build/tsan/bin/kudu with pid 10430
16:11:23.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:23.450556  9977 catalog_manager.cc:4841] TS e257bad618b34cb98a4da61a671d08f2 (127.9.178.129:38963): tablet 574390c2aab3431a99507b85e30e1b7b (table org.apache.kudu.client.TestClientFailoverSupport-KILL [id=d686692d2b174868911afdafc5f7407d]) successfully deleted
16:11:23.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:23.484345  9930 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvrVe1g/build/tsan/bin/kudu with pid 10707
16:11:23.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:23.515728  9930 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvrVe1g/build/tsan/bin/kudu with pid 9947
16:11:23.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:23.544970  9930 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvrVe1g/build/tsan/bin/kudu with pid 10075
16:11:24.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-08-11T16:11:24Z chronyd exiting
.16:11:25.929 [INFO - main] (RandomUtils.java:49) Using random seed: 1786464685929
16:11:25.932 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
16:11:25.933 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
16:11:25.933 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskvrVe1g/test-tmp
16:11:25.933 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
16:11:25.933 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskvrVe1g/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
16:11:25.939 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

16:11:26.244 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
16:11:26.244 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

16:11:26.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:26.247633 11336 mini_oidc.cc:152] Starting JWKS server
16:11:26.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:26.251590 11336 webserver.cc:460] Webserver started at http://127.0.0.1:35189/ using document root <none> and password file <none>
16:11:26.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:26.252127 11336 mini_oidc.cc:189] Starting OIDC Discovery server
16:11:26.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:26.253984 11336 webserver.cc:460] Webserver started at http://127.0.0.1:36501/ using document root <none> and password file <none>
16:11:26.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-08-11T16:11:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
16:11:26.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-08-11T16:11:26Z Disabled control of system clock
16:11:26.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:26.305078 11336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvrVe1g/build/tsan/bin/kudu
16:11:26.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskvrVe1g/build/tsan/bin/kudu
16:11:26.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/master-0/wal
16:11:26.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/master-0/data
16:11:26.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
16:11:26.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
16:11:26.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
16:11:26.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
16:11:26.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
16:11:26.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
16:11:26.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/master-0/logs
16:11:26.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/master-0/data/info.pb
16:11:26.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
16:11:26.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
16:11:26.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
16:11:26.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
16:11:26.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
16:11:26.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
16:11:26.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
16:11:26.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
16:11:26.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
16:11:26.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
16:11:26.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
16:11:26.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
16:11:26.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.18.62:46141
16:11:26.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.18.62
16:11:26.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
16:11:26.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.18.20:41183
16:11:26.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
16:11:26.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
16:11:26.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
16:11:26.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
16:11:26.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.11.18.62:46141,127.11.18.61:38211,127.11.18.60:46107
16:11:26.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
16:11:26.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:35189/jwks.json with env {}
16:11:26.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:26.589299 11360 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
16:11:26.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:26.589928 11360 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
16:11:26.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:26.590457 11360 flags.cc:425] Enabled unsafe flag: --never_fsync=true
16:11:26.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:26.619997 11360 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
16:11:26.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:26.620251 11360 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
16:11:26.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:26.620436 11360 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
16:11:26.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:26.620620 11360 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
16:11:26.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:26.620803 11360 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
16:11:26.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:26.620950 11360 flags.cc:425] Enabled experimental flag: --jwks_url=http://localhost:35189/jwks.json
16:11:26.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:26.653882 11360 master_runner.cc:386] Master server non-default flags:
16:11:26.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
16:11:26.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.18.20:41183
16:11:26.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
16:11:26.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
16:11:26.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/master-0/data
16:11:26.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/master-0/wal
16:11:26.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
16:11:26.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.11.18.62:46141,127.11.18.61:38211,127.11.18.60:46107
16:11:26.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
16:11:26.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
16:11:26.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
16:11:26.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.18.62:46141
16:11:26.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
16:11:26.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
16:11:26.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
16:11:26.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:35189/jwks.json
16:11:26.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
16:11:26.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
16:11:26.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/master-0/data/info.pb
16:11:26.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.18.62
16:11:26.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
16:11:26.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
16:11:26.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
16:11:26.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
16:11:26.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
16:11:26.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
16:11:26.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/master-0/logs
16:11:26.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
16:11:26.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
16:11:26.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
16:11:26.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
16:11:26.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.18.0-SNAPSHOT
16:11:26.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
16:11:26.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
16:11:26.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by systest at 11 Aug 2026 15:12:52 UTC on ccycloud.quasar-tzrfpd.root.comops.site
16:11:26.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 4580143
16:11:26.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
16:11:26.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:26.655189 11360 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
16:11:26.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:26.657251 11360 file_cache.cc:493] Constructed file cache file cache with capacity 419430
16:11:26.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:26.675225 11370 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
16:11:27.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:26.675283 11369 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
16:11:27.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:26.676436 11360 server_base.cc:1034] running on GCE node
16:11:27.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:26.676558 11374 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
16:11:27.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:27.776104 11360 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
16:11:27.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:27.778885 11360 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
16:11:27.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:27.780242 11360 hybrid_clock.cc:648] HybridClock initialized: now 1786464687780200 us; error 55 us; skew 500 ppm
16:11:27.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:27.781109 11360 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
16:11:27.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:27.790151 11360 webserver.cc:460] Webserver started at http://127.11.18.62:43521/ using document root <none> and password file <none>
16:11:27.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:27.791078 11360 fs_manager.cc:359] Metadata directory not provided
16:11:27.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:27.791285 11360 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
16:11:27.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:27.791824 11360 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
16:11:27.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:27.796713 11360 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/master-0/data/instance:
16:11:27.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6e59c875afec4be8af316d3aa9f32b8e"
16:11:27.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-11 16:11:27 on dist-test-slave-nj21"
16:11:27.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:27.797878 11360 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/master-0/wal/instance:
16:11:27.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6e59c875afec4be8af316d3aa9f32b8e"
16:11:27.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-11 16:11:27 on dist-test-slave-nj21"
16:11:27.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:27.804759 11360 fs_manager.cc:691] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.001s
16:11:27.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:27.810134 11383 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
16:11:27.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:27.811165 11360 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
16:11:27.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:27.811441 11360 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/master-0/data,/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/master-0/wal
16:11:27.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6e59c875afec4be8af316d3aa9f32b8e"
16:11:27.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-11 16:11:27 on dist-test-slave-nj21"
16:11:27.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:27.811756 11360 fs_report.cc:383] FS layout report
16:11:27.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
16:11:27.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/master-0/wal
16:11:27.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/master-0/wal
16:11:27.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/master-0/data/data
16:11:27.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
16:11:27.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
16:11:27.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
16:11:27.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
16:11:27.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
16:11:27.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
16:11:27.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
16:11:27.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
16:11:27.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
16:11:27.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
16:11:27.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
16:11:27.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:27.850485 11360 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
16:11:27.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:27.851876 11360 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
16:11:27.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:27.852270 11360 kserver.cc:163] Server-wide thread pool size limit: 3276
16:11:27.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:27.918395 11360 rpc_server.cc:307] RPC server started. Bound to: 127.11.18.62:46141
16:11:27.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:27.918497 11471 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.18.62:46141 every 8 connection(s)
16:11:27.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:27.921083 11360 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/master-0/data/info.pb
16:11:27.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:27.925973 11472 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
16:11:27.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:27.928392 11336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvrVe1g/build/tsan/bin/kudu as pid 11360
16:11:27.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:27.928922 11336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/master-0/wal/instance
16:11:27.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:27.933845 11336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvrVe1g/build/tsan/bin/kudu
16:11:27.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskvrVe1g/build/tsan/bin/kudu
16:11:27.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/master-1/wal
16:11:27.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/master-1/data
16:11:27.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
16:11:27.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
16:11:27.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
16:11:27.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
16:11:27.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
16:11:27.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
16:11:27.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/master-1/logs
16:11:27.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/master-1/data/info.pb
16:11:27.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
16:11:27.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
16:11:27.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
16:11:27.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
16:11:27.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
16:11:27.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
16:11:27.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
16:11:27.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
16:11:27.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
16:11:27.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
16:11:27.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
16:11:27.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
16:11:27.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.18.61:38211
16:11:27.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.18.61
16:11:27.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
16:11:27.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.18.20:41183
16:11:27.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
16:11:27.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
16:11:27.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
16:11:27.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
16:11:27.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.11.18.62:46141,127.11.18.61:38211,127.11.18.60:46107
16:11:27.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
16:11:27.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:35189/jwks.json with env {}
16:11:27.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:27.941282 11472 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.18.62" port: 46141 } has no permanent_uuid. Determining permanent_uuid...
16:11:27.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:27.972352 11472 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.18.61" port: 38211 } has no permanent_uuid. Determining permanent_uuid...
16:11:27.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:27.974608 11387 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.18.61:38211: connect: Connection refused (error 111)
16:11:27.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:27.978382 11472 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.18.61:38211: Network error: Client connection negotiation failed: client connection to 127.11.18.61:38211: connect: Connection refused (error 111)
16:11:28.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:28.027788 11472 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.18.61" port: 38211 } attempt: 1
16:11:28.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:28.031348 11472 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.18.61:38211: Network error: Client connection negotiation failed: client connection to 127.11.18.61:38211: connect: Connection refused (error 111)
16:11:28.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:28.099743 11472 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.18.61" port: 38211 } attempt: 2
16:11:28.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:28.103358 11472 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.18.61:38211: Network error: Client connection negotiation failed: client connection to 127.11.18.61:38211: connect: Connection refused (error 111)
16:11:28.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:28.194706 11472 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.18.61" port: 38211 } attempt: 3
16:11:28.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:28.198683 11472 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.18.61:38211: Network error: Client connection negotiation failed: client connection to 127.11.18.61:38211: connect: Connection refused (error 111)
16:11:28.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:28.233964 11478 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
16:11:28.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:28.234535 11478 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
16:11:28.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:28.235024 11478 flags.cc:425] Enabled unsafe flag: --never_fsync=true
16:11:28.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:28.264683 11478 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
16:11:28.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:28.265033 11478 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
16:11:28.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:28.265239 11478 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
16:11:28.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:28.265426 11478 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
16:11:28.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:28.265609 11478 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
16:11:28.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:28.265744 11478 flags.cc:425] Enabled experimental flag: --jwks_url=http://localhost:35189/jwks.json
16:11:28.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:28.299793 11478 master_runner.cc:386] Master server non-default flags:
16:11:28.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
16:11:28.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.18.20:41183
16:11:28.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
16:11:28.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
16:11:28.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/master-1/data
16:11:28.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/master-1/wal
16:11:28.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
16:11:28.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.11.18.62:46141,127.11.18.61:38211,127.11.18.60:46107
16:11:28.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
16:11:28.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
16:11:28.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
16:11:28.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.18.61:38211
16:11:28.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
16:11:28.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
16:11:28.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
16:11:28.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:35189/jwks.json
16:11:28.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
16:11:28.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
16:11:28.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/master-1/data/info.pb
16:11:28.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.18.61
16:11:28.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
16:11:28.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
16:11:28.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
16:11:28.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
16:11:28.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
16:11:28.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
16:11:28.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/master-1/logs
16:11:28.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
16:11:28.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
16:11:28.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
16:11:28.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
16:11:28.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.18.0-SNAPSHOT
16:11:28.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
16:11:28.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
16:11:28.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by systest at 11 Aug 2026 15:12:52 UTC on ccycloud.quasar-tzrfpd.root.comops.site
16:11:28.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 4580143
16:11:28.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
16:11:28.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:28.300983 11478 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
16:11:28.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:28.302453 11478 file_cache.cc:493] Constructed file cache file cache with capacity 419430
16:11:28.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:28.320760 11493 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
16:11:28.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:28.342120 11472 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.18.61" port: 38211 } attempt: 4
16:11:28.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:28.345727 11472 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.18.61:38211: Network error: Client connection negotiation failed: client connection to 127.11.18.61:38211: connect: Connection refused (error 111)
16:11:28.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:28.645216 11472 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.18.61" port: 38211 } attempt: 5
16:11:28.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:28.649125 11472 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.18.61:38211: Network error: Client connection negotiation failed: client connection to 127.11.18.61:38211: connect: Connection refused (error 111)
16:11:29.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:29.196574 11472 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.18.61" port: 38211 } attempt: 6
16:11:29.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:29.205806 11472 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.18.61:38211: Network error: Client connection negotiation failed: client connection to 127.11.18.61:38211: connect: Connection refused (error 111)
16:11:29.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:28.321031 11496 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
16:11:29.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:28.321384 11492 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
16:11:29.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:28.321997 11478 server_base.cc:1034] running on GCE node
16:11:29.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:29.410084 11478 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
16:11:29.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:29.412945 11478 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
16:11:29.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:29.414348 11478 hybrid_clock.cc:648] HybridClock initialized: now 1786464689414314 us; error 49 us; skew 500 ppm
16:11:29.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:29.415127 11478 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
16:11:29.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:29.421615 11478 webserver.cc:460] Webserver started at http://127.11.18.61:38459/ using document root <none> and password file <none>
16:11:29.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:29.422457 11478 fs_manager.cc:359] Metadata directory not provided
16:11:29.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:29.422640 11478 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
16:11:29.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:29.423014 11478 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
16:11:29.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:29.427661 11478 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/master-1/data/instance:
16:11:29.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3b0580d0f39846b292086b9da681c79f"
16:11:29.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-11 16:11:29 on dist-test-slave-nj21"
16:11:29.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:29.428727 11478 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/master-1/wal/instance:
16:11:29.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3b0580d0f39846b292086b9da681c79f"
16:11:29.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-11 16:11:29 on dist-test-slave-nj21"
16:11:29.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:29.435570 11478 fs_manager.cc:691] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.000s
16:11:29.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:29.440599 11511 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
16:11:29.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:29.441546 11478 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.002s
16:11:29.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:29.441812 11478 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/master-1/data,/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/master-1/wal
16:11:29.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3b0580d0f39846b292086b9da681c79f"
16:11:29.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-11 16:11:29 on dist-test-slave-nj21"
16:11:29.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:29.442090 11478 fs_report.cc:383] FS layout report
16:11:29.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
16:11:29.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/master-1/wal
16:11:29.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/master-1/wal
16:11:29.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/master-1/data/data
16:11:29.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
16:11:29.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
16:11:29.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
16:11:29.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
16:11:29.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
16:11:29.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
16:11:29.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
16:11:29.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
16:11:29.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
16:11:29.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
16:11:29.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
16:11:29.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:29.478722 11478 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
16:11:29.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:29.480125 11478 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
16:11:29.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:29.480521 11478 kserver.cc:163] Server-wide thread pool size limit: 3276
16:11:29.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:29.546940 11478 rpc_server.cc:307] RPC server started. Bound to: 127.11.18.61:38211
16:11:29.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:29.547031 11588 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.18.61:38211 every 8 connection(s)
16:11:29.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:29.549459 11478 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/master-1/data/info.pb
16:11:29.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:29.553791 11336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvrVe1g/build/tsan/bin/kudu as pid 11478
16:11:29.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:29.554184 11336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/master-1/wal/instance
16:11:29.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:29.554205 11589 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
16:11:29.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:29.556273 11336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvrVe1g/build/tsan/bin/kudu
16:11:29.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskvrVe1g/build/tsan/bin/kudu
16:11:29.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/master-2/wal
16:11:29.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/master-2/data
16:11:29.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
16:11:29.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
16:11:29.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
16:11:29.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
16:11:29.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
16:11:29.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
16:11:29.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/master-2/logs
16:11:29.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/master-2/data/info.pb
16:11:29.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
16:11:29.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
16:11:29.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
16:11:29.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
16:11:29.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
16:11:29.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
16:11:29.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
16:11:29.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
16:11:29.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
16:11:29.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
16:11:29.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
16:11:29.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
16:11:29.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.18.60:46107
16:11:29.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.18.60
16:11:29.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
16:11:29.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.18.20:41183
16:11:29.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
16:11:29.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
16:11:29.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
16:11:29.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
16:11:29.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.11.18.62:46141,127.11.18.61:38211,127.11.18.60:46107
16:11:29.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
16:11:29.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:35189/jwks.json with env {}
16:11:29.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:29.565002 11589 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.18.62" port: 46141 } has no permanent_uuid. Determining permanent_uuid...
16:11:29.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:29.586133 11589 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.18.61" port: 38211 } has no permanent_uuid. Determining permanent_uuid...
16:11:29.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:29.601547 11589 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.18.60" port: 46107 } has no permanent_uuid. Determining permanent_uuid...
16:11:29.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:29.603660 11517 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.18.60:46107: connect: Connection refused (error 111)
16:11:29.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:29.607362 11589 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.18.60:46107: Network error: Client connection negotiation failed: client connection to 127.11.18.60:46107: connect: Connection refused (error 111)
16:11:29.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:29.656793 11589 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.18.60" port: 46107 } attempt: 1
16:11:29.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:29.660408 11589 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.18.60:46107: Network error: Client connection negotiation failed: client connection to 127.11.18.60:46107: connect: Connection refused (error 111)
16:11:29.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:29.728793 11589 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.18.60" port: 46107 } attempt: 2
16:11:29.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:29.732599 11589 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.18.60:46107: Network error: Client connection negotiation failed: client connection to 127.11.18.60:46107: connect: Connection refused (error 111)
16:11:29.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:29.823973 11589 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.18.60" port: 46107 } attempt: 3
16:11:29.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:29.827342 11589 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.18.60:46107: Network error: Client connection negotiation failed: client connection to 127.11.18.60:46107: connect: Connection refused (error 111)
16:11:29.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:29.857417 11593 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
16:11:29.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:29.857946 11593 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
16:11:29.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:29.858405 11593 flags.cc:425] Enabled unsafe flag: --never_fsync=true
16:11:29.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:29.887931 11593 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
16:11:29.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:29.888185 11593 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
16:11:29.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:29.888378 11593 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
16:11:29.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:29.888561 11593 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
16:11:29.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:29.888739 11593 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
16:11:29.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:29.888882 11593 flags.cc:425] Enabled experimental flag: --jwks_url=http://localhost:35189/jwks.json
16:11:29.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:29.922230 11593 master_runner.cc:386] Master server non-default flags:
16:11:29.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
16:11:29.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.18.20:41183
16:11:29.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
16:11:29.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
16:11:29.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/master-2/data
16:11:29.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/master-2/wal
16:11:29.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
16:11:29.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.11.18.62:46141,127.11.18.61:38211,127.11.18.60:46107
16:11:29.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
16:11:29.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
16:11:29.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
16:11:29.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.18.60:46107
16:11:29.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
16:11:29.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
16:11:29.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
16:11:29.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:35189/jwks.json
16:11:29.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
16:11:29.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
16:11:29.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/master-2/data/info.pb
16:11:29.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.18.60
16:11:29.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
16:11:29.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
16:11:29.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
16:11:29.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
16:11:29.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
16:11:29.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
16:11:29.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/master-2/logs
16:11:29.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
16:11:29.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
16:11:29.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
16:11:29.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
16:11:29.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.18.0-SNAPSHOT
16:11:29.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
16:11:29.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
16:11:29.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by systest at 11 Aug 2026 15:12:52 UTC on ccycloud.quasar-tzrfpd.root.comops.site
16:11:29.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 4580143
16:11:29.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
16:11:29.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:29.923401 11593 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
16:11:29.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:29.924932 11593 file_cache.cc:493] Constructed file cache file cache with capacity 419430
16:11:29.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:29.970755 11589 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.18.60" port: 46107 } attempt: 4
16:11:29.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:29.974382 11589 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.18.60:46107: Network error: Client connection negotiation failed: client connection to 127.11.18.60:46107: connect: Connection refused (error 111)
16:11:30.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:30.266242 11472 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.18.61" port: 38211 } attempt: 7
16:11:30.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:30.273727 11589 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.18.60" port: 46107 } attempt: 5
16:11:30.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:30.277710 11589 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.18.60:46107: Network error: Client connection negotiation failed: client connection to 127.11.18.60:46107: connect: Connection refused (error 111)
16:11:30.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:30.279194 11472 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.18.60" port: 46107 } has no permanent_uuid. Determining permanent_uuid...
16:11:30.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:30.284204 11472 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.18.60:46107: Network error: Client connection negotiation failed: client connection to 127.11.18.60:46107: connect: Connection refused (error 111)
16:11:30.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:30.342696 11472 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.18.60" port: 46107 } attempt: 1
16:11:30.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:30.346335 11472 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.18.60:46107: Network error: Client connection negotiation failed: client connection to 127.11.18.60:46107: connect: Connection refused (error 111)
16:11:30.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:30.427749 11472 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.18.60" port: 46107 } attempt: 2
16:11:30.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:30.431228 11472 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.18.60:46107: Network error: Client connection negotiation failed: client connection to 127.11.18.60:46107: connect: Connection refused (error 111)
16:11:30.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:30.516731 11472 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.18.60" port: 46107 } attempt: 3
16:11:30.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:30.520728 11472 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.18.60:46107: Network error: Client connection negotiation failed: client connection to 127.11.18.60:46107: connect: Connection refused (error 111)
16:11:30.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:30.661110 11472 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.18.60" port: 46107 } attempt: 4
16:11:30.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:30.664565 11472 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.18.60:46107: Network error: Client connection negotiation failed: client connection to 127.11.18.60:46107: connect: Connection refused (error 111)
16:11:30.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:30.825114 11589 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.18.60" port: 46107 } attempt: 6
16:11:30.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:30.831046 11589 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.18.60:46107: Network error: Client connection negotiation failed: client connection to 127.11.18.60:46107: connect: Connection refused (error 111)
16:11:30.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:30.948073 11472 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.18.60" port: 46107 } attempt: 5
16:11:30.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:30.951958 11472 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.11.18.60:46107: Network error: Client connection negotiation failed: client connection to 127.11.18.60:46107: connect: Connection refused (error 111)
16:11:31.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:29.942440 11610 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
16:11:31.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:29.942402 11609 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
16:11:31.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:29.942744 11614 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
16:11:31.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:29.943746 11593 server_base.cc:1034] running on GCE node
16:11:31.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.034435 11593 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
16:11:31.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.037062 11593 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
16:11:31.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.038383 11593 hybrid_clock.cc:648] HybridClock initialized: now 1786464691038359 us; error 47 us; skew 500 ppm
16:11:31.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.039163 11593 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
16:11:31.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.045265 11593 webserver.cc:460] Webserver started at http://127.11.18.60:35761/ using document root <none> and password file <none>
16:11:31.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.046145 11593 fs_manager.cc:359] Metadata directory not provided
16:11:31.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.046329 11593 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
16:11:31.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.046710 11593 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
16:11:31.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.051462 11593 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/master-2/data/instance:
16:11:31.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "357246e67cbb426b81f94ecca052ca05"
16:11:31.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-11 16:11:31 on dist-test-slave-nj21"
16:11:31.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.052529 11593 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/master-2/wal/instance:
16:11:31.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "357246e67cbb426b81f94ecca052ca05"
16:11:31.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-11 16:11:31 on dist-test-slave-nj21"
16:11:31.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.059306 11593 fs_manager.cc:691] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.000s
16:11:31.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.064623 11629 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
16:11:31.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.065657 11593 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.002s
16:11:31.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.065934 11593 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/master-2/data,/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/master-2/wal
16:11:31.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "357246e67cbb426b81f94ecca052ca05"
16:11:31.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-11 16:11:31 on dist-test-slave-nj21"
16:11:31.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.066231 11593 fs_report.cc:383] FS layout report
16:11:31.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
16:11:31.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/master-2/wal
16:11:31.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/master-2/wal
16:11:31.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/master-2/data/data
16:11:31.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
16:11:31.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
16:11:31.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
16:11:31.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
16:11:31.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
16:11:31.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
16:11:31.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
16:11:31.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
16:11:31.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
16:11:31.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
16:11:31.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
16:11:31.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.095796 11593 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
16:11:31.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.097235 11593 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
16:11:31.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.097626 11593 kserver.cc:163] Server-wide thread pool size limit: 3276
16:11:31.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.164255 11593 rpc_server.cc:307] RPC server started. Bound to: 127.11.18.60:46107
16:11:31.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.164364 11713 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.18.60:46107 every 8 connection(s)
16:11:31.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.166796 11593 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/master-2/data/info.pb
16:11:31.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.167784 11336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvrVe1g/build/tsan/bin/kudu as pid 11593
16:11:31.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.168270 11336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/master-2/wal/instance
16:11:31.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.172494 11714 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
16:11:31.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.188309 11714 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.18.62" port: 46141 } has no permanent_uuid. Determining permanent_uuid...
16:11:31.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.213956 11714 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.18.61" port: 38211 } has no permanent_uuid. Determining permanent_uuid...
16:11:31.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.225136 11714 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.18.60" port: 46107 } has no permanent_uuid. Determining permanent_uuid...
16:11:31.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.241585 11714 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 357246e67cbb426b81f94ecca052ca05: Bootstrap starting.
16:11:31.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.246834 11714 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 357246e67cbb426b81f94ecca052ca05: Neither blocks nor log segments found. Creating new log.
16:11:31.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.249063 11714 log.cc:824] T 00000000000000000000000000000000 P 357246e67cbb426b81f94ecca052ca05: Log is configured to *not* fsync() on all Append() calls
16:11:31.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.253129 11714 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 357246e67cbb426b81f94ecca052ca05: No bootstrap required, opened a new log
16:11:31.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.272505 11714 raft_consensus.cc:348] T 00000000000000000000000000000000 P 357246e67cbb426b81f94ecca052ca05 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e59c875afec4be8af316d3aa9f32b8e" member_type: VOTER last_known_addr { host: "127.11.18.62" port: 46141 } } peers { permanent_uuid: "3b0580d0f39846b292086b9da681c79f" member_type: VOTER last_known_addr { host: "127.11.18.61" port: 38211 } } peers { permanent_uuid: "357246e67cbb426b81f94ecca052ca05" member_type: VOTER last_known_addr { host: "127.11.18.60" port: 46107 } }
16:11:31.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.273074 11714 raft_consensus.cc:374] T 00000000000000000000000000000000 P 357246e67cbb426b81f94ecca052ca05 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
16:11:31.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.273257 11714 raft_consensus.cc:729] T 00000000000000000000000000000000 P 357246e67cbb426b81f94ecca052ca05 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 357246e67cbb426b81f94ecca052ca05, State: Initialized, Role: FOLLOWER
16:11:31.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.273849 11714 consensus_queue.cc:260] T 00000000000000000000000000000000 P 357246e67cbb426b81f94ecca052ca05 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e59c875afec4be8af316d3aa9f32b8e" member_type: VOTER last_known_addr { host: "127.11.18.62" port: 46141 } } peers { permanent_uuid: "3b0580d0f39846b292086b9da681c79f" member_type: VOTER last_known_addr { host: "127.11.18.61" port: 38211 } } peers { permanent_uuid: "357246e67cbb426b81f94ecca052ca05" member_type: VOTER last_known_addr { host: "127.11.18.60" port: 46107 } }
16:11:31.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.276057 11726 sys_catalog.cc:455] T 00000000000000000000000000000000 P 357246e67cbb426b81f94ecca052ca05 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e59c875afec4be8af316d3aa9f32b8e" member_type: VOTER last_known_addr { host: "127.11.18.62" port: 46141 } } peers { permanent_uuid: "3b0580d0f39846b292086b9da681c79f" member_type: VOTER last_known_addr { host: "127.11.18.61" port: 38211 } } peers { permanent_uuid: "357246e67cbb426b81f94ecca052ca05" member_type: VOTER last_known_addr { host: "127.11.18.60" port: 46107 } } }
16:11:31.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.276671 11726 sys_catalog.cc:458] T 00000000000000000000000000000000 P 357246e67cbb426b81f94ecca052ca05 [sys.catalog]: This master's current role is: FOLLOWER
16:11:31.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.277469 11714 sys_catalog.cc:564] T 00000000000000000000000000000000 P 357246e67cbb426b81f94ecca052ca05 [sys.catalog]: configured and running, proceeding with master startup.
16:11:31.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:31.301393 11740 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 357246e67cbb426b81f94ecca052ca05: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
16:11:31.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:31.301730 11740 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
16:11:31.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.297107 11593 master_runner.cc:186] Error getting master registration for 127.11.18.62:46141: OK, instance_id { permanent_uuid: "6e59c875afec4be8af316d3aa9f32b8e" instance_seqno: 1786464687900460 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
16:11:31.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.318971 11593 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
16:11:31.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:31.352402 11646 tablet.cc:2369] T 00000000000000000000000000000000 P 357246e67cbb426b81f94ecca052ca05: Can't schedule compaction. Clean time has not been advanced past its initial value.
16:11:31.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.504338 11472 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.18.60" port: 46107 } attempt: 6
16:11:31.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.521970 11472 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e59c875afec4be8af316d3aa9f32b8e: Bootstrap starting.
16:11:31.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.527083 11472 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6e59c875afec4be8af316d3aa9f32b8e: Neither blocks nor log segments found. Creating new log.
16:11:31.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.528795 11472 log.cc:824] T 00000000000000000000000000000000 P 6e59c875afec4be8af316d3aa9f32b8e: Log is configured to *not* fsync() on all Append() calls
16:11:31.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.533056 11472 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e59c875afec4be8af316d3aa9f32b8e: No bootstrap required, opened a new log
16:11:31.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.557888 11472 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6e59c875afec4be8af316d3aa9f32b8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e59c875afec4be8af316d3aa9f32b8e" member_type: VOTER last_known_addr { host: "127.11.18.62" port: 46141 } } peers { permanent_uuid: "3b0580d0f39846b292086b9da681c79f" member_type: VOTER last_known_addr { host: "127.11.18.61" port: 38211 } } peers { permanent_uuid: "357246e67cbb426b81f94ecca052ca05" member_type: VOTER last_known_addr { host: "127.11.18.60" port: 46107 } }
16:11:31.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.559000 11472 raft_consensus.cc:374] T 00000000000000000000000000000000 P 6e59c875afec4be8af316d3aa9f32b8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
16:11:31.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.559551 11472 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6e59c875afec4be8af316d3aa9f32b8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e59c875afec4be8af316d3aa9f32b8e, State: Initialized, Role: FOLLOWER
16:11:31.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.560730 11472 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6e59c875afec4be8af316d3aa9f32b8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e59c875afec4be8af316d3aa9f32b8e" member_type: VOTER last_known_addr { host: "127.11.18.62" port: 46141 } } peers { permanent_uuid: "3b0580d0f39846b292086b9da681c79f" member_type: VOTER last_known_addr { host: "127.11.18.61" port: 38211 } } peers { permanent_uuid: "357246e67cbb426b81f94ecca052ca05" member_type: VOTER last_known_addr { host: "127.11.18.60" port: 46107 } }
16:11:31.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.567188 11746 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e59c875afec4be8af316d3aa9f32b8e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e59c875afec4be8af316d3aa9f32b8e" member_type: VOTER last_known_addr { host: "127.11.18.62" port: 46141 } } peers { permanent_uuid: "3b0580d0f39846b292086b9da681c79f" member_type: VOTER last_known_addr { host: "127.11.18.61" port: 38211 } } peers { permanent_uuid: "357246e67cbb426b81f94ecca052ca05" member_type: VOTER last_known_addr { host: "127.11.18.60" port: 46107 } } }
16:11:31.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.568475 11746 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e59c875afec4be8af316d3aa9f32b8e [sys.catalog]: This master's current role is: FOLLOWER
16:11:31.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.569000 11472 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6e59c875afec4be8af316d3aa9f32b8e [sys.catalog]: configured and running, proceeding with master startup.
16:11:31.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:31.601025 11759 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6e59c875afec4be8af316d3aa9f32b8e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
16:11:31.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:31.601599 11759 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
16:11:31.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:31.610581 11391 tablet.cc:2369] T 00000000000000000000000000000000 P 6e59c875afec4be8af316d3aa9f32b8e: Can't schedule compaction. Clean time has not been advanced past its initial value.
16:11:31.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.597805 11360 master_runner.cc:186] Error getting master registration for 127.11.18.61:38211: OK, instance_id { permanent_uuid: "3b0580d0f39846b292086b9da681c79f" instance_seqno: 1786464689529257 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
16:11:31.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.630213 11360 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
16:11:31.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.698055 11746 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6e59c875afec4be8af316d3aa9f32b8e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
16:11:31.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.698593 11746 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6e59c875afec4be8af316d3aa9f32b8e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e59c875afec4be8af316d3aa9f32b8e" member_type: VOTER last_known_addr { host: "127.11.18.62" port: 46141 } } peers { permanent_uuid: "3b0580d0f39846b292086b9da681c79f" member_type: VOTER last_known_addr { host: "127.11.18.61" port: 38211 } } peers { permanent_uuid: "357246e67cbb426b81f94ecca052ca05" member_type: VOTER last_known_addr { host: "127.11.18.60" port: 46107 } }
16:11:31.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.700958 11746 leader_election.cc:288] T 00000000000000000000000000000000 P 6e59c875afec4be8af316d3aa9f32b8e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b0580d0f39846b292086b9da681c79f (127.11.18.61:38211), 357246e67cbb426b81f94ecca052ca05 (127.11.18.60:46107)
16:11:31.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.702881 11674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6e59c875afec4be8af316d3aa9f32b8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "357246e67cbb426b81f94ecca052ca05" is_pre_election: true
16:11:31.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.703820 11674 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 357246e67cbb426b81f94ecca052ca05 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6e59c875afec4be8af316d3aa9f32b8e in term 0.
16:11:31.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.705058 11389 leader_election.cc:302] T 00000000000000000000000000000000 P 6e59c875afec4be8af316d3aa9f32b8e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 357246e67cbb426b81f94ecca052ca05, 6e59c875afec4be8af316d3aa9f32b8e; no voters: 
16:11:31.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.705986 11746 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6e59c875afec4be8af316d3aa9f32b8e [term 0 FOLLOWER]: Leader pre-election won for term 1
16:11:31.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.706302 11746 raft_consensus.cc:482] T 00000000000000000000000000000000 P 6e59c875afec4be8af316d3aa9f32b8e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
16:11:31.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.706599 11746 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6e59c875afec4be8af316d3aa9f32b8e [term 0 FOLLOWER]: Advancing to term 1
16:11:31.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.712834 11746 raft_consensus.cc:504] T 00000000000000000000000000000000 P 6e59c875afec4be8af316d3aa9f32b8e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e59c875afec4be8af316d3aa9f32b8e" member_type: VOTER last_known_addr { host: "127.11.18.62" port: 46141 } } peers { permanent_uuid: "3b0580d0f39846b292086b9da681c79f" member_type: VOTER last_known_addr { host: "127.11.18.61" port: 38211 } } peers { permanent_uuid: "357246e67cbb426b81f94ecca052ca05" member_type: VOTER last_known_addr { host: "127.11.18.60" port: 46107 } }
16:11:31.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.714932 11746 leader_election.cc:288] T 00000000000000000000000000000000 P 6e59c875afec4be8af316d3aa9f32b8e [CANDIDATE]: Term 1 election: Requested vote from peers 3b0580d0f39846b292086b9da681c79f (127.11.18.61:38211), 357246e67cbb426b81f94ecca052ca05 (127.11.18.60:46107)
16:11:31.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.715790 11674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6e59c875afec4be8af316d3aa9f32b8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "357246e67cbb426b81f94ecca052ca05"
16:11:31.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.716315 11674 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 357246e67cbb426b81f94ecca052ca05 [term 0 FOLLOWER]: Advancing to term 1
16:11:31.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.722747 11674 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 357246e67cbb426b81f94ecca052ca05 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6e59c875afec4be8af316d3aa9f32b8e in term 1.
16:11:31.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.723850 11389 leader_election.cc:302] T 00000000000000000000000000000000 P 6e59c875afec4be8af316d3aa9f32b8e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 357246e67cbb426b81f94ecca052ca05, 6e59c875afec4be8af316d3aa9f32b8e; no voters: 
16:11:31.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.724690 11746 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 6e59c875afec4be8af316d3aa9f32b8e [term 1 FOLLOWER]: Leader election won for term 1
16:11:31.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.734984 11746 raft_consensus.cc:686] T 00000000000000000000000000000000 P 6e59c875afec4be8af316d3aa9f32b8e [term 1 LEADER]: Becoming Leader. State: Replica: 6e59c875afec4be8af316d3aa9f32b8e, State: Running, Role: LEADER
16:11:31.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.736071 11746 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6e59c875afec4be8af316d3aa9f32b8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e59c875afec4be8af316d3aa9f32b8e" member_type: VOTER last_known_addr { host: "127.11.18.62" port: 46141 } } peers { permanent_uuid: "3b0580d0f39846b292086b9da681c79f" member_type: VOTER last_known_addr { host: "127.11.18.61" port: 38211 } } peers { permanent_uuid: "357246e67cbb426b81f94ecca052ca05" member_type: VOTER last_known_addr { host: "127.11.18.60" port: 46107 } }
16:11:31.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.765079 11762 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e59c875afec4be8af316d3aa9f32b8e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6e59c875afec4be8af316d3aa9f32b8e. Latest consensus state: current_term: 1 leader_uuid: "6e59c875afec4be8af316d3aa9f32b8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e59c875afec4be8af316d3aa9f32b8e" member_type: VOTER last_known_addr { host: "127.11.18.62" port: 46141 } } peers { permanent_uuid: "3b0580d0f39846b292086b9da681c79f" member_type: VOTER last_known_addr { host: "127.11.18.61" port: 38211 } } peers { permanent_uuid: "357246e67cbb426b81f94ecca052ca05" member_type: VOTER last_known_addr { host: "127.11.18.60" port: 46107 } } }
16:11:31.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.765837 11762 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e59c875afec4be8af316d3aa9f32b8e [sys.catalog]: This master's current role is: LEADER
16:11:31.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.773780 11764 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
16:11:31.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.780974 11764 catalog_manager.cc:1484] Initializing Kudu cluster ID...
16:11:31.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.803206 11674 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 357246e67cbb426b81f94ecca052ca05 [term 1 FOLLOWER]: Refusing update from remote peer 6e59c875afec4be8af316d3aa9f32b8e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
16:11:31.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.804922 11746 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6e59c875afec4be8af316d3aa9f32b8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "357246e67cbb426b81f94ecca052ca05" member_type: VOTER last_known_addr { host: "127.11.18.60" port: 46107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
16:11:31.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.830883 11766 sys_catalog.cc:455] T 00000000000000000000000000000000 P 357246e67cbb426b81f94ecca052ca05 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6e59c875afec4be8af316d3aa9f32b8e. Latest consensus state: current_term: 1 leader_uuid: "6e59c875afec4be8af316d3aa9f32b8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e59c875afec4be8af316d3aa9f32b8e" member_type: VOTER last_known_addr { host: "127.11.18.62" port: 46141 } } peers { permanent_uuid: "3b0580d0f39846b292086b9da681c79f" member_type: VOTER last_known_addr { host: "127.11.18.61" port: 38211 } } peers { permanent_uuid: "357246e67cbb426b81f94ecca052ca05" member_type: VOTER last_known_addr { host: "127.11.18.60" port: 46107 } } }
16:11:31.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.831656 11766 sys_catalog.cc:458] T 00000000000000000000000000000000 P 357246e67cbb426b81f94ecca052ca05 [sys.catalog]: This master's current role is: FOLLOWER
16:11:31.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.838091 11765 mvcc.cc:205] Tried to move back new op lower bound from 7317359377595596800 to 7317359377360400384. Current Snapshot: MvccSnapshot[applied={T|T < 7317359377595596800}]
16:11:31.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.853641 11766 sys_catalog.cc:455] T 00000000000000000000000000000000 P 357246e67cbb426b81f94ecca052ca05 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6e59c875afec4be8af316d3aa9f32b8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e59c875afec4be8af316d3aa9f32b8e" member_type: VOTER last_known_addr { host: "127.11.18.62" port: 46141 } } peers { permanent_uuid: "3b0580d0f39846b292086b9da681c79f" member_type: VOTER last_known_addr { host: "127.11.18.61" port: 38211 } } peers { permanent_uuid: "357246e67cbb426b81f94ecca052ca05" member_type: VOTER last_known_addr { host: "127.11.18.60" port: 46107 } } }
16:11:31.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.857054 11766 sys_catalog.cc:458] T 00000000000000000000000000000000 P 357246e67cbb426b81f94ecca052ca05 [sys.catalog]: This master's current role is: FOLLOWER
16:11:31.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.858121 11746 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e59c875afec4be8af316d3aa9f32b8e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6e59c875afec4be8af316d3aa9f32b8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e59c875afec4be8af316d3aa9f32b8e" member_type: VOTER last_known_addr { host: "127.11.18.62" port: 46141 } } peers { permanent_uuid: "3b0580d0f39846b292086b9da681c79f" member_type: VOTER last_known_addr { host: "127.11.18.61" port: 38211 } } peers { permanent_uuid: "357246e67cbb426b81f94ecca052ca05" member_type: VOTER last_known_addr { host: "127.11.18.60" port: 46107 } } }
16:11:31.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.858839 11746 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e59c875afec4be8af316d3aa9f32b8e [sys.catalog]: This master's current role is: LEADER
16:11:31.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.860684 11764 catalog_manager.cc:1347] Generated new cluster ID: 7df0d8d621ef47e18f192892ac71d4f9
16:11:31.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.860987 11764 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
16:11:31.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.891731 11589 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.18.60" port: 46107 } attempt: 7
16:11:31.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.902482 11764 catalog_manager.cc:1370] Generated new certificate authority record
16:11:31.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.905773 11764 catalog_manager.cc:1504] Loading token signing keys...
16:11:31.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.965214 11764 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 6e59c875afec4be8af316d3aa9f32b8e: Generated new TSK 0
16:11:31.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.966660 11764 catalog_manager.cc:1514] Initializing in-progress tserver states...
16:11:31.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.970129 11589 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b0580d0f39846b292086b9da681c79f: Bootstrap starting.
16:11:31.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.979105 11589 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3b0580d0f39846b292086b9da681c79f: Neither blocks nor log segments found. Creating new log.
16:11:31.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.981279 11336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvrVe1g/build/tsan/bin/kudu
16:11:31.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskvrVe1g/build/tsan/bin/kudu
16:11:31.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/ts-0/wal
16:11:31.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/ts-0/data
16:11:31.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
16:11:31.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
16:11:31.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
16:11:31.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
16:11:31.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
16:11:31.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
16:11:31.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/ts-0/logs
16:11:31.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/ts-0/data/info.pb
16:11:31.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
16:11:31.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
16:11:31.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
16:11:31.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
16:11:31.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
16:11:31.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
16:11:31.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
16:11:31.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
16:11:31.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
16:11:31.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
16:11:31.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.18.1:0
16:11:31.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.11.18.1
16:11:31.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.18.1
16:11:31.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
16:11:31.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.11.18.62:46141,127.11.18.61:38211,127.11.18.60:46107
16:11:31.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.18.20:41183
16:11:31.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
16:11:31.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
16:11:31.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
16:11:31.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:31.993886 11589 log.cc:824] T 00000000000000000000000000000000 P 3b0580d0f39846b292086b9da681c79f: Log is configured to *not* fsync() on all Append() calls
16:11:32.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:32.006044 11589 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3b0580d0f39846b292086b9da681c79f: No bootstrap required, opened a new log
16:11:32.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:32.036012 11589 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3b0580d0f39846b292086b9da681c79f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e59c875afec4be8af316d3aa9f32b8e" member_type: VOTER last_known_addr { host: "127.11.18.62" port: 46141 } } peers { permanent_uuid: "3b0580d0f39846b292086b9da681c79f" member_type: VOTER last_known_addr { host: "127.11.18.61" port: 38211 } } peers { permanent_uuid: "357246e67cbb426b81f94ecca052ca05" member_type: VOTER last_known_addr { host: "127.11.18.60" port: 46107 } }
16:11:32.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:32.037128 11589 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3b0580d0f39846b292086b9da681c79f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
16:11:32.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:32.037581 11589 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3b0580d0f39846b292086b9da681c79f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b0580d0f39846b292086b9da681c79f, State: Initialized, Role: FOLLOWER
16:11:32.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:32.038764 11589 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3b0580d0f39846b292086b9da681c79f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e59c875afec4be8af316d3aa9f32b8e" member_type: VOTER last_known_addr { host: "127.11.18.62" port: 46141 } } peers { permanent_uuid: "3b0580d0f39846b292086b9da681c79f" member_type: VOTER last_known_addr { host: "127.11.18.61" port: 38211 } } peers { permanent_uuid: "357246e67cbb426b81f94ecca052ca05" member_type: VOTER last_known_addr { host: "127.11.18.60" port: 46107 } }
16:11:32.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:32.057760 11556 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6e59c875afec4be8af316d3aa9f32b8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b0580d0f39846b292086b9da681c79f"
16:11:32.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:32.059270 11557 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "6e59c875afec4be8af316d3aa9f32b8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b0580d0f39846b292086b9da681c79f" is_pre_election: true
16:11:32.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:32.060653 11781 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b0580d0f39846b292086b9da681c79f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e59c875afec4be8af316d3aa9f32b8e" member_type: VOTER last_known_addr { host: "127.11.18.62" port: 46141 } } peers { permanent_uuid: "3b0580d0f39846b292086b9da681c79f" member_type: VOTER last_known_addr { host: "127.11.18.61" port: 38211 } } peers { permanent_uuid: "357246e67cbb426b81f94ecca052ca05" member_type: VOTER last_known_addr { host: "127.11.18.60" port: 46107 } } }
16:11:32.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:32.067543 11555 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3b0580d0f39846b292086b9da681c79f [term 0 FOLLOWER]: Advancing to term 1
16:11:32.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:32.077633 11781 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b0580d0f39846b292086b9da681c79f [sys.catalog]: This master's current role is: FOLLOWER
16:11:32.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:32.073441 11589 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3b0580d0f39846b292086b9da681c79f [sys.catalog]: configured and running, proceeding with master startup.
16:11:32.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:32.083416 11555 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3b0580d0f39846b292086b9da681c79f [term 1 FOLLOWER]: Refusing update from remote peer 6e59c875afec4be8af316d3aa9f32b8e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
16:11:32.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:32.085392 11775 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 6e59c875afec4be8af316d3aa9f32b8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b0580d0f39846b292086b9da681c79f" member_type: VOTER last_known_addr { host: "127.11.18.61" port: 38211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
16:11:32.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:32.146188 11781 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b0580d0f39846b292086b9da681c79f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6e59c875afec4be8af316d3aa9f32b8e. Latest consensus state: current_term: 1 leader_uuid: "6e59c875afec4be8af316d3aa9f32b8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e59c875afec4be8af316d3aa9f32b8e" member_type: VOTER last_known_addr { host: "127.11.18.62" port: 46141 } } peers { permanent_uuid: "3b0580d0f39846b292086b9da681c79f" member_type: VOTER last_known_addr { host: "127.11.18.61" port: 38211 } } peers { permanent_uuid: "357246e67cbb426b81f94ecca052ca05" member_type: VOTER last_known_addr { host: "127.11.18.60" port: 46107 } } }
16:11:32.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:32.147058 11781 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b0580d0f39846b292086b9da681c79f [sys.catalog]: This master's current role is: FOLLOWER
16:11:32.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:32.148319 11792 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b0580d0f39846b292086b9da681c79f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "6e59c875afec4be8af316d3aa9f32b8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e59c875afec4be8af316d3aa9f32b8e" member_type: VOTER last_known_addr { host: "127.11.18.62" port: 46141 } } peers { permanent_uuid: "3b0580d0f39846b292086b9da681c79f" member_type: VOTER last_known_addr { host: "127.11.18.61" port: 38211 } } peers { permanent_uuid: "357246e67cbb426b81f94ecca052ca05" member_type: VOTER last_known_addr { host: "127.11.18.60" port: 46107 } } }
16:11:32.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:32.155827 11792 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b0580d0f39846b292086b9da681c79f [sys.catalog]: This master's current role is: FOLLOWER
16:11:32.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:32.174180 11804 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
16:11:32.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:32.307153 11740 catalog_manager.cc:1259] Loaded cluster ID: 7df0d8d621ef47e18f192892ac71d4f9
16:11:32.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:32.307713 11740 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 357246e67cbb426b81f94ecca052ca05: loading cluster ID for follower catalog manager: success
16:11:32.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:32.315320 11740 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 357246e67cbb426b81f94ecca052ca05: acquiring CA information for follower catalog manager: success
16:11:32.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:32.320901 11740 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 357246e67cbb426b81f94ecca052ca05: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
16:11:32.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:32.465428 11777 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
16:11:32.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:32.466074 11777 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
16:11:32.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:32.466840 11777 flags.cc:425] Enabled unsafe flag: --never_fsync=true
16:11:32.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:32.524499 11777 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
16:11:32.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:32.525892 11777 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.18.1
16:11:32.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:32.538913 11812 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e59c875afec4be8af316d3aa9f32b8e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "6e59c875afec4be8af316d3aa9f32b8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e59c875afec4be8af316d3aa9f32b8e" member_type: VOTER last_known_addr { host: "127.11.18.62" port: 46141 } } peers { permanent_uuid: "3b0580d0f39846b292086b9da681c79f" member_type: VOTER last_known_addr { host: "127.11.18.61" port: 38211 } } peers { permanent_uuid: "357246e67cbb426b81f94ecca052ca05" member_type: VOTER last_known_addr { host: "127.11.18.60" port: 46107 } } }
16:11:32.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:32.541065 11812 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e59c875afec4be8af316d3aa9f32b8e [sys.catalog]: This master's current role is: LEADER
16:11:32.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:32.587517 11777 tablet_server_runner.cc:78] Tablet server non-default flags:
16:11:32.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
16:11:32.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.18.20:41183
16:11:32.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
16:11:32.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
16:11:32.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/ts-0/data
16:11:32.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/ts-0/wal
16:11:32.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
16:11:32.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
16:11:32.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.18.1:0
16:11:32.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
16:11:32.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
16:11:32.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
16:11:32.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/ts-0/data/info.pb
16:11:32.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.18.1
16:11:32.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
16:11:32.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.11.18.62:46141,127.11.18.61:38211,127.11.18.60:46107
16:11:32.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
16:11:32.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
16:11:32.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
16:11:32.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
16:11:32.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
16:11:32.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.11.18.1
16:11:32.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/ts-0/logs
16:11:32.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
16:11:32.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
16:11:32.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
16:11:32.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
16:11:32.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.18.0-SNAPSHOT
16:11:32.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
16:11:32.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
16:11:32.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by systest at 11 Aug 2026 15:12:52 UTC on ccycloud.quasar-tzrfpd.root.comops.site
16:11:32.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 4580143
16:11:32.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
16:11:32.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:32.589118 11777 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
16:11:32.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:32.591218 11777 file_cache.cc:493] Constructed file cache file cache with capacity 419430
16:11:32.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:32.625893 11819 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
16:11:33.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:33.195356 11804 catalog_manager.cc:1259] Loaded cluster ID: 7df0d8d621ef47e18f192892ac71d4f9
16:11:33.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:33.196799 11804 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 3b0580d0f39846b292086b9da681c79f: loading cluster ID for follower catalog manager: success
16:11:33.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:33.228214 11804 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 3b0580d0f39846b292086b9da681c79f: acquiring CA information for follower catalog manager: success
16:11:33.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:33.249806 11804 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 3b0580d0f39846b292086b9da681c79f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
16:11:34.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:32.626696 11818 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
16:11:34.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:34.014073 11817 debug-util.cc:398] Leaking SignalData structure 0x7b0800014860 after lost signal to thread 11777
16:11:34.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:34.111815 11777 thread.cc:636] GCE (cloud detector) Time spent creating pthread: real 1.490s	user 0.491s	sys 0.687s
16:11:34.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:34.113638 11777 thread.cc:602] GCE (cloud detector) Time spent starting thread: real 1.492s	user 0.492s	sys 0.687s
16:11:34.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:34.122977 11833 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
16:11:34.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:34.124210 11777 server_base.cc:1034] running on GCE node
16:11:34.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:34.125798 11777 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
16:11:34.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:34.128412 11777 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
16:11:34.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:34.129913 11777 hybrid_clock.cc:648] HybridClock initialized: now 1786464694129803 us; error 103 us; skew 500 ppm
16:11:34.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:34.131170 11777 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
16:11:34.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:34.142413 11777 webserver.cc:460] Webserver started at http://127.11.18.1:42959/ using document root <none> and password file <none>
16:11:34.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:34.143646 11777 fs_manager.cc:359] Metadata directory not provided
16:11:34.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:34.143944 11777 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
16:11:34.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:34.144485 11777 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
16:11:34.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:34.151427 11777 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/ts-0/data/instance:
16:11:34.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "0e0d4c00a1bb42368f2945079442adff"
16:11:34.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-11 16:11:34 on dist-test-slave-nj21"
16:11:34.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:34.152920 11777 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/ts-0/wal/instance:
16:11:34.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "0e0d4c00a1bb42368f2945079442adff"
16:11:34.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-11 16:11:34 on dist-test-slave-nj21"
16:11:34.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:34.162691 11777 fs_manager.cc:691] Time spent creating directory manager: real 0.009s	user 0.006s	sys 0.004s
16:11:34.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:34.179121 11843 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
16:11:34.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:34.180573 11777 fs_manager.cc:725] Time spent opening block manager: real 0.014s	user 0.006s	sys 0.009s
16:11:34.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:34.180963 11777 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/ts-0/data,/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/ts-0/wal
16:11:34.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "0e0d4c00a1bb42368f2945079442adff"
16:11:34.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-11 16:11:34 on dist-test-slave-nj21"
16:11:34.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:34.181381 11777 fs_report.cc:383] FS layout report
16:11:34.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
16:11:34.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/ts-0/wal
16:11:34.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/ts-0/wal
16:11:34.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/ts-0/data/data
16:11:34.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
16:11:34.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
16:11:34.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
16:11:34.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
16:11:34.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
16:11:34.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
16:11:34.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
16:11:34.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
16:11:34.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
16:11:34.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
16:11:34.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
16:11:34.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:34.250875 11777 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
16:11:34.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:34.252389 11777 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
16:11:34.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:34.252880 11777 kserver.cc:163] Server-wide thread pool size limit: 3276
16:11:34.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:34.255733 11777 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
16:11:34.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:34.261240 11777 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
16:11:34.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:34.261441 11777 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
16:11:34.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:34.261735 11777 ts_tablet_manager.cc:610] Registered 0 tablets
16:11:34.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:34.261927 11777 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
16:11:34.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:34.432991 11777 rpc_server.cc:307] RPC server started. Bound to: 127.11.18.1:34721
16:11:34.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:34.433096 12011 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.18.1:34721 every 8 connection(s)
16:11:34.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:34.435652 11777 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/ts-0/data/info.pb
16:11:34.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:34.437912 11336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvrVe1g/build/tsan/bin/kudu as pid 11777
16:11:34.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:34.438359 11336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/ts-0/wal/instance
16:11:34.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:34.458014 11336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvrVe1g/build/tsan/bin/kudu
16:11:34.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskvrVe1g/build/tsan/bin/kudu
16:11:34.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/ts-1/wal
16:11:34.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/ts-1/data
16:11:34.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
16:11:34.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
16:11:34.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
16:11:34.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
16:11:34.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
16:11:34.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
16:11:34.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/ts-1/logs
16:11:34.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/ts-1/data/info.pb
16:11:34.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
16:11:34.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
16:11:34.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
16:11:34.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
16:11:34.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
16:11:34.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
16:11:34.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
16:11:34.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
16:11:34.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
16:11:34.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
16:11:34.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.18.2:0
16:11:34.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.11.18.2
16:11:34.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.18.2
16:11:34.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
16:11:34.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.11.18.62:46141,127.11.18.61:38211,127.11.18.60:46107
16:11:34.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.18.20:41183
16:11:34.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
16:11:34.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
16:11:34.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
16:11:34.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:34.514941 12013 heartbeater.cc:347] Connected to a master server at 127.11.18.60:46107
16:11:34.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:34.515313 12013 heartbeater.cc:464] Registering TS with master...
16:11:34.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:34.516310 12013 heartbeater.cc:511] Master 127.11.18.60:46107 requested a full tablet report, sending...
16:11:34.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:34.519433 11661 ts_manager.cc:194] Registered new tserver with Master: 0e0d4c00a1bb42368f2945079442adff (127.11.18.1:34721)
16:11:34.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:34.520988 12012 heartbeater.cc:347] Connected to a master server at 127.11.18.61:38211
16:11:34.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:34.521302 12012 heartbeater.cc:464] Registering TS with master...
16:11:34.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:34.522068 12012 heartbeater.cc:511] Master 127.11.18.61:38211 requested a full tablet report, sending...
16:11:34.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:34.522764 12024 heartbeater.cc:347] Connected to a master server at 127.11.18.62:46141
16:11:34.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:34.523108 12024 heartbeater.cc:464] Registering TS with master...
16:11:34.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:34.523934 12024 heartbeater.cc:511] Master 127.11.18.62:46141 requested a full tablet report, sending...
16:11:34.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:34.526537 11410 ts_manager.cc:194] Registered new tserver with Master: 0e0d4c00a1bb42368f2945079442adff (127.11.18.1:34721)
16:11:34.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:34.526539 11538 ts_manager.cc:194] Registered new tserver with Master: 0e0d4c00a1bb42368f2945079442adff (127.11.18.1:34721)
16:11:34.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:34.529423 11410 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.18.1:41533
16:11:34.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:34.801136 12031 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
16:11:34.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:34.801661 12031 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
16:11:34.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:34.802258 12031 flags.cc:425] Enabled unsafe flag: --never_fsync=true
16:11:34.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:34.833858 12031 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
16:11:34.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:34.834654 12031 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.18.2
16:11:34.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:34.868018 12031 tablet_server_runner.cc:78] Tablet server non-default flags:
16:11:34.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
16:11:34.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.18.20:41183
16:11:34.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
16:11:34.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
16:11:34.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/ts-1/data
16:11:34.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/ts-1/wal
16:11:34.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
16:11:34.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
16:11:34.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.18.2:0
16:11:34.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
16:11:34.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
16:11:34.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
16:11:34.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/ts-1/data/info.pb
16:11:34.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.18.2
16:11:34.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
16:11:34.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.11.18.62:46141,127.11.18.61:38211,127.11.18.60:46107
16:11:34.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
16:11:34.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
16:11:34.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
16:11:34.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
16:11:34.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
16:11:34.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.11.18.2
16:11:34.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/ts-1/logs
16:11:34.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
16:11:34.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
16:11:34.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
16:11:34.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
16:11:34.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.18.0-SNAPSHOT
16:11:34.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
16:11:34.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
16:11:34.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by systest at 11 Aug 2026 15:12:52 UTC on ccycloud.quasar-tzrfpd.root.comops.site
16:11:34.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 4580143
16:11:34.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
16:11:34.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:34.869297 12031 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
16:11:34.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:34.871443 12031 file_cache.cc:493] Constructed file cache file cache with capacity 419430
16:11:34.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:34.892701 12041 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
16:11:35.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:35.028555 11584 debug-util.cc:398] Leaking SignalData structure 0x7b0800082a40 after lost signal to thread 11486
16:11:35.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:35.535399 12024 heartbeater.cc:503] Master 127.11.18.62:46141 was elected leader, sending a full tablet report...
16:11:36.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:34.894227 12051 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
16:11:36.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:34.894778 12031 server_base.cc:1034] running on GCE node
16:11:36.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:34.893402 12042 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
16:11:36.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:36.095024 12031 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
16:11:36.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:36.097872 12031 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
16:11:36.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:36.099334 12031 hybrid_clock.cc:648] HybridClock initialized: now 1786464696099236 us; error 97 us; skew 500 ppm
16:11:36.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:36.100489 12031 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
16:11:36.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:36.108387 12031 webserver.cc:460] Webserver started at http://127.11.18.2:36445/ using document root <none> and password file <none>
16:11:36.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:36.109623 12031 fs_manager.cc:359] Metadata directory not provided
16:11:36.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:36.109902 12031 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
16:11:36.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:36.110512 12031 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
16:11:36.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:36.117589 12031 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/ts-1/data/instance:
16:11:36.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "569c6e53a65648b9b4a790d67eca8882"
16:11:36.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-11 16:11:36 on dist-test-slave-nj21"
16:11:36.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:36.119096 12031 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/ts-1/wal/instance:
16:11:36.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "569c6e53a65648b9b4a790d67eca8882"
16:11:36.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-11 16:11:36 on dist-test-slave-nj21"
16:11:36.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:36.128803 12031 fs_manager.cc:691] Time spent creating directory manager: real 0.009s	user 0.007s	sys 0.001s
16:11:36.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:36.136068 12066 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
16:11:36.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:36.137095 12031 fs_manager.cc:725] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
16:11:36.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:36.137372 12031 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/ts-1/data,/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/ts-1/wal
16:11:36.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "569c6e53a65648b9b4a790d67eca8882"
16:11:36.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-11 16:11:36 on dist-test-slave-nj21"
16:11:36.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:36.137672 12031 fs_report.cc:383] FS layout report
16:11:36.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
16:11:36.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/ts-1/wal
16:11:36.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/ts-1/wal
16:11:36.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/ts-1/data/data
16:11:36.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
16:11:36.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
16:11:36.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
16:11:36.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
16:11:36.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
16:11:36.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
16:11:36.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
16:11:36.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
16:11:36.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
16:11:36.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
16:11:36.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
16:11:36.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:36.224874 12031 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
16:11:36.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:36.226421 12031 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
16:11:36.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:36.226907 12031 kserver.cc:163] Server-wide thread pool size limit: 3276
16:11:36.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:36.229995 12031 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
16:11:36.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:36.234185 12031 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
16:11:36.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:36.234385 12031 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
16:11:36.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:36.234690 12031 ts_tablet_manager.cc:610] Registered 0 tablets
16:11:36.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:36.234865 12031 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
16:11:36.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:36.396836 12031 rpc_server.cc:307] RPC server started. Bound to: 127.11.18.2:35173
16:11:36.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:36.396929 12259 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.18.2:35173 every 8 connection(s)
16:11:36.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:36.399415 12031 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/ts-1/data/info.pb
16:11:36.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:36.402590 11336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvrVe1g/build/tsan/bin/kudu as pid 12031
16:11:36.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:36.403204 11336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/ts-1/wal/instance
16:11:36.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:36.420439 11336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvrVe1g/build/tsan/bin/kudu
16:11:36.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskvrVe1g/build/tsan/bin/kudu
16:11:36.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/ts-2/wal
16:11:36.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/ts-2/data
16:11:36.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
16:11:36.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
16:11:36.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
16:11:36.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
16:11:36.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
16:11:36.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
16:11:36.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/ts-2/logs
16:11:36.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/ts-2/data/info.pb
16:11:36.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
16:11:36.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
16:11:36.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
16:11:36.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
16:11:36.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
16:11:36.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
16:11:36.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
16:11:36.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
16:11:36.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
16:11:36.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
16:11:36.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.18.3:0
16:11:36.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.11.18.3
16:11:36.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.18.3
16:11:36.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
16:11:36.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.11.18.62:46141,127.11.18.61:38211,127.11.18.60:46107
16:11:36.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.18.20:41183
16:11:36.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
16:11:36.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
16:11:36.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
16:11:36.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:36.457424 12263 heartbeater.cc:347] Connected to a master server at 127.11.18.60:46107
16:11:36.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:36.457939 12263 heartbeater.cc:464] Registering TS with master...
16:11:36.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:36.459173 12263 heartbeater.cc:511] Master 127.11.18.60:46107 requested a full tablet report, sending...
16:11:36.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:36.461401 12265 heartbeater.cc:347] Connected to a master server at 127.11.18.62:46141
16:11:36.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:36.461723 12265 heartbeater.cc:464] Registering TS with master...
16:11:36.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:36.462134 11661 ts_manager.cc:194] Registered new tserver with Master: 569c6e53a65648b9b4a790d67eca8882 (127.11.18.2:35173)
16:11:36.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:36.462486 12265 heartbeater.cc:511] Master 127.11.18.62:46141 requested a full tablet report, sending...
16:11:36.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:36.464759 11410 ts_manager.cc:194] Registered new tserver with Master: 569c6e53a65648b9b4a790d67eca8882 (127.11.18.2:35173)
16:11:36.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:36.466660 11410 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.18.2:57857
16:11:36.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:36.466936 12261 heartbeater.cc:347] Connected to a master server at 127.11.18.61:38211
16:11:36.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:36.467263 12261 heartbeater.cc:464] Registering TS with master...
16:11:36.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:36.468029 12261 heartbeater.cc:511] Master 127.11.18.61:38211 requested a full tablet report, sending...
16:11:36.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:36.470623 11538 ts_manager.cc:194] Registered new tserver with Master: 569c6e53a65648b9b4a790d67eca8882 (127.11.18.2:35173)
16:11:36.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:36.761068 12278 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
16:11:36.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:36.761521 12278 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
16:11:36.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:36.761943 12278 flags.cc:425] Enabled unsafe flag: --never_fsync=true
16:11:36.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:36.793426 12278 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
16:11:36.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:36.794198 12278 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.18.3
16:11:36.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:36.827210 12278 tablet_server_runner.cc:78] Tablet server non-default flags:
16:11:36.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
16:11:36.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.18.20:41183
16:11:36.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
16:11:36.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
16:11:36.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/ts-2/data
16:11:36.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/ts-2/wal
16:11:36.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
16:11:36.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
16:11:36.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.18.3:0
16:11:36.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
16:11:36.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
16:11:36.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
16:11:36.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/ts-2/data/info.pb
16:11:36.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.18.3
16:11:36.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
16:11:36.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.11.18.62:46141,127.11.18.61:38211,127.11.18.60:46107
16:11:36.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
16:11:36.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
16:11:36.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
16:11:36.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
16:11:36.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
16:11:36.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.11.18.3
16:11:36.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/ts-2/logs
16:11:36.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
16:11:36.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
16:11:36.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
16:11:36.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
16:11:36.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.18.0-SNAPSHOT
16:11:36.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
16:11:36.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
16:11:36.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by systest at 11 Aug 2026 15:12:52 UTC on ccycloud.quasar-tzrfpd.root.comops.site
16:11:36.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 4580143
16:11:36.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
16:11:36.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:36.828490 12278 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
16:11:36.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:36.830164 12278 file_cache.cc:493] Constructed file cache file cache with capacity 419430
16:11:36.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:36.849522 12291 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
16:11:37.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:37.470997 12265 heartbeater.cc:503] Master 127.11.18.62:46141 was elected leader, sending a full tablet report...
16:11:37.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:36.849951 12292 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
16:11:37.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:36.850931 12294 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
16:11:37.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:37.938237 12293 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
16:11:37.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:37.938313 12278 server_base.cc:1029] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
16:11:37.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:37.941460 12278 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
16:11:37.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:37.943588 12278 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
16:11:37.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:37.947121 12278 hybrid_clock.cc:648] HybridClock initialized: now 1786464697946519 us; error 606 us; skew 500 ppm
16:11:37.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:37.948015 12278 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
16:11:37.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:37.953998 12278 webserver.cc:460] Webserver started at http://127.11.18.3:40721/ using document root <none> and password file <none>
16:11:37.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:37.954953 12278 fs_manager.cc:359] Metadata directory not provided
16:11:37.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:37.955173 12278 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
16:11:37.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:37.955722 12278 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
16:11:37.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:37.961027 12278 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/ts-2/data/instance:
16:11:37.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "40e256a91d114593bbfb3204b8db718b"
16:11:37.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-11 16:11:37 on dist-test-slave-nj21"
16:11:37.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:37.962064 12278 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/ts-2/wal/instance:
16:11:37.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "40e256a91d114593bbfb3204b8db718b"
16:11:37.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-11 16:11:37 on dist-test-slave-nj21"
16:11:37.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:37.968804 12278 fs_manager.cc:691] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.001s
16:11:37.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:37.974254 12305 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
16:11:37.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:37.975257 12278 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
16:11:37.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:37.975538 12278 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/ts-2/data,/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/ts-2/wal
16:11:37.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "40e256a91d114593bbfb3204b8db718b"
16:11:37.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-11 16:11:37 on dist-test-slave-nj21"
16:11:37.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:37.975878 12278 fs_report.cc:383] FS layout report
16:11:37.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
16:11:37.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/ts-2/wal
16:11:37.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/ts-2/wal
16:11:37.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/ts-2/data/data
16:11:37.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
16:11:37.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
16:11:37.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
16:11:37.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
16:11:37.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
16:11:37.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
16:11:37.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
16:11:37.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
16:11:37.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
16:11:37.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
16:11:37.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
16:11:38.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.028712 12278 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
16:11:38.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.030396 12278 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
16:11:38.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.030885 12278 kserver.cc:163] Server-wide thread pool size limit: 3276
16:11:38.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.033418 12278 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
16:11:38.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.037410 12278 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
16:11:38.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.037600 12278 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
16:11:38.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.037892 12278 ts_tablet_manager.cc:610] Registered 0 tablets
16:11:38.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.038051 12278 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
16:11:38.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.173933 12278 rpc_server.cc:307] RPC server started. Bound to: 127.11.18.3:35519
16:11:38.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.174016 12491 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.18.3:35519 every 8 connection(s)
16:11:38.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.176687 12278 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/ts-2/data/info.pb
16:11:38.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.179767 11336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvrVe1g/build/tsan/bin/kudu as pid 12278
16:11:38.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.180269 11336 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/ts-2/wal/instance
16:11:38.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.228543 12493 heartbeater.cc:347] Connected to a master server at 127.11.18.60:46107
16:11:38.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.228880 12494 heartbeater.cc:347] Connected to a master server at 127.11.18.62:46141
16:11:38.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.229660 12494 heartbeater.cc:464] Registering TS with master...
16:11:38.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.230751 12494 heartbeater.cc:511] Master 127.11.18.62:46141 requested a full tablet report, sending...
16:11:38.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.228899 12493 heartbeater.cc:464] Registering TS with master...
16:11:38.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.233677 12493 heartbeater.cc:511] Master 127.11.18.60:46107 requested a full tablet report, sending...
16:11:38.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.235410 11410 ts_manager.cc:194] Registered new tserver with Master: 40e256a91d114593bbfb3204b8db718b (127.11.18.3:35519)
16:11:38.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.237035 11410 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.11.18.3:60533
16:11:38.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.237758 11661 ts_manager.cc:194] Registered new tserver with Master: 40e256a91d114593bbfb3204b8db718b (127.11.18.3:35519)
16:11:38.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.242280 12492 heartbeater.cc:347] Connected to a master server at 127.11.18.61:38211
16:11:38.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.242616 12492 heartbeater.cc:464] Registering TS with master...
16:11:38.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.243232 12492 heartbeater.cc:511] Master 127.11.18.61:38211 requested a full tablet report, sending...
16:11:38.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.246150 11538 ts_manager.cc:194] Registered new tserver with Master: 40e256a91d114593bbfb3204b8db718b (127.11.18.3:35519)
16:11:38.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.260493 11336 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
16:11:38.271 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
16:11:38.271 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

16:11:38.273 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.11.18.62"
      port: 46141
    }
    bound_http_address {
      host: "127.11.18.62"
      port: 43521
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.11.18.61"
      port: 38211
    }
    bound_http_address {
      host: "127.11.18.61"
      port: 38459
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.11.18.60"
      port: 46107
    }
    bound_http_address {
      host: "127.11.18.60"
      port: 35761
    }
  }
}

16:11:38.273 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

16:11:38.274 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.11.18.1"
      port: 34721
    }
    bound_http_address {
      host: "127.11.18.1"
      port: 42959
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.11.18.2"
      port: 35173
    }
    bound_http_address {
      host: "127.11.18.2"
      port: 36445
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.11.18.3"
      port: 35519
    }
    bound_http_address {
      host: "127.11.18.3"
      port: 40721
    }
  }
}

16:11:38.275 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
16:11:38.278 [ERROR - main] (ResourceLeakDetector.java:327) LEAK: HashedWheelTimer.release() was not called before it's garbage-collected. See https://netty.io/wiki/reference-counted-objects.html for more information.
Recent access records: 
Created at:
	io.netty.util.HashedWheelTimer.<init>(HashedWheelTimer.java:312)
	io.netty.util.HashedWheelTimer.<init>(HashedWheelTimer.java:251)
	io.netty.util.HashedWheelTimer.<init>(HashedWheelTimer.java:224)
	io.netty.util.HashedWheelTimer.<init>(HashedWheelTimer.java:203)
	io.netty.util.HashedWheelTimer.<init>(HashedWheelTimer.java:185)
	org.apache.kudu.client.AsyncKuduScanner.<init>(AsyncKuduScanner.java:296)
	org.apache.kudu.client.AsyncKuduScanner.<init>(AsyncKuduScanner.java:431)
	org.apache.kudu.client.AsyncKuduScanner$AsyncKuduScannerBuilder.build(AsyncKuduScanner.java:1417)
	org.apache.kudu.client.TestClientFailoverSupport$1.get(TestClientFailoverSupport.java:82)
	org.apache.kudu.test.junit.AssertHelpers.assertEventuallyTrue(AssertHelpers.java:40)
	org.apache.kudu.client.TestClientFailoverSupport.waitUntilRowCount(TestClientFailoverSupport.java:78)
	org.apache.kudu.client.TestClientFailoverSupport.doTestMasterFailover(TestClientFailoverSupport.java:123)
	org.apache.kudu.client.TestClientFailoverSupport.testKillLeaderMaster(TestClientFailoverSupport.java:96)
	sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	java.lang.reflect.Method.invoke(Method.java:498)
	org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
	org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
	org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
	org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
	org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299)
	org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293)
	java.util.concurrent.FutureTask.run(FutureTask.java:266)
	java.lang.Thread.run(Thread.java:750)
16:11:38.279 [ERROR - main] (ResourceLeakDetector.java:327) LEAK: HashedWheelTimer.release() was not called before it's garbage-collected. See https://netty.io/wiki/reference-counted-objects.html for more information.
Recent access records: 
Created at:
	io.netty.util.HashedWheelTimer.<init>(HashedWheelTimer.java:312)
	io.netty.util.HashedWheelTimer.<init>(HashedWheelTimer.java:251)
	io.netty.util.HashedWheelTimer.<init>(HashedWheelTimer.java:224)
	io.netty.util.HashedWheelTimer.<init>(HashedWheelTimer.java:203)
	io.netty.util.HashedWheelTimer.<init>(HashedWheelTimer.java:185)
	org.apache.kudu.client.AsyncKuduScanner.<init>(AsyncKuduScanner.java:296)
	org.apache.kudu.client.AsyncKuduScanner.<init>(AsyncKuduScanner.java:431)
	org.apache.kudu.client.AsyncKuduScanner$AsyncKuduScannerBuilder.build(AsyncKuduScanner.java:1417)
	org.apache.kudu.client.TestClientFailoverSupport$1.get(TestClientFailoverSupport.java:82)
	org.apache.kudu.test.junit.AssertHelpers.assertEventuallyTrue(AssertHelpers.java:40)
	org.apache.kudu.client.TestClientFailoverSupport.waitUntilRowCount(TestClientFailoverSupport.java:78)
	org.apache.kudu.client.TestClientFailoverSupport.doTestMasterFailover(TestClientFailoverSupport.java:149)
	org.apache.kudu.client.TestClientFailoverSupport.testKillLeaderMaster(TestClientFailoverSupport.java:96)
	sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	java.lang.reflect.Method.invoke(Method.java:498)
	org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
	org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
	org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
	org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
	org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299)
	org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293)
	java.util.concurrent.FutureTask.run(FutureTask.java:266)
	java.lang.Thread.run(Thread.java:750)
16:11:38.281 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
16:11:38.282 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.11.18.60:46107(127.11.18.60:46107)] connecting to peer
16:11:38.284 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.11.18.61:38211(127.11.18.61:38211)] connecting to peer
16:11:38.286 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.11.18.62:46141(127.11.18.62:46141)] connecting to peer
16:11:38.286 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.11.18.60:46107(127.11.18.60:46107)] Successfully connected to peer
16:11:38.290 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.11.18.61:38211(127.11.18.61:38211)] Successfully connected to peer
16:11:38.291 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.18.60
16:11:38.294 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.18.61
16:11:38.311 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.11.18.62:46141(127.11.18.62:46141)] Successfully connected to peer
16:11:38.316 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x6c231841, L:/127.0.0.1:38632 - R:/127.11.18.60:46107] using SASL/PLAIN
16:11:38.318 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x5414284c, L:/127.0.0.1:60510 - R:/127.11.18.61:38211] using SASL/PLAIN
16:11:38.318 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.18.62
16:11:38.337 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xdf0f9e67, L:/127.0.0.1:60726 - R:/127.11.18.62:46141] using SASL/PLAIN
16:11:38.340 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
16:11:38.340 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=59), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.18.60:46107, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.18.61:38211, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.18.62:46141, [39ms] Sub RPC ConnectToMaster: received response from server master-127.11.18.61:38211: OK, [41ms] Sub RPC ConnectToMaster: received response from server master-127.11.18.60:46107: OK, [57ms] Sub RPC ConnectToMaster: received response from server master-127.11.18.62:46141: OK, deferred=null) after lookup
16:11:38.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.343005 11410 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60726:
16:11:38.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "org.apache.kudu.client.TestClientFailoverSupport-RESTART"
16:11:38.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
16:11:38.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
16:11:38.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key"
16:11:38.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
16:11:38.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
16:11:38.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
16:11:38.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
16:11:38.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
16:11:38.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
16:11:38.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
16:11:38.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
16:11:38.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column1_i"
16:11:38.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
16:11:38.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
16:11:38.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
16:11:38.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
16:11:38.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
16:11:38.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
16:11:38.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
16:11:38.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
16:11:38.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column2_i"
16:11:38.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
16:11:38.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
16:11:38.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
16:11:38.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
16:11:38.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
16:11:38.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
16:11:38.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
16:11:38.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
16:11:38.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column3_s"
16:11:38.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
16:11:38.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
16:11:38.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: true
16:11:38.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: DICT_ENCODING
16:11:38.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: LZ4
16:11:38.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 4096
16:11:38.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
16:11:38.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
16:11:38.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
16:11:38.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
16:11:38.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column4_b"
16:11:38.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BOOL
16:11:38.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
16:11:38.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
16:11:38.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
16:11:38.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
16:11:38.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
16:11:38.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
16:11:38.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
16:11:38.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
16:11:38.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
16:11:38.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
16:11:38.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key"
16:11:38.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
16:11:38.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
16:11:38.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
16:11:38.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:38.346864 11410 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table org.apache.kudu.client.TestClientFailoverSupport-RESTART in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
16:11:38.378 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 018ab1f098c34e71a2149a262a395ccb
16:11:38.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.416138 11915 tablet_service.cc:1467] Processing CreateTablet for tablet 909606cd99904d2bb821f4137631d353 (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-RESTART [id=018ab1f098c34e71a2149a262a395ccb]), partition=RANGE (key) PARTITION UNBOUNDED
16:11:38.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.417965 11915 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 909606cd99904d2bb821f4137631d353. 1 dirs total, 0 dirs full, 0 dirs failed
16:11:38.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.427408 12147 tablet_service.cc:1467] Processing CreateTablet for tablet 909606cd99904d2bb821f4137631d353 (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-RESTART [id=018ab1f098c34e71a2149a262a395ccb]), partition=RANGE (key) PARTITION UNBOUNDED
16:11:38.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.428839 12381 tablet_service.cc:1467] Processing CreateTablet for tablet 909606cd99904d2bb821f4137631d353 (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-RESTART [id=018ab1f098c34e71a2149a262a395ccb]), partition=RANGE (key) PARTITION UNBOUNDED
16:11:38.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.431847 12381 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 909606cd99904d2bb821f4137631d353. 1 dirs total, 0 dirs full, 0 dirs failed
16:11:38.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.435935 12147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 909606cd99904d2bb821f4137631d353. 1 dirs total, 0 dirs full, 0 dirs failed
16:11:38.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.454479 12539 tablet_bootstrap.cc:492] T 909606cd99904d2bb821f4137631d353 P 0e0d4c00a1bb42368f2945079442adff: Bootstrap starting.
16:11:38.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.461206 12540 tablet_bootstrap.cc:492] T 909606cd99904d2bb821f4137631d353 P 40e256a91d114593bbfb3204b8db718b: Bootstrap starting.
16:11:38.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.461566 12539 tablet_bootstrap.cc:654] T 909606cd99904d2bb821f4137631d353 P 0e0d4c00a1bb42368f2945079442adff: Neither blocks nor log segments found. Creating new log.
16:11:38.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.463743 12539 log.cc:824] T 909606cd99904d2bb821f4137631d353 P 0e0d4c00a1bb42368f2945079442adff: Log is configured to *not* fsync() on all Append() calls
16:11:38.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.468223 12541 tablet_bootstrap.cc:492] T 909606cd99904d2bb821f4137631d353 P 569c6e53a65648b9b4a790d67eca8882: Bootstrap starting.
16:11:38.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.471200 12540 tablet_bootstrap.cc:654] T 909606cd99904d2bb821f4137631d353 P 40e256a91d114593bbfb3204b8db718b: Neither blocks nor log segments found. Creating new log.
16:11:38.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.473282 12540 log.cc:824] T 909606cd99904d2bb821f4137631d353 P 40e256a91d114593bbfb3204b8db718b: Log is configured to *not* fsync() on all Append() calls
16:11:38.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.475260 12541 tablet_bootstrap.cc:654] T 909606cd99904d2bb821f4137631d353 P 569c6e53a65648b9b4a790d67eca8882: Neither blocks nor log segments found. Creating new log.
16:11:38.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.476114 12539 tablet_bootstrap.cc:492] T 909606cd99904d2bb821f4137631d353 P 0e0d4c00a1bb42368f2945079442adff: No bootstrap required, opened a new log
16:11:38.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.476752 12539 ts_tablet_manager.cc:1397] T 909606cd99904d2bb821f4137631d353 P 0e0d4c00a1bb42368f2945079442adff: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.004s
16:11:38.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.477425 12541 log.cc:824] T 909606cd99904d2bb821f4137631d353 P 569c6e53a65648b9b4a790d67eca8882: Log is configured to *not* fsync() on all Append() calls
16:11:38.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.481552 12540 tablet_bootstrap.cc:492] T 909606cd99904d2bb821f4137631d353 P 40e256a91d114593bbfb3204b8db718b: No bootstrap required, opened a new log
16:11:38.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.481941 12540 ts_tablet_manager.cc:1397] T 909606cd99904d2bb821f4137631d353 P 40e256a91d114593bbfb3204b8db718b: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.000s
16:11:38.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.482837 12541 tablet_bootstrap.cc:492] T 909606cd99904d2bb821f4137631d353 P 569c6e53a65648b9b4a790d67eca8882: No bootstrap required, opened a new log
16:11:38.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.483283 12541 ts_tablet_manager.cc:1397] T 909606cd99904d2bb821f4137631d353 P 569c6e53a65648b9b4a790d67eca8882: Time spent bootstrapping tablet: real 0.016s	user 0.007s	sys 0.005s
16:11:38.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.506794 12539 raft_consensus.cc:348] T 909606cd99904d2bb821f4137631d353 P 0e0d4c00a1bb42368f2945079442adff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0d4c00a1bb42368f2945079442adff" member_type: VOTER last_known_addr { host: "127.11.18.1" port: 34721 } } peers { permanent_uuid: "40e256a91d114593bbfb3204b8db718b" member_type: VOTER last_known_addr { host: "127.11.18.3" port: 35519 } } peers { permanent_uuid: "569c6e53a65648b9b4a790d67eca8882" member_type: VOTER last_known_addr { host: "127.11.18.2" port: 35173 } }
16:11:38.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.507691 12539 raft_consensus.cc:374] T 909606cd99904d2bb821f4137631d353 P 0e0d4c00a1bb42368f2945079442adff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
16:11:38.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.507992 12539 raft_consensus.cc:729] T 909606cd99904d2bb821f4137631d353 P 0e0d4c00a1bb42368f2945079442adff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e0d4c00a1bb42368f2945079442adff, State: Initialized, Role: FOLLOWER
16:11:38.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.508863 12539 consensus_queue.cc:260] T 909606cd99904d2bb821f4137631d353 P 0e0d4c00a1bb42368f2945079442adff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0d4c00a1bb42368f2945079442adff" member_type: VOTER last_known_addr { host: "127.11.18.1" port: 34721 } } peers { permanent_uuid: "40e256a91d114593bbfb3204b8db718b" member_type: VOTER last_known_addr { host: "127.11.18.3" port: 35519 } } peers { permanent_uuid: "569c6e53a65648b9b4a790d67eca8882" member_type: VOTER last_known_addr { host: "127.11.18.2" port: 35173 } }
16:11:38.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.509603 12540 raft_consensus.cc:348] T 909606cd99904d2bb821f4137631d353 P 40e256a91d114593bbfb3204b8db718b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0d4c00a1bb42368f2945079442adff" member_type: VOTER last_known_addr { host: "127.11.18.1" port: 34721 } } peers { permanent_uuid: "40e256a91d114593bbfb3204b8db718b" member_type: VOTER last_known_addr { host: "127.11.18.3" port: 35519 } } peers { permanent_uuid: "569c6e53a65648b9b4a790d67eca8882" member_type: VOTER last_known_addr { host: "127.11.18.2" port: 35173 } }
16:11:38.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.511108 12540 raft_consensus.cc:374] T 909606cd99904d2bb821f4137631d353 P 40e256a91d114593bbfb3204b8db718b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
16:11:38.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.511518 12540 raft_consensus.cc:729] T 909606cd99904d2bb821f4137631d353 P 40e256a91d114593bbfb3204b8db718b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40e256a91d114593bbfb3204b8db718b, State: Initialized, Role: FOLLOWER
16:11:38.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.511968 12541 raft_consensus.cc:348] T 909606cd99904d2bb821f4137631d353 P 569c6e53a65648b9b4a790d67eca8882 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0d4c00a1bb42368f2945079442adff" member_type: VOTER last_known_addr { host: "127.11.18.1" port: 34721 } } peers { permanent_uuid: "40e256a91d114593bbfb3204b8db718b" member_type: VOTER last_known_addr { host: "127.11.18.3" port: 35519 } } peers { permanent_uuid: "569c6e53a65648b9b4a790d67eca8882" member_type: VOTER last_known_addr { host: "127.11.18.2" port: 35173 } }
16:11:38.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.512813 12541 raft_consensus.cc:374] T 909606cd99904d2bb821f4137631d353 P 569c6e53a65648b9b4a790d67eca8882 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
16:11:38.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.513108 12541 raft_consensus.cc:729] T 909606cd99904d2bb821f4137631d353 P 569c6e53a65648b9b4a790d67eca8882 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 569c6e53a65648b9b4a790d67eca8882, State: Initialized, Role: FOLLOWER
16:11:38.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.512588 12540 consensus_queue.cc:260] T 909606cd99904d2bb821f4137631d353 P 40e256a91d114593bbfb3204b8db718b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0d4c00a1bb42368f2945079442adff" member_type: VOTER last_known_addr { host: "127.11.18.1" port: 34721 } } peers { permanent_uuid: "40e256a91d114593bbfb3204b8db718b" member_type: VOTER last_known_addr { host: "127.11.18.3" port: 35519 } } peers { permanent_uuid: "569c6e53a65648b9b4a790d67eca8882" member_type: VOTER last_known_addr { host: "127.11.18.2" port: 35173 } }
16:11:38.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.514500 12541 consensus_queue.cc:260] T 909606cd99904d2bb821f4137631d353 P 569c6e53a65648b9b4a790d67eca8882 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0d4c00a1bb42368f2945079442adff" member_type: VOTER last_known_addr { host: "127.11.18.1" port: 34721 } } peers { permanent_uuid: "40e256a91d114593bbfb3204b8db718b" member_type: VOTER last_known_addr { host: "127.11.18.3" port: 35519 } } peers { permanent_uuid: "569c6e53a65648b9b4a790d67eca8882" member_type: VOTER last_known_addr { host: "127.11.18.2" port: 35173 } }
16:11:38.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.523162 12540 ts_tablet_manager.cc:1428] T 909606cd99904d2bb821f4137631d353 P 40e256a91d114593bbfb3204b8db718b: Time spent starting tablet: real 0.041s	user 0.026s	sys 0.008s
16:11:38.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.524142 12494 heartbeater.cc:503] Master 127.11.18.62:46141 was elected leader, sending a full tablet report...
16:11:38.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.535984 12539 ts_tablet_manager.cc:1428] T 909606cd99904d2bb821f4137631d353 P 0e0d4c00a1bb42368f2945079442adff: Time spent starting tablet: real 0.059s	user 0.029s	sys 0.016s
16:11:38.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.539986 12541 ts_tablet_manager.cc:1428] T 909606cd99904d2bb821f4137631d353 P 569c6e53a65648b9b4a790d67eca8882: Time spent starting tablet: real 0.056s	user 0.026s	sys 0.027s
16:11:38.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.620054 12549 raft_consensus.cc:482] T 909606cd99904d2bb821f4137631d353 P 0e0d4c00a1bb42368f2945079442adff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
16:11:38.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.620596 12549 raft_consensus.cc:504] T 909606cd99904d2bb821f4137631d353 P 0e0d4c00a1bb42368f2945079442adff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0d4c00a1bb42368f2945079442adff" member_type: VOTER last_known_addr { host: "127.11.18.1" port: 34721 } } peers { permanent_uuid: "40e256a91d114593bbfb3204b8db718b" member_type: VOTER last_known_addr { host: "127.11.18.3" port: 35519 } } peers { permanent_uuid: "569c6e53a65648b9b4a790d67eca8882" member_type: VOTER last_known_addr { host: "127.11.18.2" port: 35173 } }
16:11:38.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.623023 12549 leader_election.cc:288] T 909606cd99904d2bb821f4137631d353 P 0e0d4c00a1bb42368f2945079442adff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40e256a91d114593bbfb3204b8db718b (127.11.18.3:35519), 569c6e53a65648b9b4a790d67eca8882 (127.11.18.2:35173)
16:11:38.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.635574 12415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "909606cd99904d2bb821f4137631d353" candidate_uuid: "0e0d4c00a1bb42368f2945079442adff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40e256a91d114593bbfb3204b8db718b" is_pre_election: true
16:11:38.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.636344 12415 raft_consensus.cc:2454] T 909606cd99904d2bb821f4137631d353 P 40e256a91d114593bbfb3204b8db718b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e0d4c00a1bb42368f2945079442adff in term 0.
16:11:38.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.636497 12189 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "909606cd99904d2bb821f4137631d353" candidate_uuid: "0e0d4c00a1bb42368f2945079442adff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "569c6e53a65648b9b4a790d67eca8882" is_pre_election: true
16:11:38.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.637269 12189 raft_consensus.cc:2454] T 909606cd99904d2bb821f4137631d353 P 569c6e53a65648b9b4a790d67eca8882 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e0d4c00a1bb42368f2945079442adff in term 0.
16:11:38.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.637391 11847 leader_election.cc:302] T 909606cd99904d2bb821f4137631d353 P 0e0d4c00a1bb42368f2945079442adff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0d4c00a1bb42368f2945079442adff, 40e256a91d114593bbfb3204b8db718b; no voters: 
16:11:38.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.638075 12549 raft_consensus.cc:2781] T 909606cd99904d2bb821f4137631d353 P 0e0d4c00a1bb42368f2945079442adff [term 0 FOLLOWER]: Leader pre-election won for term 1
16:11:38.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.638403 12549 raft_consensus.cc:482] T 909606cd99904d2bb821f4137631d353 P 0e0d4c00a1bb42368f2945079442adff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
16:11:38.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.638689 12549 raft_consensus.cc:3037] T 909606cd99904d2bb821f4137631d353 P 0e0d4c00a1bb42368f2945079442adff [term 0 FOLLOWER]: Advancing to term 1
16:11:38.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.642779 12549 raft_consensus.cc:504] T 909606cd99904d2bb821f4137631d353 P 0e0d4c00a1bb42368f2945079442adff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0d4c00a1bb42368f2945079442adff" member_type: VOTER last_known_addr { host: "127.11.18.1" port: 34721 } } peers { permanent_uuid: "40e256a91d114593bbfb3204b8db718b" member_type: VOTER last_known_addr { host: "127.11.18.3" port: 35519 } } peers { permanent_uuid: "569c6e53a65648b9b4a790d67eca8882" member_type: VOTER last_known_addr { host: "127.11.18.2" port: 35173 } }
16:11:38.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.644106 12549 leader_election.cc:288] T 909606cd99904d2bb821f4137631d353 P 0e0d4c00a1bb42368f2945079442adff [CANDIDATE]: Term 1 election: Requested vote from peers 40e256a91d114593bbfb3204b8db718b (127.11.18.3:35519), 569c6e53a65648b9b4a790d67eca8882 (127.11.18.2:35173)
16:11:38.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.644852 12415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "909606cd99904d2bb821f4137631d353" candidate_uuid: "0e0d4c00a1bb42368f2945079442adff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40e256a91d114593bbfb3204b8db718b"
16:11:38.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.645025 12189 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "909606cd99904d2bb821f4137631d353" candidate_uuid: "0e0d4c00a1bb42368f2945079442adff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "569c6e53a65648b9b4a790d67eca8882"
16:11:38.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.645236 12415 raft_consensus.cc:3037] T 909606cd99904d2bb821f4137631d353 P 40e256a91d114593bbfb3204b8db718b [term 0 FOLLOWER]: Advancing to term 1
16:11:38.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.645495 12189 raft_consensus.cc:3037] T 909606cd99904d2bb821f4137631d353 P 569c6e53a65648b9b4a790d67eca8882 [term 0 FOLLOWER]: Advancing to term 1
16:11:38.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.649590 12189 raft_consensus.cc:2454] T 909606cd99904d2bb821f4137631d353 P 569c6e53a65648b9b4a790d67eca8882 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e0d4c00a1bb42368f2945079442adff in term 1.
16:11:38.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.649791 12415 raft_consensus.cc:2454] T 909606cd99904d2bb821f4137631d353 P 40e256a91d114593bbfb3204b8db718b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e0d4c00a1bb42368f2945079442adff in term 1.
16:11:38.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.650350 11847 leader_election.cc:302] T 909606cd99904d2bb821f4137631d353 P 0e0d4c00a1bb42368f2945079442adff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e0d4c00a1bb42368f2945079442adff, 569c6e53a65648b9b4a790d67eca8882; no voters: 
16:11:38.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.650861 12549 raft_consensus.cc:2781] T 909606cd99904d2bb821f4137631d353 P 0e0d4c00a1bb42368f2945079442adff [term 1 FOLLOWER]: Leader election won for term 1
16:11:38.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.652479 12549 raft_consensus.cc:686] T 909606cd99904d2bb821f4137631d353 P 0e0d4c00a1bb42368f2945079442adff [term 1 LEADER]: Becoming Leader. State: Replica: 0e0d4c00a1bb42368f2945079442adff, State: Running, Role: LEADER
16:11:38.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.653312 12549 consensus_queue.cc:237] T 909606cd99904d2bb821f4137631d353 P 0e0d4c00a1bb42368f2945079442adff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0d4c00a1bb42368f2945079442adff" member_type: VOTER last_known_addr { host: "127.11.18.1" port: 34721 } } peers { permanent_uuid: "40e256a91d114593bbfb3204b8db718b" member_type: VOTER last_known_addr { host: "127.11.18.3" port: 35519 } } peers { permanent_uuid: "569c6e53a65648b9b4a790d67eca8882" member_type: VOTER last_known_addr { host: "127.11.18.2" port: 35173 } }
16:11:38.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.665102 11410 catalog_manager.cc:5495] T 909606cd99904d2bb821f4137631d353 P 0e0d4c00a1bb42368f2945079442adff reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e0d4c00a1bb42368f2945079442adff (127.11.18.1). New cstate: current_term: 1 leader_uuid: "0e0d4c00a1bb42368f2945079442adff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0d4c00a1bb42368f2945079442adff" member_type: VOTER last_known_addr { host: "127.11.18.1" port: 34721 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40e256a91d114593bbfb3204b8db718b" member_type: VOTER last_known_addr { host: "127.11.18.3" port: 35519 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "569c6e53a65648b9b4a790d67eca8882" member_type: VOTER last_known_addr { host: "127.11.18.2" port: 35173 } health_report { overall_health: UNKNOWN } } }
16:11:38.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:38.696112 12273 tablet.cc:2369] T 909606cd99904d2bb821f4137631d353 P 569c6e53a65648b9b4a790d67eca8882: Can't schedule compaction. Clean time has not been advanced past its initial value.
16:11:38.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:38.703441 12509 tablet.cc:2369] T 909606cd99904d2bb821f4137631d353 P 40e256a91d114593bbfb3204b8db718b: Can't schedule compaction. Clean time has not been advanced past its initial value.
16:11:38.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:38.747754 12027 tablet.cc:2369] T 909606cd99904d2bb821f4137631d353 P 0e0d4c00a1bb42368f2945079442adff: Can't schedule compaction. Clean time has not been advanced past its initial value.
16:11:38.849 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 018ab1f098c34e71a2149a262a395ccb
16:11:38.853 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 909606cd99904d2bb821f4137631d353 for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
16:11:38.853 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=909606cd99904d2bb821f4137631d353@[0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721)[L],40e256a91d114593bbfb3204b8db718b(127.11.18.3:35519),569c6e53a65648b9b4a790d67eca8882(127.11.18.2:35173)]}]
16:11:38.854 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=4), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.18.62:46141, [3ms] Sub RPC GetTableLocations: received response from server master-127.11.18.62:46141: OK, deferred=null) after lookup
16:11:38.855 [DEBUG - kudu-nio-0] (Connection.java:748) [peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721)] connecting to peer
16:11:38.856 [DEBUG - kudu-nio-1] (Connection.java:757) [peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721)] Successfully connected to peer
16:11:38.879 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x86831e4b, L:/127.0.0.1:37494 - R:/127.11.18.1:34721] using TOKEN/null
16:11:38.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.892459 12189 raft_consensus.cc:1261] T 909606cd99904d2bb821f4137631d353 P 569c6e53a65648b9b4a790d67eca8882 [term 1 FOLLOWER]: Refusing update from remote peer 0e0d4c00a1bb42368f2945079442adff: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
16:11:38.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.892745 12415 raft_consensus.cc:1261] T 909606cd99904d2bb821f4137631d353 P 40e256a91d114593bbfb3204b8db718b [term 1 FOLLOWER]: Refusing update from remote peer 0e0d4c00a1bb42368f2945079442adff: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
16:11:38.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.893909 12556 consensus_queue.cc:1035] T 909606cd99904d2bb821f4137631d353 P 0e0d4c00a1bb42368f2945079442adff [LEADER]: Connected to new peer: Peer: permanent_uuid: "569c6e53a65648b9b4a790d67eca8882" member_type: VOTER last_known_addr { host: "127.11.18.2" port: 35173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
16:11:38.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.894517 12549 consensus_queue.cc:1035] T 909606cd99904d2bb821f4137631d353 P 0e0d4c00a1bb42368f2945079442adff [LEADER]: Connected to new peer: Peer: permanent_uuid: "40e256a91d114593bbfb3204b8db718b" member_type: VOTER last_known_addr { host: "127.11.18.3" port: 35519 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
16:11:38.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.918228 12560 mvcc.cc:205] Tried to move back new op lower bound from 7317359406649393152 to 7317359405691203584. Current Snapshot: MvccSnapshot[applied={T|T < 7317359406649393152}]
16:11:38.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.920722 12562 mvcc.cc:205] Tried to move back new op lower bound from 7317359406649393152 to 7317359405691203584. Current Snapshot: MvccSnapshot[applied={T|T < 7317359406649393152 or (T in {7317359406649393152})}]
16:11:38.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:38.946568 12565 mvcc.cc:205] Tried to move back new op lower bound from 7317359406649393152 to 7317359405691203584. Current Snapshot: MvccSnapshot[applied={T|T < 7317359406649393152}]
16:11:39.087 [DEBUG - kudu-nio-1] (AsyncKuduScanner.java:1374) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 10 rows, more = false) for scanner KuduScanner(table=org.apache.kudu.client.TestClientFailoverSupport-RESTART, tablet=909606cd99904d2bb821f4137631d353, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
16:11:39.088 [INFO - Time-limited test] (MiniKuduCluster.java:399) Killing master server 127.11.18.62:46141
16:11:39.089 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: stop_daemon {
  id {
    type: MASTER
    index: 0
  }
}

16:11:39.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:39.089717 11336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvrVe1g/build/tsan/bin/kudu with pid 11360
16:11:39.131 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.11.18.62:46141(127.11.18.62:46141)] handling channelInactive
16:11:39.131 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.18.62:46141(127.11.18.62:46141)] cleaning up while in state READY due to: connection closed
16:11:39.134 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
16:11:39.134 [INFO - Time-limited test] (MiniKuduCluster.java:380) Starting master server 127.11.18.62:46141
16:11:39.137 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: start_daemon {
  id {
    type: MASTER
    index: 0
  }
}

16:11:39.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:39.138952 11336 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskvrVe1g/build/tsan/bin/kudu
16:11:39.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskvrVe1g/build/tsan/bin/kudu
16:11:39.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/master-0/wal
16:11:39.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/master-0/data
16:11:39.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
16:11:39.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
16:11:39.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
16:11:39.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
16:11:39.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
16:11:39.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
16:11:39.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/master-0/logs
16:11:39.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/master-0/data/info.pb
16:11:39.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
16:11:39.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
16:11:39.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
16:11:39.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
16:11:39.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
16:11:39.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
16:11:39.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
16:11:39.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
16:11:39.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
16:11:39.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
16:11:39.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
16:11:39.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
16:11:39.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.18.62:46141
16:11:39.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.18.62
16:11:39.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=43521
16:11:39.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.18.20:41183
16:11:39.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
16:11:39.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
16:11:39.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
16:11:39.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
16:11:39.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.11.18.62:46141,127.11.18.61:38211,127.11.18.60:46107
16:11:39.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
16:11:39.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:35189/jwks.json with env {}
16:11:39.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:39.521348 12583 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
16:11:39.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:39.522240 12583 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
16:11:39.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:39.523346 12583 flags.cc:425] Enabled unsafe flag: --never_fsync=true
16:11:39.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:39.557179 12583 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
16:11:39.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:39.557535 12583 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
16:11:39.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:39.557861 12583 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
16:11:39.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:39.558153 12583 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
16:11:39.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:39.558440 12583 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
16:11:39.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:39.558689 12583 flags.cc:425] Enabled experimental flag: --jwks_url=http://localhost:35189/jwks.json
16:11:39.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:39.595522 12583 master_runner.cc:386] Master server non-default flags:
16:11:39.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
16:11:39.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.18.20:41183
16:11:39.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
16:11:39.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
16:11:39.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/master-0/data
16:11:39.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/master-0/wal
16:11:39.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
16:11:39.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.11.18.62:46141,127.11.18.61:38211,127.11.18.60:46107
16:11:39.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
16:11:39.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
16:11:39.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
16:11:39.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.18.62:46141
16:11:39.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
16:11:39.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
16:11:39.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
16:11:39.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:35189/jwks.json
16:11:39.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
16:11:39.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
16:11:39.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/master-0/data/info.pb
16:11:39.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.18.62
16:11:39.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=43521
16:11:39.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
16:11:39.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
16:11:39.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
16:11:39.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
16:11:39.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
16:11:39.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/master-0/logs
16:11:39.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
16:11:39.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
16:11:39.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
16:11:39.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
16:11:39.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.18.0-SNAPSHOT
16:11:39.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
16:11:39.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
16:11:39.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by systest at 11 Aug 2026 15:12:52 UTC on ccycloud.quasar-tzrfpd.root.comops.site
16:11:39.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 4580143
16:11:39.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
16:11:39.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:39.597092 12583 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
16:11:39.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:39.598970 12583 file_cache.cc:493] Constructed file cache file cache with capacity 419430
16:11:39.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:39.617233 12596 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
16:11:39.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:39.950603 12494 heartbeater.cc:644] Failed to heartbeat to 127.11.18.62:46141 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.11.18.62:46141: connect: Connection refused (error 111)
16:11:39.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:39.964248 12265 heartbeater.cc:644] Failed to heartbeat to 127.11.18.62:46141 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.11.18.62:46141: connect: Connection refused (error 111)
16:11:39.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:39.964738 12024 heartbeater.cc:644] Failed to heartbeat to 127.11.18.62:46141 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.11.18.62:46141: connect: Connection refused (error 111)
16:11:40.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:40.187332 12617 raft_consensus.cc:482] T 00000000000000000000000000000000 P 357246e67cbb426b81f94ecca052ca05 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6e59c875afec4be8af316d3aa9f32b8e)
16:11:40.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:40.194650 12617 raft_consensus.cc:504] T 00000000000000000000000000000000 P 357246e67cbb426b81f94ecca052ca05 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e59c875afec4be8af316d3aa9f32b8e" member_type: VOTER last_known_addr { host: "127.11.18.62" port: 46141 } } peers { permanent_uuid: "3b0580d0f39846b292086b9da681c79f" member_type: VOTER last_known_addr { host: "127.11.18.61" port: 38211 } } peers { permanent_uuid: "357246e67cbb426b81f94ecca052ca05" member_type: VOTER last_known_addr { host: "127.11.18.60" port: 46107 } }
16:11:40.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:40.199437 11555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "357246e67cbb426b81f94ecca052ca05" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "3b0580d0f39846b292086b9da681c79f" is_pre_election: true
16:11:40.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:40.200374 11555 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3b0580d0f39846b292086b9da681c79f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 357246e67cbb426b81f94ecca052ca05 in term 1.
16:11:40.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:40.202207 11633 leader_election.cc:302] T 00000000000000000000000000000000 P 357246e67cbb426b81f94ecca052ca05 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 357246e67cbb426b81f94ecca052ca05, 3b0580d0f39846b292086b9da681c79f; no voters: 
16:11:40.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:40.211841 12617 leader_election.cc:288] T 00000000000000000000000000000000 P 357246e67cbb426b81f94ecca052ca05 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6e59c875afec4be8af316d3aa9f32b8e (127.11.18.62:46141), 3b0580d0f39846b292086b9da681c79f (127.11.18.61:38211)
16:11:40.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:40.212836 12617 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 357246e67cbb426b81f94ecca052ca05 [term 1 FOLLOWER]: Leader pre-election won for term 2
16:11:40.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:40.213138 12617 raft_consensus.cc:482] T 00000000000000000000000000000000 P 357246e67cbb426b81f94ecca052ca05 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6e59c875afec4be8af316d3aa9f32b8e)
16:11:40.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:40.213461 12617 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 357246e67cbb426b81f94ecca052ca05 [term 1 FOLLOWER]: Advancing to term 2
16:11:40.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:40.218343 11631 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.18.62:46141: connect: Connection refused (error 111)
16:11:40.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:40.223487 12613 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3b0580d0f39846b292086b9da681c79f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6e59c875afec4be8af316d3aa9f32b8e)
16:11:40.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:40.227806 12613 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3b0580d0f39846b292086b9da681c79f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e59c875afec4be8af316d3aa9f32b8e" member_type: VOTER last_known_addr { host: "127.11.18.62" port: 46141 } } peers { permanent_uuid: "3b0580d0f39846b292086b9da681c79f" member_type: VOTER last_known_addr { host: "127.11.18.61" port: 38211 } } peers { permanent_uuid: "357246e67cbb426b81f94ecca052ca05" member_type: VOTER last_known_addr { host: "127.11.18.60" port: 46107 } }
16:11:40.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:40.235852 11631 leader_election.cc:334] T 00000000000000000000000000000000 P 357246e67cbb426b81f94ecca052ca05 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6e59c875afec4be8af316d3aa9f32b8e (127.11.18.62:46141): Network error: Client connection negotiation failed: client connection to 127.11.18.62:46141: connect: Connection refused (error 111)
16:11:40.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:40.240468 12617 raft_consensus.cc:504] T 00000000000000000000000000000000 P 357246e67cbb426b81f94ecca052ca05 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e59c875afec4be8af316d3aa9f32b8e" member_type: VOTER last_known_addr { host: "127.11.18.62" port: 46141 } } peers { permanent_uuid: "3b0580d0f39846b292086b9da681c79f" member_type: VOTER last_known_addr { host: "127.11.18.61" port: 38211 } } peers { permanent_uuid: "357246e67cbb426b81f94ecca052ca05" member_type: VOTER last_known_addr { host: "127.11.18.60" port: 46107 } }
16:11:40.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:40.243399 12617 leader_election.cc:288] T 00000000000000000000000000000000 P 357246e67cbb426b81f94ecca052ca05 [CANDIDATE]: Term 2 election: Requested vote from peers 6e59c875afec4be8af316d3aa9f32b8e (127.11.18.62:46141), 3b0580d0f39846b292086b9da681c79f (127.11.18.61:38211)
16:11:40.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:40.243818 11674 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "3b0580d0f39846b292086b9da681c79f" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "357246e67cbb426b81f94ecca052ca05" is_pre_election: true
16:11:40.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:40.244661 11674 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 357246e67cbb426b81f94ecca052ca05 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3b0580d0f39846b292086b9da681c79f in current term 2: Already voted for candidate 357246e67cbb426b81f94ecca052ca05 in this term.
16:11:40.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:40.245635 11555 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "357246e67cbb426b81f94ecca052ca05" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "3b0580d0f39846b292086b9da681c79f"
16:11:40.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:40.246209 11555 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3b0580d0f39846b292086b9da681c79f [term 1 FOLLOWER]: Advancing to term 2
16:11:40.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:40.246320 11512 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.18.62:46141: connect: Connection refused (error 111) [suppressed 6 similar messages]
16:11:40.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:40.253078 12613 leader_election.cc:288] T 00000000000000000000000000000000 P 3b0580d0f39846b292086b9da681c79f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6e59c875afec4be8af316d3aa9f32b8e (127.11.18.62:46141), 357246e67cbb426b81f94ecca052ca05 (127.11.18.60:46107)
16:11:40.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:40.257932 11555 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 3b0580d0f39846b292086b9da681c79f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 357246e67cbb426b81f94ecca052ca05 in term 2.
16:11:40.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:40.261107 11631 leader_election.cc:334] T 00000000000000000000000000000000 P 357246e67cbb426b81f94ecca052ca05 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6e59c875afec4be8af316d3aa9f32b8e (127.11.18.62:46141): Network error: Client connection negotiation failed: client connection to 127.11.18.62:46141: connect: Connection refused (error 111)
16:11:40.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:40.262702 11633 leader_election.cc:302] T 00000000000000000000000000000000 P 357246e67cbb426b81f94ecca052ca05 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 357246e67cbb426b81f94ecca052ca05, 3b0580d0f39846b292086b9da681c79f; no voters: 6e59c875afec4be8af316d3aa9f32b8e
16:11:40.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:40.263629 12617 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 357246e67cbb426b81f94ecca052ca05 [term 2 FOLLOWER]: Leader election won for term 2
16:11:40.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:40.264539 12617 raft_consensus.cc:686] T 00000000000000000000000000000000 P 357246e67cbb426b81f94ecca052ca05 [term 2 LEADER]: Becoming Leader. State: Replica: 357246e67cbb426b81f94ecca052ca05, State: Running, Role: LEADER
16:11:40.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:40.265838 12617 consensus_queue.cc:237] T 00000000000000000000000000000000 P 357246e67cbb426b81f94ecca052ca05 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e59c875afec4be8af316d3aa9f32b8e" member_type: VOTER last_known_addr { host: "127.11.18.62" port: 46141 } } peers { permanent_uuid: "3b0580d0f39846b292086b9da681c79f" member_type: VOTER last_known_addr { host: "127.11.18.61" port: 38211 } } peers { permanent_uuid: "357246e67cbb426b81f94ecca052ca05" member_type: VOTER last_known_addr { host: "127.11.18.60" port: 46107 } }
16:11:40.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:40.275484 11512 leader_election.cc:334] T 00000000000000000000000000000000 P 3b0580d0f39846b292086b9da681c79f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6e59c875afec4be8af316d3aa9f32b8e (127.11.18.62:46141): Network error: Client connection negotiation failed: client connection to 127.11.18.62:46141: connect: Connection refused (error 111)
16:11:40.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:40.275964 11512 leader_election.cc:302] T 00000000000000000000000000000000 P 3b0580d0f39846b292086b9da681c79f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3b0580d0f39846b292086b9da681c79f; no voters: 357246e67cbb426b81f94ecca052ca05, 6e59c875afec4be8af316d3aa9f32b8e
16:11:40.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:40.277360 12613 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 3b0580d0f39846b292086b9da681c79f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
16:11:40.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:40.281210 12621 sys_catalog.cc:455] T 00000000000000000000000000000000 P 357246e67cbb426b81f94ecca052ca05 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 357246e67cbb426b81f94ecca052ca05. Latest consensus state: current_term: 2 leader_uuid: "357246e67cbb426b81f94ecca052ca05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e59c875afec4be8af316d3aa9f32b8e" member_type: VOTER last_known_addr { host: "127.11.18.62" port: 46141 } } peers { permanent_uuid: "3b0580d0f39846b292086b9da681c79f" member_type: VOTER last_known_addr { host: "127.11.18.61" port: 38211 } } peers { permanent_uuid: "357246e67cbb426b81f94ecca052ca05" member_type: VOTER last_known_addr { host: "127.11.18.60" port: 46107 } } }
16:11:40.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:40.282227 12621 sys_catalog.cc:458] T 00000000000000000000000000000000 P 357246e67cbb426b81f94ecca052ca05 [sys.catalog]: This master's current role is: LEADER
16:11:40.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:40.285770 12629 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
16:11:40.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:40.295064 12629 catalog_manager.cc:669] Loaded metadata for table org.apache.kudu.client.TestClientFailoverSupport-RESTART [id=018ab1f098c34e71a2149a262a395ccb]
16:11:40.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:40.301404 12629 tablet_loader.cc:96] loaded metadata for tablet 909606cd99904d2bb821f4137631d353 (table org.apache.kudu.client.TestClientFailoverSupport-RESTART [id=018ab1f098c34e71a2149a262a395ccb])
16:11:40.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:40.302629 12629 catalog_manager.cc:1484] Initializing Kudu cluster ID...
16:11:40.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:40.306495 12629 catalog_manager.cc:1259] Loaded cluster ID: 7df0d8d621ef47e18f192892ac71d4f9
16:11:40.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:40.306713 12629 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
16:11:40.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:40.311584 12629 catalog_manager.cc:1504] Loading token signing keys...
16:11:40.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:40.315497 12629 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 357246e67cbb426b81f94ecca052ca05: Loaded TSK: 0
16:11:40.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:40.317029 12629 catalog_manager.cc:1514] Initializing in-progress tserver states...
16:11:40.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:39.619211 12599 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
16:11:40.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:39.620867 12583 server_base.cc:1034] running on GCE node
16:11:40.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:39.618393 12595 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
16:11:40.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:40.774703 12583 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
16:11:40.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:40.777696 12583 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
16:11:40.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:40.779095 12583 hybrid_clock.cc:648] HybridClock initialized: now 1786464700779055 us; error 50 us; skew 500 ppm
16:11:40.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:40.780107 12583 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
16:11:40.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:40.792719 12583 webserver.cc:460] Webserver started at http://127.11.18.62:43521/ using document root <none> and password file <none>
16:11:40.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:40.793924 12583 fs_manager.cc:359] Metadata directory not provided
16:11:40.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:40.794212 12583 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
16:11:40.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:40.804966 12583 fs_manager.cc:709] Time spent opening directory manager: real 0.006s	user 0.007s	sys 0.000s
16:11:40.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:40.810985 11631 consensus_peers.cc:487] T 00000000000000000000000000000000 P 357246e67cbb426b81f94ecca052ca05 -> Peer 6e59c875afec4be8af316d3aa9f32b8e (127.11.18.62:46141): Couldn't send request to peer 6e59c875afec4be8af316d3aa9f32b8e. Status: Network error: Client connection negotiation failed: client connection to 127.11.18.62:46141: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
16:11:40.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:40.811260 12646 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
16:11:40.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:40.812376 12583 fs_manager.cc:725] Time spent opening block manager: real 0.005s	user 0.005s	sys 0.000s
16:11:40.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:40.812692 12583 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/master-0/data,/tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/master-0/wal
16:11:40.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6e59c875afec4be8af316d3aa9f32b8e"
16:11:40.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-11 16:11:27 on dist-test-slave-nj21"
16:11:40.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:40.815347 12583 fs_report.cc:383] FS layout report
16:11:40.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
16:11:40.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/master-0/wal
16:11:40.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/master-0/wal
16:11:40.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/master-0/data/data
16:11:40.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
16:11:40.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
16:11:40.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
16:11:40.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
16:11:40.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
16:11:40.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
16:11:40.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
16:11:40.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
16:11:40.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
16:11:40.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
16:11:40.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
16:11:40.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:40.853008 12583 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
16:11:40.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:40.854446 12583 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
16:11:40.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:40.854936 12583 kserver.cc:163] Server-wide thread pool size limit: 3276
16:11:40.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:40.881984 11555 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 3b0580d0f39846b292086b9da681c79f [term 2 FOLLOWER]: Refusing update from remote peer 357246e67cbb426b81f94ecca052ca05: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 2 index: 8. (index mismatch)
16:11:40.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:40.883879 12634 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 357246e67cbb426b81f94ecca052ca05 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b0580d0f39846b292086b9da681c79f" member_type: VOTER last_known_addr { host: "127.11.18.61" port: 38211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
16:11:40.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:40.894922 12674 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b0580d0f39846b292086b9da681c79f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 357246e67cbb426b81f94ecca052ca05. Latest consensus state: current_term: 2 leader_uuid: "357246e67cbb426b81f94ecca052ca05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e59c875afec4be8af316d3aa9f32b8e" member_type: VOTER last_known_addr { host: "127.11.18.62" port: 46141 } } peers { permanent_uuid: "3b0580d0f39846b292086b9da681c79f" member_type: VOTER last_known_addr { host: "127.11.18.61" port: 38211 } } peers { permanent_uuid: "357246e67cbb426b81f94ecca052ca05" member_type: VOTER last_known_addr { host: "127.11.18.60" port: 46107 } } }
16:11:40.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:40.895843 12674 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b0580d0f39846b292086b9da681c79f [sys.catalog]: This master's current role is: FOLLOWER
16:11:40.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:40.901479 12634 sys_catalog.cc:455] T 00000000000000000000000000000000 P 357246e67cbb426b81f94ecca052ca05 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "357246e67cbb426b81f94ecca052ca05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e59c875afec4be8af316d3aa9f32b8e" member_type: VOTER last_known_addr { host: "127.11.18.62" port: 46141 } } peers { permanent_uuid: "3b0580d0f39846b292086b9da681c79f" member_type: VOTER last_known_addr { host: "127.11.18.61" port: 38211 } } peers { permanent_uuid: "357246e67cbb426b81f94ecca052ca05" member_type: VOTER last_known_addr { host: "127.11.18.60" port: 46107 } } }
16:11:40.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:40.902335 12634 sys_catalog.cc:458] T 00000000000000000000000000000000 P 357246e67cbb426b81f94ecca052ca05 [sys.catalog]: This master's current role is: LEADER
16:11:40.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:40.905196 12674 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3b0580d0f39846b292086b9da681c79f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "357246e67cbb426b81f94ecca052ca05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e59c875afec4be8af316d3aa9f32b8e" member_type: VOTER last_known_addr { host: "127.11.18.62" port: 46141 } } peers { permanent_uuid: "3b0580d0f39846b292086b9da681c79f" member_type: VOTER last_known_addr { host: "127.11.18.61" port: 38211 } } peers { permanent_uuid: "357246e67cbb426b81f94ecca052ca05" member_type: VOTER last_known_addr { host: "127.11.18.60" port: 46107 } } }
16:11:40.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:40.905841 12674 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3b0580d0f39846b292086b9da681c79f [sys.catalog]: This master's current role is: FOLLOWER
16:11:40.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:40.954624 12583 rpc_server.cc:307] RPC server started. Bound to: 127.11.18.62:46141
16:11:40.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:40.955503 12748 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.11.18.62:46141 every 8 connection(s)
16:11:40.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:40.958449 12583 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskvrVe1g/test-tmp/mini-kudu-cluster6234635020405351360/master-0/data/info.pb
16:11:40.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:40.967417 11336 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskvrVe1g/build/tsan/bin/kudu as pid 12583
16:11:40.968 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
16:11:40.969 [INFO - Time-limited test] (MiniKuduCluster.java:475) Killing tablet server 127.11.18.1:34721
16:11:40.969 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: stop_daemon {
  id {
    type: TSERVER
    index: 0
  }
}

16:11:40.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:40.970181 11336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvrVe1g/build/tsan/bin/kudu with pid 11777
16:11:40.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:40.994057 12754 sys_catalog.cc:263] Verifying existing consensus state
16:11:41.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:41.001606 12754 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e59c875afec4be8af316d3aa9f32b8e: Bootstrap starting.
16:11:41.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:41.004587 12265 heartbeater.cc:347] Connected to a master server at 127.11.18.62:46141
16:11:41.029 [DEBUG - kudu-nio-1] (Connection.java:239) [peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721)] handling channelInactive
16:11:41.029 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
16:11:41.029 [DEBUG - kudu-nio-1] (Connection.java:709) [peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721)] cleaning up while in state READY due to: connection closed
16:11:41.030 [DEBUG - Time-limited test] (Connection.java:748) [peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721)] connecting to peer
16:11:41.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:41.030853 12758 negotiation.cc:337] Failed RPC negotiation. Trace:
16:11:41.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0811 16:11:40.968551 (+     0us) reactor.cc:625] Submitting negotiation task for server connection from 127.11.18.1:42069 (local address 127.11.18.62:46141)
16:11:41.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0811 16:11:40.982188 (+ 13637us) server_negotiation.cc:206] Beginning negotiation
16:11:41.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0811 16:11:40.982212 (+    24us) server_negotiation.cc:399] Waiting for connection header
16:11:41.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0811 16:11:41.029297 (+ 47085us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.11.18.1:42069: BlockingRecv error: recv got EOF from 127.11.18.1:42069 (error 108)
16:11:41.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"server-negotiator.queue_time_us":13316,"thread_start_us":13846,"threads_started":1}
16:11:41.034 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721): Connection refused: /127.11.18.1:34721
16:11:41.034 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721)] cleaning up while in state CONNECTING due to: Failed to connect to peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721): Connection refused: /127.11.18.1:34721
16:11:41.034 [INFO - kudu-nio-0] (AsyncKuduClient.java:2355) Invalidating location 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721) for tablet 909606cd99904d2bb821f4137631d353: Failed to connect to peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721): Connection refused: /127.11.18.1:34721
16:11:41.042 [DEBUG - pool-6-thread-1] (Connection.java:748) [peer master-127.11.18.62:46141(127.11.18.62:46141)] connecting to peer
16:11:41.044 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.11.18.62:46141(127.11.18.62:46141)] Successfully connected to peer
16:11:41.046 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.11.18.62
16:11:41.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:41.047258 12754 log.cc:824] T 00000000000000000000000000000000 P 6e59c875afec4be8af316d3aa9f32b8e: Log is configured to *not* fsync() on all Append() calls
16:11:41.069 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xf9b975f4, L:/127.0.0.1:60816 - R:/127.11.18.62:46141] using SASL/PLAIN
16:11:41.073 [DEBUG - kudu-nio-1] (RemoteTablet.java:166) master-127.11.18.62:46141 was demoted as the leader for Kudu Master
16:11:41.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:41.073897 12754 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e59c875afec4be8af316d3aa9f32b8e: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=5 ignored=0} mutations{seen=2 ignored=0} orphaned_commits=0. Pending: 0 replicates
16:11:41.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:41.074729 12754 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6e59c875afec4be8af316d3aa9f32b8e: Bootstrap complete.
16:11:41.089 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
16:11:41.089 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableLocations, tablet=Kudu Master, attempt=2, TimeoutTracker(timeout=29988, elapsed=46), Traces: [0ms] sending RPC to server master-127.11.18.62:46141, [31ms] delaying RPC due to: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [31ms] received response from server master-127.11.18.62:46141: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [40ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.18.60:46107, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.18.61:38211, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.18.62:46141, [46ms] Sub RPC ConnectToMaster: received response from server master-127.11.18.60:46107: OK, deferred=Deferred@138577962(state=PENDING, result=null, callback=get tablet locations from the master for table org.apache.kudu.client.TestClientFailoverSupport-RESTART -> release master lookup permit -> retry RPC, errback=passthrough -> release master lookup permit -> retry RPC after error)) after lookup
16:11:41.096 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.11.18.62:46141: Catalog manager is not initialized. State: Starting
16:11:41.096 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 909606cd99904d2bb821f4137631d353 for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
16:11:41.096 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=909606cd99904d2bb821f4137631d353@[0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721)[L],40e256a91d114593bbfb3204b8db718b(127.11.18.3:35519),569c6e53a65648b9b4a790d67eca8882(127.11.18.2:35173)]}]
16:11:41.097 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=909606cd99904d2bb821f4137631d353, attempt=2, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=67), Traces: [0ms] sending RPC to server 0e0d4c00a1bb42368f2945079442adff, [4ms] received response from server 0e0d4c00a1bb42368f2945079442adff: Network error: Failed to connect to peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721): Connection refused: /127.11.18.1:34721, [4ms] delaying RPC due to: Network error: Failed to connect to peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721): Connection refused: /127.11.18.1:34721, [12ms] refreshing cache from master, [12ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.18.62:46141, [43ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [43ms] Sub RPC GetTableLocations: received response from server master-127.11.18.62:46141: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [52ms] Sub RPC GetTableLocations: refreshing cache from master, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.18.60:46107, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.18.61:38211, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.18.62:46141, [58ms] Sub RPC ConnectToMaster: received response from server master-127.11.18.60:46107: OK, [61ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.18.60:46107, [63ms] Sub RPC ConnectToMaster: received response from server master-127.11.18.61:38211: OK, [66ms] Sub RPC GetTableLocations: received response from server master-127.11.18.60:46107: OK, deferred=Deferred@925313961(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$82/142867575@4dc7fdcf -> passthrough -> wakeup thread Time-limited test, errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@51582f85 -> wakeup thread Time-limited test)) after lookup
16:11:41.098 [DEBUG - kudu-nio-0] (Connection.java:748) [peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721)] connecting to peer
16:11:41.099 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721): Connection refused: /127.11.18.1:34721
16:11:41.099 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721)] cleaning up while in state CONNECTING due to: Failed to connect to peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721): Connection refused: /127.11.18.1:34721
16:11:41.099 [INFO - kudu-nio-0] (AsyncKuduClient.java:2355) Invalidating location 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721) for tablet 909606cd99904d2bb821f4137631d353: Failed to connect to peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721): Connection refused: /127.11.18.1:34721
16:11:41.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:41.101061 12754 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6e59c875afec4be8af316d3aa9f32b8e [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e59c875afec4be8af316d3aa9f32b8e" member_type: VOTER last_known_addr { host: "127.11.18.62" port: 46141 } } peers { permanent_uuid: "3b0580d0f39846b292086b9da681c79f" member_type: VOTER last_known_addr { host: "127.11.18.61" port: 38211 } } peers { permanent_uuid: "357246e67cbb426b81f94ecca052ca05" member_type: VOTER last_known_addr { host: "127.11.18.60" port: 46107 } }
16:11:41.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:41.103708 12754 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6e59c875afec4be8af316d3aa9f32b8e [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6e59c875afec4be8af316d3aa9f32b8e, State: Initialized, Role: FOLLOWER
16:11:41.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:41.104744 12754 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6e59c875afec4be8af316d3aa9f32b8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e59c875afec4be8af316d3aa9f32b8e" member_type: VOTER last_known_addr { host: "127.11.18.62" port: 46141 } } peers { permanent_uuid: "3b0580d0f39846b292086b9da681c79f" member_type: VOTER last_known_addr { host: "127.11.18.61" port: 38211 } } peers { permanent_uuid: "357246e67cbb426b81f94ecca052ca05" member_type: VOTER last_known_addr { host: "127.11.18.60" port: 46107 } }
16:11:41.107 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 909606cd99904d2bb821f4137631d353 for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
16:11:41.108 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=909606cd99904d2bb821f4137631d353@[0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721)[L],40e256a91d114593bbfb3204b8db718b(127.11.18.3:35519),569c6e53a65648b9b4a790d67eca8882(127.11.18.2:35173)]}]
16:11:41.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:41.108040 12764 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e59c875afec4be8af316d3aa9f32b8e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e59c875afec4be8af316d3aa9f32b8e" member_type: VOTER last_known_addr { host: "127.11.18.62" port: 46141 } } peers { permanent_uuid: "3b0580d0f39846b292086b9da681c79f" member_type: VOTER last_known_addr { host: "127.11.18.61" port: 38211 } } peers { permanent_uuid: "357246e67cbb426b81f94ecca052ca05" member_type: VOTER last_known_addr { host: "127.11.18.60" port: 46107 } } }
16:11:41.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:41.108906 12764 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e59c875afec4be8af316d3aa9f32b8e [sys.catalog]: This master's current role is: FOLLOWER
16:11:41.109 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=909606cd99904d2bb821f4137631d353, attempt=4, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=78), Traces: [0ms] sending RPC to server 0e0d4c00a1bb42368f2945079442adff, [4ms] received response from server 0e0d4c00a1bb42368f2945079442adff: Network error: Failed to connect to peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721): Connection refused: /127.11.18.1:34721, [4ms] delaying RPC due to: Network error: Failed to connect to peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721): Connection refused: /127.11.18.1:34721, [12ms] refreshing cache from master, [12ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.18.62:46141, [43ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [43ms] Sub RPC GetTableLocations: received response from server master-127.11.18.62:46141: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [52ms] Sub RPC GetTableLocations: refreshing cache from master, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.18.60:46107, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.18.61:38211, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.18.62:46141, [58ms] Sub RPC ConnectToMaster: received response from server master-127.11.18.60:46107: OK, [61ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.18.60:46107, [63ms] Sub RPC ConnectToMaster: received response from server master-127.11.18.61:38211: OK, [66ms] Sub RPC GetTableLocations: received response from server master-127.11.18.60:46107: OK, [67ms] sending RPC to server 0e0d4c00a1bb42368f2945079442adff, [69ms] received response from server 0e0d4c00a1bb42368f2945079442adff: Network error: Failed to connect to peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721): Connection refused: /127.11.18.1:34721, [69ms] delaying RPC due to: Network error: Failed to connect to peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721): Connection refused: /127.11.18.1:34721, [72ms] refreshing cache from master, [73ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.18.60:46107, [77ms] Sub RPC GetTableLocations: received response from server master-127.11.18.60:46107: OK, deferred=Deferred@925313961(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$82/142867575@4dc7fdcf -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@138577962 after retry RPC@103390433), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@51582f85 -> wakeup thread Time-limited test -> (continuation of Deferred@138577962 after retry RPC@103390433))) after lookup
16:11:41.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:41.109939 12754 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6e59c875afec4be8af316d3aa9f32b8e [sys.catalog]: configured and running, proceeding with master startup.
16:11:41.111 [DEBUG - kudu-nio-0] (Connection.java:748) [peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721)] connecting to peer
16:11:41.112 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721): Connection refused: /127.11.18.1:34721
16:11:41.112 [DEBUG - kudu-nio-1] (Connection.java:709) [peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721)] cleaning up while in state CONNECTING due to: Failed to connect to peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721): Connection refused: /127.11.18.1:34721
16:11:41.113 [INFO - kudu-nio-1] (AsyncKuduClient.java:2355) Invalidating location 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721) for tablet 909606cd99904d2bb821f4137631d353: Failed to connect to peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721): Connection refused: /127.11.18.1:34721
16:11:41.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:41.137249 12781 catalog_manager.cc:1259] Loaded cluster ID: 7df0d8d621ef47e18f192892ac71d4f9
16:11:41.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:41.137531 12781 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 6e59c875afec4be8af316d3aa9f32b8e: loading cluster ID for follower catalog manager: success
16:11:41.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:41.145123 12781 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 6e59c875afec4be8af316d3aa9f32b8e: acquiring CA information for follower catalog manager: success
16:11:41.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:41.150498 12781 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 6e59c875afec4be8af316d3aa9f32b8e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
16:11:41.152 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 909606cd99904d2bb821f4137631d353 for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
16:11:41.153 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=909606cd99904d2bb821f4137631d353@[0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721)[L],40e256a91d114593bbfb3204b8db718b(127.11.18.3:35519),569c6e53a65648b9b4a790d67eca8882(127.11.18.2:35173)]}]
16:11:41.153 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=909606cd99904d2bb821f4137631d353, attempt=6, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=123), Traces: [0ms] sending RPC to server 0e0d4c00a1bb42368f2945079442adff, [4ms] received response from server 0e0d4c00a1bb42368f2945079442adff: Network error: Failed to connect to peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721): Connection refused: /127.11.18.1:34721, [4ms] delaying RPC due to: Network error: Failed to connect to peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721): Connection refused: /127.11.18.1:34721, [12ms] refreshing cache from master, [12ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.18.62:46141, [43ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [43ms] Sub RPC GetTableLocations: received response from server master-127.11.18.62:46141: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [52ms] Sub RPC GetTableLocations: refreshing cache from master, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.18.60:46107, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.18.61:38211, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.18.62:46141, [58ms] Sub RPC ConnectToMaster: received response from server master-127.11.18.60:46107: OK, [61ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.18.60:46107, [63ms] Sub RPC ConnectToMaster: received response from server master-127.11.18.61:38211: OK, [66ms] Sub RPC GetTableLocations: received response from server master-127.11.18.60:46107: OK, [67ms] sending RPC to server 0e0d4c00a1bb42368f2945079442adff, [69ms] received response from server 0e0d4c00a1bb42368f2945079442adff: Network error: Failed to connect to peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721): Connection refused: /127.11.18.1:34721, [69ms] delaying RPC due to: Network error: Failed to connect to peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721): Connection refused: /127.11.18.1:34721, [72ms] refreshing cache from master, [73ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.18.60:46107, [77ms] Sub RPC GetTableLocations: received response from server master-127.11.18.60:46107: OK, [80ms] sending RPC to server 0e0d4c00a1bb42368f2945079442adff, [83ms] received response from server 0e0d4c00a1bb42368f2945079442adff: Network error: Failed to connect to peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721): Connection refused: /127.11.18.1:34721, [83ms] delaying RPC due to: Network error: Failed to connect to peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721): Connection refused: /127.11.18.1:34721, [112ms] refreshing cache from master, [113ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.18.60:46107, [122ms] Sub RPC GetTableLocations: received response from server master-127.11.18.60:46107: OK, deferred=Deferred@925313961(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$82/142867575@4dc7fdcf -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@138577962 after retry RPC@103390433) -> (continuation of Deferred@923267176 after retry RPC@2097392893), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@51582f85 -> wakeup thread Time-limited test -> (continuation of Deferred@138577962 after retry RPC@103390433) -> (continuation of Deferred@923267176 after retry RPC@2097392893))) after lookup
16:11:41.155 [DEBUG - kudu-nio-0] (Connection.java:748) [peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721)] connecting to peer
16:11:41.156 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721): Connection refused: /127.11.18.1:34721
16:11:41.156 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721)] cleaning up while in state CONNECTING due to: Failed to connect to peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721): Connection refused: /127.11.18.1:34721
16:11:41.156 [INFO - kudu-nio-0] (AsyncKuduClient.java:2355) Invalidating location 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721) for tablet 909606cd99904d2bb821f4137631d353: Failed to connect to peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721): Connection refused: /127.11.18.1:34721
16:11:41.188 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 909606cd99904d2bb821f4137631d353 for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
16:11:41.188 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=909606cd99904d2bb821f4137631d353@[0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721)[L],40e256a91d114593bbfb3204b8db718b(127.11.18.3:35519),569c6e53a65648b9b4a790d67eca8882(127.11.18.2:35173)]}]
16:11:41.189 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=909606cd99904d2bb821f4137631d353, attempt=8, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=158), Traces: [0ms] sending RPC to server 0e0d4c00a1bb42368f2945079442adff, [4ms] received response from server 0e0d4c00a1bb42368f2945079442adff: Network error: Failed to connect to peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721): Connection refused: /127.11.18.1:34721, [4ms] delaying RPC due to: Network error: Failed to connect to peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721): Connection refused: /127.11.18.1:34721, [12ms] refreshing cache from master, [12ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.18.62:46141, [43ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [43ms] Sub RPC GetTableLocations: received response from server master-127.11.18.62:46141: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [52ms] Sub RPC GetTableLocations: refreshing cache from master, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.18.60:46107, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.18.61:38211, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.18.62:46141, [58ms] Sub RPC ConnectToMaster: received response from server master-127.11.18.60:46107: OK, [61ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.18.60:46107, [63ms] Sub RPC ConnectToMaster: received response from server master-127.11.18.61:38211: OK, [66ms] Sub RPC GetTableLocations: received response from server master-127.11.18.60:46107: OK, [67ms] sending RPC to server 0e0d4c00a1bb42368f2945079442adff, [69ms] received response from server 0e0d4c00a1bb42368f2945079442adff: Network error: Failed to connect to peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721): Connection refused: /127.11.18.1:34721, [69ms] delaying RPC due to: Network error: Failed to connect to peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721): Connection refused: /127.11.18.1:34721, [72ms] refreshing cache from master, [73ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.18.60:46107, [77ms] Sub RPC GetTableLocations: received response from server master-127.11.18.60:46107: OK, [80ms] sending RPC to server 0e0d4c00a1bb42368f2945079442adff, [83ms] received response from server 0e0d4c00a1bb42368f2945079442adff: Network error: Failed to connect to peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721): Connection refused: /127.11.18.1:34721, [83ms] delaying RPC due to: Network error: Failed to connect to peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721): Connection refused: /127.11.18.1:34721, [112ms] refreshing cache from master, [113ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.18.60:46107, [122ms] Sub RPC GetTableLocations: received response from server master-127.11.18.60:46107: OK, [124ms] sending RPC to server 0e0d4c00a1bb42368f2945079442adff, [126ms] received response from server 0e0d4c00a1bb42368f2945079442adff: Network error: Failed to connect to peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721): Connection refused: /127.11.18.1:34721, [126ms] delaying RPC due to: Network error: Failed to connect to peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721): Connection refused: /127.11.18.1:34721, [153ms] refreshing cache from master, [153ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.18.60:46107, [157ms] Sub RPC GetTableLocations: received response from server master-127.11.18.60:46107: OK, deferred=Deferred@925313961(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$82/142867575@4dc7fdcf -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@138577962 after retry RPC@103390433) -> (continuation of Deferred@923267176 after retry RPC@2097392893) -> (continuation of Deferred@781888916 after retry RPC@627167707), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@51582f85 -> wakeup thread Time-limited test -> (continuation of Deferred@138577962 after retry RPC@103390433) -> (continuation of Deferred@923267176 after retry RPC@2097392893) -> (continuation of Deferred@781888916 after retry RPC@627167707))) after lookup
16:11:41.189 [DEBUG - kudu-nio-0] (Connection.java:748) [peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721)] connecting to peer
16:11:41.195 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721): Connection refused: /127.11.18.1:34721
16:11:41.195 [DEBUG - kudu-nio-1] (Connection.java:709) [peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721)] cleaning up while in state CONNECTING due to: Failed to connect to peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721): Connection refused: /127.11.18.1:34721
16:11:41.195 [INFO - kudu-nio-1] (AsyncKuduClient.java:2355) Invalidating location 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721) for tablet 909606cd99904d2bb821f4137631d353: Failed to connect to peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721): Connection refused: /127.11.18.1:34721
16:11:41.347 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 909606cd99904d2bb821f4137631d353 for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
16:11:41.347 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=909606cd99904d2bb821f4137631d353@[0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721)[L],40e256a91d114593bbfb3204b8db718b(127.11.18.3:35519),569c6e53a65648b9b4a790d67eca8882(127.11.18.2:35173)]}]
16:11:41.348 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=909606cd99904d2bb821f4137631d353, attempt=10, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=317), Traces: [0ms] sending RPC to server 0e0d4c00a1bb42368f2945079442adff, [4ms] received response from server 0e0d4c00a1bb42368f2945079442adff: Network error: Failed to connect to peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721): Connection refused: /127.11.18.1:34721, [4ms] delaying RPC due to: Network error: Failed to connect to peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721): Connection refused: /127.11.18.1:34721, [12ms] refreshing cache from master, [12ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.18.62:46141, [43ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [43ms] Sub RPC GetTableLocations: received response from server master-127.11.18.62:46141: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [52ms] Sub RPC GetTableLocations: refreshing cache from master, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.18.60:46107, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.18.61:38211, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.18.62:46141, [58ms] Sub RPC ConnectToMaster: received response from server master-127.11.18.60:46107: OK, [61ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.18.60:46107, [63ms] Sub RPC ConnectToMaster: received response from server master-127.11.18.61:38211: OK, [66ms] Sub RPC GetTableLocations: received response from server master-127.11.18.60:46107: OK, [67ms] sending RPC to server 0e0d4c00a1bb42368f2945079442adff, [69ms] received response from server 0e0d4c00a1bb42368f2945079442adff: Network error: Failed to connect to peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721): Connection refused: /127.11.18.1:34721, [69ms] delaying RPC due to: Network error: Failed to connect to peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721): Connection refused: /127.11.18.1:34721, [72ms] refreshing cache from master, [73ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.18.60:46107, [77ms] Sub RPC GetTableLocations: received response from server master-127.11.18.60:46107: OK, [80ms] sending RPC to server 0e0d4c00a1bb42368f2945079442adff, [83ms] received response from server 0e0d4c00a1bb42368f2945079442adff: Network error: Failed to connect to peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721): Connection refused: /127.11.18.1:34721, [83ms] delaying RPC due to: Network error: Failed to connect to peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721): Connection refused: /127.11.18.1:34721, [112ms] refreshing cache from master, [113ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.18.60:46107, [122ms] Sub RPC GetTableLocations: received response from server master-127.11.18.60:46107: OK, [124ms] sending RPC to server 0e0d4c00a1bb42368f2945079442adff, [126ms] received response from server 0e0d4c00a1bb42368f2945079442adff: Network error: Failed to connect to peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721): Connection refused: /127.11.18.1:34721, [126ms] delaying RPC due to: Network error: Failed to connect to peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721): Connection refused: /127.11.18.1:34721, [153ms] refreshing cache from master, [153ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.18.60:46107, [157ms] Sub RPC GetTableLocations: received response from server master-127.11.18.60:46107: OK, [159ms] sending RPC to server 0e0d4c00a1bb42368f2945079442adff, [165ms] received response from server 0e0d4c00a1bb42368f2945079442adff: Network error: Failed to connect to peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721): Connection refused: /127.11.18.1:34721, [165ms] delaying RPC due to: Network error: Failed to connect to peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721): Connection refused: /127.11.18.1:34721, [313ms] refreshing cache from master, [313ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.18.60:46107, [316ms] Sub RPC GetTableLocations: received response from server master-127.11.18.60:46107: OK, deferred=Deferred@925313961(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$82/142867575@4dc7fdcf -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@138577962 after retry RPC@103390433) -> (continuation of Deferred@923267176 after retry RPC@2097392893) -> (continuation of Deferred@781888916 after retry RPC@627167707) -> (continuation of Deferred@527068663 after retry RPC@875464904), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@51582f85 -> wakeup thread Time-limited test -> (continuation of Deferred@138577962 after retry RPC@103390433) -> (continuation of Deferred@923267176 after retry RPC@2097392893) -> (continuation of Deferred@781888916 after retry RPC@627167707) -> (continuation of Deferred@527068663 after retry RPC@875464904))) after lookup
16:11:41.349 [DEBUG - kudu-nio-0] (Connection.java:748) [peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721)] connecting to peer
16:11:41.350 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721): Connection refused: /127.11.18.1:34721
16:11:41.350 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721)] cleaning up while in state CONNECTING due to: Failed to connect to peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721): Connection refused: /127.11.18.1:34721
16:11:41.350 [INFO - kudu-nio-0] (AsyncKuduClient.java:2355) Invalidating location 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721) for tablet 909606cd99904d2bb821f4137631d353: Failed to connect to peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721): Connection refused: /127.11.18.1:34721
16:11:41.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:41.420523 12700 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6e59c875afec4be8af316d3aa9f32b8e [term 1 FOLLOWER]: Advancing to term 2
16:11:41.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:41.436347 12797 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e59c875afec4be8af316d3aa9f32b8e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "357246e67cbb426b81f94ecca052ca05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e59c875afec4be8af316d3aa9f32b8e" member_type: VOTER last_known_addr { host: "127.11.18.62" port: 46141 } } peers { permanent_uuid: "3b0580d0f39846b292086b9da681c79f" member_type: VOTER last_known_addr { host: "127.11.18.61" port: 38211 } } peers { permanent_uuid: "357246e67cbb426b81f94ecca052ca05" member_type: VOTER last_known_addr { host: "127.11.18.60" port: 46107 } } }
16:11:41.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:41.437652 12797 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e59c875afec4be8af316d3aa9f32b8e [sys.catalog]: This master's current role is: FOLLOWER
16:11:41.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:41.440748 12764 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6e59c875afec4be8af316d3aa9f32b8e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 357246e67cbb426b81f94ecca052ca05. Latest consensus state: current_term: 2 leader_uuid: "357246e67cbb426b81f94ecca052ca05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e59c875afec4be8af316d3aa9f32b8e" member_type: VOTER last_known_addr { host: "127.11.18.62" port: 46141 } } peers { permanent_uuid: "3b0580d0f39846b292086b9da681c79f" member_type: VOTER last_known_addr { host: "127.11.18.61" port: 38211 } } peers { permanent_uuid: "357246e67cbb426b81f94ecca052ca05" member_type: VOTER last_known_addr { host: "127.11.18.60" port: 46107 } } }
16:11:41.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:41.441234 12764 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6e59c875afec4be8af316d3aa9f32b8e [sys.catalog]: This master's current role is: FOLLOWER
16:11:41.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:41.825379 12679 sys_catalog.cc:455] T 00000000000000000000000000000000 P 357246e67cbb426b81f94ecca052ca05 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "357246e67cbb426b81f94ecca052ca05" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6e59c875afec4be8af316d3aa9f32b8e" member_type: VOTER last_known_addr { host: "127.11.18.62" port: 46141 } } peers { permanent_uuid: "3b0580d0f39846b292086b9da681c79f" member_type: VOTER last_known_addr { host: "127.11.18.61" port: 38211 } } peers { permanent_uuid: "357246e67cbb426b81f94ecca052ca05" member_type: VOTER last_known_addr { host: "127.11.18.60" port: 46107 } } }
16:11:41.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:41.826179 12679 sys_catalog.cc:458] T 00000000000000000000000000000000 P 357246e67cbb426b81f94ecca052ca05 [sys.catalog]: This master's current role is: LEADER
16:11:41.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:41.969451 12493 heartbeater.cc:503] Master 127.11.18.60:46107 was elected leader, sending a full tablet report...
16:11:41.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:41.970961 12263 heartbeater.cc:503] Master 127.11.18.60:46107 was elected leader, sending a full tablet report...
16:11:41.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:41.990342 12494 heartbeater.cc:347] Connected to a master server at 127.11.18.62:46141
16:11:41.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:41.997172 12673 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "40e256a91d114593bbfb3204b8db718b" instance_seqno: 1786464698137479) as {username='slave'} at 127.11.18.3:43617; Asking this server to re-register.
16:11:41.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:41.998317 12494 heartbeater.cc:464] Registering TS with master...
16:11:42.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:42.001719 12673 ts_manager.cc:194] Registered new tserver with Master: 40e256a91d114593bbfb3204b8db718b (127.11.18.3:35519)
16:11:42.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:42.010317 12673 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "569c6e53a65648b9b4a790d67eca8882" instance_seqno: 1786464696360460) as {username='slave'} at 127.11.18.2:52763; Asking this server to re-register.
16:11:42.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:42.011641 12265 heartbeater.cc:464] Registering TS with master...
16:11:42.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:42.014667 12673 ts_manager.cc:194] Registered new tserver with Master: 569c6e53a65648b9b4a790d67eca8882 (127.11.18.2:35173)
16:11:42.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:42.190356 12806 raft_consensus.cc:482] T 909606cd99904d2bb821f4137631d353 P 569c6e53a65648b9b4a790d67eca8882 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0e0d4c00a1bb42368f2945079442adff)
16:11:42.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:42.190831 12806 raft_consensus.cc:504] T 909606cd99904d2bb821f4137631d353 P 569c6e53a65648b9b4a790d67eca8882 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0d4c00a1bb42368f2945079442adff" member_type: VOTER last_known_addr { host: "127.11.18.1" port: 34721 } } peers { permanent_uuid: "40e256a91d114593bbfb3204b8db718b" member_type: VOTER last_known_addr { host: "127.11.18.3" port: 35519 } } peers { permanent_uuid: "569c6e53a65648b9b4a790d67eca8882" member_type: VOTER last_known_addr { host: "127.11.18.2" port: 35173 } }
16:11:42.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:42.193493 12806 leader_election.cc:288] T 909606cd99904d2bb821f4137631d353 P 569c6e53a65648b9b4a790d67eca8882 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0e0d4c00a1bb42368f2945079442adff (127.11.18.1:34721), 40e256a91d114593bbfb3204b8db718b (127.11.18.3:35519)
16:11:42.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:42.197250 12073 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.18.1:34721: connect: Connection refused (error 111)
16:11:42.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:42.202409 12073 leader_election.cc:334] T 909606cd99904d2bb821f4137631d353 P 569c6e53a65648b9b4a790d67eca8882 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0e0d4c00a1bb42368f2945079442adff (127.11.18.1:34721): Network error: Client connection negotiation failed: client connection to 127.11.18.1:34721: connect: Connection refused (error 111)
16:11:42.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:42.207171 12415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "909606cd99904d2bb821f4137631d353" candidate_uuid: "569c6e53a65648b9b4a790d67eca8882" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "40e256a91d114593bbfb3204b8db718b" is_pre_election: true
16:11:42.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:42.208590 12073 leader_election.cc:302] T 909606cd99904d2bb821f4137631d353 P 569c6e53a65648b9b4a790d67eca8882 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 569c6e53a65648b9b4a790d67eca8882; no voters: 0e0d4c00a1bb42368f2945079442adff, 40e256a91d114593bbfb3204b8db718b
16:11:42.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:42.209362 12806 raft_consensus.cc:2726] T 909606cd99904d2bb821f4137631d353 P 569c6e53a65648b9b4a790d67eca8882 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
16:11:42.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:42.307329 12817 raft_consensus.cc:482] T 909606cd99904d2bb821f4137631d353 P 40e256a91d114593bbfb3204b8db718b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0e0d4c00a1bb42368f2945079442adff)
16:11:42.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:42.307767 12817 raft_consensus.cc:504] T 909606cd99904d2bb821f4137631d353 P 40e256a91d114593bbfb3204b8db718b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0d4c00a1bb42368f2945079442adff" member_type: VOTER last_known_addr { host: "127.11.18.1" port: 34721 } } peers { permanent_uuid: "40e256a91d114593bbfb3204b8db718b" member_type: VOTER last_known_addr { host: "127.11.18.3" port: 35519 } } peers { permanent_uuid: "569c6e53a65648b9b4a790d67eca8882" member_type: VOTER last_known_addr { host: "127.11.18.2" port: 35173 } }
16:11:42.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:42.309926 12817 leader_election.cc:288] T 909606cd99904d2bb821f4137631d353 P 40e256a91d114593bbfb3204b8db718b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0e0d4c00a1bb42368f2945079442adff (127.11.18.1:34721), 569c6e53a65648b9b4a790d67eca8882 (127.11.18.2:35173)
16:11:42.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:42.311627 12308 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.18.1:34721: connect: Connection refused (error 111)
16:11:42.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:42.316988 12308 leader_election.cc:334] T 909606cd99904d2bb821f4137631d353 P 40e256a91d114593bbfb3204b8db718b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0e0d4c00a1bb42368f2945079442adff (127.11.18.1:34721): Network error: Client connection negotiation failed: client connection to 127.11.18.1:34721: connect: Connection refused (error 111)
16:11:42.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:42.322924 12184 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "909606cd99904d2bb821f4137631d353" candidate_uuid: "40e256a91d114593bbfb3204b8db718b" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "569c6e53a65648b9b4a790d67eca8882" is_pre_election: true
16:11:42.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:42.323611 12184 raft_consensus.cc:2454] T 909606cd99904d2bb821f4137631d353 P 569c6e53a65648b9b4a790d67eca8882 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40e256a91d114593bbfb3204b8db718b in term 1.
16:11:42.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:42.324698 12308 leader_election.cc:302] T 909606cd99904d2bb821f4137631d353 P 40e256a91d114593bbfb3204b8db718b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40e256a91d114593bbfb3204b8db718b, 569c6e53a65648b9b4a790d67eca8882; no voters: 0e0d4c00a1bb42368f2945079442adff
16:11:42.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:42.325464 12817 raft_consensus.cc:2781] T 909606cd99904d2bb821f4137631d353 P 40e256a91d114593bbfb3204b8db718b [term 1 FOLLOWER]: Leader pre-election won for term 2
16:11:42.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:42.325742 12817 raft_consensus.cc:482] T 909606cd99904d2bb821f4137631d353 P 40e256a91d114593bbfb3204b8db718b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0e0d4c00a1bb42368f2945079442adff)
16:11:42.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:42.326081 12817 raft_consensus.cc:3037] T 909606cd99904d2bb821f4137631d353 P 40e256a91d114593bbfb3204b8db718b [term 1 FOLLOWER]: Advancing to term 2
16:11:42.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:42.330503 12817 raft_consensus.cc:504] T 909606cd99904d2bb821f4137631d353 P 40e256a91d114593bbfb3204b8db718b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0d4c00a1bb42368f2945079442adff" member_type: VOTER last_known_addr { host: "127.11.18.1" port: 34721 } } peers { permanent_uuid: "40e256a91d114593bbfb3204b8db718b" member_type: VOTER last_known_addr { host: "127.11.18.3" port: 35519 } } peers { permanent_uuid: "569c6e53a65648b9b4a790d67eca8882" member_type: VOTER last_known_addr { host: "127.11.18.2" port: 35173 } }
16:11:42.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:42.331935 12817 leader_election.cc:288] T 909606cd99904d2bb821f4137631d353 P 40e256a91d114593bbfb3204b8db718b [CANDIDATE]: Term 2 election: Requested vote from peers 0e0d4c00a1bb42368f2945079442adff (127.11.18.1:34721), 569c6e53a65648b9b4a790d67eca8882 (127.11.18.2:35173)
16:11:42.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:42.334107 12184 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "909606cd99904d2bb821f4137631d353" candidate_uuid: "40e256a91d114593bbfb3204b8db718b" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "569c6e53a65648b9b4a790d67eca8882"
16:11:42.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:42.334635 12184 raft_consensus.cc:3037] T 909606cd99904d2bb821f4137631d353 P 569c6e53a65648b9b4a790d67eca8882 [term 1 FOLLOWER]: Advancing to term 2
16:11:42.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:42.335808 12308 leader_election.cc:334] T 909606cd99904d2bb821f4137631d353 P 40e256a91d114593bbfb3204b8db718b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 0e0d4c00a1bb42368f2945079442adff (127.11.18.1:34721): Network error: Client connection negotiation failed: client connection to 127.11.18.1:34721: connect: Connection refused (error 111)
16:11:42.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:42.340909 12184 raft_consensus.cc:2454] T 909606cd99904d2bb821f4137631d353 P 569c6e53a65648b9b4a790d67eca8882 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40e256a91d114593bbfb3204b8db718b in term 2.
16:11:42.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:42.341782 12308 leader_election.cc:302] T 909606cd99904d2bb821f4137631d353 P 40e256a91d114593bbfb3204b8db718b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40e256a91d114593bbfb3204b8db718b, 569c6e53a65648b9b4a790d67eca8882; no voters: 0e0d4c00a1bb42368f2945079442adff
16:11:42.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:42.342461 12817 raft_consensus.cc:2781] T 909606cd99904d2bb821f4137631d353 P 40e256a91d114593bbfb3204b8db718b [term 2 FOLLOWER]: Leader election won for term 2
16:11:42.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:42.344208 12817 raft_consensus.cc:686] T 909606cd99904d2bb821f4137631d353 P 40e256a91d114593bbfb3204b8db718b [term 2 LEADER]: Becoming Leader. State: Replica: 40e256a91d114593bbfb3204b8db718b, State: Running, Role: LEADER
16:11:42.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:42.345075 12817 consensus_queue.cc:237] T 909606cd99904d2bb821f4137631d353 P 40e256a91d114593bbfb3204b8db718b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 1.11, Last appended by leader: 11, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0d4c00a1bb42368f2945079442adff" member_type: VOTER last_known_addr { host: "127.11.18.1" port: 34721 } } peers { permanent_uuid: "40e256a91d114593bbfb3204b8db718b" member_type: VOTER last_known_addr { host: "127.11.18.3" port: 35519 } } peers { permanent_uuid: "569c6e53a65648b9b4a790d67eca8882" member_type: VOTER last_known_addr { host: "127.11.18.2" port: 35173 } }
16:11:42.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:42.354985 11659 catalog_manager.cc:5495] T 909606cd99904d2bb821f4137631d353 P 40e256a91d114593bbfb3204b8db718b reported cstate change: term changed from 1 to 2, leader changed from 0e0d4c00a1bb42368f2945079442adff (127.11.18.1) to 40e256a91d114593bbfb3204b8db718b (127.11.18.3). New cstate: current_term: 2 leader_uuid: "40e256a91d114593bbfb3204b8db718b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e0d4c00a1bb42368f2945079442adff" member_type: VOTER last_known_addr { host: "127.11.18.1" port: 34721 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40e256a91d114593bbfb3204b8db718b" member_type: VOTER last_known_addr { host: "127.11.18.3" port: 35519 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "569c6e53a65648b9b4a790d67eca8882" member_type: VOTER last_known_addr { host: "127.11.18.2" port: 35173 } health_report { overall_health: UNKNOWN } } }
16:11:42.667 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 909606cd99904d2bb821f4137631d353 for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
16:11:42.668 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=909606cd99904d2bb821f4137631d353@[0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721),40e256a91d114593bbfb3204b8db718b(127.11.18.3:35519)[L],569c6e53a65648b9b4a790d67eca8882(127.11.18.2:35173)]}]
16:11:42.669 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=909606cd99904d2bb821f4137631d353, attempt=12, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=1638), Traces: [0ms] sending RPC to server 0e0d4c00a1bb42368f2945079442adff, [4ms] received response from server 0e0d4c00a1bb42368f2945079442adff: Network error: Failed to connect to peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721): Connection refused: /127.11.18.1:34721, [4ms] delaying RPC due to: Network error: Failed to connect to peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721): Connection refused: /127.11.18.1:34721, [12ms] refreshing cache from master, [12ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.18.62:46141, [43ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [43ms] Sub RPC GetTableLocations: received response from server master-127.11.18.62:46141: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [52ms] Sub RPC GetTableLocations: refreshing cache from master, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.18.60:46107, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.18.61:38211, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.18.62:46141, [58ms] Sub RPC ConnectToMaster: received response from server master-127.11.18.60:46107: OK, [61ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.18.60:46107, [63ms] Sub RPC ConnectToMaster: received response from server master-127.11.18.61:38211: OK, [66ms] Sub RPC GetTableLocations: received response from server master-127.11.18.60:46107: OK, [67ms] sending RPC to server 0e0d4c00a1bb42368f2945079442adff, [69ms] received response from server 0e0d4c00a1bb42368f2945079442adff: Network error: Failed to connect to peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721): Connection refused: /127.11.18.1:34721, [69ms] delaying RPC due to: Network error: Failed to connect to peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721): Connection refused: /127.11.18.1:34721, [72ms] refreshing cache from master, [73ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.18.60:46107, [77ms] Sub RPC GetTableLocations: received response from server master-127.11.18.60:46107: OK, [80ms] sending RPC to server 0e0d4c00a1bb42368f2945079442adff, [83ms] received response from server 0e0d4c00a1bb42368f2945079442adff: Network error: Failed to connect to peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721): Connection refused: /127.11.18.1:34721, [83ms] delaying RPC due to: Network error: Failed to connect to peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721): Connection refused: /127.11.18.1:34721, [112ms] refreshing cache from master, [113ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.18.60:46107, [122ms] Sub RPC GetTableLocations: received response from server master-127.11.18.60:46107: OK, [124ms] sending RPC to server 0e0d4c00a1bb42368f2945079442adff, [126ms] received response from server 0e0d4c00a1bb42368f2945079442adff: Network error: Failed to connect to peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721): Connection refused: /127.11.18.1:34721, [126ms] delaying RPC due to: Network error: Failed to connect to peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721): Connection refused: /127.11.18.1:34721, [153ms] refreshing cache from master, [153ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.18.60:46107, [157ms] Sub RPC GetTableLocations: received response from server master-127.11.18.60:46107: OK, [159ms] sending RPC to server 0e0d4c00a1bb42368f2945079442adff, [165ms] received response from server 0e0d4c00a1bb42368f2945079442adff: Network error: Failed to connect to peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721): Connection refused: /127.11.18.1:34721, [165ms] delaying RPC due to: Network error: Failed to connect to peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721): Connection refused: /127.11.18.1:34721, [313ms] refreshing cache from master, [313ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.18.60:46107, [316ms] Sub RPC GetTableLocations: received response from server master-127.11.18.60:46107: OK, [318ms] sending RPC to server 0e0d4c00a1bb42368f2945079442adff, [320ms] received response from server 0e0d4c00a1bb42368f2945079442adff: Network error: Failed to connect to peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721): Connection refused: /127.11.18.1:34721, [320ms] delaying RPC due to: Network error: Failed to connect to peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721): Connection refused: /127.11.18.1:34721, [1633ms] refreshing cache from master, [1633ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.18.60:46107, [1637ms] Sub RPC GetTableLocations: received response from server master-127.11.18.60:46107: OK, deferred=Deferred@925313961(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$82/142867575@4dc7fdcf -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@138577962 after retry RPC@103390433) -> (continuation of Deferred@923267176 after retry RPC@2097392893) -> (continuation of Deferred@781888916 after retry RPC@627167707) -> (continuation of Deferred@527068663 after retry RPC@875464904) -> (continuation of Deferred@167352648 after retry RPC@96326965), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@51582f85 -> wakeup thread Time-limited test -> (continuation of Deferred@138577962 after retry RPC@103390433) -> (continuation of Deferred@923267176 after retry RPC@2097392893) -> (continuation of Deferred@781888916 after retry RPC@627167707) -> (continuation of Deferred@527068663 after retry RPC@875464904) -> (continuation of Deferred@167352648 after retry RPC@96326965))) after lookup
16:11:42.670 [DEBUG - kudu-nio-0] (Connection.java:748) [peer 40e256a91d114593bbfb3204b8db718b(127.11.18.3:35519)] connecting to peer
16:11:42.672 [DEBUG - kudu-nio-1] (Connection.java:757) [peer 40e256a91d114593bbfb3204b8db718b(127.11.18.3:35519)] Successfully connected to peer
16:11:42.696 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x3035d8fb, L:/127.0.0.1:41504 - R:/127.11.18.3:35519] using TOKEN/null
16:11:42.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:42.706776 12184 raft_consensus.cc:1261] T 909606cd99904d2bb821f4137631d353 P 569c6e53a65648b9b4a790d67eca8882 [term 2 FOLLOWER]: Refusing update from remote peer 40e256a91d114593bbfb3204b8db718b: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 2 index: 13. (index mismatch)
16:11:42.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:42.709017 12821 consensus_queue.cc:1035] T 909606cd99904d2bb821f4137631d353 P 40e256a91d114593bbfb3204b8db718b [LEADER]: Connected to new peer: Peer: permanent_uuid: "569c6e53a65648b9b4a790d67eca8882" member_type: VOTER last_known_addr { host: "127.11.18.2" port: 35173 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
16:11:42.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:42.710810 12308 consensus_peers.cc:487] T 909606cd99904d2bb821f4137631d353 P 40e256a91d114593bbfb3204b8db718b -> Peer 0e0d4c00a1bb42368f2945079442adff (127.11.18.1:34721): Couldn't send request to peer 0e0d4c00a1bb42368f2945079442adff. Status: Network error: Client connection negotiation failed: client connection to 127.11.18.1:34721: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
16:11:42.906 [DEBUG - kudu-nio-1] (AsyncKuduScanner.java:1374) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 20 rows, more = false) for scanner KuduScanner(table=org.apache.kudu.client.TestClientFailoverSupport-RESTART, tablet=909606cd99904d2bb821f4137631d353, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
16:11:42.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:42.909024 11659 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:38632:
16:11:42.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "org.apache.kudu.client.TestClientFailoverSupport-RESTART" }
16:11:42.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:42.909726 11659 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:38632:
16:11:42.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "org.apache.kudu.client.TestClientFailoverSupport-RESTART" }
16:11:42.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:42.974689 11659 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 357246e67cbb426b81f94ecca052ca05: Sending DeleteTablet for 3 replicas of tablet 909606cd99904d2bb821f4137631d353
16:11:42.989 [DEBUG - main] (Connection.java:575) [peer master-127.11.18.62:46141(127.11.18.62:46141)] disconnecting while in state READY
16:11:42.989 [DEBUG - main] (Connection.java:575) [peer 0e0d4c00a1bb42368f2945079442adff(127.11.18.1:34721)] disconnecting while in state TERMINATED
16:11:42.989 [DEBUG - main] (Connection.java:575) [peer 40e256a91d114593bbfb3204b8db718b(127.11.18.3:35519)] disconnecting while in state READY
16:11:42.989 [DEBUG - main] (Connection.java:575) [peer master-127.11.18.61:38211(127.11.18.61:38211)] disconnecting while in state READY
16:11:42.989 [DEBUG - main] (Connection.java:575) [peer master-127.11.18.60:46107(127.11.18.60:46107)] disconnecting while in state READY
16:11:42.996 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.11.18.62:46141(127.11.18.62:46141)] handling channelInactive
16:11:42.997 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.18.62:46141(127.11.18.62:46141)] cleaning up while in state READY due to: connection closed
16:11:42.997 [DEBUG - kudu-nio-1] (Connection.java:239) [peer 40e256a91d114593bbfb3204b8db718b(127.11.18.3:35519)] handling channelInactive
16:11:42.997 [DEBUG - kudu-nio-1] (Connection.java:709) [peer 40e256a91d114593bbfb3204b8db718b(127.11.18.3:35519)] cleaning up while in state READY due to: connection closed
16:11:42.997 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.11.18.61:38211(127.11.18.61:38211)] handling channelInactive
16:11:42.997 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.18.61:38211(127.11.18.61:38211)] cleaning up while in state READY due to: connection closed
16:11:43.000 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
16:11:43.004 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.11.18.60:46107(127.11.18.60:46107)] handling channelInactive
16:11:43.004 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.18.60:46107(127.11.18.60:46107)] cleaning up while in state READY due to: connection closed
16:11:43.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:43.005338 11336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvrVe1g/build/tsan/bin/kudu with pid 12031
16:11:43.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:43.033653 12381 tablet_service.cc:1514] Processing DeleteTablet for tablet 909606cd99904d2bb821f4137631d353 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-11 16:11:42 UTC) from {username='slave'} at 127.0.0.1:41514
16:11:43.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:43.036254 11639 catalog_manager.cc:4584] TS 0e0d4c00a1bb42368f2945079442adff (127.11.18.1:34721): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 909606cd99904d2bb821f4137631d353: Network error: Client connection negotiation failed: client connection to 127.11.18.1:34721: connect: Connection refused (error 111)
16:11:43.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:43.038215 12876 tablet_replica.cc:330] T 909606cd99904d2bb821f4137631d353 P 40e256a91d114593bbfb3204b8db718b: stopping tablet replica
16:11:43.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:43.038965 12876 raft_consensus.cc:2229] T 909606cd99904d2bb821f4137631d353 P 40e256a91d114593bbfb3204b8db718b [term 2 LEADER]: Raft consensus shutting down.
16:11:43.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:43.040480 12876 raft_consensus.cc:2258] T 909606cd99904d2bb821f4137631d353 P 40e256a91d114593bbfb3204b8db718b [term 2 FOLLOWER]: Raft consensus is shut down!
16:11:43.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:43.043293 12876 ts_tablet_manager.cc:1905] T 909606cd99904d2bb821f4137631d353 P 40e256a91d114593bbfb3204b8db718b: Deleting tablet data with delete state TABLET_DATA_DELETED
16:11:43.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:43.055595 11336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvrVe1g/build/tsan/bin/kudu with pid 12278
16:11:43.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 16:11:43.056595 12870 negotiation.cc:337] Failed RPC negotiation. Trace:
16:11:43.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0811 16:11:42.989108 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.11.18.2:35173 (local address 127.0.0.1:42156)
16:11:43.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0811 16:11:43.023978 (+ 34870us) negotiation.cc:107] Waiting for socket to connect
16:11:43.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0811 16:11:43.024024 (+    46us) client_negotiation.cc:174] Beginning negotiation
16:11:43.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0811 16:11:43.024246 (+   222us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
16:11:43.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0811 16:11:43.055405 (+ 31159us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.11.18.2:35173: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
16:11:43.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"client-negotiator.queue_time_us":33458,"thread_start_us":41332,"threads_started":1}
16:11:43.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:43.089847 11336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvrVe1g/build/tsan/bin/kudu with pid 12583
16:11:43.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:43.123719 11336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvrVe1g/build/tsan/bin/kudu with pid 11478
16:11:43.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 16:11:43.153013 11336 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskvrVe1g/build/tsan/bin/kudu with pid 11593
16:11:44.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-08-11T16:11:44Z chronyd exiting

Time: 38.994

OK (2 tests)

