JUnit version 4.13.2
.08:00:53.319 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1783497653309
08:00:53.382 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
08:00:53.449 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
08:00:53.458 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-tasktDuNhD/test-tmp
08:00:53.463 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
08:00:53.466 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-tasktDuNhD/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
08:00:53.661 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

08:00:53.831 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
08:00:53.832 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

08:00:53.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:53.836282 31083 mini_oidc.cc:150] Starting JWKS server
08:00:53.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:53.839574 31083 webserver.cc:533] Webserver started at http://127.0.0.1:38239/ using document root <none> and password file <none>
08:00:53.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:53.839993 31083 mini_oidc.cc:186] Starting OIDC Discovery server
08:00:53.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:53.841641 31083 webserver.cc:533] Webserver started at http://127.0.0.1:32897/ using document root <none> and password file <none>
08:00:53.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T08:00:53Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
08:00:53.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T08:00:53Z Disabled control of system clock
08:00:53.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:53.898738 31083 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasktDuNhD/build/tsan/bin/kudu
08:00:53.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-tasktDuNhD/build/tsan/bin/kudu
08:00:53.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/master-0/wal
08:00:53.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/master-0/data
08:00:53.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:00:53.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:00:53.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:00:53.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:00:53.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:00:53.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:00:53.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/master-0/logs
08:00:53.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/master-0/data/info.pb
08:00:53.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:00:53.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:00:53.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:00:53.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:00:53.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:00:53.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:00:53.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:00:53.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:00:53.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
08:00:53.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:00:53.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:00:53.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:00:53.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.30.90.254:39231
08:00:53.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.30.90.254
08:00:53.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:00:53.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.30.90.212:36103
08:00:53.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:00:53.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:00:53.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:00:53.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:00:53.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.30.90.254:39231,127.30.90.253:42583,127.30.90.252:46693
08:00:53.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:00:53.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:38239/jwks.json with env {}
08:00:54.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:54.191649 31095 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:00:54.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:54.192345 31095 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:00:54.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:54.193156 31095 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:00:54.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:54.225739 31095 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
08:00:54.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:54.226105 31095 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:00:54.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:54.226430 31095 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
08:00:54.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:54.226778 31095 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
08:00:54.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:54.227138 31095 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
08:00:54.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:54.227411 31095 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:38239/jwks.json
08:00:54.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:54.264348 31095 master_runner.cc:387] Master server non-default flags:
08:00:54.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:00:54.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.30.90.212:36103
08:00:54.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:00:54.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:00:54.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/master-0/data
08:00:54.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/master-0/wal
08:00:54.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:00:54.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.30.90.254:39231,127.30.90.253:42583,127.30.90.252:46693
08:00:54.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:00:54.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:00:54.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:00:54.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.30.90.254:39231
08:00:54.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:00:54.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:00:54.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:00:54.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:38239/jwks.json
08:00:54.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:00:54.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:00:54.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/master-0/data/info.pb
08:00:54.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.30.90.254
08:00:54.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:00:54.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:00:54.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:00:54.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:00:54.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:00:54.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:00:54.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/master-0/logs
08:00:54.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:00:54.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:00:54.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:00:54.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
08:00:54.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:00:54.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
08:00:54.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:00:54.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 07:43:22 UTC on e7f111948823
08:00:54.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12771
08:00:54.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:00:54.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:54.266170 31095 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:00:54.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:54.268585 31095 file_cache.cc:504] Constructed file cache file cache with capacity 419430
08:00:54.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:54.282025 31101 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:00:55.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:54.282038 31102 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:00:55.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:55.390573 31103 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1106 milliseconds
08:00:55.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:55.392373 31104 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:00:55.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:55.395458 31095 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.114s	user 0.415s	sys 0.698s
08:00:55.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:55.395752 31095 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.114s	user 0.415s	sys 0.698s
08:00:55.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:55.396039 31095 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:00:55.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:55.397418 31095 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:00:55.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:55.400230 31095 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:00:55.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:55.401633 31095 hybrid_clock.cc:648] HybridClock initialized: now 1783497655401591 us; error 58 us; skew 500 ppm
08:00:55.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:55.402633 31095 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:00:55.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:55.410147 31095 webserver.cc:533] Webserver started at http://127.30.90.254:44517/ using document root <none> and password file <none>
08:00:55.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:55.411361 31095 fs_manager.cc:362] Metadata directory not provided
08:00:55.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:55.411607 31095 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:00:55.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:55.412189 31095 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:00:55.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:55.416726 31095 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/master-0/data/instance:
08:00:55.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "51d367845ccb46a9b65fb650ccf827d2"
08:00:55.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 08:00:55 on dist-test-slave-ltj1"
08:00:55.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:55.418135 31095 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/master-0/wal/instance:
08:00:55.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "51d367845ccb46a9b65fb650ccf827d2"
08:00:55.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 08:00:55 on dist-test-slave-ltj1"
08:00:55.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:55.428668 31095 fs_manager.cc:696] Time spent creating directory manager: real 0.010s	user 0.007s	sys 0.005s
08:00:55.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:55.443233 31111 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:00:55.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:55.445571 31095 fs_manager.cc:730] Time spent opening block manager: real 0.012s	user 0.006s	sys 0.001s
08:00:55.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:55.445901 31095 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/master-0/data,/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/master-0/wal
08:00:55.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "51d367845ccb46a9b65fb650ccf827d2"
08:00:55.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 08:00:55 on dist-test-slave-ltj1"
08:00:55.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:55.446201 31095 fs_report.cc:389] FS layout report
08:00:55.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:00:55.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/master-0/wal
08:00:55.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/master-0/wal
08:00:55.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/master-0/data/data
08:00:55.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:00:55.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:00:55.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:00:55.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:00:55.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:00:55.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:00:55.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:00:55.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:00:55.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:00:55.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:00:55.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:00:55.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:55.511049 31095 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:00:55.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:55.513067 31095 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:00:55.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:55.513741 31095 kserver.cc:163] Server-wide thread pool size limit: 3276
08:00:55.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:55.582281 31095 rpc_server.cc:307] RPC server started. Bound to: 127.30.90.254:39231
08:00:55.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:55.582356 31162 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.30.90.254:39231 every 8 connection(s)
08:00:55.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:55.585281 31095 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/master-0/data/info.pb
08:00:55.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:55.590513 31083 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasktDuNhD/build/tsan/bin/kudu as pid 31095
08:00:55.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:55.591053 31083 external_mini_cluster.cc:1448] Reading /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/master-0/wal/instance
08:00:55.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:55.591799 31163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
08:00:55.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:55.596014 31083 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasktDuNhD/build/tsan/bin/kudu
08:00:55.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-tasktDuNhD/build/tsan/bin/kudu
08:00:55.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/master-1/wal
08:00:55.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/master-1/data
08:00:55.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:00:55.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:00:55.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:00:55.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:00:55.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:00:55.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:00:55.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/master-1/logs
08:00:55.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/master-1/data/info.pb
08:00:55.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:00:55.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:00:55.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:00:55.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:00:55.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:00:55.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:00:55.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:00:55.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:00:55.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
08:00:55.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:00:55.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:00:55.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:00:55.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.30.90.253:42583
08:00:55.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.30.90.253
08:00:55.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:00:55.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.30.90.212:36103
08:00:55.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:00:55.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:00:55.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:00:55.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:00:55.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.30.90.254:39231,127.30.90.253:42583,127.30.90.252:46693
08:00:55.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:00:55.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:38239/jwks.json with env {}
08:00:55.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:55.606998 31163 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.90.254" port: 39231 } has no permanent_uuid. Determining permanent_uuid...
08:00:55.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:55.638042 31163 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.90.253" port: 42583 } has no permanent_uuid. Determining permanent_uuid...
08:00:55.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:55.640552 31115 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.30.90.253:42583: connect: Connection refused (error 111)
08:00:55.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:55.645531 31163 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.90.253:42583: Network error: Client connection negotiation failed: client connection to 127.30.90.253:42583: connect: Connection refused (error 111)
08:00:55.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:55.695155 31163 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.90.253" port: 42583 } attempt: 1
08:00:55.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:55.699592 31163 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.90.253:42583: Network error: Client connection negotiation failed: client connection to 127.30.90.253:42583: connect: Connection refused (error 111)
08:00:55.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:55.768162 31163 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.90.253" port: 42583 } attempt: 2
08:00:55.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:55.773171 31163 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.90.253:42583: Network error: Client connection negotiation failed: client connection to 127.30.90.253:42583: connect: Connection refused (error 111)
08:00:55.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:55.864578 31163 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.90.253" port: 42583 } attempt: 3
08:00:55.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:55.869710 31163 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.90.253:42583: Network error: Client connection negotiation failed: client connection to 127.30.90.253:42583: connect: Connection refused (error 111)
08:00:55.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:55.903273 31165 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:00:55.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:55.903924 31165 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:00:55.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:55.904398 31165 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:00:55.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:55.938302 31165 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
08:00:55.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:55.938695 31165 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:00:55.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:55.939065 31165 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
08:00:55.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:55.939342 31165 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
08:00:55.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:55.939535 31165 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
08:00:55.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:55.939674 31165 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:38239/jwks.json
08:00:55.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:55.976742 31165 master_runner.cc:387] Master server non-default flags:
08:00:55.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:00:55.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.30.90.212:36103
08:00:55.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:00:55.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:00:55.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/master-1/data
08:00:55.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/master-1/wal
08:00:55.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:00:55.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.30.90.254:39231,127.30.90.253:42583,127.30.90.252:46693
08:00:55.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:00:55.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:00:55.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:00:55.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.30.90.253:42583
08:00:55.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:00:55.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:00:55.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:00:55.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:38239/jwks.json
08:00:55.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:00:55.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:00:55.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/master-1/data/info.pb
08:00:55.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.30.90.253
08:00:55.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:00:55.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:00:55.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:00:55.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:00:55.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:00:55.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:00:55.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/master-1/logs
08:00:55.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:00:55.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:00:55.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:00:55.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
08:00:55.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:00:55.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
08:00:55.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:00:55.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 07:43:22 UTC on e7f111948823
08:00:55.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12771
08:00:55.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:00:55.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:55.978045 31165 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:00:55.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:55.979799 31165 file_cache.cc:504] Constructed file cache file cache with capacity 419430
08:00:55.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:55.992760 31174 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:00:56.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:56.013116 31163 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.90.253" port: 42583 } attempt: 4
08:00:56.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:56.018204 31163 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.90.253:42583: Network error: Client connection negotiation failed: client connection to 127.30.90.253:42583: connect: Connection refused (error 111)
08:00:56.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:56.317656 31163 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.90.253" port: 42583 } attempt: 5
08:00:56.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:56.323282 31163 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.90.253:42583: Network error: Client connection negotiation failed: client connection to 127.30.90.253:42583: connect: Connection refused (error 111)
08:00:56.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:56.870779 31163 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.90.253" port: 42583 } attempt: 6
08:00:56.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:56.882385 31163 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.90.253:42583: Network error: Client connection negotiation failed: client connection to 127.30.90.253:42583: connect: Connection refused (error 111)
08:00:57.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:55.994475 31175 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:00:57.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:57.151984 31176 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1156 milliseconds
08:00:57.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:57.152668 31177 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:00:57.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:57.152689 31165 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:00:57.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:57.156806 31165 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:00:57.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:57.159760 31165 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:00:57.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:57.161213 31165 hybrid_clock.cc:648] HybridClock initialized: now 1783497657161143 us; error 83 us; skew 500 ppm
08:00:57.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:57.162045 31165 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:00:57.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:57.167966 31165 webserver.cc:533] Webserver started at http://127.30.90.253:45207/ using document root <none> and password file <none>
08:00:57.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:57.169061 31165 fs_manager.cc:362] Metadata directory not provided
08:00:57.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:57.169353 31165 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:00:57.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:57.169945 31165 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:00:57.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:57.176443 31165 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/master-1/data/instance:
08:00:57.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1b0495e904244bf89e8ddf7839389404"
08:00:57.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 08:00:57 on dist-test-slave-ltj1"
08:00:57.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:57.177609 31165 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/master-1/wal/instance:
08:00:57.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1b0495e904244bf89e8ddf7839389404"
08:00:57.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 08:00:57 on dist-test-slave-ltj1"
08:00:57.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:57.184952 31165 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.004s	sys 0.004s
08:00:57.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:57.190884 31186 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:00:57.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:57.192054 31165 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
08:00:57.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:57.192405 31165 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/master-1/data,/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/master-1/wal
08:00:57.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1b0495e904244bf89e8ddf7839389404"
08:00:57.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 08:00:57 on dist-test-slave-ltj1"
08:00:57.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:57.192847 31165 fs_report.cc:389] FS layout report
08:00:57.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:00:57.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/master-1/wal
08:00:57.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/master-1/wal
08:00:57.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/master-1/data/data
08:00:57.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:00:57.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:00:57.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:00:57.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:00:57.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:00:57.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:00:57.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:00:57.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:00:57.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:00:57.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:00:57.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:00:57.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:57.241024 31165 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:00:57.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:57.242660 31165 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:00:57.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:57.243206 31165 kserver.cc:163] Server-wide thread pool size limit: 3276
08:00:57.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:57.314368 31165 rpc_server.cc:307] RPC server started. Bound to: 127.30.90.253:42583
08:00:57.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:57.314435 31237 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.30.90.253:42583 every 8 connection(s)
08:00:57.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:57.317329 31165 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/master-1/data/info.pb
08:00:57.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:57.319528 31083 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasktDuNhD/build/tsan/bin/kudu as pid 31165
08:00:57.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:57.320009 31083 external_mini_cluster.cc:1448] Reading /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/master-1/wal/instance
08:00:57.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:57.322333 31083 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasktDuNhD/build/tsan/bin/kudu
08:00:57.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-tasktDuNhD/build/tsan/bin/kudu
08:00:57.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/master-2/wal
08:00:57.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/master-2/data
08:00:57.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:00:57.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:00:57.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:00:57.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:00:57.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:00:57.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:00:57.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/master-2/logs
08:00:57.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/master-2/data/info.pb
08:00:57.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:00:57.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:00:57.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:00:57.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:00:57.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:00:57.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:00:57.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:00:57.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:00:57.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
08:00:57.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:00:57.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:00:57.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:00:57.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.30.90.252:46693
08:00:57.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.30.90.252
08:00:57.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:00:57.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.30.90.212:36103
08:00:57.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:00:57.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:00:57.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:00:57.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:00:57.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.30.90.254:39231,127.30.90.253:42583,127.30.90.252:46693
08:00:57.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:00:57.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:38239/jwks.json with env {}
08:00:57.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:57.323604 31238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
08:00:57.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:57.337070 31238 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.90.254" port: 39231 } has no permanent_uuid. Determining permanent_uuid...
08:00:57.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:57.358282 31238 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.90.253" port: 42583 } has no permanent_uuid. Determining permanent_uuid...
08:00:57.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:57.372789 31238 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.90.252" port: 46693 } has no permanent_uuid. Determining permanent_uuid...
08:00:57.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:57.375097 31188 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.30.90.252:46693: connect: Connection refused (error 111)
08:00:57.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:57.379170 31238 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.90.252:46693: Network error: Client connection negotiation failed: client connection to 127.30.90.252:46693: connect: Connection refused (error 111)
08:00:57.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:57.428714 31238 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.90.252" port: 46693 } attempt: 1
08:00:57.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:57.434387 31238 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.90.252:46693: Network error: Client connection negotiation failed: client connection to 127.30.90.252:46693: connect: Connection refused (error 111)
08:00:57.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:57.502817 31238 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.90.252" port: 46693 } attempt: 2
08:00:57.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:57.506901 31238 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.90.252:46693: Network error: Client connection negotiation failed: client connection to 127.30.90.252:46693: connect: Connection refused (error 111)
08:00:57.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:57.598412 31238 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.90.252" port: 46693 } attempt: 3
08:00:57.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:57.602866 31238 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.90.252:46693: Network error: Client connection negotiation failed: client connection to 127.30.90.252:46693: connect: Connection refused (error 111)
08:00:57.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:57.628561 31240 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:00:57.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:57.629119 31240 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:00:57.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:57.629660 31240 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:00:57.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:57.662743 31240 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
08:00:57.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:57.663034 31240 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:00:57.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:57.663290 31240 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
08:00:57.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:57.663486 31240 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
08:00:57.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:57.663676 31240 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
08:00:57.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:57.663812 31240 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:38239/jwks.json
08:00:57.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:57.701049 31240 master_runner.cc:387] Master server non-default flags:
08:00:57.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:00:57.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.30.90.212:36103
08:00:57.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:00:57.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:00:57.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/master-2/data
08:00:57.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/master-2/wal
08:00:57.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:00:57.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.30.90.254:39231,127.30.90.253:42583,127.30.90.252:46693
08:00:57.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:00:57.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:00:57.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:00:57.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.30.90.252:46693
08:00:57.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:00:57.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:00:57.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:00:57.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:38239/jwks.json
08:00:57.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:00:57.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:00:57.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/master-2/data/info.pb
08:00:57.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.30.90.252
08:00:57.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:00:57.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:00:57.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:00:57.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:00:57.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:00:57.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:00:57.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/master-2/logs
08:00:57.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:00:57.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:00:57.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:00:57.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
08:00:57.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:00:57.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
08:00:57.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:00:57.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 07:43:22 UTC on e7f111948823
08:00:57.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12771
08:00:57.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:00:57.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:57.702381 31240 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:00:57.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:57.704257 31240 file_cache.cc:504] Constructed file cache file cache with capacity 419430
08:00:57.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:57.715508 31250 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:00:57.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:57.746265 31238 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.90.252" port: 46693 } attempt: 4
08:00:57.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:57.753460 31238 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.90.252:46693: Network error: Client connection negotiation failed: client connection to 127.30.90.252:46693: connect: Connection refused (error 111)
08:00:57.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:57.942938 31163 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.90.253" port: 42583 } attempt: 7
08:00:57.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:57.985033 31163 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.90.252" port: 46693 } has no permanent_uuid. Determining permanent_uuid...
08:00:58.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:58.002715 31163 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.90.252:46693: Network error: Client connection negotiation failed: client connection to 127.30.90.252:46693: connect: Connection refused (error 111)
08:00:58.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:58.052943 31238 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.90.252" port: 46693 } attempt: 5
08:00:58.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:58.061314 31163 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.90.252" port: 46693 } attempt: 1
08:00:58.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:58.064975 31238 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.90.252:46693: Network error: Client connection negotiation failed: client connection to 127.30.90.252:46693: connect: Connection refused (error 111)
08:00:58.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:58.068243 31163 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.90.252:46693: Network error: Client connection negotiation failed: client connection to 127.30.90.252:46693: connect: Connection refused (error 111)
08:00:58.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:58.149838 31163 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.90.252" port: 46693 } attempt: 2
08:00:58.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:58.157636 31163 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.90.252:46693: Network error: Client connection negotiation failed: client connection to 127.30.90.252:46693: connect: Connection refused (error 111)
08:00:58.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:58.243175 31163 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.90.252" port: 46693 } attempt: 3
08:00:58.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:58.250758 31163 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.90.252:46693: Network error: Client connection negotiation failed: client connection to 127.30.90.252:46693: connect: Connection refused (error 111)
08:00:58.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:58.391280 31163 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.90.252" port: 46693 } attempt: 4
08:00:58.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:58.399399 31163 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.90.252:46693: Network error: Client connection negotiation failed: client connection to 127.30.90.252:46693: connect: Connection refused (error 111)
08:00:58.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:58.612468 31238 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.90.252" port: 46693 } attempt: 6
08:00:58.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:58.643028 31238 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.90.252:46693: Network error: Client connection negotiation failed: client connection to 127.30.90.252:46693: connect: Connection refused (error 111)
08:00:58.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:58.682906 31163 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.90.252" port: 46693 } attempt: 5
08:00:58.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:58.690402 31163 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.30.90.252:46693: Network error: Client connection negotiation failed: client connection to 127.30.90.252:46693: connect: Connection refused (error 111)
08:00:58.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:57.716136 31251 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:00:58.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:58.976848 31253 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:00:58.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:58.979677 31240 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.264s	user 0.421s	sys 0.826s
08:00:58.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:58.980484 31240 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.265s	user 0.422s	sys 0.827s
08:00:58.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:58.980604 31252 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1259 milliseconds
08:00:58.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:58.980803 31240 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:00:58.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:58.982326 31240 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:00:58.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:58.985441 31240 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:00:58.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:58.987226 31240 hybrid_clock.cc:648] HybridClock initialized: now 1783497658987176 us; error 43 us; skew 500 ppm
08:00:58.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:58.988344 31240 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:00:58.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:58.996946 31240 webserver.cc:533] Webserver started at http://127.30.90.252:40845/ using document root <none> and password file <none>
08:00:58.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:58.998245 31240 fs_manager.cc:362] Metadata directory not provided
08:00:58.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:58.998561 31240 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:00:58.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:58.999133 31240 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:00:59.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.005574 31240 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/master-2/data/instance:
08:00:59.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "aa6cc82c575b49acb9dd9a7f924ad8d2"
08:00:59.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 08:00:58 on dist-test-slave-ltj1"
08:00:59.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.007200 31240 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/master-2/wal/instance:
08:00:59.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "aa6cc82c575b49acb9dd9a7f924ad8d2"
08:00:59.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 08:00:58 on dist-test-slave-ltj1"
08:00:59.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.017020 31240 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.006s	sys 0.003s
08:00:59.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.024772 31265 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:00:59.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.025952 31240 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.001s	sys 0.004s
08:00:59.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.026281 31240 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/master-2/data,/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/master-2/wal
08:00:59.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "aa6cc82c575b49acb9dd9a7f924ad8d2"
08:00:59.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 08:00:58 on dist-test-slave-ltj1"
08:00:59.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.026612 31240 fs_report.cc:389] FS layout report
08:00:59.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:00:59.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/master-2/wal
08:00:59.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/master-2/wal
08:00:59.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/master-2/data/data
08:00:59.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:00:59.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:00:59.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:00:59.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:00:59.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:00:59.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:00:59.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:00:59.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:00:59.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:00:59.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:00:59.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:00:59.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.097187 31240 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:00:59.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.098726 31240 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:00:59.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.099200 31240 kserver.cc:163] Server-wide thread pool size limit: 3276
08:00:59.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.167886 31240 rpc_server.cc:307] RPC server started. Bound to: 127.30.90.252:46693
08:00:59.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.167956 31316 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.30.90.252:46693 every 8 connection(s)
08:00:59.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.170603 31240 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/master-2/data/info.pb
08:00:59.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.176653 31317 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
08:00:59.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.177297 31083 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasktDuNhD/build/tsan/bin/kudu as pid 31240
08:00:59.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.177784 31083 external_mini_cluster.cc:1448] Reading /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/master-2/wal/instance
08:00:59.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.191927 31317 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.90.254" port: 39231 } has no permanent_uuid. Determining permanent_uuid...
08:00:59.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.219442 31317 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.90.253" port: 42583 } has no permanent_uuid. Determining permanent_uuid...
08:00:59.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.229323 31317 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.30.90.252" port: 46693 } has no permanent_uuid. Determining permanent_uuid...
08:00:59.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.242895 31163 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.90.252" port: 46693 } attempt: 6
08:00:59.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.248960 31317 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa6cc82c575b49acb9dd9a7f924ad8d2: Bootstrap starting.
08:00:59.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.255911 31317 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P aa6cc82c575b49acb9dd9a7f924ad8d2: Neither blocks nor log segments found. Creating new log.
08:00:59.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.258653 31317 log.cc:826] T 00000000000000000000000000000000 P aa6cc82c575b49acb9dd9a7f924ad8d2: Log is configured to *not* fsync() on all Append() calls
08:00:59.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.261909 31163 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 51d367845ccb46a9b65fb650ccf827d2: Bootstrap starting.
08:00:59.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.263476 31317 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P aa6cc82c575b49acb9dd9a7f924ad8d2: No bootstrap required, opened a new log
08:00:59.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.267563 31163 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 51d367845ccb46a9b65fb650ccf827d2: Neither blocks nor log segments found. Creating new log.
08:00:59.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.269850 31163 log.cc:826] T 00000000000000000000000000000000 P 51d367845ccb46a9b65fb650ccf827d2: Log is configured to *not* fsync() on all Append() calls
08:00:59.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.279439 31163 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 51d367845ccb46a9b65fb650ccf827d2: No bootstrap required, opened a new log
08:00:59.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.288820 31317 raft_consensus.cc:359] T 00000000000000000000000000000000 P aa6cc82c575b49acb9dd9a7f924ad8d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d367845ccb46a9b65fb650ccf827d2" member_type: VOTER last_known_addr { host: "127.30.90.254" port: 39231 } } peers { permanent_uuid: "1b0495e904244bf89e8ddf7839389404" member_type: VOTER last_known_addr { host: "127.30.90.253" port: 42583 } } peers { permanent_uuid: "aa6cc82c575b49acb9dd9a7f924ad8d2" member_type: VOTER last_known_addr { host: "127.30.90.252" port: 46693 } }
08:00:59.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.289441 31317 raft_consensus.cc:385] T 00000000000000000000000000000000 P aa6cc82c575b49acb9dd9a7f924ad8d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:00:59.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.289631 31317 raft_consensus.cc:740] T 00000000000000000000000000000000 P aa6cc82c575b49acb9dd9a7f924ad8d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa6cc82c575b49acb9dd9a7f924ad8d2, State: Initialized, Role: FOLLOWER
08:00:59.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.290349 31317 consensus_queue.cc:260] T 00000000000000000000000000000000 P aa6cc82c575b49acb9dd9a7f924ad8d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d367845ccb46a9b65fb650ccf827d2" member_type: VOTER last_known_addr { host: "127.30.90.254" port: 39231 } } peers { permanent_uuid: "1b0495e904244bf89e8ddf7839389404" member_type: VOTER last_known_addr { host: "127.30.90.253" port: 42583 } } peers { permanent_uuid: "aa6cc82c575b49acb9dd9a7f924ad8d2" member_type: VOTER last_known_addr { host: "127.30.90.252" port: 46693 } }
08:00:59.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.293043 31328 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa6cc82c575b49acb9dd9a7f924ad8d2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d367845ccb46a9b65fb650ccf827d2" member_type: VOTER last_known_addr { host: "127.30.90.254" port: 39231 } } peers { permanent_uuid: "1b0495e904244bf89e8ddf7839389404" member_type: VOTER last_known_addr { host: "127.30.90.253" port: 42583 } } peers { permanent_uuid: "aa6cc82c575b49acb9dd9a7f924ad8d2" member_type: VOTER last_known_addr { host: "127.30.90.252" port: 46693 } } }
08:00:59.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.293843 31328 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa6cc82c575b49acb9dd9a7f924ad8d2 [sys.catalog]: This master's current role is: FOLLOWER
08:00:59.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.294703 31317 sys_catalog.cc:565] T 00000000000000000000000000000000 P aa6cc82c575b49acb9dd9a7f924ad8d2 [sys.catalog]: configured and running, proceeding with master startup.
08:00:59.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.301601 31163 raft_consensus.cc:359] T 00000000000000000000000000000000 P 51d367845ccb46a9b65fb650ccf827d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d367845ccb46a9b65fb650ccf827d2" member_type: VOTER last_known_addr { host: "127.30.90.254" port: 39231 } } peers { permanent_uuid: "1b0495e904244bf89e8ddf7839389404" member_type: VOTER last_known_addr { host: "127.30.90.253" port: 42583 } } peers { permanent_uuid: "aa6cc82c575b49acb9dd9a7f924ad8d2" member_type: VOTER last_known_addr { host: "127.30.90.252" port: 46693 } }
08:00:59.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.303066 31163 raft_consensus.cc:385] T 00000000000000000000000000000000 P 51d367845ccb46a9b65fb650ccf827d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:00:59.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.303745 31163 raft_consensus.cc:740] T 00000000000000000000000000000000 P 51d367845ccb46a9b65fb650ccf827d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51d367845ccb46a9b65fb650ccf827d2, State: Initialized, Role: FOLLOWER
08:00:59.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.304749 31163 consensus_queue.cc:260] T 00000000000000000000000000000000 P 51d367845ccb46a9b65fb650ccf827d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d367845ccb46a9b65fb650ccf827d2" member_type: VOTER last_known_addr { host: "127.30.90.254" port: 39231 } } peers { permanent_uuid: "1b0495e904244bf89e8ddf7839389404" member_type: VOTER last_known_addr { host: "127.30.90.253" port: 42583 } } peers { permanent_uuid: "aa6cc82c575b49acb9dd9a7f924ad8d2" member_type: VOTER last_known_addr { host: "127.30.90.252" port: 46693 } }
08:00:59.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.307747 31334 sys_catalog.cc:455] T 00000000000000000000000000000000 P 51d367845ccb46a9b65fb650ccf827d2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d367845ccb46a9b65fb650ccf827d2" member_type: VOTER last_known_addr { host: "127.30.90.254" port: 39231 } } peers { permanent_uuid: "1b0495e904244bf89e8ddf7839389404" member_type: VOTER last_known_addr { host: "127.30.90.253" port: 42583 } } peers { permanent_uuid: "aa6cc82c575b49acb9dd9a7f924ad8d2" member_type: VOTER last_known_addr { host: "127.30.90.252" port: 46693 } } }
08:00:59.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.308840 31334 sys_catalog.cc:458] T 00000000000000000000000000000000 P 51d367845ccb46a9b65fb650ccf827d2 [sys.catalog]: This master's current role is: FOLLOWER
08:00:59.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.309629 31163 sys_catalog.cc:565] T 00000000000000000000000000000000 P 51d367845ccb46a9b65fb650ccf827d2 [sys.catalog]: configured and running, proceeding with master startup.
08:00:59.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:59.340607 31345 catalog_manager.cc:1594] T 00000000000000000000000000000000 P aa6cc82c575b49acb9dd9a7f924ad8d2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
08:00:59.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:59.341006 31345 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
08:00:59.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:59.354172 31271 tablet.cc:2406] T 00000000000000000000000000000000 P aa6cc82c575b49acb9dd9a7f924ad8d2: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:00:59.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:59.354403 31352 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 51d367845ccb46a9b65fb650ccf827d2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
08:00:59.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:59.354727 31352 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
08:00:59.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.325986 31240 master_runner.cc:187] Error getting master registration for 127.30.90.254:39231: OK, instance_id { permanent_uuid: "51d367845ccb46a9b65fb650ccf827d2" instance_seqno: 1783497655564379 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
08:00:59.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.361403 31240 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
08:00:59.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.338313 31095 master_runner.cc:187] Error getting master registration for 127.30.90.253:42583: OK, instance_id { permanent_uuid: "1b0495e904244bf89e8ddf7839389404" instance_seqno: 1783497657295480 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
08:00:59.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.372433 31095 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
08:00:59.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:59.525144 31117 tablet.cc:2406] T 00000000000000000000000000000000 P 51d367845ccb46a9b65fb650ccf827d2: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:00:59.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.560051 31334 raft_consensus.cc:493] T 00000000000000000000000000000000 P 51d367845ccb46a9b65fb650ccf827d2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:00:59.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.560645 31334 raft_consensus.cc:515] T 00000000000000000000000000000000 P 51d367845ccb46a9b65fb650ccf827d2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d367845ccb46a9b65fb650ccf827d2" member_type: VOTER last_known_addr { host: "127.30.90.254" port: 39231 } } peers { permanent_uuid: "1b0495e904244bf89e8ddf7839389404" member_type: VOTER last_known_addr { host: "127.30.90.253" port: 42583 } } peers { permanent_uuid: "aa6cc82c575b49acb9dd9a7f924ad8d2" member_type: VOTER last_known_addr { host: "127.30.90.252" port: 46693 } }
08:00:59.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.564425 31334 leader_election.cc:290] T 00000000000000000000000000000000 P 51d367845ccb46a9b65fb650ccf827d2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b0495e904244bf89e8ddf7839389404 (127.30.90.253:42583), aa6cc82c575b49acb9dd9a7f924ad8d2 (127.30.90.252:46693)
08:00:59.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.564679 31292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "51d367845ccb46a9b65fb650ccf827d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa6cc82c575b49acb9dd9a7f924ad8d2" is_pre_election: true
08:00:59.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.565531 31292 raft_consensus.cc:2468] T 00000000000000000000000000000000 P aa6cc82c575b49acb9dd9a7f924ad8d2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51d367845ccb46a9b65fb650ccf827d2 in term 0.
08:00:59.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.566871 31113 leader_election.cc:304] T 00000000000000000000000000000000 P 51d367845ccb46a9b65fb650ccf827d2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51d367845ccb46a9b65fb650ccf827d2, aa6cc82c575b49acb9dd9a7f924ad8d2; no voters: 
08:00:59.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.567791 31334 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 51d367845ccb46a9b65fb650ccf827d2 [term 0 FOLLOWER]: Leader pre-election won for term 1
08:00:59.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.568120 31334 raft_consensus.cc:493] T 00000000000000000000000000000000 P 51d367845ccb46a9b65fb650ccf827d2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:00:59.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.568430 31334 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 51d367845ccb46a9b65fb650ccf827d2 [term 0 FOLLOWER]: Advancing to term 1
08:00:59.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.579361 31334 raft_consensus.cc:515] T 00000000000000000000000000000000 P 51d367845ccb46a9b65fb650ccf827d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d367845ccb46a9b65fb650ccf827d2" member_type: VOTER last_known_addr { host: "127.30.90.254" port: 39231 } } peers { permanent_uuid: "1b0495e904244bf89e8ddf7839389404" member_type: VOTER last_known_addr { host: "127.30.90.253" port: 42583 } } peers { permanent_uuid: "aa6cc82c575b49acb9dd9a7f924ad8d2" member_type: VOTER last_known_addr { host: "127.30.90.252" port: 46693 } }
08:00:59.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.583580 31334 leader_election.cc:290] T 00000000000000000000000000000000 P 51d367845ccb46a9b65fb650ccf827d2 [CANDIDATE]: Term 1 election: Requested vote from peers 1b0495e904244bf89e8ddf7839389404 (127.30.90.253:42583), aa6cc82c575b49acb9dd9a7f924ad8d2 (127.30.90.252:46693)
08:00:59.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.585032 31292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "51d367845ccb46a9b65fb650ccf827d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa6cc82c575b49acb9dd9a7f924ad8d2"
08:00:59.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.585578 31292 raft_consensus.cc:3060] T 00000000000000000000000000000000 P aa6cc82c575b49acb9dd9a7f924ad8d2 [term 0 FOLLOWER]: Advancing to term 1
08:00:59.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.593385 31292 raft_consensus.cc:2468] T 00000000000000000000000000000000 P aa6cc82c575b49acb9dd9a7f924ad8d2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51d367845ccb46a9b65fb650ccf827d2 in term 1.
08:00:59.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.595144 31113 leader_election.cc:304] T 00000000000000000000000000000000 P 51d367845ccb46a9b65fb650ccf827d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51d367845ccb46a9b65fb650ccf827d2, aa6cc82c575b49acb9dd9a7f924ad8d2; no voters: 
08:00:59.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.596493 31334 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 51d367845ccb46a9b65fb650ccf827d2 [term 1 FOLLOWER]: Leader election won for term 1
08:00:59.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.621449 31334 raft_consensus.cc:697] T 00000000000000000000000000000000 P 51d367845ccb46a9b65fb650ccf827d2 [term 1 LEADER]: Becoming Leader. State: Replica: 51d367845ccb46a9b65fb650ccf827d2, State: Running, Role: LEADER
08:00:59.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.623433 31334 consensus_queue.cc:237] T 00000000000000000000000000000000 P 51d367845ccb46a9b65fb650ccf827d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d367845ccb46a9b65fb650ccf827d2" member_type: VOTER last_known_addr { host: "127.30.90.254" port: 39231 } } peers { permanent_uuid: "1b0495e904244bf89e8ddf7839389404" member_type: VOTER last_known_addr { host: "127.30.90.253" port: 42583 } } peers { permanent_uuid: "aa6cc82c575b49acb9dd9a7f924ad8d2" member_type: VOTER last_known_addr { host: "127.30.90.252" port: 46693 } }
08:00:59.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.642644 31354 sys_catalog.cc:455] T 00000000000000000000000000000000 P 51d367845ccb46a9b65fb650ccf827d2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 51d367845ccb46a9b65fb650ccf827d2. Latest consensus state: current_term: 1 leader_uuid: "51d367845ccb46a9b65fb650ccf827d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d367845ccb46a9b65fb650ccf827d2" member_type: VOTER last_known_addr { host: "127.30.90.254" port: 39231 } } peers { permanent_uuid: "1b0495e904244bf89e8ddf7839389404" member_type: VOTER last_known_addr { host: "127.30.90.253" port: 42583 } } peers { permanent_uuid: "aa6cc82c575b49acb9dd9a7f924ad8d2" member_type: VOTER last_known_addr { host: "127.30.90.252" port: 46693 } } }
08:00:59.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.643582 31354 sys_catalog.cc:458] T 00000000000000000000000000000000 P 51d367845ccb46a9b65fb650ccf827d2 [sys.catalog]: This master's current role is: LEADER
08:00:59.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.660957 31356 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
08:00:59.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.668991 31356 catalog_manager.cc:1520] Initializing Kudu cluster ID...
08:00:59.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.696244 31292 raft_consensus.cc:1275] T 00000000000000000000000000000000 P aa6cc82c575b49acb9dd9a7f924ad8d2 [term 1 FOLLOWER]: Refusing update from remote peer 51d367845ccb46a9b65fb650ccf827d2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
08:00:59.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.698947 31354 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 51d367845ccb46a9b65fb650ccf827d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa6cc82c575b49acb9dd9a7f924ad8d2" member_type: VOTER last_known_addr { host: "127.30.90.252" port: 46693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:00:59.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.706203 31238 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.30.90.252" port: 46693 } attempt: 7
08:00:59.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.750613 31328 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa6cc82c575b49acb9dd9a7f924ad8d2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 51d367845ccb46a9b65fb650ccf827d2. Latest consensus state: current_term: 1 leader_uuid: "51d367845ccb46a9b65fb650ccf827d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d367845ccb46a9b65fb650ccf827d2" member_type: VOTER last_known_addr { host: "127.30.90.254" port: 39231 } } peers { permanent_uuid: "1b0495e904244bf89e8ddf7839389404" member_type: VOTER last_known_addr { host: "127.30.90.253" port: 42583 } } peers { permanent_uuid: "aa6cc82c575b49acb9dd9a7f924ad8d2" member_type: VOTER last_known_addr { host: "127.30.90.252" port: 46693 } } }
08:00:59.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.751353 31328 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa6cc82c575b49acb9dd9a7f924ad8d2 [sys.catalog]: This master's current role is: FOLLOWER
08:00:59.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.754837 31357 mvcc.cc:204] Tried to move back new op lower bound from 7305206414096678912 to 7305206413829328896. Current Snapshot: MvccSnapshot[applied={T|T < 7305206414096678912}]
08:00:59.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.769362 31238 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b0495e904244bf89e8ddf7839389404: Bootstrap starting.
08:00:59.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.770841 31334 sys_catalog.cc:455] T 00000000000000000000000000000000 P 51d367845ccb46a9b65fb650ccf827d2 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "51d367845ccb46a9b65fb650ccf827d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d367845ccb46a9b65fb650ccf827d2" member_type: VOTER last_known_addr { host: "127.30.90.254" port: 39231 } } peers { permanent_uuid: "1b0495e904244bf89e8ddf7839389404" member_type: VOTER last_known_addr { host: "127.30.90.253" port: 42583 } } peers { permanent_uuid: "aa6cc82c575b49acb9dd9a7f924ad8d2" member_type: VOTER last_known_addr { host: "127.30.90.252" port: 46693 } } }
08:00:59.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.771577 31334 sys_catalog.cc:458] T 00000000000000000000000000000000 P 51d367845ccb46a9b65fb650ccf827d2 [sys.catalog]: This master's current role is: LEADER
08:00:59.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.779973 31328 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa6cc82c575b49acb9dd9a7f924ad8d2 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "51d367845ccb46a9b65fb650ccf827d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d367845ccb46a9b65fb650ccf827d2" member_type: VOTER last_known_addr { host: "127.30.90.254" port: 39231 } } peers { permanent_uuid: "1b0495e904244bf89e8ddf7839389404" member_type: VOTER last_known_addr { host: "127.30.90.253" port: 42583 } } peers { permanent_uuid: "aa6cc82c575b49acb9dd9a7f924ad8d2" member_type: VOTER last_known_addr { host: "127.30.90.252" port: 46693 } } }
08:00:59.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.780710 31328 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa6cc82c575b49acb9dd9a7f924ad8d2 [sys.catalog]: This master's current role is: FOLLOWER
08:00:59.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.788656 31356 catalog_manager.cc:1383] Generated new cluster ID: a803207fe7794c6abbe45df267e73465
08:00:59.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.788985 31356 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
08:00:59.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.795337 31238 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1b0495e904244bf89e8ddf7839389404: Neither blocks nor log segments found. Creating new log.
08:00:59.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:00:59.807763 31234 debug-util.cc:398] Leaking SignalData structure 0x7b080007c8a0 after lost signal to thread 31169
08:00:59.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.814364 31238 log.cc:826] T 00000000000000000000000000000000 P 1b0495e904244bf89e8ddf7839389404: Log is configured to *not* fsync() on all Append() calls
08:00:59.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.832638 31356 catalog_manager.cc:1406] Generated new certificate authority record
08:00:59.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.835168 31356 catalog_manager.cc:1540] Loading token signing keys...
08:00:59.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.839677 31238 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b0495e904244bf89e8ddf7839389404: No bootstrap required, opened a new log
08:00:59.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.871949 31356 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 51d367845ccb46a9b65fb650ccf827d2: Generated new TSK 0
08:00:59.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.879966 31356 catalog_manager.cc:1550] Initializing in-progress tserver states...
08:00:59.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.925951 31083 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasktDuNhD/build/tsan/bin/kudu
08:00:59.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-tasktDuNhD/build/tsan/bin/kudu
08:00:59.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/ts-0/wal
08:00:59.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/ts-0/data
08:00:59.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:00:59.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:00:59.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:00:59.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:00:59.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:00:59.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:00:59.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/ts-0/logs
08:00:59.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/ts-0/data/info.pb
08:00:59.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:00:59.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:00:59.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:00:59.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:00:59.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:00:59.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:00:59.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:00:59.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:00:59.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
08:00:59.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:00:59.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.30.90.193:0
08:00:59.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.30.90.193
08:00:59.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.30.90.193
08:00:59.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:00:59.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.30.90.254:39231,127.30.90.253:42583,127.30.90.252:46693
08:00:59.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.30.90.212:36103
08:00:59.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:00:59.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:00:59.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
08:00:59.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.937898 31238 raft_consensus.cc:359] T 00000000000000000000000000000000 P 1b0495e904244bf89e8ddf7839389404 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d367845ccb46a9b65fb650ccf827d2" member_type: VOTER last_known_addr { host: "127.30.90.254" port: 39231 } } peers { permanent_uuid: "1b0495e904244bf89e8ddf7839389404" member_type: VOTER last_known_addr { host: "127.30.90.253" port: 42583 } } peers { permanent_uuid: "aa6cc82c575b49acb9dd9a7f924ad8d2" member_type: VOTER last_known_addr { host: "127.30.90.252" port: 46693 } }
08:00:59.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.942727 31238 raft_consensus.cc:385] T 00000000000000000000000000000000 P 1b0495e904244bf89e8ddf7839389404 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:00:59.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.943889 31238 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1b0495e904244bf89e8ddf7839389404 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b0495e904244bf89e8ddf7839389404, State: Initialized, Role: FOLLOWER
08:00:59.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.946563 31238 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1b0495e904244bf89e8ddf7839389404 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d367845ccb46a9b65fb650ccf827d2" member_type: VOTER last_known_addr { host: "127.30.90.254" port: 39231 } } peers { permanent_uuid: "1b0495e904244bf89e8ddf7839389404" member_type: VOTER last_known_addr { host: "127.30.90.253" port: 42583 } } peers { permanent_uuid: "aa6cc82c575b49acb9dd9a7f924ad8d2" member_type: VOTER last_known_addr { host: "127.30.90.252" port: 46693 } }
08:00:59.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.977787 31211 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1b0495e904244bf89e8ddf7839389404 [term 0 FOLLOWER]: Advancing to term 1
08:00:59.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.978017 31212 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "51d367845ccb46a9b65fb650ccf827d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b0495e904244bf89e8ddf7839389404"
08:00:59.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.978199 31213 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "51d367845ccb46a9b65fb650ccf827d2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b0495e904244bf89e8ddf7839389404" is_pre_election: true
08:00:59.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.987716 31211 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 1b0495e904244bf89e8ddf7839389404 [term 1 FOLLOWER]: Refusing update from remote peer 51d367845ccb46a9b65fb650ccf827d2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
08:00:59.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.976783 31365 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b0495e904244bf89e8ddf7839389404 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d367845ccb46a9b65fb650ccf827d2" member_type: VOTER last_known_addr { host: "127.30.90.254" port: 39231 } } peers { permanent_uuid: "1b0495e904244bf89e8ddf7839389404" member_type: VOTER last_known_addr { host: "127.30.90.253" port: 42583 } } peers { permanent_uuid: "aa6cc82c575b49acb9dd9a7f924ad8d2" member_type: VOTER last_known_addr { host: "127.30.90.252" port: 46693 } } }
08:00:59.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.989488 31365 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b0495e904244bf89e8ddf7839389404 [sys.catalog]: This master's current role is: FOLLOWER
08:00:59.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.989305 31354 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 51d367845ccb46a9b65fb650ccf827d2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b0495e904244bf89e8ddf7839389404" member_type: VOTER last_known_addr { host: "127.30.90.253" port: 42583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
08:00:59.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:00:59.991739 31238 sys_catalog.cc:565] T 00000000000000000000000000000000 P 1b0495e904244bf89e8ddf7839389404 [sys.catalog]: configured and running, proceeding with master startup.
08:01:00.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:00.039774 31192 tablet.cc:2406] T 00000000000000000000000000000000 P 1b0495e904244bf89e8ddf7839389404: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:01:00.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:00.088958 31365 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b0495e904244bf89e8ddf7839389404 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 51d367845ccb46a9b65fb650ccf827d2. Latest consensus state: current_term: 1 leader_uuid: "51d367845ccb46a9b65fb650ccf827d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d367845ccb46a9b65fb650ccf827d2" member_type: VOTER last_known_addr { host: "127.30.90.254" port: 39231 } } peers { permanent_uuid: "1b0495e904244bf89e8ddf7839389404" member_type: VOTER last_known_addr { host: "127.30.90.253" port: 42583 } } peers { permanent_uuid: "aa6cc82c575b49acb9dd9a7f924ad8d2" member_type: VOTER last_known_addr { host: "127.30.90.252" port: 46693 } } }
08:01:00.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:00.089056 31371 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b0495e904244bf89e8ddf7839389404 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "51d367845ccb46a9b65fb650ccf827d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d367845ccb46a9b65fb650ccf827d2" member_type: VOTER last_known_addr { host: "127.30.90.254" port: 39231 } } peers { permanent_uuid: "1b0495e904244bf89e8ddf7839389404" member_type: VOTER last_known_addr { host: "127.30.90.253" port: 42583 } } peers { permanent_uuid: "aa6cc82c575b49acb9dd9a7f924ad8d2" member_type: VOTER last_known_addr { host: "127.30.90.252" port: 46693 } } }
08:01:00.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:00.089685 31365 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b0495e904244bf89e8ddf7839389404 [sys.catalog]: This master's current role is: FOLLOWER
08:01:00.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:00.089826 31371 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b0495e904244bf89e8ddf7839389404 [sys.catalog]: This master's current role is: FOLLOWER
08:01:00.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:00.123800 31381 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
08:01:00.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:00.346411 31345 catalog_manager.cc:1295] Loaded cluster ID: a803207fe7794c6abbe45df267e73465
08:01:00.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:00.347216 31345 catalog_manager.cc:1588] T 00000000000000000000000000000000 P aa6cc82c575b49acb9dd9a7f924ad8d2: loading cluster ID for follower catalog manager: success
08:01:00.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:00.359946 31345 catalog_manager.cc:1610] T 00000000000000000000000000000000 P aa6cc82c575b49acb9dd9a7f924ad8d2: acquiring CA information for follower catalog manager: success
08:01:00.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:00.370957 31345 catalog_manager.cc:1638] T 00000000000000000000000000000000 P aa6cc82c575b49acb9dd9a7f924ad8d2: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
08:01:00.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:00.568020 31364 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:01:00.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:00.569216 31364 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:01:00.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:00.570271 31364 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:01:00.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:00.631595 31364 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:01:00.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:00.633391 31364 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.90.193
08:01:00.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:00.643405 31354 sys_catalog.cc:455] T 00000000000000000000000000000000 P 51d367845ccb46a9b65fb650ccf827d2 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "51d367845ccb46a9b65fb650ccf827d2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d367845ccb46a9b65fb650ccf827d2" member_type: VOTER last_known_addr { host: "127.30.90.254" port: 39231 } } peers { permanent_uuid: "1b0495e904244bf89e8ddf7839389404" member_type: VOTER last_known_addr { host: "127.30.90.253" port: 42583 } } peers { permanent_uuid: "aa6cc82c575b49acb9dd9a7f924ad8d2" member_type: VOTER last_known_addr { host: "127.30.90.252" port: 46693 } } }
08:01:00.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:00.644600 31354 sys_catalog.cc:458] T 00000000000000000000000000000000 P 51d367845ccb46a9b65fb650ccf827d2 [sys.catalog]: This master's current role is: LEADER
08:01:00.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:00.699179 31364 tablet_server_runner.cc:78] Tablet server non-default flags:
08:01:00.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:01:00.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.30.90.212:36103
08:01:00.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:01:00.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:01:00.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/ts-0/data
08:01:00.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/ts-0/wal
08:01:00.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:01:00.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:01:00.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.30.90.193:0
08:01:00.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:01:00.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:01:00.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:01:00.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/ts-0/data/info.pb
08:01:00.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.30.90.193
08:01:00.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:01:00.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.30.90.254:39231,127.30.90.253:42583,127.30.90.252:46693
08:01:00.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:01:00.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:01:00.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:01:00.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:01:00.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:01:00.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.30.90.193
08:01:00.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/ts-0/logs
08:01:00.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:01:00.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:01:00.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:01:00.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
08:01:00.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:01:00.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
08:01:00.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:01:00.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 07:43:22 UTC on e7f111948823
08:01:00.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12771
08:01:00.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:01:00.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:00.709578 31364 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:01:00.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:00.712401 31364 file_cache.cc:504] Constructed file cache file cache with capacity 419430
08:01:00.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:00.746318 31390 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:01:01.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:01.147262 31381 catalog_manager.cc:1295] Loaded cluster ID: a803207fe7794c6abbe45df267e73465
08:01:01.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:01.147535 31381 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 1b0495e904244bf89e8ddf7839389404: loading cluster ID for follower catalog manager: success
08:01:01.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:01.168107 31381 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 1b0495e904244bf89e8ddf7839389404: acquiring CA information for follower catalog manager: success
08:01:01.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:01.182714 31381 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 1b0495e904244bf89e8ddf7839389404: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
08:01:02.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:02.134936 31388 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 31364
08:01:02.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:02.898960 31364 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 2.155s	user 0.572s	sys 1.001s
08:01:02.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:02.899339 31364 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 2.156s	user 0.572s	sys 1.001s
08:01:02.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:00.747689 31389 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:01:02.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:02.923667 31364 server_base.cc:1061] running on GCE node
08:01:02.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:02.925647 31394 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:01:02.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:02.927138 31364 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:01:02.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:02.943307 31364 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:01:02.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:02.944768 31364 hybrid_clock.cc:648] HybridClock initialized: now 1783497662944719 us; error 55 us; skew 500 ppm
08:01:02.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:02.945839 31364 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:01:02.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:02.974920 31364 webserver.cc:533] Webserver started at http://127.30.90.193:36383/ using document root <none> and password file <none>
08:01:02.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:02.976214 31364 fs_manager.cc:362] Metadata directory not provided
08:01:02.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:02.976506 31364 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:01:02.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:02.977046 31364 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:01:02.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:02.983294 31364 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/ts-0/data/instance:
08:01:02.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "965da114b2534942b775590153d032d1"
08:01:02.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 08:01:02 on dist-test-slave-ltj1"
08:01:02.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:02.984846 31364 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/ts-0/wal/instance:
08:01:02.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "965da114b2534942b775590153d032d1"
08:01:02.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 08:01:02 on dist-test-slave-ltj1"
08:01:03.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:03.013236 31364 fs_manager.cc:696] Time spent creating directory manager: real 0.028s	user 0.008s	sys 0.007s
08:01:03.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:03.027274 31400 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:01:03.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:03.028673 31364 fs_manager.cc:730] Time spent opening block manager: real 0.011s	user 0.010s	sys 0.000s
08:01:03.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:03.029115 31364 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/ts-0/data,/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/ts-0/wal
08:01:03.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "965da114b2534942b775590153d032d1"
08:01:03.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 08:01:02 on dist-test-slave-ltj1"
08:01:03.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:03.029559 31364 fs_report.cc:389] FS layout report
08:01:03.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:01:03.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/ts-0/wal
08:01:03.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/ts-0/wal
08:01:03.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/ts-0/data/data
08:01:03.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:01:03.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:01:03.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:01:03.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:01:03.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:01:03.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:01:03.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:01:03.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:01:03.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:01:03.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:01:03.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:01:03.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:03.139664 31364 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:01:03.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:03.141607 31364 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:01:03.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:03.142156 31364 kserver.cc:163] Server-wide thread pool size limit: 3276
08:01:03.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:03.145694 31364 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
08:01:03.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:03.151504 31364 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
08:01:03.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:03.151806 31364 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
08:01:03.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:03.152089 31364 ts_tablet_manager.cc:616] Registered 0 tablets
08:01:03.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:03.152302 31364 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
08:01:03.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:03.317190 31364 rpc_server.cc:307] RPC server started. Bound to: 127.30.90.193:35933
08:01:03.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:03.317322 31512 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.30.90.193:35933 every 8 connection(s)
08:01:03.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:03.319794 31364 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/ts-0/data/info.pb
08:01:03.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:03.327823 31083 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasktDuNhD/build/tsan/bin/kudu as pid 31364
08:01:03.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:03.328318 31083 external_mini_cluster.cc:1448] Reading /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/ts-0/wal/instance
08:01:03.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:03.342945 31083 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasktDuNhD/build/tsan/bin/kudu
08:01:03.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-tasktDuNhD/build/tsan/bin/kudu
08:01:03.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/ts-1/wal
08:01:03.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/ts-1/data
08:01:03.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:01:03.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:01:03.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:01:03.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:01:03.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:01:03.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:01:03.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/ts-1/logs
08:01:03.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/ts-1/data/info.pb
08:01:03.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:01:03.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:01:03.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:01:03.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:01:03.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:01:03.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:01:03.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:01:03.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:01:03.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
08:01:03.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:01:03.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.30.90.194:0
08:01:03.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.30.90.194
08:01:03.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.30.90.194
08:01:03.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:01:03.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.30.90.254:39231,127.30.90.253:42583,127.30.90.252:46693
08:01:03.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.30.90.212:36103
08:01:03.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:01:03.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:01:03.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
08:01:03.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:03.399152 31514 heartbeater.cc:344] Connected to a master server at 127.30.90.253:42583
08:01:03.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:03.399650 31514 heartbeater.cc:461] Registering TS with master...
08:01:03.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:03.401000 31514 heartbeater.cc:507] Master 127.30.90.253:42583 requested a full tablet report, sending...
08:01:03.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:03.401428 31518 heartbeater.cc:344] Connected to a master server at 127.30.90.254:39231
08:01:03.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:03.401767 31518 heartbeater.cc:461] Registering TS with master...
08:01:03.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:03.402647 31518 heartbeater.cc:507] Master 127.30.90.254:39231 requested a full tablet report, sending...
08:01:03.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:03.405529 31203 ts_manager.cc:194] Registered new tserver with Master: 965da114b2534942b775590153d032d1 (127.30.90.193:35933)
08:01:03.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:03.408588 31513 heartbeater.cc:344] Connected to a master server at 127.30.90.252:46693
08:01:03.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:03.408946 31513 heartbeater.cc:461] Registering TS with master...
08:01:03.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:03.409710 31128 ts_manager.cc:194] Registered new tserver with Master: 965da114b2534942b775590153d032d1 (127.30.90.193:35933)
08:01:03.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:03.409840 31513 heartbeater.cc:507] Master 127.30.90.252:46693 requested a full tablet report, sending...
08:01:03.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:03.412307 31128 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.30.90.193:50669
08:01:03.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:03.413188 31282 ts_manager.cc:194] Registered new tserver with Master: 965da114b2534942b775590153d032d1 (127.30.90.193:35933)
08:01:03.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:03.678921 31520 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:01:03.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:03.679490 31520 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:01:03.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:03.680109 31520 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:01:03.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:03.713238 31520 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:01:03.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:03.714085 31520 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.90.194
08:01:03.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:03.750247 31520 tablet_server_runner.cc:78] Tablet server non-default flags:
08:01:03.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:01:03.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.30.90.212:36103
08:01:03.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:01:03.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:01:03.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/ts-1/data
08:01:03.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/ts-1/wal
08:01:03.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:01:03.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:01:03.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.30.90.194:0
08:01:03.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:01:03.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:01:03.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:01:03.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/ts-1/data/info.pb
08:01:03.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.30.90.194
08:01:03.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:01:03.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.30.90.254:39231,127.30.90.253:42583,127.30.90.252:46693
08:01:03.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:01:03.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:01:03.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:01:03.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:01:03.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:01:03.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.30.90.194
08:01:03.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/ts-1/logs
08:01:03.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:01:03.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:01:03.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:01:03.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
08:01:03.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:01:03.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
08:01:03.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:01:03.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 07:43:22 UTC on e7f111948823
08:01:03.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12771
08:01:03.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:01:03.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:03.751574 31520 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:01:03.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:03.753229 31520 file_cache.cc:504] Constructed file cache file cache with capacity 419430
08:01:03.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:03.771243 31530 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:01:04.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:04.416787 31518 heartbeater.cc:499] Master 127.30.90.254:39231 was elected leader, sending a full tablet report...
08:01:05.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:03.772176 31531 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:01:05.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:05.171461 31529 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 31520
08:01:05.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:05.192484 31520 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.420s	user 0.000s	sys 0.002s
08:01:05.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:05.193431 31520 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.421s	user 0.000s	sys 0.002s
08:01:05.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:05.195911 31533 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:01:05.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:05.198395 31532 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1420 milliseconds
08:01:05.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:05.198457 31520 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:01:05.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:05.199693 31520 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:01:05.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:05.202067 31520 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:01:05.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:05.203454 31520 hybrid_clock.cc:648] HybridClock initialized: now 1783497665203409 us; error 56 us; skew 500 ppm
08:01:05.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:05.204208 31520 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:01:05.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:05.210366 31520 webserver.cc:533] Webserver started at http://127.30.90.194:39563/ using document root <none> and password file <none>
08:01:05.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:05.211354 31520 fs_manager.cc:362] Metadata directory not provided
08:01:05.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:05.211592 31520 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:01:05.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:05.212081 31520 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:01:05.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:05.216396 31520 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/ts-1/data/instance:
08:01:05.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "826bc9ae690d480bbe4467803b3ef765"
08:01:05.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 08:01:05 on dist-test-slave-ltj1"
08:01:05.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:05.217590 31520 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/ts-1/wal/instance:
08:01:05.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "826bc9ae690d480bbe4467803b3ef765"
08:01:05.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 08:01:05 on dist-test-slave-ltj1"
08:01:05.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:05.224709 31520 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.008s	sys 0.000s
08:01:05.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:05.230259 31541 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:01:05.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:05.231328 31520 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
08:01:05.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:05.231640 31520 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/ts-1/data,/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/ts-1/wal
08:01:05.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "826bc9ae690d480bbe4467803b3ef765"
08:01:05.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 08:01:05 on dist-test-slave-ltj1"
08:01:05.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:05.231997 31520 fs_report.cc:389] FS layout report
08:01:05.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:01:05.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/ts-1/wal
08:01:05.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/ts-1/wal
08:01:05.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/ts-1/data/data
08:01:05.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:01:05.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:01:05.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:01:05.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:01:05.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:01:05.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:01:05.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:01:05.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:01:05.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:01:05.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:01:05.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:01:05.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:05.282646 31520 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:01:05.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:05.284260 31520 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:01:05.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:05.284765 31520 kserver.cc:163] Server-wide thread pool size limit: 3276
08:01:05.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:05.287426 31520 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
08:01:05.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:05.291504 31520 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
08:01:05.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:05.291718 31520 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
08:01:05.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:05.292003 31520 ts_tablet_manager.cc:616] Registered 0 tablets
08:01:05.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:05.292203 31520 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
08:01:05.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:05.422878 31520 rpc_server.cc:307] RPC server started. Bound to: 127.30.90.194:40111
08:01:05.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:05.423022 31653 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.30.90.194:40111 every 8 connection(s)
08:01:05.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:05.426842 31520 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/ts-1/data/info.pb
08:01:05.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:05.432240 31083 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasktDuNhD/build/tsan/bin/kudu as pid 31520
08:01:05.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:05.432834 31083 external_mini_cluster.cc:1448] Reading /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/ts-1/wal/instance
08:01:05.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:05.457763 31083 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasktDuNhD/build/tsan/bin/kudu
08:01:05.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-tasktDuNhD/build/tsan/bin/kudu
08:01:05.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/ts-2/wal
08:01:05.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/ts-2/data
08:01:05.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:01:05.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:01:05.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:01:05.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:01:05.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:01:05.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:01:05.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/ts-2/logs
08:01:05.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/ts-2/data/info.pb
08:01:05.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:01:05.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:01:05.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:01:05.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:01:05.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:01:05.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:01:05.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:01:05.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:01:05.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
08:01:05.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:01:05.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.30.90.195:0
08:01:05.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.30.90.195
08:01:05.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.30.90.195
08:01:05.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:01:05.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.30.90.254:39231,127.30.90.253:42583,127.30.90.252:46693
08:01:05.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.30.90.212:36103
08:01:05.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:01:05.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:01:05.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
08:01:05.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:05.477543 31655 heartbeater.cc:344] Connected to a master server at 127.30.90.253:42583
08:01:05.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:05.478046 31655 heartbeater.cc:461] Registering TS with master...
08:01:05.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:05.480343 31655 heartbeater.cc:507] Master 127.30.90.253:42583 requested a full tablet report, sending...
08:01:05.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:05.483631 31203 ts_manager.cc:194] Registered new tserver with Master: 826bc9ae690d480bbe4467803b3ef765 (127.30.90.194:40111)
08:01:05.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:05.483755 31654 heartbeater.cc:344] Connected to a master server at 127.30.90.252:46693
08:01:05.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:05.484117 31654 heartbeater.cc:461] Registering TS with master...
08:01:05.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:05.484972 31654 heartbeater.cc:507] Master 127.30.90.252:46693 requested a full tablet report, sending...
08:01:05.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:05.487417 31282 ts_manager.cc:194] Registered new tserver with Master: 826bc9ae690d480bbe4467803b3ef765 (127.30.90.194:40111)
08:01:05.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:05.490353 31656 heartbeater.cc:344] Connected to a master server at 127.30.90.254:39231
08:01:05.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:05.490633 31656 heartbeater.cc:461] Registering TS with master...
08:01:05.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:05.491415 31656 heartbeater.cc:507] Master 127.30.90.254:39231 requested a full tablet report, sending...
08:01:05.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:05.493377 31128 ts_manager.cc:194] Registered new tserver with Master: 826bc9ae690d480bbe4467803b3ef765 (127.30.90.194:40111)
08:01:05.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:05.494737 31128 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.30.90.194:41317
08:01:05.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:05.769134 31664 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:01:05.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:05.769661 31664 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:01:05.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:05.770262 31664 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:01:05.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:05.803558 31664 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:01:05.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:05.804555 31664 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.30.90.195
08:01:05.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:05.840700 31664 tablet_server_runner.cc:78] Tablet server non-default flags:
08:01:05.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:01:05.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.30.90.212:36103
08:01:05.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:01:05.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:01:05.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/ts-2/data
08:01:05.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/ts-2/wal
08:01:05.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:01:05.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:01:05.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.30.90.195:0
08:01:05.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:01:05.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:01:05.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:01:05.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/ts-2/data/info.pb
08:01:05.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.30.90.195
08:01:05.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:01:05.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.30.90.254:39231,127.30.90.253:42583,127.30.90.252:46693
08:01:05.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:01:05.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:01:05.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:01:05.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:01:05.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:01:05.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.30.90.195
08:01:05.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/ts-2/logs
08:01:05.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:01:05.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:01:05.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:01:05.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
08:01:05.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:01:05.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
08:01:05.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:01:05.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 07:43:22 UTC on e7f111948823
08:01:05.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12771
08:01:05.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:01:05.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:05.842391 31664 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:01:05.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:05.844614 31664 file_cache.cc:504] Constructed file cache file cache with capacity 419430
08:01:05.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:05.856739 31670 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:01:06.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:06.498047 31656 heartbeater.cc:499] Master 127.30.90.254:39231 was elected leader, sending a full tablet report...
08:01:07.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:07.259747 31669 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 31664
08:01:07.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:07.354130 31664 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.497s	user 0.711s	sys 0.779s
08:01:07.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:07.354450 31664 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.497s	user 0.711s	sys 0.779s
08:01:07.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:05.857236 31671 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:01:07.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:07.357079 31673 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:01:07.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:07.360399 31672 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1503 milliseconds
08:01:07.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:07.360462 31664 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:01:07.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:07.361652 31664 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:01:07.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:07.363893 31664 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:01:07.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:07.365279 31664 hybrid_clock.cc:648] HybridClock initialized: now 1783497667365237 us; error 50 us; skew 500 ppm
08:01:07.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:07.366302 31664 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:01:07.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:07.372427 31664 webserver.cc:533] Webserver started at http://127.30.90.195:45669/ using document root <none> and password file <none>
08:01:07.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:07.373445 31664 fs_manager.cc:362] Metadata directory not provided
08:01:07.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:07.373673 31664 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:01:07.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:07.374157 31664 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:01:07.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:07.378549 31664 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/ts-2/data/instance:
08:01:07.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6c8167a42a7b489e92ff1abc112926f0"
08:01:07.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 08:01:07 on dist-test-slave-ltj1"
08:01:07.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:07.379714 31664 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/ts-2/wal/instance:
08:01:07.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6c8167a42a7b489e92ff1abc112926f0"
08:01:07.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 08:01:07 on dist-test-slave-ltj1"
08:01:07.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:07.386670 31664 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.001s
08:01:07.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:07.391964 31681 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:01:07.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:07.392994 31664 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.003s
08:01:07.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:07.393322 31664 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/ts-2/data,/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/ts-2/wal
08:01:07.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6c8167a42a7b489e92ff1abc112926f0"
08:01:07.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 08:01:07 on dist-test-slave-ltj1"
08:01:07.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:07.393697 31664 fs_report.cc:389] FS layout report
08:01:07.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:01:07.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/ts-2/wal
08:01:07.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/ts-2/wal
08:01:07.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/ts-2/data/data
08:01:07.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:01:07.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:01:07.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:01:07.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:01:07.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:01:07.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:01:07.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:01:07.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:01:07.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:01:07.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:01:07.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:01:07.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:07.461827 31664 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:01:07.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:07.463405 31664 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:01:07.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:07.463855 31664 kserver.cc:163] Server-wide thread pool size limit: 3276
08:01:07.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:07.466393 31664 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
08:01:07.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:07.470568 31664 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
08:01:07.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:07.470759 31664 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
08:01:07.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:07.470970 31664 ts_tablet_manager.cc:616] Registered 0 tablets
08:01:07.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:07.471155 31664 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
08:01:07.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:07.601914 31664 rpc_server.cc:307] RPC server started. Bound to: 127.30.90.195:40261
08:01:07.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:07.601984 31793 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.30.90.195:40261 every 8 connection(s)
08:01:07.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:07.605479 31664 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/ts-2/data/info.pb
08:01:07.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:07.610044 31083 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasktDuNhD/build/tsan/bin/kudu as pid 31664
08:01:07.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:07.610432 31083 external_mini_cluster.cc:1448] Reading /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/ts-2/wal/instance
08:01:07.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:07.645849 31796 heartbeater.cc:344] Connected to a master server at 127.30.90.254:39231
08:01:07.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:07.646034 31795 heartbeater.cc:344] Connected to a master server at 127.30.90.253:42583
08:01:07.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:07.646387 31796 heartbeater.cc:461] Registering TS with master...
08:01:07.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:07.646387 31795 heartbeater.cc:461] Registering TS with master...
08:01:07.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:07.647905 31795 heartbeater.cc:507] Master 127.30.90.253:42583 requested a full tablet report, sending...
08:01:07.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:07.647909 31796 heartbeater.cc:507] Master 127.30.90.254:39231 requested a full tablet report, sending...
08:01:07.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:07.651177 31128 ts_manager.cc:194] Registered new tserver with Master: 6c8167a42a7b489e92ff1abc112926f0 (127.30.90.195:40261)
08:01:07.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:07.651419 31203 ts_manager.cc:194] Registered new tserver with Master: 6c8167a42a7b489e92ff1abc112926f0 (127.30.90.195:40261)
08:01:07.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:07.652782 31128 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.30.90.195:48857
08:01:07.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:07.661048 31794 heartbeater.cc:344] Connected to a master server at 127.30.90.252:46693
08:01:07.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:07.661374 31794 heartbeater.cc:461] Registering TS with master...
08:01:07.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:07.661958 31794 heartbeater.cc:507] Master 127.30.90.252:46693 requested a full tablet report, sending...
08:01:07.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:07.665894 31282 ts_manager.cc:194] Registered new tserver with Master: 6c8167a42a7b489e92ff1abc112926f0 (127.30.90.195:40261)
08:01:07.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:07.683776 31083 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
08:01:07.694 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
08:01:07.696 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

08:01:07.704 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.30.90.254"
      port: 39231
    }
    bound_http_address {
      host: "127.30.90.254"
      port: 44517
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.30.90.253"
      port: 42583
    }
    bound_http_address {
      host: "127.30.90.253"
      port: 45207
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.30.90.252"
      port: 46693
    }
    bound_http_address {
      host: "127.30.90.252"
      port: 40845
    }
  }
}

08:01:07.708 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

08:01:07.710 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.30.90.193"
      port: 35933
    }
    bound_http_address {
      host: "127.30.90.193"
      port: 36383
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.30.90.194"
      port: 40111
    }
    bound_http_address {
      host: "127.30.90.194"
      port: 39563
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.30.90.195"
      port: 40261
    }
    bound_http_address {
      host: "127.30.90.195"
      port: 45669
    }
  }
}

08:01:07.710 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
08:01:07.930 [DEBUG - main] (CompositeStrategy.java:59) Unable to load modern Subject methods, relying only on legacy methods
java.lang.NoSuchMethodException: javax.security.auth.Subject.current()
	at java.base/java.lang.Class.getDeclaredMethod(Class.java:2677)
	at org.apache.kudu.client.internals.ModernStrategy.<init>(ModernStrategy.java:51)
	at org.apache.kudu.client.internals.CompositeStrategy.<init>(CompositeStrategy.java:52)
	at org.apache.kudu.client.internals.CompositeStrategy.<clinit>(CompositeStrategy.java:41)
	at org.apache.kudu.client.internals.SecurityManagerCompatibility.get(SecurityManagerCompatibility.java:43)
	at org.apache.kudu.client.SecurityContext.setupSubject(SecurityContext.java:155)
	at org.apache.kudu.client.SecurityContext.<init>(SecurityContext.java:138)
	at org.apache.kudu.client.AsyncKuduClient.<init>(AsyncKuduClient.java:431)
	at org.apache.kudu.client.AsyncKuduClient$AsyncKuduClientBuilder.build(AsyncKuduClient.java:3109)
	at org.apache.kudu.test.KuduTestHarness.before(KuduTestHarness.java:161)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:50)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.doOneAttemptAndReport(RetryRule.java:184)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.evaluate(RetryRule.java:244)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runners.Suite.runChild(Suite.java:128)
	at org.junit.runners.Suite.runChild(Suite.java:27)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
	at org.junit.runner.JUnitCore.runMain(JUnitCore.java:77)
	at org.junit.runner.JUnitCore.main(JUnitCore.java:36)
08:01:07.997 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:01:08.185 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.30.90.254:39231(127.30.90.254:39231)] connecting to peer
08:01:08.252 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.30.90.252:46693(127.30.90.252:46693)] connecting to peer
08:01:08.254 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.30.90.253:42583(127.30.90.253:42583)] connecting to peer
08:01:08.274 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.30.90.253:42583(127.30.90.253:42583)] Successfully connected to peer
08:01:08.277 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.30.90.252:46693(127.30.90.252:46693)] Successfully connected to peer
08:01:08.296 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.30.90.254:39231(127.30.90.254:39231)] Successfully connected to peer
08:01:08.379 [DEBUG - kudu-nio-0] (Negotiator.java:528) SASL mechanism PLAIN chosen for peer 127.30.90.254
08:01:08.384 [DEBUG - kudu-nio-1] (Negotiator.java:528) SASL mechanism PLAIN chosen for peer 127.30.90.252
08:01:08.384 [DEBUG - kudu-nio-2] (Negotiator.java:528) SASL mechanism PLAIN chosen for peer 127.30.90.253
08:01:08.633 [DEBUG - kudu-nio-0] (Negotiator.java:918) Authenticated connection [id: 0x8ab7de6f, L:/127.0.0.1:35270 - R:/127.30.90.254:39231] using SASL/PLAIN
08:01:08.633 [DEBUG - kudu-nio-2] (Negotiator.java:918) Authenticated connection [id: 0xf6a1ac01, L:/127.0.0.1:32970 - R:/127.30.90.253:42583] using SASL/PLAIN
08:01:08.633 [DEBUG - kudu-nio-1] (Negotiator.java:918) Authenticated connection [id: 0x0a82d8dd, L:/127.0.0.1:44936 - R:/127.30.90.252:46693] using SASL/PLAIN
08:01:08.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:08.656451 31796 heartbeater.cc:499] Master 127.30.90.254:39231 was elected leader, sending a full tablet report...
08:01:08.673 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:01:08.675 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=536), Traces: [0ms] refreshing cache from master, [30ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.254:39231, [110ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.252:46693, [112ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.253:42583, [506ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.253:42583: OK, [506ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.252:46693: OK, [506ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.254:39231: OK, deferred=null) after lookup
08:01:08.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:08.731475 31128 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:35270:
08:01:08.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "org.apache.kudu.client.TestClientFailoverSupport-KILL"
08:01:08.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
08:01:08.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:01:08.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key"
08:01:08.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
08:01:08.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
08:01:08.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:01:08.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:01:08.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:01:08.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:01:08.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:01:08.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:01:08.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column1_i"
08:01:08.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
08:01:08.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
08:01:08.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:01:08.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:01:08.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:01:08.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:01:08.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:01:08.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:01:08.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column2_i"
08:01:08.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
08:01:08.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
08:01:08.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:01:08.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:01:08.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:01:08.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:01:08.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:01:08.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:01:08.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column3_s"
08:01:08.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
08:01:08.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
08:01:08.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: true
08:01:08.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: DICT_ENCODING
08:01:08.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: LZ4
08:01:08.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 4096
08:01:08.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:01:08.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:01:08.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:01:08.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:01:08.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column4_b"
08:01:08.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BOOL
08:01:08.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
08:01:08.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:01:08.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:01:08.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:01:08.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:01:08.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:01:08.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
08:01:08.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
08:01:08.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
08:01:08.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
08:01:08.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key"
08:01:08.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
08:01:08.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:01:08.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
08:01:08.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:08.735857 31128 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table org.apache.kudu.client.TestClientFailoverSupport-KILL in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
08:01:08.791 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 056faa1176c948f39436968192abf2d1
08:01:08.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:08.820712 31589 tablet_service.cc:1511] Processing CreateTablet for tablet 976594a12f5c4e3e9928e9e50c91f431 (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-KILL [id=056faa1176c948f39436968192abf2d1]), partition=RANGE (key) PARTITION UNBOUNDED
08:01:08.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:08.823524 31589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 976594a12f5c4e3e9928e9e50c91f431. 1 dirs total, 0 dirs full, 0 dirs failed
08:01:08.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:08.837426 31448 tablet_service.cc:1511] Processing CreateTablet for tablet 976594a12f5c4e3e9928e9e50c91f431 (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-KILL [id=056faa1176c948f39436968192abf2d1]), partition=RANGE (key) PARTITION UNBOUNDED
08:01:08.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:08.841033 31448 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 976594a12f5c4e3e9928e9e50c91f431. 1 dirs total, 0 dirs full, 0 dirs failed
08:01:08.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:08.842710 31729 tablet_service.cc:1511] Processing CreateTablet for tablet 976594a12f5c4e3e9928e9e50c91f431 (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-KILL [id=056faa1176c948f39436968192abf2d1]), partition=RANGE (key) PARTITION UNBOUNDED
08:01:08.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:08.844642 31729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 976594a12f5c4e3e9928e9e50c91f431. 1 dirs total, 0 dirs full, 0 dirs failed
08:01:08.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:08.868974 31829 tablet_bootstrap.cc:492] T 976594a12f5c4e3e9928e9e50c91f431 P 826bc9ae690d480bbe4467803b3ef765: Bootstrap starting.
08:01:08.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:08.869621 31830 tablet_bootstrap.cc:492] T 976594a12f5c4e3e9928e9e50c91f431 P 965da114b2534942b775590153d032d1: Bootstrap starting.
08:01:08.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:08.877101 31830 tablet_bootstrap.cc:654] T 976594a12f5c4e3e9928e9e50c91f431 P 965da114b2534942b775590153d032d1: Neither blocks nor log segments found. Creating new log.
08:01:08.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:08.879498 31830 log.cc:826] T 976594a12f5c4e3e9928e9e50c91f431 P 965da114b2534942b775590153d032d1: Log is configured to *not* fsync() on all Append() calls
08:01:08.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:08.879729 31829 tablet_bootstrap.cc:654] T 976594a12f5c4e3e9928e9e50c91f431 P 826bc9ae690d480bbe4467803b3ef765: Neither blocks nor log segments found. Creating new log.
08:01:08.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:08.882009 31829 log.cc:826] T 976594a12f5c4e3e9928e9e50c91f431 P 826bc9ae690d480bbe4467803b3ef765: Log is configured to *not* fsync() on all Append() calls
08:01:08.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:08.887262 31832 tablet_bootstrap.cc:492] T 976594a12f5c4e3e9928e9e50c91f431 P 6c8167a42a7b489e92ff1abc112926f0: Bootstrap starting.
08:01:08.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:08.887553 31830 tablet_bootstrap.cc:492] T 976594a12f5c4e3e9928e9e50c91f431 P 965da114b2534942b775590153d032d1: No bootstrap required, opened a new log
08:01:08.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:08.888116 31830 ts_tablet_manager.cc:1403] T 976594a12f5c4e3e9928e9e50c91f431 P 965da114b2534942b775590153d032d1: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.007s
08:01:08.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:08.893406 31832 tablet_bootstrap.cc:654] T 976594a12f5c4e3e9928e9e50c91f431 P 6c8167a42a7b489e92ff1abc112926f0: Neither blocks nor log segments found. Creating new log.
08:01:08.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:08.893513 31829 tablet_bootstrap.cc:492] T 976594a12f5c4e3e9928e9e50c91f431 P 826bc9ae690d480bbe4467803b3ef765: No bootstrap required, opened a new log
08:01:08.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:08.894079 31829 ts_tablet_manager.cc:1403] T 976594a12f5c4e3e9928e9e50c91f431 P 826bc9ae690d480bbe4467803b3ef765: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.000s
08:01:08.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:08.896261 31832 log.cc:826] T 976594a12f5c4e3e9928e9e50c91f431 P 6c8167a42a7b489e92ff1abc112926f0: Log is configured to *not* fsync() on all Append() calls
08:01:08.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:08.901546 31832 tablet_bootstrap.cc:492] T 976594a12f5c4e3e9928e9e50c91f431 P 6c8167a42a7b489e92ff1abc112926f0: No bootstrap required, opened a new log
08:01:08.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:08.902915 31832 ts_tablet_manager.cc:1403] T 976594a12f5c4e3e9928e9e50c91f431 P 6c8167a42a7b489e92ff1abc112926f0: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.005s
08:01:08.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:08.915453 31830 raft_consensus.cc:359] T 976594a12f5c4e3e9928e9e50c91f431 P 965da114b2534942b775590153d032d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "826bc9ae690d480bbe4467803b3ef765" member_type: VOTER last_known_addr { host: "127.30.90.194" port: 40111 } } peers { permanent_uuid: "6c8167a42a7b489e92ff1abc112926f0" member_type: VOTER last_known_addr { host: "127.30.90.195" port: 40261 } } peers { permanent_uuid: "965da114b2534942b775590153d032d1" member_type: VOTER last_known_addr { host: "127.30.90.193" port: 35933 } }
08:01:08.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:08.916399 31830 raft_consensus.cc:385] T 976594a12f5c4e3e9928e9e50c91f431 P 965da114b2534942b775590153d032d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:01:08.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:08.916836 31830 raft_consensus.cc:740] T 976594a12f5c4e3e9928e9e50c91f431 P 965da114b2534942b775590153d032d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 965da114b2534942b775590153d032d1, State: Initialized, Role: FOLLOWER
08:01:08.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:08.917879 31830 consensus_queue.cc:260] T 976594a12f5c4e3e9928e9e50c91f431 P 965da114b2534942b775590153d032d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "826bc9ae690d480bbe4467803b3ef765" member_type: VOTER last_known_addr { host: "127.30.90.194" port: 40111 } } peers { permanent_uuid: "6c8167a42a7b489e92ff1abc112926f0" member_type: VOTER last_known_addr { host: "127.30.90.195" port: 40261 } } peers { permanent_uuid: "965da114b2534942b775590153d032d1" member_type: VOTER last_known_addr { host: "127.30.90.193" port: 35933 } }
08:01:08.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:08.921885 31830 ts_tablet_manager.cc:1434] T 976594a12f5c4e3e9928e9e50c91f431 P 965da114b2534942b775590153d032d1: Time spent starting tablet: real 0.033s	user 0.020s	sys 0.012s
08:01:08.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:08.925151 31832 raft_consensus.cc:359] T 976594a12f5c4e3e9928e9e50c91f431 P 6c8167a42a7b489e92ff1abc112926f0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "826bc9ae690d480bbe4467803b3ef765" member_type: VOTER last_known_addr { host: "127.30.90.194" port: 40111 } } peers { permanent_uuid: "6c8167a42a7b489e92ff1abc112926f0" member_type: VOTER last_known_addr { host: "127.30.90.195" port: 40261 } } peers { permanent_uuid: "965da114b2534942b775590153d032d1" member_type: VOTER last_known_addr { host: "127.30.90.193" port: 35933 } }
08:01:08.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:08.926288 31832 raft_consensus.cc:385] T 976594a12f5c4e3e9928e9e50c91f431 P 6c8167a42a7b489e92ff1abc112926f0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:01:08.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:08.926784 31832 raft_consensus.cc:740] T 976594a12f5c4e3e9928e9e50c91f431 P 6c8167a42a7b489e92ff1abc112926f0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c8167a42a7b489e92ff1abc112926f0, State: Initialized, Role: FOLLOWER
08:01:08.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:08.927701 31832 consensus_queue.cc:260] T 976594a12f5c4e3e9928e9e50c91f431 P 6c8167a42a7b489e92ff1abc112926f0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "826bc9ae690d480bbe4467803b3ef765" member_type: VOTER last_known_addr { host: "127.30.90.194" port: 40111 } } peers { permanent_uuid: "6c8167a42a7b489e92ff1abc112926f0" member_type: VOTER last_known_addr { host: "127.30.90.195" port: 40261 } } peers { permanent_uuid: "965da114b2534942b775590153d032d1" member_type: VOTER last_known_addr { host: "127.30.90.193" port: 35933 } }
08:01:08.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:08.927878 31829 raft_consensus.cc:359] T 976594a12f5c4e3e9928e9e50c91f431 P 826bc9ae690d480bbe4467803b3ef765 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "826bc9ae690d480bbe4467803b3ef765" member_type: VOTER last_known_addr { host: "127.30.90.194" port: 40111 } } peers { permanent_uuid: "6c8167a42a7b489e92ff1abc112926f0" member_type: VOTER last_known_addr { host: "127.30.90.195" port: 40261 } } peers { permanent_uuid: "965da114b2534942b775590153d032d1" member_type: VOTER last_known_addr { host: "127.30.90.193" port: 35933 } }
08:01:08.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:08.929407 31829 raft_consensus.cc:385] T 976594a12f5c4e3e9928e9e50c91f431 P 826bc9ae690d480bbe4467803b3ef765 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:01:08.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:08.929910 31829 raft_consensus.cc:740] T 976594a12f5c4e3e9928e9e50c91f431 P 826bc9ae690d480bbe4467803b3ef765 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 826bc9ae690d480bbe4467803b3ef765, State: Initialized, Role: FOLLOWER
08:01:08.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:08.931201 31832 ts_tablet_manager.cc:1434] T 976594a12f5c4e3e9928e9e50c91f431 P 6c8167a42a7b489e92ff1abc112926f0: Time spent starting tablet: real 0.028s	user 0.022s	sys 0.003s
08:01:08.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:08.940073 31829 consensus_queue.cc:260] T 976594a12f5c4e3e9928e9e50c91f431 P 826bc9ae690d480bbe4467803b3ef765 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "826bc9ae690d480bbe4467803b3ef765" member_type: VOTER last_known_addr { host: "127.30.90.194" port: 40111 } } peers { permanent_uuid: "6c8167a42a7b489e92ff1abc112926f0" member_type: VOTER last_known_addr { host: "127.30.90.195" port: 40261 } } peers { permanent_uuid: "965da114b2534942b775590153d032d1" member_type: VOTER last_known_addr { host: "127.30.90.193" port: 35933 } }
08:01:08.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:08.946702 31829 ts_tablet_manager.cc:1434] T 976594a12f5c4e3e9928e9e50c91f431 P 826bc9ae690d480bbe4467803b3ef765: Time spent starting tablet: real 0.052s	user 0.022s	sys 0.013s
08:01:08.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:08.975927 31660 tablet.cc:2406] T 976594a12f5c4e3e9928e9e50c91f431 P 826bc9ae690d480bbe4467803b3ef765: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:01:08.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:08.981745 31836 raft_consensus.cc:493] T 976594a12f5c4e3e9928e9e50c91f431 P 6c8167a42a7b489e92ff1abc112926f0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:01:08.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:08.982280 31836 raft_consensus.cc:515] T 976594a12f5c4e3e9928e9e50c91f431 P 6c8167a42a7b489e92ff1abc112926f0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "826bc9ae690d480bbe4467803b3ef765" member_type: VOTER last_known_addr { host: "127.30.90.194" port: 40111 } } peers { permanent_uuid: "6c8167a42a7b489e92ff1abc112926f0" member_type: VOTER last_known_addr { host: "127.30.90.195" port: 40261 } } peers { permanent_uuid: "965da114b2534942b775590153d032d1" member_type: VOTER last_known_addr { host: "127.30.90.193" port: 35933 } }
08:01:08.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:08.985046 31836 leader_election.cc:290] T 976594a12f5c4e3e9928e9e50c91f431 P 6c8167a42a7b489e92ff1abc112926f0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 826bc9ae690d480bbe4467803b3ef765 (127.30.90.194:40111), 965da114b2534942b775590153d032d1 (127.30.90.193:35933)
08:01:08.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:08.995303 31609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976594a12f5c4e3e9928e9e50c91f431" candidate_uuid: "6c8167a42a7b489e92ff1abc112926f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "826bc9ae690d480bbe4467803b3ef765" is_pre_election: true
08:01:08.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:08.996011 31609 raft_consensus.cc:2468] T 976594a12f5c4e3e9928e9e50c91f431 P 826bc9ae690d480bbe4467803b3ef765 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c8167a42a7b489e92ff1abc112926f0 in term 0.
08:01:08.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:08.997217 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976594a12f5c4e3e9928e9e50c91f431" candidate_uuid: "6c8167a42a7b489e92ff1abc112926f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "965da114b2534942b775590153d032d1" is_pre_election: true
08:01:08.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:08.997375 31682 leader_election.cc:304] T 976594a12f5c4e3e9928e9e50c91f431 P 6c8167a42a7b489e92ff1abc112926f0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c8167a42a7b489e92ff1abc112926f0, 826bc9ae690d480bbe4467803b3ef765; no voters: 
08:01:08.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:08.998018 31836 raft_consensus.cc:2804] T 976594a12f5c4e3e9928e9e50c91f431 P 6c8167a42a7b489e92ff1abc112926f0 [term 0 FOLLOWER]: Leader pre-election won for term 1
08:01:08.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:08.997946 31468 raft_consensus.cc:2468] T 976594a12f5c4e3e9928e9e50c91f431 P 965da114b2534942b775590153d032d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c8167a42a7b489e92ff1abc112926f0 in term 0.
08:01:08.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:08.998265 31836 raft_consensus.cc:493] T 976594a12f5c4e3e9928e9e50c91f431 P 6c8167a42a7b489e92ff1abc112926f0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:01:08.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:08.998466 31836 raft_consensus.cc:3060] T 976594a12f5c4e3e9928e9e50c91f431 P 6c8167a42a7b489e92ff1abc112926f0 [term 0 FOLLOWER]: Advancing to term 1
08:01:09.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:09.003723 31836 raft_consensus.cc:515] T 976594a12f5c4e3e9928e9e50c91f431 P 6c8167a42a7b489e92ff1abc112926f0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "826bc9ae690d480bbe4467803b3ef765" member_type: VOTER last_known_addr { host: "127.30.90.194" port: 40111 } } peers { permanent_uuid: "6c8167a42a7b489e92ff1abc112926f0" member_type: VOTER last_known_addr { host: "127.30.90.195" port: 40261 } } peers { permanent_uuid: "965da114b2534942b775590153d032d1" member_type: VOTER last_known_addr { host: "127.30.90.193" port: 35933 } }
08:01:09.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:09.005810 31836 leader_election.cc:290] T 976594a12f5c4e3e9928e9e50c91f431 P 6c8167a42a7b489e92ff1abc112926f0 [CANDIDATE]: Term 1 election: Requested vote from peers 826bc9ae690d480bbe4467803b3ef765 (127.30.90.194:40111), 965da114b2534942b775590153d032d1 (127.30.90.193:35933)
08:01:09.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:09.007385 31609 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976594a12f5c4e3e9928e9e50c91f431" candidate_uuid: "6c8167a42a7b489e92ff1abc112926f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "826bc9ae690d480bbe4467803b3ef765"
08:01:09.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:09.007918 31609 raft_consensus.cc:3060] T 976594a12f5c4e3e9928e9e50c91f431 P 826bc9ae690d480bbe4467803b3ef765 [term 0 FOLLOWER]: Advancing to term 1
08:01:09.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:09.009192 31468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976594a12f5c4e3e9928e9e50c91f431" candidate_uuid: "6c8167a42a7b489e92ff1abc112926f0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "965da114b2534942b775590153d032d1"
08:01:09.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:09.009717 31468 raft_consensus.cc:3060] T 976594a12f5c4e3e9928e9e50c91f431 P 965da114b2534942b775590153d032d1 [term 0 FOLLOWER]: Advancing to term 1
08:01:09.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:09.013123 31609 raft_consensus.cc:2468] T 976594a12f5c4e3e9928e9e50c91f431 P 826bc9ae690d480bbe4467803b3ef765 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c8167a42a7b489e92ff1abc112926f0 in term 1.
08:01:09.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:09.014134 31682 leader_election.cc:304] T 976594a12f5c4e3e9928e9e50c91f431 P 6c8167a42a7b489e92ff1abc112926f0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c8167a42a7b489e92ff1abc112926f0, 826bc9ae690d480bbe4467803b3ef765; no voters: 
08:01:09.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:09.015142 31836 raft_consensus.cc:2804] T 976594a12f5c4e3e9928e9e50c91f431 P 6c8167a42a7b489e92ff1abc112926f0 [term 1 FOLLOWER]: Leader election won for term 1
08:01:09.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:09.016572 31468 raft_consensus.cc:2468] T 976594a12f5c4e3e9928e9e50c91f431 P 965da114b2534942b775590153d032d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c8167a42a7b489e92ff1abc112926f0 in term 1.
08:01:09.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:09.017611 31836 raft_consensus.cc:697] T 976594a12f5c4e3e9928e9e50c91f431 P 6c8167a42a7b489e92ff1abc112926f0 [term 1 LEADER]: Becoming Leader. State: Replica: 6c8167a42a7b489e92ff1abc112926f0, State: Running, Role: LEADER
08:01:09.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:09.019387 31836 consensus_queue.cc:237] T 976594a12f5c4e3e9928e9e50c91f431 P 6c8167a42a7b489e92ff1abc112926f0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "826bc9ae690d480bbe4467803b3ef765" member_type: VOTER last_known_addr { host: "127.30.90.194" port: 40111 } } peers { permanent_uuid: "6c8167a42a7b489e92ff1abc112926f0" member_type: VOTER last_known_addr { host: "127.30.90.195" port: 40261 } } peers { permanent_uuid: "965da114b2534942b775590153d032d1" member_type: VOTER last_known_addr { host: "127.30.90.193" port: 35933 } }
08:01:09.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:09.030804 31127 catalog_manager.cc:5697] T 976594a12f5c4e3e9928e9e50c91f431 P 6c8167a42a7b489e92ff1abc112926f0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6c8167a42a7b489e92ff1abc112926f0 (127.30.90.195). New cstate: current_term: 1 leader_uuid: "6c8167a42a7b489e92ff1abc112926f0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "826bc9ae690d480bbe4467803b3ef765" member_type: VOTER last_known_addr { host: "127.30.90.194" port: 40111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c8167a42a7b489e92ff1abc112926f0" member_type: VOTER last_known_addr { host: "127.30.90.195" port: 40261 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "965da114b2534942b775590153d032d1" member_type: VOTER last_known_addr { host: "127.30.90.193" port: 35933 } health_report { overall_health: UNKNOWN } } }
08:01:09.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:09.126410 31521 tablet.cc:2406] T 976594a12f5c4e3e9928e9e50c91f431 P 965da114b2534942b775590153d032d1: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:01:09.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:09.135903 31797 tablet.cc:2406] T 976594a12f5c4e3e9928e9e50c91f431 P 6c8167a42a7b489e92ff1abc112926f0: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:01:09.188 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 056faa1176c948f39436968192abf2d1
08:01:09.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:09.192467 31790 debug-util.cc:398] Leaking SignalData structure 0x7b08000ad060 after lost signal to thread 31665
08:01:09.210 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 976594a12f5c4e3e9928e9e50c91f431 for table 'org.apache.kudu.client.TestClientFailoverSupport-KILL' with partition [<start>, <end>)
08:01:09.216 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299994, tablet=976594a12f5c4e3e9928e9e50c91f431@[6c8167a42a7b489e92ff1abc112926f0(127.30.90.195:40261)[L],826bc9ae690d480bbe4467803b3ef765(127.30.90.194:40111),965da114b2534942b775590153d032d1(127.30.90.193:35933)]}]
08:01:09.218 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=21), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.30.90.254:39231, [12ms] Sub RPC GetTableLocations: received response from server master-127.30.90.254:39231: OK, deferred=null) after lookup
08:01:09.229 [DEBUG - kudu-nio-0] (Connection.java:748) [peer 6c8167a42a7b489e92ff1abc112926f0(127.30.90.195:40261)] connecting to peer
08:01:09.232 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 6c8167a42a7b489e92ff1abc112926f0(127.30.90.195:40261)] Successfully connected to peer
08:01:09.346 [DEBUG - kudu-nio-3] (Negotiator.java:918) Authenticated connection [id: 0x19de2949, L:/127.0.0.1:60486 - R:/127.30.90.195:40261] using TOKEN/null
08:01:09.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:09.382509 31609 raft_consensus.cc:1275] T 976594a12f5c4e3e9928e9e50c91f431 P 826bc9ae690d480bbe4467803b3ef765 [term 1 FOLLOWER]: Refusing update from remote peer 6c8167a42a7b489e92ff1abc112926f0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
08:01:09.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:09.382442 31468 raft_consensus.cc:1275] T 976594a12f5c4e3e9928e9e50c91f431 P 965da114b2534942b775590153d032d1 [term 1 FOLLOWER]: Refusing update from remote peer 6c8167a42a7b489e92ff1abc112926f0: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
08:01:09.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:09.384819 31840 consensus_queue.cc:1048] T 976594a12f5c4e3e9928e9e50c91f431 P 6c8167a42a7b489e92ff1abc112926f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "965da114b2534942b775590153d032d1" member_type: VOTER last_known_addr { host: "127.30.90.193" port: 35933 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:01:09.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:09.386389 31836 consensus_queue.cc:1048] T 976594a12f5c4e3e9928e9e50c91f431 P 6c8167a42a7b489e92ff1abc112926f0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "826bc9ae690d480bbe4467803b3ef765" member_type: VOTER last_known_addr { host: "127.30.90.194" port: 40111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
08:01:09.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:09.447965 31845 mvcc.cc:204] Tried to move back new op lower bound from 7305206453766000640 to 7305206452311404544. Current Snapshot: MvccSnapshot[applied={T|T < 7305206453766000640}]
08:01:09.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:09.459272 31846 mvcc.cc:204] Tried to move back new op lower bound from 7305206453766000640 to 7305206452311404544. Current Snapshot: MvccSnapshot[applied={T|T < 7305206453766000640}]
08:01:09.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:09.476881 31847 mvcc.cc:204] Tried to move back new op lower bound from 7305206453766000640 to 7305206452311404544. Current Snapshot: MvccSnapshot[applied={T|T < 7305206453766000640}]
08:01:09.840 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 10 rows, more = false) for scanner KuduScanner(table=org.apache.kudu.client.TestClientFailoverSupport-KILL, tablet=976594a12f5c4e3e9928e9e50c91f431, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:01:09.843 [INFO - Time-limited test] (MiniKuduCluster.java:399) Killing master server 127.30.90.254:39231
08:01:09.845 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: stop_daemon {
  id {
    type: MASTER
    index: 0
  }
}

08:01:09.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:09.845866 31083 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasktDuNhD/build/tsan/bin/kudu with pid 31095
08:01:09.882 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.30.90.254:39231(127.30.90.254:39231)] handling channelInactive
08:01:09.883 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.90.254:39231(127.30.90.254:39231)] cleaning up while in state READY due to: connection closed
08:01:09.883 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
08:01:09.884 [INFO - Time-limited test] (MiniKuduCluster.java:475) Killing tablet server 127.30.90.195:40261
08:01:09.885 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: stop_daemon {
  id {
    type: TSERVER
    index: 2
  }
}

08:01:09.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:09.885520 31083 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasktDuNhD/build/tsan/bin/kudu with pid 31664
08:01:09.911 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 6c8167a42a7b489e92ff1abc112926f0(127.30.90.195:40261)] handling channelInactive
08:01:09.911 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
08:01:09.911 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 6c8167a42a7b489e92ff1abc112926f0(127.30.90.195:40261)] cleaning up while in state READY due to: connection closed
08:01:09.912 [DEBUG - Time-limited test] (Connection.java:748) [peer 6c8167a42a7b489e92ff1abc112926f0(127.30.90.195:40261)] connecting to peer
08:01:09.915 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer 6c8167a42a7b489e92ff1abc112926f0(127.30.90.195:40261): Connection refused: /127.30.90.195:40261
08:01:09.915 [DEBUG - kudu-nio-4] (Connection.java:709) [peer 6c8167a42a7b489e92ff1abc112926f0(127.30.90.195:40261)] cleaning up while in state CONNECTING due to: Failed to connect to peer 6c8167a42a7b489e92ff1abc112926f0(127.30.90.195:40261): Connection refused: /127.30.90.195:40261
08:01:09.915 [INFO - kudu-nio-4] (AsyncKuduClient.java:2355) Invalidating location 6c8167a42a7b489e92ff1abc112926f0(127.30.90.195:40261) for tablet 976594a12f5c4e3e9928e9e50c91f431: Failed to connect to peer 6c8167a42a7b489e92ff1abc112926f0(127.30.90.195:40261): Connection refused: /127.30.90.195:40261
08:01:09.920 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.30.90.254:39231(127.30.90.254:39231)] connecting to peer
08:01:09.922 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231
08:01:09.922 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.90.254:39231(127.30.90.254:39231)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231
08:01:09.922 [INFO - kudu-nio-5] (AsyncKuduClient.java:2355) Invalidating location master-127.30.90.254:39231(127.30.90.254:39231) for tablet Kudu Master: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231
08:01:09.939 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.30.90.254:39231(127.30.90.254:39231)] connecting to peer
08:01:09.943 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231
08:01:09.944 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.90.254:39231(127.30.90.254:39231)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231
08:01:09.945 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.90.254:39231: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231
08:01:09.948 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.30.90.254:39231,127.30.90.252:46693,127.30.90.253:42583; will retry
08:01:09.960 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.30.90.254:39231(127.30.90.254:39231)] connecting to peer
08:01:09.962 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231
08:01:09.962 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.90.254:39231(127.30.90.254:39231)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231
08:01:09.963 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.90.254:39231: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231
08:01:09.965 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.90.254:39231,127.30.90.252:46693,127.30.90.253:42583; will retry
08:01:09.980 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.30.90.254:39231(127.30.90.254:39231)] connecting to peer
08:01:09.982 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231
08:01:09.982 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.90.254:39231(127.30.90.254:39231)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231
08:01:09.982 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.90.254:39231: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231
08:01:09.985 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.90.254:39231,127.30.90.252:46693,127.30.90.253:42583; will retry
08:01:10.020 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.30.90.254:39231(127.30.90.254:39231)] connecting to peer
08:01:10.022 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231
08:01:10.023 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.90.254:39231(127.30.90.254:39231)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231
08:01:10.023 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.30.90.254:39231: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231
08:01:10.025 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.90.254:39231,127.30.90.252:46693,127.30.90.253:42583; will retry
08:01:10.060 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.30.90.254:39231(127.30.90.254:39231)] connecting to peer
08:01:10.062 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231
08:01:10.063 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.90.254:39231(127.30.90.254:39231)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231
08:01:10.063 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.30.90.254:39231: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231
08:01:10.065 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.90.254:39231,127.30.90.252:46693,127.30.90.253:42583; will retry
08:01:10.080 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.30.90.254:39231(127.30.90.254:39231)] connecting to peer
08:01:10.081 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231
08:01:10.082 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.30.90.254:39231(127.30.90.254:39231)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231
08:01:10.082 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.30.90.254:39231: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231
08:01:10.085 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.90.254:39231,127.30.90.252:46693,127.30.90.253:42583; will retry
08:01:10.200 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.30.90.254:39231(127.30.90.254:39231)] connecting to peer
08:01:10.201 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231
08:01:10.201 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.30.90.254:39231(127.30.90.254:39231)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231
08:01:10.202 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.30.90.254:39231: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231
08:01:10.204 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.90.254:39231,127.30.90.252:46693,127.30.90.253:42583; will retry
08:01:10.420 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.30.90.254:39231(127.30.90.254:39231)] connecting to peer
08:01:10.421 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231
08:01:10.422 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.30.90.254:39231(127.30.90.254:39231)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231
08:01:10.422 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.30.90.254:39231: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231
08:01:10.426 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.90.254:39231,127.30.90.252:46693,127.30.90.253:42583; will retry
08:01:10.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:10.512993 31518 heartbeater.cc:646] Failed to heartbeat to 127.30.90.254:39231 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.30.90.254:39231: connect: Connection refused (error 111)
08:01:10.520 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.30.90.254:39231(127.30.90.254:39231)] connecting to peer
08:01:10.521 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231
08:01:10.521 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.30.90.254:39231(127.30.90.254:39231)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231
08:01:10.521 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.30.90.254:39231: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231
08:01:10.525 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.30.90.254:39231,127.30.90.252:46693,127.30.90.253:42583; will retry
08:01:10.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:10.526516 31656 heartbeater.cc:646] Failed to heartbeat to 127.30.90.254:39231 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.30.90.254:39231: connect: Connection refused (error 111)
08:01:10.880 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.30.90.254:39231(127.30.90.254:39231)] connecting to peer
08:01:10.882 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231
08:01:10.882 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.30.90.254:39231(127.30.90.254:39231)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231
08:01:10.883 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.30.90.254:39231: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231
08:01:10.886 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.30.90.254:39231,127.30.90.252:46693,127.30.90.253:42583; will retry
08:01:10.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:10.958158 31865 raft_consensus.cc:493] T 00000000000000000000000000000000 P aa6cc82c575b49acb9dd9a7f924ad8d2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51d367845ccb46a9b65fb650ccf827d2)
08:01:10.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:10.958618 31865 raft_consensus.cc:515] T 00000000000000000000000000000000 P aa6cc82c575b49acb9dd9a7f924ad8d2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d367845ccb46a9b65fb650ccf827d2" member_type: VOTER last_known_addr { host: "127.30.90.254" port: 39231 } } peers { permanent_uuid: "1b0495e904244bf89e8ddf7839389404" member_type: VOTER last_known_addr { host: "127.30.90.253" port: 42583 } } peers { permanent_uuid: "aa6cc82c575b49acb9dd9a7f924ad8d2" member_type: VOTER last_known_addr { host: "127.30.90.252" port: 46693 } }
08:01:10.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:10.960807 31865 leader_election.cc:290] T 00000000000000000000000000000000 P aa6cc82c575b49acb9dd9a7f924ad8d2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51d367845ccb46a9b65fb650ccf827d2 (127.30.90.254:39231), 1b0495e904244bf89e8ddf7839389404 (127.30.90.253:42583)
08:01:10.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:10.963629 31269 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.30.90.254:39231: connect: Connection refused (error 111)
08:01:10.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:10.963744 31211 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "aa6cc82c575b49acb9dd9a7f924ad8d2" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "1b0495e904244bf89e8ddf7839389404" is_pre_election: true
08:01:10.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:10.966899 31269 leader_election.cc:336] T 00000000000000000000000000000000 P aa6cc82c575b49acb9dd9a7f924ad8d2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 51d367845ccb46a9b65fb650ccf827d2 (127.30.90.254:39231): Network error: Client connection negotiation failed: client connection to 127.30.90.254:39231: connect: Connection refused (error 111)
08:01:10.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:10.967258 31269 leader_election.cc:304] T 00000000000000000000000000000000 P aa6cc82c575b49acb9dd9a7f924ad8d2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa6cc82c575b49acb9dd9a7f924ad8d2; no voters: 1b0495e904244bf89e8ddf7839389404, 51d367845ccb46a9b65fb650ccf827d2
08:01:10.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:10.967836 31865 raft_consensus.cc:2749] T 00000000000000000000000000000000 P aa6cc82c575b49acb9dd9a7f924ad8d2 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
08:01:10.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:10.994740 31868 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1b0495e904244bf89e8ddf7839389404 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51d367845ccb46a9b65fb650ccf827d2)
08:01:10.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:10.995275 31868 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1b0495e904244bf89e8ddf7839389404 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d367845ccb46a9b65fb650ccf827d2" member_type: VOTER last_known_addr { host: "127.30.90.254" port: 39231 } } peers { permanent_uuid: "1b0495e904244bf89e8ddf7839389404" member_type: VOTER last_known_addr { host: "127.30.90.253" port: 42583 } } peers { permanent_uuid: "aa6cc82c575b49acb9dd9a7f924ad8d2" member_type: VOTER last_known_addr { host: "127.30.90.252" port: 46693 } }
08:01:10.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:10.997328 31868 leader_election.cc:290] T 00000000000000000000000000000000 P 1b0495e904244bf89e8ddf7839389404 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51d367845ccb46a9b65fb650ccf827d2 (127.30.90.254:39231), aa6cc82c575b49acb9dd9a7f924ad8d2 (127.30.90.252:46693)
08:01:10.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:10.998646 31292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1b0495e904244bf89e8ddf7839389404" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "aa6cc82c575b49acb9dd9a7f924ad8d2" is_pre_election: true
08:01:10.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:10.999221 31292 raft_consensus.cc:2468] T 00000000000000000000000000000000 P aa6cc82c575b49acb9dd9a7f924ad8d2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b0495e904244bf89e8ddf7839389404 in term 1.
08:01:10.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:10.999483 31190 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.30.90.254:39231: connect: Connection refused (error 111) [suppressed 6 similar messages]
08:01:11.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:11.000640 31188 leader_election.cc:304] T 00000000000000000000000000000000 P 1b0495e904244bf89e8ddf7839389404 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b0495e904244bf89e8ddf7839389404, aa6cc82c575b49acb9dd9a7f924ad8d2; no voters: 
08:01:11.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:11.001503 31868 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1b0495e904244bf89e8ddf7839389404 [term 1 FOLLOWER]: Leader pre-election won for term 2
08:01:11.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:11.002425 31868 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1b0495e904244bf89e8ddf7839389404 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 51d367845ccb46a9b65fb650ccf827d2)
08:01:11.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:11.002705 31868 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1b0495e904244bf89e8ddf7839389404 [term 1 FOLLOWER]: Advancing to term 2
08:01:11.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:11.003363 31190 leader_election.cc:336] T 00000000000000000000000000000000 P 1b0495e904244bf89e8ddf7839389404 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 51d367845ccb46a9b65fb650ccf827d2 (127.30.90.254:39231): Network error: Client connection negotiation failed: client connection to 127.30.90.254:39231: connect: Connection refused (error 111)
08:01:11.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:11.009570 31868 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1b0495e904244bf89e8ddf7839389404 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d367845ccb46a9b65fb650ccf827d2" member_type: VOTER last_known_addr { host: "127.30.90.254" port: 39231 } } peers { permanent_uuid: "1b0495e904244bf89e8ddf7839389404" member_type: VOTER last_known_addr { host: "127.30.90.253" port: 42583 } } peers { permanent_uuid: "aa6cc82c575b49acb9dd9a7f924ad8d2" member_type: VOTER last_known_addr { host: "127.30.90.252" port: 46693 } }
08:01:11.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:11.011397 31868 leader_election.cc:290] T 00000000000000000000000000000000 P 1b0495e904244bf89e8ddf7839389404 [CANDIDATE]: Term 2 election: Requested vote from peers 51d367845ccb46a9b65fb650ccf827d2 (127.30.90.254:39231), aa6cc82c575b49acb9dd9a7f924ad8d2 (127.30.90.252:46693)
08:01:11.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:11.012528 31292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1b0495e904244bf89e8ddf7839389404" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "aa6cc82c575b49acb9dd9a7f924ad8d2"
08:01:11.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:11.013065 31292 raft_consensus.cc:3060] T 00000000000000000000000000000000 P aa6cc82c575b49acb9dd9a7f924ad8d2 [term 1 FOLLOWER]: Advancing to term 2
08:01:11.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:11.015290 31190 leader_election.cc:336] T 00000000000000000000000000000000 P 1b0495e904244bf89e8ddf7839389404 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 51d367845ccb46a9b65fb650ccf827d2 (127.30.90.254:39231): Network error: Client connection negotiation failed: client connection to 127.30.90.254:39231: connect: Connection refused (error 111)
08:01:11.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:11.018903 31292 raft_consensus.cc:2468] T 00000000000000000000000000000000 P aa6cc82c575b49acb9dd9a7f924ad8d2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b0495e904244bf89e8ddf7839389404 in term 2.
08:01:11.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:11.019912 31188 leader_election.cc:304] T 00000000000000000000000000000000 P 1b0495e904244bf89e8ddf7839389404 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1b0495e904244bf89e8ddf7839389404, aa6cc82c575b49acb9dd9a7f924ad8d2; no voters: 51d367845ccb46a9b65fb650ccf827d2
08:01:11.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:11.020704 31868 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1b0495e904244bf89e8ddf7839389404 [term 2 FOLLOWER]: Leader election won for term 2
08:01:11.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:11.021675 31868 raft_consensus.cc:697] T 00000000000000000000000000000000 P 1b0495e904244bf89e8ddf7839389404 [term 2 LEADER]: Becoming Leader. State: Replica: 1b0495e904244bf89e8ddf7839389404, State: Running, Role: LEADER
08:01:11.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:11.022535 31868 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1b0495e904244bf89e8ddf7839389404 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d367845ccb46a9b65fb650ccf827d2" member_type: VOTER last_known_addr { host: "127.30.90.254" port: 39231 } } peers { permanent_uuid: "1b0495e904244bf89e8ddf7839389404" member_type: VOTER last_known_addr { host: "127.30.90.253" port: 42583 } } peers { permanent_uuid: "aa6cc82c575b49acb9dd9a7f924ad8d2" member_type: VOTER last_known_addr { host: "127.30.90.252" port: 46693 } }
08:01:11.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:11.026535 31871 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b0495e904244bf89e8ddf7839389404 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1b0495e904244bf89e8ddf7839389404. Latest consensus state: current_term: 2 leader_uuid: "1b0495e904244bf89e8ddf7839389404" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d367845ccb46a9b65fb650ccf827d2" member_type: VOTER last_known_addr { host: "127.30.90.254" port: 39231 } } peers { permanent_uuid: "1b0495e904244bf89e8ddf7839389404" member_type: VOTER last_known_addr { host: "127.30.90.253" port: 42583 } } peers { permanent_uuid: "aa6cc82c575b49acb9dd9a7f924ad8d2" member_type: VOTER last_known_addr { host: "127.30.90.252" port: 46693 } } }
08:01:11.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:11.027311 31871 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b0495e904244bf89e8ddf7839389404 [sys.catalog]: This master's current role is: LEADER
08:01:11.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:11.029532 31873 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
08:01:11.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:11.039393 31873 catalog_manager.cc:679] Loaded metadata for table org.apache.kudu.client.TestClientFailoverSupport-KILL [id=056faa1176c948f39436968192abf2d1]
08:01:11.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:11.043859 31873 tablet_loader.cc:96] loaded metadata for tablet 976594a12f5c4e3e9928e9e50c91f431 (table org.apache.kudu.client.TestClientFailoverSupport-KILL [id=056faa1176c948f39436968192abf2d1])
08:01:11.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:11.044720 31873 catalog_manager.cc:1520] Initializing Kudu cluster ID...
08:01:11.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:11.047276 31873 catalog_manager.cc:1295] Loaded cluster ID: a803207fe7794c6abbe45df267e73465
08:01:11.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:11.047451 31873 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
08:01:11.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:11.050365 31873 catalog_manager.cc:1540] Loading token signing keys...
08:01:11.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:11.052858 31873 catalog_manager.cc:6081] T 00000000000000000000000000000000 P 1b0495e904244bf89e8ddf7839389404: Loaded TSK: 0
08:01:11.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:11.053853 31873 catalog_manager.cc:1550] Initializing in-progress tserver states...
08:01:11.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:11.256278 31874 raft_consensus.cc:493] T 976594a12f5c4e3e9928e9e50c91f431 P 965da114b2534942b775590153d032d1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c8167a42a7b489e92ff1abc112926f0)
08:01:11.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:11.256913 31874 raft_consensus.cc:515] T 976594a12f5c4e3e9928e9e50c91f431 P 965da114b2534942b775590153d032d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "826bc9ae690d480bbe4467803b3ef765" member_type: VOTER last_known_addr { host: "127.30.90.194" port: 40111 } } peers { permanent_uuid: "6c8167a42a7b489e92ff1abc112926f0" member_type: VOTER last_known_addr { host: "127.30.90.195" port: 40261 } } peers { permanent_uuid: "965da114b2534942b775590153d032d1" member_type: VOTER last_known_addr { host: "127.30.90.193" port: 35933 } }
08:01:11.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:11.258885 31875 raft_consensus.cc:493] T 976594a12f5c4e3e9928e9e50c91f431 P 826bc9ae690d480bbe4467803b3ef765 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 6c8167a42a7b489e92ff1abc112926f0)
08:01:11.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:11.259325 31875 raft_consensus.cc:515] T 976594a12f5c4e3e9928e9e50c91f431 P 826bc9ae690d480bbe4467803b3ef765 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "826bc9ae690d480bbe4467803b3ef765" member_type: VOTER last_known_addr { host: "127.30.90.194" port: 40111 } } peers { permanent_uuid: "6c8167a42a7b489e92ff1abc112926f0" member_type: VOTER last_known_addr { host: "127.30.90.195" port: 40261 } } peers { permanent_uuid: "965da114b2534942b775590153d032d1" member_type: VOTER last_known_addr { host: "127.30.90.193" port: 35933 } }
08:01:11.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:11.259976 31874 leader_election.cc:290] T 976594a12f5c4e3e9928e9e50c91f431 P 965da114b2534942b775590153d032d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 826bc9ae690d480bbe4467803b3ef765 (127.30.90.194:40111), 6c8167a42a7b489e92ff1abc112926f0 (127.30.90.195:40261)
08:01:11.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:11.262153 31875 leader_election.cc:290] T 976594a12f5c4e3e9928e9e50c91f431 P 826bc9ae690d480bbe4467803b3ef765 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6c8167a42a7b489e92ff1abc112926f0 (127.30.90.195:40261), 965da114b2534942b775590153d032d1 (127.30.90.193:35933)
08:01:11.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:11.265187 31404 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.30.90.195:40261: connect: Connection refused (error 111)
08:01:11.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:11.275482 31608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976594a12f5c4e3e9928e9e50c91f431" candidate_uuid: "965da114b2534942b775590153d032d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "826bc9ae690d480bbe4467803b3ef765" is_pre_election: true
08:01:11.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:11.276207 31608 raft_consensus.cc:2468] T 976594a12f5c4e3e9928e9e50c91f431 P 826bc9ae690d480bbe4467803b3ef765 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 965da114b2534942b775590153d032d1 in term 1.
08:01:11.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:11.278427 31401 leader_election.cc:304] T 976594a12f5c4e3e9928e9e50c91f431 P 965da114b2534942b775590153d032d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 826bc9ae690d480bbe4467803b3ef765, 965da114b2534942b775590153d032d1; no voters: 
08:01:11.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:11.279871 31874 raft_consensus.cc:2804] T 976594a12f5c4e3e9928e9e50c91f431 P 965da114b2534942b775590153d032d1 [term 1 FOLLOWER]: Leader pre-election won for term 2
08:01:11.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:11.280252 31874 raft_consensus.cc:493] T 976594a12f5c4e3e9928e9e50c91f431 P 965da114b2534942b775590153d032d1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 6c8167a42a7b489e92ff1abc112926f0)
08:01:11.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:11.280592 31874 raft_consensus.cc:3060] T 976594a12f5c4e3e9928e9e50c91f431 P 965da114b2534942b775590153d032d1 [term 1 FOLLOWER]: Advancing to term 2
08:01:11.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:11.283245 31545 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.30.90.195:40261: connect: Connection refused (error 111)
08:01:11.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:11.284596 31404 leader_election.cc:336] T 976594a12f5c4e3e9928e9e50c91f431 P 965da114b2534942b775590153d032d1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6c8167a42a7b489e92ff1abc112926f0 (127.30.90.195:40261): Network error: Client connection negotiation failed: client connection to 127.30.90.195:40261: connect: Connection refused (error 111)
08:01:11.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:11.287415 31874 raft_consensus.cc:515] T 976594a12f5c4e3e9928e9e50c91f431 P 965da114b2534942b775590153d032d1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "826bc9ae690d480bbe4467803b3ef765" member_type: VOTER last_known_addr { host: "127.30.90.194" port: 40111 } } peers { permanent_uuid: "6c8167a42a7b489e92ff1abc112926f0" member_type: VOTER last_known_addr { host: "127.30.90.195" port: 40261 } } peers { permanent_uuid: "965da114b2534942b775590153d032d1" member_type: VOTER last_known_addr { host: "127.30.90.193" port: 35933 } }
08:01:11.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:11.288759 31545 leader_election.cc:336] T 976594a12f5c4e3e9928e9e50c91f431 P 826bc9ae690d480bbe4467803b3ef765 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 6c8167a42a7b489e92ff1abc112926f0 (127.30.90.195:40261): Network error: Client connection negotiation failed: client connection to 127.30.90.195:40261: connect: Connection refused (error 111)
08:01:11.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:11.289865 31874 leader_election.cc:290] T 976594a12f5c4e3e9928e9e50c91f431 P 965da114b2534942b775590153d032d1 [CANDIDATE]: Term 2 election: Requested vote from peers 826bc9ae690d480bbe4467803b3ef765 (127.30.90.194:40111), 6c8167a42a7b489e92ff1abc112926f0 (127.30.90.195:40261)
08:01:11.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:11.290060 31608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976594a12f5c4e3e9928e9e50c91f431" candidate_uuid: "965da114b2534942b775590153d032d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "826bc9ae690d480bbe4467803b3ef765"
08:01:11.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:11.290670 31608 raft_consensus.cc:3060] T 976594a12f5c4e3e9928e9e50c91f431 P 826bc9ae690d480bbe4467803b3ef765 [term 1 FOLLOWER]: Advancing to term 2
08:01:11.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:11.293448 31404 leader_election.cc:336] T 976594a12f5c4e3e9928e9e50c91f431 P 965da114b2534942b775590153d032d1 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 6c8167a42a7b489e92ff1abc112926f0 (127.30.90.195:40261): Network error: Client connection negotiation failed: client connection to 127.30.90.195:40261: connect: Connection refused (error 111)
08:01:11.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:11.294309 31467 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "976594a12f5c4e3e9928e9e50c91f431" candidate_uuid: "826bc9ae690d480bbe4467803b3ef765" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "965da114b2534942b775590153d032d1" is_pre_election: true
08:01:11.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:11.295027 31467 raft_consensus.cc:2393] T 976594a12f5c4e3e9928e9e50c91f431 P 965da114b2534942b775590153d032d1 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 826bc9ae690d480bbe4467803b3ef765 in current term 2: Already voted for candidate 965da114b2534942b775590153d032d1 in this term.
08:01:11.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:11.296195 31608 raft_consensus.cc:2468] T 976594a12f5c4e3e9928e9e50c91f431 P 826bc9ae690d480bbe4467803b3ef765 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 965da114b2534942b775590153d032d1 in term 2.
08:01:11.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:11.296270 31542 leader_election.cc:304] T 976594a12f5c4e3e9928e9e50c91f431 P 826bc9ae690d480bbe4467803b3ef765 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 826bc9ae690d480bbe4467803b3ef765; no voters: 6c8167a42a7b489e92ff1abc112926f0, 965da114b2534942b775590153d032d1
08:01:11.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:11.296958 31875 raft_consensus.cc:2749] T 976594a12f5c4e3e9928e9e50c91f431 P 826bc9ae690d480bbe4467803b3ef765 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
08:01:11.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:11.297235 31401 leader_election.cc:304] T 976594a12f5c4e3e9928e9e50c91f431 P 965da114b2534942b775590153d032d1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 826bc9ae690d480bbe4467803b3ef765, 965da114b2534942b775590153d032d1; no voters: 6c8167a42a7b489e92ff1abc112926f0
08:01:11.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:11.297887 31874 raft_consensus.cc:2804] T 976594a12f5c4e3e9928e9e50c91f431 P 965da114b2534942b775590153d032d1 [term 2 FOLLOWER]: Leader election won for term 2
08:01:11.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:11.299428 31874 raft_consensus.cc:697] T 976594a12f5c4e3e9928e9e50c91f431 P 965da114b2534942b775590153d032d1 [term 2 LEADER]: Becoming Leader. State: Replica: 965da114b2534942b775590153d032d1, State: Running, Role: LEADER
08:01:11.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:11.300909 31874 consensus_queue.cc:237] T 976594a12f5c4e3e9928e9e50c91f431 P 965da114b2534942b775590153d032d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 1.11, Last appended by leader: 11, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "826bc9ae690d480bbe4467803b3ef765" member_type: VOTER last_known_addr { host: "127.30.90.194" port: 40111 } } peers { permanent_uuid: "6c8167a42a7b489e92ff1abc112926f0" member_type: VOTER last_known_addr { host: "127.30.90.195" port: 40261 } } peers { permanent_uuid: "965da114b2534942b775590153d032d1" member_type: VOTER last_known_addr { host: "127.30.90.193" port: 35933 } }
08:01:11.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:11.311589 31203 catalog_manager.cc:5697] T 976594a12f5c4e3e9928e9e50c91f431 P 965da114b2534942b775590153d032d1 reported cstate change: term changed from 1 to 2, leader changed from 6c8167a42a7b489e92ff1abc112926f0 (127.30.90.195) to 965da114b2534942b775590153d032d1 (127.30.90.193). New cstate: current_term: 2 leader_uuid: "965da114b2534942b775590153d032d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "826bc9ae690d480bbe4467803b3ef765" member_type: VOTER last_known_addr { host: "127.30.90.194" port: 40111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6c8167a42a7b489e92ff1abc112926f0" member_type: VOTER last_known_addr { host: "127.30.90.195" port: 40261 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "965da114b2534942b775590153d032d1" member_type: VOTER last_known_addr { host: "127.30.90.193" port: 35933 } health_report { overall_health: HEALTHY } } }
08:01:11.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:11.339366 31292 raft_consensus.cc:1275] T 00000000000000000000000000000000 P aa6cc82c575b49acb9dd9a7f924ad8d2 [term 2 FOLLOWER]: Refusing update from remote peer 1b0495e904244bf89e8ddf7839389404: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
08:01:11.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:11.340837 31871 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 1b0495e904244bf89e8ddf7839389404 [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa6cc82c575b49acb9dd9a7f924ad8d2" member_type: VOTER last_known_addr { host: "127.30.90.252" port: 46693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
08:01:11.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:11.341857 31190 consensus_peers.cc:597] T 00000000000000000000000000000000 P 1b0495e904244bf89e8ddf7839389404 -> Peer 51d367845ccb46a9b65fb650ccf827d2 (127.30.90.254:39231): Couldn't send request to peer 51d367845ccb46a9b65fb650ccf827d2. Status: Network error: Client connection negotiation failed: client connection to 127.30.90.254:39231: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
08:01:11.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:11.347463 31865 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa6cc82c575b49acb9dd9a7f924ad8d2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1b0495e904244bf89e8ddf7839389404. Latest consensus state: current_term: 2 leader_uuid: "1b0495e904244bf89e8ddf7839389404" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d367845ccb46a9b65fb650ccf827d2" member_type: VOTER last_known_addr { host: "127.30.90.254" port: 39231 } } peers { permanent_uuid: "1b0495e904244bf89e8ddf7839389404" member_type: VOTER last_known_addr { host: "127.30.90.253" port: 42583 } } peers { permanent_uuid: "aa6cc82c575b49acb9dd9a7f924ad8d2" member_type: VOTER last_known_addr { host: "127.30.90.252" port: 46693 } } }
08:01:11.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:11.348097 31865 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa6cc82c575b49acb9dd9a7f924ad8d2 [sys.catalog]: This master's current role is: FOLLOWER
08:01:11.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:11.352033 31868 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b0495e904244bf89e8ddf7839389404 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "1b0495e904244bf89e8ddf7839389404" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d367845ccb46a9b65fb650ccf827d2" member_type: VOTER last_known_addr { host: "127.30.90.254" port: 39231 } } peers { permanent_uuid: "1b0495e904244bf89e8ddf7839389404" member_type: VOTER last_known_addr { host: "127.30.90.253" port: 42583 } } peers { permanent_uuid: "aa6cc82c575b49acb9dd9a7f924ad8d2" member_type: VOTER last_known_addr { host: "127.30.90.252" port: 46693 } } }
08:01:11.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:11.352751 31868 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b0495e904244bf89e8ddf7839389404 [sys.catalog]: This master's current role is: LEADER
08:01:11.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:11.353834 31865 sys_catalog.cc:455] T 00000000000000000000000000000000 P aa6cc82c575b49acb9dd9a7f924ad8d2 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "1b0495e904244bf89e8ddf7839389404" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51d367845ccb46a9b65fb650ccf827d2" member_type: VOTER last_known_addr { host: "127.30.90.254" port: 39231 } } peers { permanent_uuid: "1b0495e904244bf89e8ddf7839389404" member_type: VOTER last_known_addr { host: "127.30.90.253" port: 42583 } } peers { permanent_uuid: "aa6cc82c575b49acb9dd9a7f924ad8d2" member_type: VOTER last_known_addr { host: "127.30.90.252" port: 46693 } } }
08:01:11.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:11.354477 31865 sys_catalog.cc:458] T 00000000000000000000000000000000 P aa6cc82c575b49acb9dd9a7f924ad8d2 [sys.catalog]: This master's current role is: FOLLOWER
08:01:11.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:11.744930 31608 raft_consensus.cc:1275] T 976594a12f5c4e3e9928e9e50c91f431 P 826bc9ae690d480bbe4467803b3ef765 [term 2 FOLLOWER]: Refusing update from remote peer 965da114b2534942b775590153d032d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 2 index: 12. (index mismatch)
08:01:11.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:11.746312 31874 consensus_queue.cc:1048] T 976594a12f5c4e3e9928e9e50c91f431 P 965da114b2534942b775590153d032d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "826bc9ae690d480bbe4467803b3ef765" member_type: VOTER last_known_addr { host: "127.30.90.194" port: 40111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
08:01:11.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:11.749173 31655 heartbeater.cc:499] Master 127.30.90.253:42583 was elected leader, sending a full tablet report...
08:01:11.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:11.768676 31514 heartbeater.cc:499] Master 127.30.90.253:42583 was elected leader, sending a full tablet report...
08:01:11.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:11.772861 31404 consensus_peers.cc:597] T 976594a12f5c4e3e9928e9e50c91f431 P 965da114b2534942b775590153d032d1 -> Peer 6c8167a42a7b489e92ff1abc112926f0 (127.30.90.195:40261): Couldn't send request to peer 6c8167a42a7b489e92ff1abc112926f0. Status: Network error: Client connection negotiation failed: client connection to 127.30.90.195:40261: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
08:01:12.939 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.30.90.254:39231(127.30.90.254:39231)] connecting to peer
08:01:12.941 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231
08:01:12.941 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.30.90.254:39231(127.30.90.254:39231)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231
08:01:12.941 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.30.90.254:39231: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231
08:01:12.946 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:01:12.948 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableLocations, tablet=Kudu Master, attempt=12, TimeoutTracker(timeout=29993, elapsed=3026), Traces: [0ms] sending RPC to server master-127.30.90.254:39231, [3ms] received response from server master-127.30.90.254:39231: Network error: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231, [3ms] delaying RPC due to: Network error: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231, [20ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.254:39231, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.252:46693, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.253:42583, [26ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.252:46693: OK, [26ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.253:42583: OK, [26ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.254:39231: Network error: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231, [29ms] delaying RPC due to: Service unavailable: Master config (127.30.90.254:39231,127.30.90.252:46693,127.30.90.253:42583) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231, [40ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.254:39231, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.252:46693, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.253:42583, [44ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.254:39231: Network error: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231, [46ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.253:42583: OK, [46ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.252:46693: OK, [46ms] delaying RPC due to: Service unavailable: Master config (127.30.90.254:39231,127.30.90.252:46693,127.30.90.253:42583) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.254:39231, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.252:46693, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.253:42583, [63ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.254:39231: Network error: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231, [66ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.253:42583: OK, [66ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.252:46693: OK, [66ms] delaying RPC due to: Service unavailable: Master config (127.30.90.254:39231,127.30.90.252:46693,127.30.90.253:42583) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.254:39231, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.252:46693, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.253:42583, [104ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.254:39231: Network error: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231, [106ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.253:42583: OK, [106ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.252:46693: OK, [106ms] delaying RPC due to: Service unavailable: Master config (127.30.90.254:39231,127.30.90.252:46693,127.30.90.253:42583) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231, [140ms] refreshing cache from master, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.254:39231, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.252:46693, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.253:42583, [144ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.254:39231: Network error: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231, [146ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.253:42583: OK, [146ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.252:46693: OK, [147ms] delaying RPC due to: Service unavailable: Master config (127.30.90.254:39231,127.30.90.252:46693,127.30.90.253:42583) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231, [160ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.254:39231, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.252:46693, [162ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.253:42583, [163ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.254:39231: Network error: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231, [165ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.252:46693: OK, [166ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.253:42583: OK, [166ms] delaying RPC due to: Service unavailable: Master config (127.30.90.254:39231,127.30.90.252:46693,127.30.90.253:42583) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231, [280ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.254:39231, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.252:46693, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.253:42583, [282ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.254:39231: Network error: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231, [285ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.253:42583: OK, [285ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.252:46693: OK, [286ms] delaying RPC due to: Service unavailable: Master config (127.30.90.254:39231,127.30.90.252:46693,127.30.90.253:42583) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231, [501ms] refreshing cache from master, [501ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.254:39231, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.252:46693, [503ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.254:39231: Network error: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231, [503ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.253:42583, [506ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.252:46693: OK, [507ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.253:42583: OK, [508ms] delaying RPC due to: Service unavailable: Master config (127.30.90.254:39231,127.30.90.252:46693,127.30.90.253:42583) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231, [600ms] refreshing cache from master, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.254:39231, [601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.252:46693, [602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.253:42583, [602ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.254:39231: Network error: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231, [606ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.253:42583: OK, [606ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.252:46693: OK, [606ms] delaying RPC due to: Service unavailable: Master config (127.30.90.254:39231,127.30.90.252:46693,127.30.90.253:42583) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231, [961ms] refreshing cache from master, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.254:39231, [962ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.252:46693, [963ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.253:42583, [963ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.254:39231: Network error: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231, [966ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.252:46693: OK, [966ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.253:42583: OK, [967ms] delaying RPC due to: Service unavailable: Master config (127.30.90.254:39231,127.30.90.252:46693,127.30.90.253:42583) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231, [3020ms] refreshing cache from master, [3020ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.254:39231, [3021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.252:46693, [3021ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.253:42583, [3022ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.254:39231: Network error: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231, [3025ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.252:46693: OK, [3026ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.253:42583: OK, deferred=Deferred@1848550506(state=PENDING, result=null, callback=get tablet locations from the master for table org.apache.kudu.client.TestClientFailoverSupport-KILL -> release master lookup permit -> retry RPC -> (continuation of Deferred@1334383122 after retry RPC after error@648866618) -> (continuation of Deferred@1306146689 after retry RPC after error@1456265124) -> (continuation of Deferred@1364350701 after retry RPC after error@275157702) -> (continuation of Deferred@203217268 after retry RPC after error@1021136548) -> (continuation of Deferred@2147193580 after retry RPC after error@1538252663) -> (continuation of Deferred@823294479 after retry RPC after error@1735178983) -> (continuation of Deferred@1143158804 after retry RPC after error@1632768896) -> (continuation of Deferred@1127403431 after retry RPC after error@1091305124) -> (continuation of Deferred@473275657 after retry RPC after error@1837777692) -> (continuation of Deferred@940635901 after retry RPC after error@644923781), errback=passthrough -> release master lookup permit -> retry RPC after error -> (continuation of Deferred@1334383122 after retry RPC after error@648866618) -> (continuation of Deferred@1306146689 after retry RPC after error@1456265124) -> (continuation of Deferred@1364350701 after retry RPC after error@275157702) -> (continuation of Deferred@203217268 after retry RPC after error@1021136548) -> (continuation of Deferred@2147193580 after retry RPC after error@1538252663) -> (continuation of Deferred@823294479 after retry RPC after error@1735178983) -> (continuation of Deferred@1143158804 after retry RPC after error@1632768896) -> (continuation of Deferred@1127403431 after retry RPC after error@1091305124) -> (continuation of Deferred@473275657 after retry RPC after error@1837777692) -> (continuation of Deferred@940635901 after retry RPC after error@644923781))) after lookup
08:01:12.955 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 976594a12f5c4e3e9928e9e50c91f431 for table 'org.apache.kudu.client.TestClientFailoverSupport-KILL' with partition [<start>, <end>)
08:01:12.955 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=976594a12f5c4e3e9928e9e50c91f431@[6c8167a42a7b489e92ff1abc112926f0(127.30.90.195:40261),826bc9ae690d480bbe4467803b3ef765(127.30.90.194:40111),965da114b2534942b775590153d032d1(127.30.90.193:35933)[L]]}]
08:01:12.957 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=976594a12f5c4e3e9928e9e50c91f431, attempt=2, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=3044), Traces: [0ms] sending RPC to server 6c8167a42a7b489e92ff1abc112926f0, [3ms] received response from server 6c8167a42a7b489e92ff1abc112926f0: Network error: Failed to connect to peer 6c8167a42a7b489e92ff1abc112926f0(127.30.90.195:40261): Connection refused: /127.30.90.195:40261, [4ms] delaying RPC due to: Network error: Failed to connect to peer 6c8167a42a7b489e92ff1abc112926f0(127.30.90.195:40261): Connection refused: /127.30.90.195:40261, [7ms] refreshing cache from master, [7ms] Sub RPC GetTableLocations: sending RPC to server master-127.30.90.254:39231, [10ms] Sub RPC GetTableLocations: received response from server master-127.30.90.254:39231: Network error: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231, [10ms] Sub RPC GetTableLocations: delaying RPC due to: Network error: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231, [27ms] Sub RPC GetTableLocations: refreshing cache from master, [27ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.254:39231, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.252:46693, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.253:42583, [33ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.252:46693: OK, [33ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.253:42583: OK, [33ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.254:39231: Network error: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231, [36ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.30.90.254:39231,127.30.90.252:46693,127.30.90.253:42583) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231, [47ms] Sub RPC GetTableLocations: refreshing cache from master, [48ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.254:39231, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.252:46693, [49ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.253:42583, [51ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.254:39231: Network error: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231, [53ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.253:42583: OK, [53ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.252:46693: OK, [53ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.30.90.254:39231,127.30.90.252:46693,127.30.90.253:42583) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231, [68ms] Sub RPC GetTableLocations: refreshing cache from master, [68ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.254:39231, [69ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.252:46693, [69ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.253:42583, [70ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.254:39231: Network error: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231, [73ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.253:42583: OK, [73ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.252:46693: OK, [73ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.30.90.254:39231,127.30.90.252:46693,127.30.90.253:42583) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231, [107ms] Sub RPC GetTableLocations: refreshing cache from master, [107ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.254:39231, [108ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.252:46693, [109ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.253:42583, [111ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.254:39231: Network error: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231, [113ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.253:42583: OK, [113ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.252:46693: OK, [113ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.30.90.254:39231,127.30.90.252:46693,127.30.90.253:42583) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231, [147ms] Sub RPC GetTableLocations: refreshing cache from master, [148ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.254:39231, [149ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.252:46693, [149ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.253:42583, [151ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.254:39231: Network error: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231, [153ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.253:42583: OK, [153ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.252:46693: OK, [154ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.30.90.254:39231,127.30.90.252:46693,127.30.90.253:42583) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231, [167ms] Sub RPC GetTableLocations: refreshing cache from master, [168ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.254:39231, [169ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.252:46693, [169ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.253:42583, [170ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.254:39231: Network error: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231, [172ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.252:46693: OK, [173ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.253:42583: OK, [173ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.30.90.254:39231,127.30.90.252:46693,127.30.90.253:42583) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231, [287ms] Sub RPC GetTableLocations: refreshing cache from master, [288ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.254:39231, [288ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.252:46693, [289ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.253:42583, [289ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.254:39231: Network error: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231, [292ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.253:42583: OK, [292ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.252:46693: OK, [293ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.30.90.254:39231,127.30.90.252:46693,127.30.90.253:42583) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231, [508ms] Sub RPC GetTableLocations: refreshing cache from master, [508ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.254:39231, [509ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.252:46693, [510ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.254:39231: Network error: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231, [510ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.253:42583, [513ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.252:46693: OK, [514ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.253:42583: OK, [515ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.30.90.254:39231,127.30.90.252:46693,127.30.90.253:42583) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231, [607ms] Sub RPC GetTableLocations: refreshing cache from master, [608ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.254:39231, [608ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.252:46693, [609ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.253:42583, [609ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.254:39231: Network error: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231, [613ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.253:42583: OK, [613ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.252:46693: OK, [613ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.30.90.254:39231,127.30.90.252:46693,127.30.90.253:42583) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231, [968ms] Sub RPC GetTableLocations: refreshing cache from master, [968ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.254:39231, [969ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.252:46693, [970ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.253:42583, [970ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.254:39231: Network error: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231, [973ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.252:46693: OK, [973ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.253:42583: OK, [974ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.30.90.254:39231,127.30.90.252:46693,127.30.90.253:42583) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231, [3027ms] Sub RPC GetTableLocations: refreshing cache from master, [3027ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.254:39231, [3028ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.252:46693, [3028ms] Sub RPC ConnectToMaster: sending RPC to server master-127.30.90.253:42583, [3029ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.254:39231: Network error: Failed to connect to peer master-127.30.90.254:39231(127.30.90.254:39231): Connection refused: /127.30.90.254:39231, [3032ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.252:46693: OK, [3033ms] Sub RPC ConnectToMaster: received response from server master-127.30.90.253:42583: OK, [3037ms] Sub RPC GetTableLocations: sending RPC to server master-127.30.90.253:42583, [3042ms] Sub RPC GetTableLocations: received response from server master-127.30.90.253:42583: OK, deferred=Deferred@699461355(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$230/0x00007fd8d03349f8@1628423e -> passthrough -> wakeup thread Time-limited test, errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@36f4c597 -> wakeup thread Time-limited test)) after lookup
08:01:12.960 [DEBUG - kudu-nio-2] (Connection.java:748) [peer 965da114b2534942b775590153d032d1(127.30.90.193:35933)] connecting to peer
08:01:12.961 [DEBUG - kudu-nio-1] (Connection.java:757) [peer 965da114b2534942b775590153d032d1(127.30.90.193:35933)] Successfully connected to peer
08:01:12.983 [DEBUG - kudu-nio-1] (Negotiator.java:918) Authenticated connection [id: 0x2292db4c, L:/127.0.0.1:43434 - R:/127.30.90.193:35933] using TOKEN/null
08:01:13.152 [DEBUG - kudu-nio-1] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 20 rows, more = false) for scanner KuduScanner(table=org.apache.kudu.client.TestClientFailoverSupport-KILL, tablet=976594a12f5c4e3e9928e9e50c91f431, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:01:13.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:13.157897 31203 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:32970:
08:01:13.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "org.apache.kudu.client.TestClientFailoverSupport-KILL" }
08:01:13.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:13.158587 31203 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:32970:
08:01:13.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "org.apache.kudu.client.TestClientFailoverSupport-KILL" }
08:01:13.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:13.219913 31203 catalog_manager.cc:5984] T 00000000000000000000000000000000 P 1b0495e904244bf89e8ddf7839389404: Sending DeleteTablet for 3 replicas of tablet 976594a12f5c4e3e9928e9e50c91f431
08:01:13.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:13.255613 31190 catalog_manager.cc:4755] TS 6c8167a42a7b489e92ff1abc112926f0 (127.30.90.195:40261): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 976594a12f5c4e3e9928e9e50c91f431: Network error: Client connection negotiation failed: client connection to 127.30.90.195:40261: connect: Connection refused (error 111)
08:01:13.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:13.258361 31589 tablet_service.cc:1558] Processing DeleteTablet for tablet 976594a12f5c4e3e9928e9e50c91f431 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-07-08 08:01:13 UTC) from {username='slave'} at 127.0.0.1:48440
08:01:13.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:13.262943 31448 tablet_service.cc:1558] Processing DeleteTablet for tablet 976594a12f5c4e3e9928e9e50c91f431 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-07-08 08:01:13 UTC) from {username='slave'} at 127.0.0.1:43450
08:01:13.265 [DEBUG - main] (Connection.java:575) [peer 965da114b2534942b775590153d032d1(127.30.90.193:35933)] disconnecting while in state READY
08:01:13.271 [DEBUG - kudu-nio-1] (Connection.java:239) [peer 965da114b2534942b775590153d032d1(127.30.90.193:35933)] handling channelInactive
08:01:13.275 [DEBUG - kudu-nio-1] (Connection.java:709) [peer 965da114b2534942b775590153d032d1(127.30.90.193:35933)] cleaning up while in state READY due to: connection closed
08:01:13.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:13.275965 31921 tablet_replica.cc:333] T 976594a12f5c4e3e9928e9e50c91f431 P 965da114b2534942b775590153d032d1: stopping tablet replica
08:01:13.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:13.277262 31921 raft_consensus.cc:2243] T 976594a12f5c4e3e9928e9e50c91f431 P 965da114b2534942b775590153d032d1 [term 2 LEADER]: Raft consensus shutting down.
08:01:13.277 [DEBUG - main] (Connection.java:575) [peer master-127.30.90.254:39231(127.30.90.254:39231)] disconnecting while in state TERMINATED
08:01:13.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:13.278784 31921 raft_consensus.cc:2272] T 976594a12f5c4e3e9928e9e50c91f431 P 965da114b2534942b775590153d032d1 [term 2 FOLLOWER]: Raft consensus is shut down!
08:01:13.280 [DEBUG - main] (Connection.java:575) [peer 6c8167a42a7b489e92ff1abc112926f0(127.30.90.195:40261)] disconnecting while in state TERMINATED
08:01:13.281 [DEBUG - main] (Connection.java:575) [peer master-127.30.90.253:42583(127.30.90.253:42583)] disconnecting while in state READY
08:01:13.281 [DEBUG - main] (Connection.java:575) [peer master-127.30.90.252:46693(127.30.90.252:46693)] disconnecting while in state READY
08:01:13.282 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.30.90.253:42583(127.30.90.253:42583)] handling channelInactive
08:01:13.282 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.30.90.252:46693(127.30.90.252:46693)] handling channelInactive
08:01:13.282 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.30.90.253:42583(127.30.90.253:42583)] cleaning up while in state READY due to: connection closed
08:01:13.282 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.30.90.252:46693(127.30.90.252:46693)] cleaning up while in state READY due to: connection closed
08:01:13.283 [DEBUG - main] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:01:13.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:13.285722 31921 ts_tablet_manager.cc:1916] T 976594a12f5c4e3e9928e9e50c91f431 P 965da114b2534942b775590153d032d1: Deleting tablet data with delete state TABLET_DATA_DELETED
08:01:13.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:13.292039 31919 tablet_replica.cc:333] T 976594a12f5c4e3e9928e9e50c91f431 P 826bc9ae690d480bbe4467803b3ef765: stopping tablet replica
08:01:13.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:13.294551 31083 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasktDuNhD/build/tsan/bin/kudu with pid 31364
08:01:13.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:13.294611 31919 raft_consensus.cc:2243] T 976594a12f5c4e3e9928e9e50c91f431 P 826bc9ae690d480bbe4467803b3ef765 [term 2 FOLLOWER]: Raft consensus shutting down.
08:01:13.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:13.297377 31919 raft_consensus.cc:2272] T 976594a12f5c4e3e9928e9e50c91f431 P 826bc9ae690d480bbe4467803b3ef765 [term 2 FOLLOWER]: Raft consensus is shut down!
08:01:13.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:13.299889 31919 ts_tablet_manager.cc:1916] T 976594a12f5c4e3e9928e9e50c91f431 P 826bc9ae690d480bbe4467803b3ef765: Deleting tablet data with delete state TABLET_DATA_DELETED
08:01:13.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:13.309763 31919 ts_tablet_manager.cc:1929] T 976594a12f5c4e3e9928e9e50c91f431 P 826bc9ae690d480bbe4467803b3ef765: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.22
08:01:13.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:13.310065 31919 log.cc:1199] T 976594a12f5c4e3e9928e9e50c91f431 P 826bc9ae690d480bbe4467803b3ef765: Deleting WAL directory at /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster9862474104002082460/ts-1/wal/wals/976594a12f5c4e3e9928e9e50c91f431
08:01:13.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:13.310644 31919 ts_tablet_manager.cc:1950] T 976594a12f5c4e3e9928e9e50c91f431 P 826bc9ae690d480bbe4467803b3ef765: Deleting consensus metadata
08:01:13.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:13.313051 31187 catalog_manager.cc:5028] TS 826bc9ae690d480bbe4467803b3ef765 (127.30.90.194:40111): tablet 976594a12f5c4e3e9928e9e50c91f431 (table org.apache.kudu.client.TestClientFailoverSupport-KILL [id=056faa1176c948f39436968192abf2d1]) successfully deleted
08:01:13.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:13.318828 31083 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasktDuNhD/build/tsan/bin/kudu with pid 31520
08:01:13.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:13.341822 31083 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasktDuNhD/build/tsan/bin/kudu with pid 31165
08:01:13.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:13.364502 31083 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasktDuNhD/build/tsan/bin/kudu with pid 31240
08:01:14.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T08:01:14Z chronyd exiting
.08:01:15.694 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1783497675694
08:01:15.697 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
08:01:15.698 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
08:01:15.698 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-tasktDuNhD/test-tmp
08:01:15.698 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
08:01:15.699 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-tasktDuNhD/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
08:01:15.701 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

08:01:16.019 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
08:01:16.020 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

08:01:16.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:16.023506 31927 mini_oidc.cc:150] Starting JWKS server
08:01:16.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:16.026636 31927 webserver.cc:533] Webserver started at http://127.0.0.1:35551/ using document root <none> and password file <none>
08:01:16.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:16.027055 31927 mini_oidc.cc:186] Starting OIDC Discovery server
08:01:16.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:16.028821 31927 webserver.cc:533] Webserver started at http://127.0.0.1:40873/ using document root <none> and password file <none>
08:01:16.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T08:01:16Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
08:01:16.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T08:01:16Z Disabled control of system clock
08:01:16.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:16.088805 31927 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasktDuNhD/build/tsan/bin/kudu
08:01:16.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-tasktDuNhD/build/tsan/bin/kudu
08:01:16.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/master-0/wal
08:01:16.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/master-0/data
08:01:16.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:01:16.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:01:16.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:01:16.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:01:16.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:01:16.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:01:16.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/master-0/logs
08:01:16.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/master-0/data/info.pb
08:01:16.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:01:16.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:01:16.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:01:16.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:01:16.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:01:16.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:01:16.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:01:16.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:01:16.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
08:01:16.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:01:16.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:01:16.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:01:16.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.31.45.254:33973
08:01:16.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.31.45.254
08:01:16.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:01:16.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.31.45.212:43675
08:01:16.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:01:16.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:01:16.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:01:16.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:01:16.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.31.45.254:33973,127.31.45.253:44911,127.31.45.252:43307
08:01:16.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:01:16.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:35551/jwks.json with env {}
08:01:16.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:16.380245 31939 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:01:16.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:16.380929 31939 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:01:16.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:16.381582 31939 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:01:16.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:16.414680 31939 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
08:01:16.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:16.415027 31939 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:01:16.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:16.415373 31939 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
08:01:16.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:16.415712 31939 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
08:01:16.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:16.416018 31939 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
08:01:16.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:16.416247 31939 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:35551/jwks.json
08:01:16.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:16.453344 31939 master_runner.cc:387] Master server non-default flags:
08:01:16.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:01:16.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.31.45.212:43675
08:01:16.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:01:16.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:01:16.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/master-0/data
08:01:16.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/master-0/wal
08:01:16.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:01:16.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.31.45.254:33973,127.31.45.253:44911,127.31.45.252:43307
08:01:16.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:01:16.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:01:16.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:01:16.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.31.45.254:33973
08:01:16.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:01:16.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:01:16.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:01:16.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:35551/jwks.json
08:01:16.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:01:16.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:01:16.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/master-0/data/info.pb
08:01:16.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.31.45.254
08:01:16.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:01:16.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:01:16.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:01:16.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:01:16.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:01:16.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:01:16.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/master-0/logs
08:01:16.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:01:16.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:01:16.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:01:16.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
08:01:16.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:01:16.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
08:01:16.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:01:16.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 07:43:22 UTC on e7f111948823
08:01:16.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12771
08:01:16.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:01:16.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:16.455160 31939 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:01:16.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:16.456990 31939 file_cache.cc:504] Constructed file cache file cache with capacity 419430
08:01:16.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:16.468535 31945 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:01:18.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:17.870543 31944 debug-util.cc:398] Leaking SignalData structure 0x7b0800028020 after lost signal to thread 31939
08:01:18.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:18.011977 31944 kernel_stack_watchdog.cc:198] Thread 31939 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 400ms:
08:01:18.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
08:01:18.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
08:01:18.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
08:01:18.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
08:01:18.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:16.468899 31946 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:01:18.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:18.012964 31939 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.545s	user 0.573s	sys 0.969s
08:01:18.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:18.013327 31939 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.545s	user 0.573s	sys 0.969s
08:01:18.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:18.015041 31948 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:01:18.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:18.017009 31947 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1543 milliseconds
08:01:18.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:18.017036 31939 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:01:18.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:18.018211 31939 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:01:18.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:18.020699 31939 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:01:18.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:18.022040 31939 hybrid_clock.cc:648] HybridClock initialized: now 1783497678021993 us; error 60 us; skew 500 ppm
08:01:18.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:18.022830 31939 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:01:18.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:18.028896 31939 webserver.cc:533] Webserver started at http://127.31.45.254:44275/ using document root <none> and password file <none>
08:01:18.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:18.029811 31939 fs_manager.cc:362] Metadata directory not provided
08:01:18.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:18.030004 31939 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:01:18.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:18.030411 31939 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:01:18.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:18.034660 31939 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/master-0/data/instance:
08:01:18.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ef18df293cb04df6bf01c1ea6a46276a"
08:01:18.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 08:01:18 on dist-test-slave-ltj1"
08:01:18.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:18.035831 31939 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/master-0/wal/instance:
08:01:18.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ef18df293cb04df6bf01c1ea6a46276a"
08:01:18.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 08:01:18 on dist-test-slave-ltj1"
08:01:18.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:18.042973 31939 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.001s
08:01:18.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:18.048534 31955 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:01:18.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:18.049595 31939 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
08:01:18.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:18.049939 31939 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/master-0/data,/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/master-0/wal
08:01:18.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ef18df293cb04df6bf01c1ea6a46276a"
08:01:18.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 08:01:18 on dist-test-slave-ltj1"
08:01:18.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:18.050302 31939 fs_report.cc:389] FS layout report
08:01:18.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:01:18.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/master-0/wal
08:01:18.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/master-0/wal
08:01:18.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/master-0/data/data
08:01:18.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:01:18.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:01:18.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:01:18.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:01:18.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:01:18.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:01:18.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:01:18.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:01:18.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:01:18.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:01:18.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:01:18.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:18.096349 31939 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:01:18.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:18.097924 31939 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:01:18.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:18.098417 31939 kserver.cc:163] Server-wide thread pool size limit: 3276
08:01:18.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:18.166694 31939 rpc_server.cc:307] RPC server started. Bound to: 127.31.45.254:33973
08:01:18.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:18.166816 32006 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.45.254:33973 every 8 connection(s)
08:01:18.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:18.169425 31939 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/master-0/data/info.pb
08:01:18.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:18.172539 31927 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasktDuNhD/build/tsan/bin/kudu as pid 31939
08:01:18.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:18.173023 31927 external_mini_cluster.cc:1448] Reading /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/master-0/wal/instance
08:01:18.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:18.175364 32007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
08:01:18.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:18.176420 31927 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasktDuNhD/build/tsan/bin/kudu
08:01:18.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-tasktDuNhD/build/tsan/bin/kudu
08:01:18.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/master-1/wal
08:01:18.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/master-1/data
08:01:18.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:01:18.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:01:18.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:01:18.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:01:18.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:01:18.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:01:18.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/master-1/logs
08:01:18.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/master-1/data/info.pb
08:01:18.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:01:18.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:01:18.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:01:18.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:01:18.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:01:18.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:01:18.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:01:18.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:01:18.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
08:01:18.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:01:18.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:01:18.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:01:18.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.31.45.253:44911
08:01:18.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.31.45.253
08:01:18.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:01:18.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.31.45.212:43675
08:01:18.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:01:18.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:01:18.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:01:18.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:01:18.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.31.45.254:33973,127.31.45.253:44911,127.31.45.252:43307
08:01:18.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:01:18.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:35551/jwks.json with env {}
08:01:18.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:18.185786 32007 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.31.45.254" port: 33973 } has no permanent_uuid. Determining permanent_uuid...
08:01:18.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:18.216455 32007 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.31.45.253" port: 44911 } has no permanent_uuid. Determining permanent_uuid...
08:01:18.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:18.219039 31958 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.31.45.253:44911: connect: Connection refused (error 111)
08:01:18.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:18.223186 32007 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.45.253:44911: Network error: Client connection negotiation failed: client connection to 127.31.45.253:44911: connect: Connection refused (error 111)
08:01:18.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:18.272699 32007 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.45.253" port: 44911 } attempt: 1
08:01:18.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:18.276918 32007 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.45.253:44911: Network error: Client connection negotiation failed: client connection to 127.31.45.253:44911: connect: Connection refused (error 111)
08:01:18.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:18.345435 32007 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.45.253" port: 44911 } attempt: 2
08:01:18.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:18.349716 32007 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.45.253:44911: Network error: Client connection negotiation failed: client connection to 127.31.45.253:44911: connect: Connection refused (error 111)
08:01:18.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:18.441200 32007 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.45.253" port: 44911 } attempt: 3
08:01:18.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:18.445874 32007 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.45.253:44911: Network error: Client connection negotiation failed: client connection to 127.31.45.253:44911: connect: Connection refused (error 111)
08:01:18.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:18.481616 32009 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:01:18.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:18.482353 32009 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:01:18.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:18.482966 32009 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:01:18.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:18.515585 32009 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
08:01:18.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:18.515947 32009 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:01:18.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:18.516276 32009 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
08:01:18.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:18.516611 32009 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
08:01:18.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:18.516917 32009 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
08:01:18.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:18.517149 32009 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:35551/jwks.json
08:01:18.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:18.554095 32009 master_runner.cc:387] Master server non-default flags:
08:01:18.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:01:18.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.31.45.212:43675
08:01:18.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:01:18.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:01:18.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/master-1/data
08:01:18.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/master-1/wal
08:01:18.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:01:18.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.31.45.254:33973,127.31.45.253:44911,127.31.45.252:43307
08:01:18.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:01:18.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:01:18.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:01:18.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.31.45.253:44911
08:01:18.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:01:18.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:01:18.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:01:18.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:35551/jwks.json
08:01:18.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:01:18.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:01:18.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/master-1/data/info.pb
08:01:18.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.31.45.253
08:01:18.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:01:18.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:01:18.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:01:18.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:01:18.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:01:18.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:01:18.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/master-1/logs
08:01:18.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:01:18.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:01:18.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:01:18.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
08:01:18.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:01:18.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
08:01:18.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:01:18.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 07:43:22 UTC on e7f111948823
08:01:18.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12771
08:01:18.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:01:18.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:18.555869 32009 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:01:18.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:18.557803 32009 file_cache.cc:504] Constructed file cache file cache with capacity 419430
08:01:18.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:18.568642 32018 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:01:18.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:18.589749 32007 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.45.253" port: 44911 } attempt: 4
08:01:18.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:18.596513 32007 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.45.253:44911: Network error: Client connection negotiation failed: client connection to 127.31.45.253:44911: connect: Connection refused (error 111)
08:01:18.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:18.895994 32007 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.45.253" port: 44911 } attempt: 5
08:01:18.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:18.902864 32007 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.45.253:44911: Network error: Client connection negotiation failed: client connection to 127.31.45.253:44911: connect: Connection refused (error 111)
08:01:19.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:19.450378 32007 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.45.253" port: 44911 } attempt: 6
08:01:19.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:19.476539 32007 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.45.253:44911: Network error: Client connection negotiation failed: client connection to 127.31.45.253:44911: connect: Connection refused (error 111)
08:01:19.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:18.569164 32019 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:01:19.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:19.901865 32021 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:01:19.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:19.903759 32020 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1330 milliseconds
08:01:19.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:19.904857 32009 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.336s	user 0.462s	sys 0.865s
08:01:19.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:19.905145 32009 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.337s	user 0.462s	sys 0.865s
08:01:19.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:19.905426 32009 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:01:19.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:19.906566 32009 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:01:19.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:19.909224 32009 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:01:19.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:19.910583 32009 hybrid_clock.cc:648] HybridClock initialized: now 1783497679910538 us; error 65 us; skew 500 ppm
08:01:19.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:19.911481 32009 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:01:19.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:19.918953 32009 webserver.cc:533] Webserver started at http://127.31.45.253:42263/ using document root <none> and password file <none>
08:01:19.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:19.919998 32009 fs_manager.cc:362] Metadata directory not provided
08:01:19.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:19.920230 32009 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:01:19.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:19.920737 32009 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:01:19.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:19.924976 32009 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/master-1/data/instance:
08:01:19.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f3092cb366824c8f881fcffd79b1e9e0"
08:01:19.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 08:01:19 on dist-test-slave-ltj1"
08:01:19.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:19.926247 32009 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/master-1/wal/instance:
08:01:19.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f3092cb366824c8f881fcffd79b1e9e0"
08:01:19.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 08:01:19 on dist-test-slave-ltj1"
08:01:19.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:19.934075 32009 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.009s	sys 0.001s
08:01:19.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:19.940176 32030 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:01:19.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:19.941496 32009 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.000s	sys 0.005s
08:01:19.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:19.941905 32009 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/master-1/data,/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/master-1/wal
08:01:19.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f3092cb366824c8f881fcffd79b1e9e0"
08:01:19.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 08:01:19 on dist-test-slave-ltj1"
08:01:19.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:19.942344 32009 fs_report.cc:389] FS layout report
08:01:19.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:01:19.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/master-1/wal
08:01:19.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/master-1/wal
08:01:19.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/master-1/data/data
08:01:19.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:01:19.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:01:19.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:01:19.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:01:19.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:01:19.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:01:19.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:01:19.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:01:19.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:01:19.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:01:19.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:01:20.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:20.022061 32009 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:01:20.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:20.023732 32009 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:01:20.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:20.024164 32009 kserver.cc:163] Server-wide thread pool size limit: 3276
08:01:20.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:20.090756 32009 rpc_server.cc:307] RPC server started. Bound to: 127.31.45.253:44911
08:01:20.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:20.090817 32081 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.45.253:44911 every 8 connection(s)
08:01:20.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:20.093418 32009 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/master-1/data/info.pb
08:01:20.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:20.099181 32082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
08:01:20.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:20.100818 31927 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasktDuNhD/build/tsan/bin/kudu as pid 32009
08:01:20.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:20.101171 31927 external_mini_cluster.cc:1448] Reading /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/master-1/wal/instance
08:01:20.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:20.103161 31927 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasktDuNhD/build/tsan/bin/kudu
08:01:20.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-tasktDuNhD/build/tsan/bin/kudu
08:01:20.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/master-2/wal
08:01:20.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/master-2/data
08:01:20.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:01:20.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:01:20.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:01:20.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:01:20.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:01:20.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:01:20.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/master-2/logs
08:01:20.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/master-2/data/info.pb
08:01:20.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:01:20.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:01:20.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:01:20.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:01:20.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:01:20.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:01:20.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:01:20.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:01:20.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
08:01:20.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:01:20.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:01:20.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:01:20.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.31.45.252:43307
08:01:20.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.31.45.252
08:01:20.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:01:20.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.31.45.212:43675
08:01:20.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:01:20.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:01:20.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:01:20.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:01:20.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.31.45.254:33973,127.31.45.253:44911,127.31.45.252:43307
08:01:20.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:01:20.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:35551/jwks.json with env {}
08:01:20.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:20.110906 32082 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.31.45.254" port: 33973 } has no permanent_uuid. Determining permanent_uuid...
08:01:20.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:20.137744 32082 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.31.45.253" port: 44911 } has no permanent_uuid. Determining permanent_uuid...
08:01:20.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:20.151829 32082 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.31.45.252" port: 43307 } has no permanent_uuid. Determining permanent_uuid...
08:01:20.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:20.154294 32032 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.31.45.252:43307: connect: Connection refused (error 111)
08:01:20.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:20.158372 32082 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.45.252:43307: Network error: Client connection negotiation failed: client connection to 127.31.45.252:43307: connect: Connection refused (error 111)
08:01:20.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:20.207945 32082 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.45.252" port: 43307 } attempt: 1
08:01:20.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:20.212152 32082 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.45.252:43307: Network error: Client connection negotiation failed: client connection to 127.31.45.252:43307: connect: Connection refused (error 111)
08:01:20.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:20.280627 32082 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.45.252" port: 43307 } attempt: 2
08:01:20.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:20.284950 32082 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.45.252:43307: Network error: Client connection negotiation failed: client connection to 127.31.45.252:43307: connect: Connection refused (error 111)
08:01:20.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:20.376422 32082 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.45.252" port: 43307 } attempt: 3
08:01:20.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:20.380560 32082 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.45.252:43307: Network error: Client connection negotiation failed: client connection to 127.31.45.252:43307: connect: Connection refused (error 111)
08:01:20.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:20.408552 32084 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:01:20.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:20.409108 32084 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:01:20.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:20.409574 32084 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:01:20.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:20.442852 32084 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
08:01:20.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:20.443179 32084 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:01:20.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:20.443390 32084 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
08:01:20.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:20.443601 32084 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
08:01:20.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:20.443795 32084 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
08:01:20.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:20.443944 32084 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:35551/jwks.json
08:01:20.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:20.480244 32084 master_runner.cc:387] Master server non-default flags:
08:01:20.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:01:20.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.31.45.212:43675
08:01:20.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:01:20.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:01:20.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/master-2/data
08:01:20.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/master-2/wal
08:01:20.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:01:20.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.31.45.254:33973,127.31.45.253:44911,127.31.45.252:43307
08:01:20.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:01:20.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:01:20.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:01:20.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.31.45.252:43307
08:01:20.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:01:20.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:01:20.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:01:20.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:35551/jwks.json
08:01:20.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:01:20.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:01:20.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/master-2/data/info.pb
08:01:20.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.31.45.252
08:01:20.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:01:20.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:01:20.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:01:20.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:01:20.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:01:20.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:01:20.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/master-2/logs
08:01:20.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:01:20.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:01:20.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:01:20.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
08:01:20.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:01:20.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
08:01:20.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:01:20.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 07:43:22 UTC on e7f111948823
08:01:20.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12771
08:01:20.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:01:20.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:20.481571 32084 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:01:20.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:20.483132 32084 file_cache.cc:504] Constructed file cache file cache with capacity 419430
08:01:20.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:20.493592 32094 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:01:20.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:20.524037 32082 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.45.252" port: 43307 } attempt: 4
08:01:20.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:20.529068 32082 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.45.252:43307: Network error: Client connection negotiation failed: client connection to 127.31.45.252:43307: connect: Connection refused (error 111)
08:01:20.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:20.537093 32007 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.45.253" port: 44911 } attempt: 7
08:01:20.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:20.562784 32007 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.31.45.252" port: 43307 } has no permanent_uuid. Determining permanent_uuid...
08:01:20.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:20.590031 32007 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.45.252:43307: Network error: Client connection negotiation failed: client connection to 127.31.45.252:43307: connect: Connection refused (error 111)
08:01:20.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:20.648530 32007 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.45.252" port: 43307 } attempt: 1
08:01:20.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:20.655313 32007 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.45.252:43307: Network error: Client connection negotiation failed: client connection to 127.31.45.252:43307: connect: Connection refused (error 111)
08:01:20.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:20.736826 32007 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.45.252" port: 43307 } attempt: 2
08:01:20.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:20.743854 32007 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.45.252:43307: Network error: Client connection negotiation failed: client connection to 127.31.45.252:43307: connect: Connection refused (error 111)
08:01:20.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:20.828552 32082 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.45.252" port: 43307 } attempt: 5
08:01:20.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:20.832227 32007 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.45.252" port: 43307 } attempt: 3
08:01:20.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:20.837077 32082 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.45.252:43307: Network error: Client connection negotiation failed: client connection to 127.31.45.252:43307: connect: Connection refused (error 111)
08:01:20.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:20.844964 32007 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.45.252:43307: Network error: Client connection negotiation failed: client connection to 127.31.45.252:43307: connect: Connection refused (error 111)
08:01:20.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:20.985492 32007 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.45.252" port: 43307 } attempt: 4
08:01:20.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:20.992606 32007 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.45.252:43307: Network error: Client connection negotiation failed: client connection to 127.31.45.252:43307: connect: Connection refused (error 111)
08:01:21.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:21.276114 32007 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.45.252" port: 43307 } attempt: 5
08:01:21.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:21.283515 32007 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.45.252:43307: Network error: Client connection negotiation failed: client connection to 127.31.45.252:43307: connect: Connection refused (error 111)
08:01:21.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:21.384577 32082 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.45.252" port: 43307 } attempt: 6
08:01:21.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:21.407310 32082 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.45.252:43307: Network error: Client connection negotiation failed: client connection to 127.31.45.252:43307: connect: Connection refused (error 111)
08:01:21.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:21.836112 32007 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.45.252" port: 43307 } attempt: 6
08:01:21.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:21.861608 32007 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.45.252:43307: Network error: Client connection negotiation failed: client connection to 127.31.45.252:43307: connect: Connection refused (error 111)
08:01:21.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:20.495013 32095 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:01:21.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:21.871527 32084 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.377s	user 0.003s	sys 0.003s
08:01:21.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:21.871933 32084 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.378s	user 0.003s	sys 0.003s
08:01:21.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:21.872695 32096 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1371 milliseconds
08:01:21.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:21.873440 32097 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:01:21.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:21.873531 32084 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:01:21.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:21.875139 32084 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:01:21.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:21.878279 32084 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:01:21.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:21.879951 32084 hybrid_clock.cc:648] HybridClock initialized: now 1783497681879904 us; error 45 us; skew 500 ppm
08:01:21.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:21.881108 32084 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:01:21.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:21.890165 32084 webserver.cc:533] Webserver started at http://127.31.45.252:41469/ using document root <none> and password file <none>
08:01:21.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:21.891522 32084 fs_manager.cc:362] Metadata directory not provided
08:01:21.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:21.891841 32084 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:01:21.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:21.892429 32084 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:01:21.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:21.898784 32084 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/master-2/data/instance:
08:01:21.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "848132dc045348b0a0c92ef5ea20b5b8"
08:01:21.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 08:01:21 on dist-test-slave-ltj1"
08:01:21.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:21.900418 32084 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/master-2/wal/instance:
08:01:21.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "848132dc045348b0a0c92ef5ea20b5b8"
08:01:21.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 08:01:21 on dist-test-slave-ltj1"
08:01:21.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:21.910483 32084 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.010s	sys 0.000s
08:01:21.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:21.918313 32111 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:01:21.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:21.919787 32084 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.003s	sys 0.000s
08:01:21.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:21.920239 32084 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/master-2/data,/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/master-2/wal
08:01:21.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "848132dc045348b0a0c92ef5ea20b5b8"
08:01:21.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 08:01:21 on dist-test-slave-ltj1"
08:01:21.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:21.920732 32084 fs_report.cc:389] FS layout report
08:01:21.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:01:21.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/master-2/wal
08:01:21.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/master-2/wal
08:01:21.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/master-2/data/data
08:01:21.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:01:21.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:01:21.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:01:21.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:01:21.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:01:21.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:01:21.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:01:21.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:01:21.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:01:21.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:01:21.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:01:22.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.001510 32084 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:01:22.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.002987 32084 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:01:22.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.003460 32084 kserver.cc:163] Server-wide thread pool size limit: 3276
08:01:22.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.071362 32084 rpc_server.cc:307] RPC server started. Bound to: 127.31.45.252:43307
08:01:22.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.071452 32162 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.45.252:43307 every 8 connection(s)
08:01:22.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.073993 32084 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/master-2/data/info.pb
08:01:22.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.078158 31927 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasktDuNhD/build/tsan/bin/kudu as pid 32084
08:01:22.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.078516 31927 external_mini_cluster.cc:1448] Reading /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/master-2/wal/instance
08:01:22.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.079859 32163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
08:01:22.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.095098 32163 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.31.45.254" port: 33973 } has no permanent_uuid. Determining permanent_uuid...
08:01:22.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.126986 32163 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.31.45.253" port: 44911 } has no permanent_uuid. Determining permanent_uuid...
08:01:22.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.136822 32163 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.31.45.252" port: 43307 } has no permanent_uuid. Determining permanent_uuid...
08:01:22.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.152791 32163 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 848132dc045348b0a0c92ef5ea20b5b8: Bootstrap starting.
08:01:22.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.159165 32163 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 848132dc045348b0a0c92ef5ea20b5b8: Neither blocks nor log segments found. Creating new log.
08:01:22.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.161083 32163 log.cc:826] T 00000000000000000000000000000000 P 848132dc045348b0a0c92ef5ea20b5b8: Log is configured to *not* fsync() on all Append() calls
08:01:22.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.165448 32163 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 848132dc045348b0a0c92ef5ea20b5b8: No bootstrap required, opened a new log
08:01:22.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.186461 32163 raft_consensus.cc:359] T 00000000000000000000000000000000 P 848132dc045348b0a0c92ef5ea20b5b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef18df293cb04df6bf01c1ea6a46276a" member_type: VOTER last_known_addr { host: "127.31.45.254" port: 33973 } } peers { permanent_uuid: "f3092cb366824c8f881fcffd79b1e9e0" member_type: VOTER last_known_addr { host: "127.31.45.253" port: 44911 } } peers { permanent_uuid: "848132dc045348b0a0c92ef5ea20b5b8" member_type: VOTER last_known_addr { host: "127.31.45.252" port: 43307 } }
08:01:22.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.187141 32163 raft_consensus.cc:385] T 00000000000000000000000000000000 P 848132dc045348b0a0c92ef5ea20b5b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:01:22.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.187386 32163 raft_consensus.cc:740] T 00000000000000000000000000000000 P 848132dc045348b0a0c92ef5ea20b5b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 848132dc045348b0a0c92ef5ea20b5b8, State: Initialized, Role: FOLLOWER
08:01:22.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.188261 32163 consensus_queue.cc:260] T 00000000000000000000000000000000 P 848132dc045348b0a0c92ef5ea20b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef18df293cb04df6bf01c1ea6a46276a" member_type: VOTER last_known_addr { host: "127.31.45.254" port: 33973 } } peers { permanent_uuid: "f3092cb366824c8f881fcffd79b1e9e0" member_type: VOTER last_known_addr { host: "127.31.45.253" port: 44911 } } peers { permanent_uuid: "848132dc045348b0a0c92ef5ea20b5b8" member_type: VOTER last_known_addr { host: "127.31.45.252" port: 43307 } }
08:01:22.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.190682 32172 sys_catalog.cc:455] T 00000000000000000000000000000000 P 848132dc045348b0a0c92ef5ea20b5b8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef18df293cb04df6bf01c1ea6a46276a" member_type: VOTER last_known_addr { host: "127.31.45.254" port: 33973 } } peers { permanent_uuid: "f3092cb366824c8f881fcffd79b1e9e0" member_type: VOTER last_known_addr { host: "127.31.45.253" port: 44911 } } peers { permanent_uuid: "848132dc045348b0a0c92ef5ea20b5b8" member_type: VOTER last_known_addr { host: "127.31.45.252" port: 43307 } } }
08:01:22.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.191469 32172 sys_catalog.cc:458] T 00000000000000000000000000000000 P 848132dc045348b0a0c92ef5ea20b5b8 [sys.catalog]: This master's current role is: FOLLOWER
08:01:22.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.192193 32163 sys_catalog.cc:565] T 00000000000000000000000000000000 P 848132dc045348b0a0c92ef5ea20b5b8 [sys.catalog]: configured and running, proceeding with master startup.
08:01:22.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:22.216683 32183 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 848132dc045348b0a0c92ef5ea20b5b8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
08:01:22.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:22.217012 32183 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
08:01:22.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.213718 32084 master_runner.cc:187] Error getting master registration for 127.31.45.254:33973: OK, instance_id { permanent_uuid: "ef18df293cb04df6bf01c1ea6a46276a" instance_seqno: 1783497678147850 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
08:01:22.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.243620 32084 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
08:01:22.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:22.258857 32117 tablet.cc:2406] T 00000000000000000000000000000000 P 848132dc045348b0a0c92ef5ea20b5b8: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:01:22.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.461706 32172 raft_consensus.cc:493] T 00000000000000000000000000000000 P 848132dc045348b0a0c92ef5ea20b5b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:01:22.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.462304 32172 raft_consensus.cc:515] T 00000000000000000000000000000000 P 848132dc045348b0a0c92ef5ea20b5b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef18df293cb04df6bf01c1ea6a46276a" member_type: VOTER last_known_addr { host: "127.31.45.254" port: 33973 } } peers { permanent_uuid: "f3092cb366824c8f881fcffd79b1e9e0" member_type: VOTER last_known_addr { host: "127.31.45.253" port: 44911 } } peers { permanent_uuid: "848132dc045348b0a0c92ef5ea20b5b8" member_type: VOTER last_known_addr { host: "127.31.45.252" port: 43307 } }
08:01:22.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.464937 32172 leader_election.cc:290] T 00000000000000000000000000000000 P 848132dc045348b0a0c92ef5ea20b5b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef18df293cb04df6bf01c1ea6a46276a (127.31.45.254:33973), f3092cb366824c8f881fcffd79b1e9e0 (127.31.45.253:44911)
08:01:22.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.467788 32082 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.45.252" port: 43307 } attempt: 7
08:01:22.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.488428 32082 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f3092cb366824c8f881fcffd79b1e9e0: Bootstrap starting.
08:01:22.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.493850 32082 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f3092cb366824c8f881fcffd79b1e9e0: Neither blocks nor log segments found. Creating new log.
08:01:22.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.496023 32082 log.cc:826] T 00000000000000000000000000000000 P f3092cb366824c8f881fcffd79b1e9e0: Log is configured to *not* fsync() on all Append() calls
08:01:22.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.501940 32082 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f3092cb366824c8f881fcffd79b1e9e0: No bootstrap required, opened a new log
08:01:22.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.520162 32082 raft_consensus.cc:359] T 00000000000000000000000000000000 P f3092cb366824c8f881fcffd79b1e9e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef18df293cb04df6bf01c1ea6a46276a" member_type: VOTER last_known_addr { host: "127.31.45.254" port: 33973 } } peers { permanent_uuid: "f3092cb366824c8f881fcffd79b1e9e0" member_type: VOTER last_known_addr { host: "127.31.45.253" port: 44911 } } peers { permanent_uuid: "848132dc045348b0a0c92ef5ea20b5b8" member_type: VOTER last_known_addr { host: "127.31.45.252" port: 43307 } }
08:01:22.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.521478 32082 raft_consensus.cc:385] T 00000000000000000000000000000000 P f3092cb366824c8f881fcffd79b1e9e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:01:22.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.521981 32082 raft_consensus.cc:740] T 00000000000000000000000000000000 P f3092cb366824c8f881fcffd79b1e9e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f3092cb366824c8f881fcffd79b1e9e0, State: Initialized, Role: FOLLOWER
08:01:22.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.522941 32082 consensus_queue.cc:260] T 00000000000000000000000000000000 P f3092cb366824c8f881fcffd79b1e9e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef18df293cb04df6bf01c1ea6a46276a" member_type: VOTER last_known_addr { host: "127.31.45.254" port: 33973 } } peers { permanent_uuid: "f3092cb366824c8f881fcffd79b1e9e0" member_type: VOTER last_known_addr { host: "127.31.45.253" port: 44911 } } peers { permanent_uuid: "848132dc045348b0a0c92ef5ea20b5b8" member_type: VOTER last_known_addr { host: "127.31.45.252" port: 43307 } }
08:01:22.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.525983 32187 sys_catalog.cc:455] T 00000000000000000000000000000000 P f3092cb366824c8f881fcffd79b1e9e0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef18df293cb04df6bf01c1ea6a46276a" member_type: VOTER last_known_addr { host: "127.31.45.254" port: 33973 } } peers { permanent_uuid: "f3092cb366824c8f881fcffd79b1e9e0" member_type: VOTER last_known_addr { host: "127.31.45.253" port: 44911 } } peers { permanent_uuid: "848132dc045348b0a0c92ef5ea20b5b8" member_type: VOTER last_known_addr { host: "127.31.45.252" port: 43307 } } }
08:01:22.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.526788 32187 sys_catalog.cc:458] T 00000000000000000000000000000000 P f3092cb366824c8f881fcffd79b1e9e0 [sys.catalog]: This master's current role is: FOLLOWER
08:01:22.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.527792 32082 sys_catalog.cc:565] T 00000000000000000000000000000000 P f3092cb366824c8f881fcffd79b1e9e0 [sys.catalog]: configured and running, proceeding with master startup.
08:01:22.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.528045 32057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "848132dc045348b0a0c92ef5ea20b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3092cb366824c8f881fcffd79b1e9e0" is_pre_election: true
08:01:22.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.528908 32057 raft_consensus.cc:2468] T 00000000000000000000000000000000 P f3092cb366824c8f881fcffd79b1e9e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 848132dc045348b0a0c92ef5ea20b5b8 in term 0.
08:01:22.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.530413 32114 leader_election.cc:304] T 00000000000000000000000000000000 P 848132dc045348b0a0c92ef5ea20b5b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 848132dc045348b0a0c92ef5ea20b5b8, f3092cb366824c8f881fcffd79b1e9e0; no voters: 
08:01:22.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.531622 32172 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 848132dc045348b0a0c92ef5ea20b5b8 [term 0 FOLLOWER]: Leader pre-election won for term 1
08:01:22.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:22.531724 32036 tablet.cc:2406] T 00000000000000000000000000000000 P f3092cb366824c8f881fcffd79b1e9e0: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:01:22.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.531971 32172 raft_consensus.cc:493] T 00000000000000000000000000000000 P 848132dc045348b0a0c92ef5ea20b5b8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:01:22.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.532289 32172 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 848132dc045348b0a0c92ef5ea20b5b8 [term 0 FOLLOWER]: Advancing to term 1
08:01:22.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.544528 32172 raft_consensus.cc:515] T 00000000000000000000000000000000 P 848132dc045348b0a0c92ef5ea20b5b8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef18df293cb04df6bf01c1ea6a46276a" member_type: VOTER last_known_addr { host: "127.31.45.254" port: 33973 } } peers { permanent_uuid: "f3092cb366824c8f881fcffd79b1e9e0" member_type: VOTER last_known_addr { host: "127.31.45.253" port: 44911 } } peers { permanent_uuid: "848132dc045348b0a0c92ef5ea20b5b8" member_type: VOTER last_known_addr { host: "127.31.45.252" port: 43307 } }
08:01:22.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.547428 32172 leader_election.cc:290] T 00000000000000000000000000000000 P 848132dc045348b0a0c92ef5ea20b5b8 [CANDIDATE]: Term 1 election: Requested vote from peers ef18df293cb04df6bf01c1ea6a46276a (127.31.45.254:33973), f3092cb366824c8f881fcffd79b1e9e0 (127.31.45.253:44911)
08:01:22.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.549244 32057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "848132dc045348b0a0c92ef5ea20b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f3092cb366824c8f881fcffd79b1e9e0"
08:01:22.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.553785 32057 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f3092cb366824c8f881fcffd79b1e9e0 [term 0 FOLLOWER]: Advancing to term 1
08:01:22.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.561579 32057 raft_consensus.cc:2468] T 00000000000000000000000000000000 P f3092cb366824c8f881fcffd79b1e9e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 848132dc045348b0a0c92ef5ea20b5b8 in term 1.
08:01:22.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.562752 32114 leader_election.cc:304] T 00000000000000000000000000000000 P 848132dc045348b0a0c92ef5ea20b5b8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 848132dc045348b0a0c92ef5ea20b5b8, f3092cb366824c8f881fcffd79b1e9e0; no voters: 
08:01:22.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.563659 32172 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 848132dc045348b0a0c92ef5ea20b5b8 [term 1 FOLLOWER]: Leader election won for term 1
08:01:22.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.576836 32172 raft_consensus.cc:697] T 00000000000000000000000000000000 P 848132dc045348b0a0c92ef5ea20b5b8 [term 1 LEADER]: Becoming Leader. State: Replica: 848132dc045348b0a0c92ef5ea20b5b8, State: Running, Role: LEADER
08:01:22.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.578176 32172 consensus_queue.cc:237] T 00000000000000000000000000000000 P 848132dc045348b0a0c92ef5ea20b5b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef18df293cb04df6bf01c1ea6a46276a" member_type: VOTER last_known_addr { host: "127.31.45.254" port: 33973 } } peers { permanent_uuid: "f3092cb366824c8f881fcffd79b1e9e0" member_type: VOTER last_known_addr { host: "127.31.45.253" port: 44911 } } peers { permanent_uuid: "848132dc045348b0a0c92ef5ea20b5b8" member_type: VOTER last_known_addr { host: "127.31.45.252" port: 43307 } }
08:01:22.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:22.591128 32198 catalog_manager.cc:1594] T 00000000000000000000000000000000 P f3092cb366824c8f881fcffd79b1e9e0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
08:01:22.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:22.591521 32198 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
08:01:22.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.568799 32009 master_runner.cc:187] Error getting master registration for 127.31.45.254:33973: OK, instance_id { permanent_uuid: "ef18df293cb04df6bf01c1ea6a46276a" instance_seqno: 1783497678147850 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
08:01:22.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.609362 32009 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
08:01:22.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.608106 32199 sys_catalog.cc:455] T 00000000000000000000000000000000 P 848132dc045348b0a0c92ef5ea20b5b8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 848132dc045348b0a0c92ef5ea20b5b8. Latest consensus state: current_term: 1 leader_uuid: "848132dc045348b0a0c92ef5ea20b5b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef18df293cb04df6bf01c1ea6a46276a" member_type: VOTER last_known_addr { host: "127.31.45.254" port: 33973 } } peers { permanent_uuid: "f3092cb366824c8f881fcffd79b1e9e0" member_type: VOTER last_known_addr { host: "127.31.45.253" port: 44911 } } peers { permanent_uuid: "848132dc045348b0a0c92ef5ea20b5b8" member_type: VOTER last_known_addr { host: "127.31.45.252" port: 43307 } } }
08:01:22.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.609867 32199 sys_catalog.cc:458] T 00000000000000000000000000000000 P 848132dc045348b0a0c92ef5ea20b5b8 [sys.catalog]: This master's current role is: LEADER
08:01:22.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.613193 32202 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
08:01:22.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.620592 32202 catalog_manager.cc:1520] Initializing Kudu cluster ID...
08:01:22.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.643915 32057 raft_consensus.cc:1275] T 00000000000000000000000000000000 P f3092cb366824c8f881fcffd79b1e9e0 [term 1 FOLLOWER]: Refusing update from remote peer 848132dc045348b0a0c92ef5ea20b5b8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
08:01:22.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.645757 32172 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 848132dc045348b0a0c92ef5ea20b5b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f3092cb366824c8f881fcffd79b1e9e0" member_type: VOTER last_known_addr { host: "127.31.45.253" port: 44911 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
08:01:22.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.675927 32187 sys_catalog.cc:455] T 00000000000000000000000000000000 P f3092cb366824c8f881fcffd79b1e9e0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 848132dc045348b0a0c92ef5ea20b5b8. Latest consensus state: current_term: 1 leader_uuid: "848132dc045348b0a0c92ef5ea20b5b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef18df293cb04df6bf01c1ea6a46276a" member_type: VOTER last_known_addr { host: "127.31.45.254" port: 33973 } } peers { permanent_uuid: "f3092cb366824c8f881fcffd79b1e9e0" member_type: VOTER last_known_addr { host: "127.31.45.253" port: 44911 } } peers { permanent_uuid: "848132dc045348b0a0c92ef5ea20b5b8" member_type: VOTER last_known_addr { host: "127.31.45.252" port: 43307 } } }
08:01:22.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.676654 32187 sys_catalog.cc:458] T 00000000000000000000000000000000 P f3092cb366824c8f881fcffd79b1e9e0 [sys.catalog]: This master's current role is: FOLLOWER
08:01:22.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.683558 32199 sys_catalog.cc:455] T 00000000000000000000000000000000 P 848132dc045348b0a0c92ef5ea20b5b8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "848132dc045348b0a0c92ef5ea20b5b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef18df293cb04df6bf01c1ea6a46276a" member_type: VOTER last_known_addr { host: "127.31.45.254" port: 33973 } } peers { permanent_uuid: "f3092cb366824c8f881fcffd79b1e9e0" member_type: VOTER last_known_addr { host: "127.31.45.253" port: 44911 } } peers { permanent_uuid: "848132dc045348b0a0c92ef5ea20b5b8" member_type: VOTER last_known_addr { host: "127.31.45.252" port: 43307 } } }
08:01:22.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.684263 32199 sys_catalog.cc:458] T 00000000000000000000000000000000 P 848132dc045348b0a0c92ef5ea20b5b8 [sys.catalog]: This master's current role is: LEADER
08:01:22.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.685704 32204 mvcc.cc:204] Tried to move back new op lower bound from 7305206508088225792 to 7305206507852664832. Current Snapshot: MvccSnapshot[applied={T|T < 7305206508088225792}]
08:01:22.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.688402 32202 catalog_manager.cc:1383] Generated new cluster ID: c7af2609f986426c9115f07b7ee9755c
08:01:22.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.688699 32202 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
08:01:22.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.696354 32187 sys_catalog.cc:455] T 00000000000000000000000000000000 P f3092cb366824c8f881fcffd79b1e9e0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "848132dc045348b0a0c92ef5ea20b5b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef18df293cb04df6bf01c1ea6a46276a" member_type: VOTER last_known_addr { host: "127.31.45.254" port: 33973 } } peers { permanent_uuid: "f3092cb366824c8f881fcffd79b1e9e0" member_type: VOTER last_known_addr { host: "127.31.45.253" port: 44911 } } peers { permanent_uuid: "848132dc045348b0a0c92ef5ea20b5b8" member_type: VOTER last_known_addr { host: "127.31.45.252" port: 43307 } } }
08:01:22.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.697041 32187 sys_catalog.cc:458] T 00000000000000000000000000000000 P f3092cb366824c8f881fcffd79b1e9e0 [sys.catalog]: This master's current role is: FOLLOWER
08:01:22.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.730755 32202 catalog_manager.cc:1406] Generated new certificate authority record
08:01:22.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.733122 32202 catalog_manager.cc:1540] Loading token signing keys...
08:01:22.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.763291 32202 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 848132dc045348b0a0c92ef5ea20b5b8: Generated new TSK 0
08:01:22.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.764493 32202 catalog_manager.cc:1550] Initializing in-progress tserver states...
08:01:22.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.787882 31927 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasktDuNhD/build/tsan/bin/kudu
08:01:22.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-tasktDuNhD/build/tsan/bin/kudu
08:01:22.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/ts-0/wal
08:01:22.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/ts-0/data
08:01:22.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:01:22.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:01:22.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:01:22.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:01:22.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:01:22.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:01:22.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/ts-0/logs
08:01:22.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/ts-0/data/info.pb
08:01:22.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:01:22.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:01:22.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:01:22.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:01:22.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:01:22.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:01:22.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:01:22.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:01:22.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
08:01:22.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:01:22.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.31.45.193:0
08:01:22.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.31.45.193
08:01:22.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.31.45.193
08:01:22.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:01:22.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.31.45.254:33973,127.31.45.253:44911,127.31.45.252:43307
08:01:22.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.31.45.212:43675
08:01:22.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:01:22.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:01:22.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
08:01:22.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.894989 32007 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.45.252" port: 43307 } attempt: 7
08:01:22.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.946592 32007 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef18df293cb04df6bf01c1ea6a46276a: Bootstrap starting.
08:01:22.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.969205 32007 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ef18df293cb04df6bf01c1ea6a46276a: Neither blocks nor log segments found. Creating new log.
08:01:22.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:22.975523 32007 log.cc:826] T 00000000000000000000000000000000 P ef18df293cb04df6bf01c1ea6a46276a: Log is configured to *not* fsync() on all Append() calls
08:01:23.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:23.003960 32007 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef18df293cb04df6bf01c1ea6a46276a: No bootstrap required, opened a new log
08:01:23.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:23.082197 32007 raft_consensus.cc:359] T 00000000000000000000000000000000 P ef18df293cb04df6bf01c1ea6a46276a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef18df293cb04df6bf01c1ea6a46276a" member_type: VOTER last_known_addr { host: "127.31.45.254" port: 33973 } } peers { permanent_uuid: "f3092cb366824c8f881fcffd79b1e9e0" member_type: VOTER last_known_addr { host: "127.31.45.253" port: 44911 } } peers { permanent_uuid: "848132dc045348b0a0c92ef5ea20b5b8" member_type: VOTER last_known_addr { host: "127.31.45.252" port: 43307 } }
08:01:23.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:23.085405 32007 raft_consensus.cc:385] T 00000000000000000000000000000000 P ef18df293cb04df6bf01c1ea6a46276a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:01:23.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:23.086241 32007 raft_consensus.cc:740] T 00000000000000000000000000000000 P ef18df293cb04df6bf01c1ea6a46276a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef18df293cb04df6bf01c1ea6a46276a, State: Initialized, Role: FOLLOWER
08:01:23.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:23.107415 32007 consensus_queue.cc:260] T 00000000000000000000000000000000 P ef18df293cb04df6bf01c1ea6a46276a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef18df293cb04df6bf01c1ea6a46276a" member_type: VOTER last_known_addr { host: "127.31.45.254" port: 33973 } } peers { permanent_uuid: "f3092cb366824c8f881fcffd79b1e9e0" member_type: VOTER last_known_addr { host: "127.31.45.253" port: 44911 } } peers { permanent_uuid: "848132dc045348b0a0c92ef5ea20b5b8" member_type: VOTER last_known_addr { host: "127.31.45.252" port: 43307 } }
08:01:23.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:23.146567 31982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "848132dc045348b0a0c92ef5ea20b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef18df293cb04df6bf01c1ea6a46276a" is_pre_election: true
08:01:23.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:23.147552 31982 raft_consensus.cc:2468] T 00000000000000000000000000000000 P ef18df293cb04df6bf01c1ea6a46276a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 848132dc045348b0a0c92ef5ea20b5b8 in term 0.
08:01:23.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:23.148628 31981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "848132dc045348b0a0c92ef5ea20b5b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef18df293cb04df6bf01c1ea6a46276a"
08:01:23.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:23.149248 31981 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ef18df293cb04df6bf01c1ea6a46276a [term 0 FOLLOWER]: Advancing to term 1
08:01:23.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:23.158337 31981 raft_consensus.cc:2468] T 00000000000000000000000000000000 P ef18df293cb04df6bf01c1ea6a46276a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 848132dc045348b0a0c92ef5ea20b5b8 in term 1.
08:01:23.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:23.159960 31980 raft_consensus.cc:1275] T 00000000000000000000000000000000 P ef18df293cb04df6bf01c1ea6a46276a [term 1 FOLLOWER]: Refusing update from remote peer 848132dc045348b0a0c92ef5ea20b5b8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
08:01:23.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:23.167683 32199 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 848132dc045348b0a0c92ef5ea20b5b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef18df293cb04df6bf01c1ea6a46276a" member_type: VOTER last_known_addr { host: "127.31.45.254" port: 33973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
08:01:23.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:23.170838 32007 sys_catalog.cc:565] T 00000000000000000000000000000000 P ef18df293cb04df6bf01c1ea6a46276a [sys.catalog]: configured and running, proceeding with master startup.
08:01:23.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:23.168861 32211 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef18df293cb04df6bf01c1ea6a46276a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef18df293cb04df6bf01c1ea6a46276a" member_type: VOTER last_known_addr { host: "127.31.45.254" port: 33973 } } peers { permanent_uuid: "f3092cb366824c8f881fcffd79b1e9e0" member_type: VOTER last_known_addr { host: "127.31.45.253" port: 44911 } } peers { permanent_uuid: "848132dc045348b0a0c92ef5ea20b5b8" member_type: VOTER last_known_addr { host: "127.31.45.252" port: 43307 } } }
08:01:23.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:23.177174 32211 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef18df293cb04df6bf01c1ea6a46276a [sys.catalog]: This master's current role is: FOLLOWER
08:01:23.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:23.274035 32208 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:01:23.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:23.278048 32208 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:01:23.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:23.279150 32208 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:01:23.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:23.285914 32211 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef18df293cb04df6bf01c1ea6a46276a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 848132dc045348b0a0c92ef5ea20b5b8. Latest consensus state: current_term: 1 leader_uuid: "848132dc045348b0a0c92ef5ea20b5b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef18df293cb04df6bf01c1ea6a46276a" member_type: VOTER last_known_addr { host: "127.31.45.254" port: 33973 } } peers { permanent_uuid: "f3092cb366824c8f881fcffd79b1e9e0" member_type: VOTER last_known_addr { host: "127.31.45.253" port: 44911 } } peers { permanent_uuid: "848132dc045348b0a0c92ef5ea20b5b8" member_type: VOTER last_known_addr { host: "127.31.45.252" port: 43307 } } }
08:01:23.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:23.286635 32211 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef18df293cb04df6bf01c1ea6a46276a [sys.catalog]: This master's current role is: FOLLOWER
08:01:23.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:23.287791 32213 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef18df293cb04df6bf01c1ea6a46276a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "848132dc045348b0a0c92ef5ea20b5b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef18df293cb04df6bf01c1ea6a46276a" member_type: VOTER last_known_addr { host: "127.31.45.254" port: 33973 } } peers { permanent_uuid: "f3092cb366824c8f881fcffd79b1e9e0" member_type: VOTER last_known_addr { host: "127.31.45.253" port: 44911 } } peers { permanent_uuid: "848132dc045348b0a0c92ef5ea20b5b8" member_type: VOTER last_known_addr { host: "127.31.45.252" port: 43307 } } }
08:01:23.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:23.288499 32213 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef18df293cb04df6bf01c1ea6a46276a [sys.catalog]: This master's current role is: FOLLOWER
08:01:23.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:23.333037 32231 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
08:01:23.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:23.340720 32208 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:01:23.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:23.342482 32208 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.31.45.193
08:01:23.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:23.388217 32208 tablet_server_runner.cc:78] Tablet server non-default flags:
08:01:23.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:01:23.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.31.45.212:43675
08:01:23.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:01:23.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:01:23.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/ts-0/data
08:01:23.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/ts-0/wal
08:01:23.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:01:23.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:01:23.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.31.45.193:0
08:01:23.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:01:23.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:01:23.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:01:23.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/ts-0/data/info.pb
08:01:23.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.31.45.193
08:01:23.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:01:23.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.31.45.254:33973,127.31.45.253:44911,127.31.45.252:43307
08:01:23.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:01:23.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:01:23.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:01:23.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:01:23.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:01:23.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.31.45.193
08:01:23.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/ts-0/logs
08:01:23.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:01:23.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:01:23.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:01:23.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
08:01:23.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:01:23.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
08:01:23.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:01:23.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 07:43:22 UTC on e7f111948823
08:01:23.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12771
08:01:23.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:01:23.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:23.389954 32208 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:01:23.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:23.391682 32208 file_cache.cc:504] Constructed file cache file cache with capacity 419430
08:01:23.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:23.405102 32233 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:01:23.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:23.598425 32198 catalog_manager.cc:1295] Loaded cluster ID: c7af2609f986426c9115f07b7ee9755c
08:01:23.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:23.599301 32198 catalog_manager.cc:1588] T 00000000000000000000000000000000 P f3092cb366824c8f881fcffd79b1e9e0: loading cluster ID for follower catalog manager: success
08:01:23.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:23.614089 32198 catalog_manager.cc:1610] T 00000000000000000000000000000000 P f3092cb366824c8f881fcffd79b1e9e0: acquiring CA information for follower catalog manager: success
08:01:23.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:23.626850 32198 catalog_manager.cc:1638] T 00000000000000000000000000000000 P f3092cb366824c8f881fcffd79b1e9e0: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
08:01:23.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:23.723523 32199 sys_catalog.cc:455] T 00000000000000000000000000000000 P 848132dc045348b0a0c92ef5ea20b5b8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "848132dc045348b0a0c92ef5ea20b5b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef18df293cb04df6bf01c1ea6a46276a" member_type: VOTER last_known_addr { host: "127.31.45.254" port: 33973 } } peers { permanent_uuid: "f3092cb366824c8f881fcffd79b1e9e0" member_type: VOTER last_known_addr { host: "127.31.45.253" port: 44911 } } peers { permanent_uuid: "848132dc045348b0a0c92ef5ea20b5b8" member_type: VOTER last_known_addr { host: "127.31.45.252" port: 43307 } } }
08:01:23.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:23.728361 32199 sys_catalog.cc:458] T 00000000000000000000000000000000 P 848132dc045348b0a0c92ef5ea20b5b8 [sys.catalog]: This master's current role is: LEADER
08:01:24.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:24.357122 32231 catalog_manager.cc:1295] Loaded cluster ID: c7af2609f986426c9115f07b7ee9755c
08:01:24.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:24.357899 32231 catalog_manager.cc:1588] T 00000000000000000000000000000000 P ef18df293cb04df6bf01c1ea6a46276a: loading cluster ID for follower catalog manager: success
08:01:24.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:24.376446 32231 catalog_manager.cc:1610] T 00000000000000000000000000000000 P ef18df293cb04df6bf01c1ea6a46276a: acquiring CA information for follower catalog manager: success
08:01:24.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:24.392611 32231 catalog_manager.cc:1638] T 00000000000000000000000000000000 P ef18df293cb04df6bf01c1ea6a46276a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
08:01:24.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:24.806164 32232 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 32208
08:01:24.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:24.904891 32208 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.494s	user 0.000s	sys 0.001s
08:01:24.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:24.906349 32208 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.495s	user 0.000s	sys 0.002s
08:01:24.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:23.406651 32234 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:01:24.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:24.912748 32236 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:01:24.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:24.914505 32208 server_base.cc:1061] running on GCE node
08:01:24.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:24.915752 32208 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:01:24.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:24.918159 32208 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:01:24.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:24.919683 32208 hybrid_clock.cc:648] HybridClock initialized: now 1783497684919632 us; error 49 us; skew 500 ppm
08:01:24.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:24.920977 32208 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:01:24.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:24.945062 32208 webserver.cc:533] Webserver started at http://127.31.45.193:38913/ using document root <none> and password file <none>
08:01:24.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:24.946722 32208 fs_manager.cc:362] Metadata directory not provided
08:01:24.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:24.947324 32208 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:01:24.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:24.948218 32208 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:01:24.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:24.956259 32208 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/ts-0/data/instance:
08:01:24.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "2949848f49e243ac999493cc0c83ae21"
08:01:24.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 08:01:24 on dist-test-slave-ltj1"
08:01:24.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:24.958580 32208 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/ts-0/wal/instance:
08:01:24.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "2949848f49e243ac999493cc0c83ae21"
08:01:24.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 08:01:24 on dist-test-slave-ltj1"
08:01:24.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:24.975675 32208 fs_manager.cc:696] Time spent creating directory manager: real 0.016s	user 0.006s	sys 0.008s
08:01:24.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:24.989961 32248 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:01:24.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:24.993233 32208 fs_manager.cc:730] Time spent opening block manager: real 0.012s	user 0.006s	sys 0.004s
08:01:24.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:24.994127 32208 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/ts-0/data,/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/ts-0/wal
08:01:24.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "2949848f49e243ac999493cc0c83ae21"
08:01:24.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 08:01:24 on dist-test-slave-ltj1"
08:01:24.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:24.994930 32208 fs_report.cc:389] FS layout report
08:01:24.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:01:24.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/ts-0/wal
08:01:24.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/ts-0/wal
08:01:24.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/ts-0/data/data
08:01:24.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:01:24.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:01:24.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:01:24.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:01:24.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:01:24.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:01:24.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:01:24.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:01:24.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:01:24.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:01:24.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:01:25.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:25.119036 32208 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:01:25.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:25.126667 32208 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:01:25.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:25.127743 32208 kserver.cc:163] Server-wide thread pool size limit: 3276
08:01:25.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:25.138475 32208 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
08:01:25.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:25.144397 32208 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
08:01:25.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:25.144716 32208 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
08:01:25.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:25.145002 32208 ts_tablet_manager.cc:616] Registered 0 tablets
08:01:25.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:25.145231 32208 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
08:01:25.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:25.356715 32208 rpc_server.cc:307] RPC server started. Bound to: 127.31.45.193:42409
08:01:25.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:25.356817 32360 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.45.193:42409 every 8 connection(s)
08:01:25.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:25.359521 32208 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/ts-0/data/info.pb
08:01:25.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:25.360167 31927 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasktDuNhD/build/tsan/bin/kudu as pid 32208
08:01:25.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:25.360620 31927 external_mini_cluster.cc:1448] Reading /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/ts-0/wal/instance
08:01:25.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:25.375411 31927 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasktDuNhD/build/tsan/bin/kudu
08:01:25.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-tasktDuNhD/build/tsan/bin/kudu
08:01:25.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/ts-1/wal
08:01:25.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/ts-1/data
08:01:25.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:01:25.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:01:25.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:01:25.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:01:25.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:01:25.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:01:25.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/ts-1/logs
08:01:25.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/ts-1/data/info.pb
08:01:25.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:01:25.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:01:25.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:01:25.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:01:25.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:01:25.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:01:25.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:01:25.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:01:25.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
08:01:25.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:01:25.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.31.45.194:0
08:01:25.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.31.45.194
08:01:25.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.31.45.194
08:01:25.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:01:25.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.31.45.254:33973,127.31.45.253:44911,127.31.45.252:43307
08:01:25.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.31.45.212:43675
08:01:25.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:01:25.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:01:25.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
08:01:25.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:25.432669 32361 heartbeater.cc:344] Connected to a master server at 127.31.45.252:43307
08:01:25.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:25.433175 32361 heartbeater.cc:461] Registering TS with master...
08:01:25.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:25.434576 32361 heartbeater.cc:507] Master 127.31.45.252:43307 requested a full tablet report, sending...
08:01:25.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:25.437748 32128 ts_manager.cc:194] Registered new tserver with Master: 2949848f49e243ac999493cc0c83ae21 (127.31.45.193:42409)
08:01:25.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:25.440315 32362 heartbeater.cc:344] Connected to a master server at 127.31.45.253:44911
08:01:25.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:25.440452 32128 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.31.45.193:50429
08:01:25.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:25.440651 32362 heartbeater.cc:461] Registering TS with master...
08:01:25.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:25.441470 32362 heartbeater.cc:507] Master 127.31.45.253:44911 requested a full tablet report, sending...
08:01:25.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:25.445075 32047 ts_manager.cc:194] Registered new tserver with Master: 2949848f49e243ac999493cc0c83ae21 (127.31.45.193:42409)
08:01:25.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:25.446583 32368 heartbeater.cc:344] Connected to a master server at 127.31.45.254:33973
08:01:25.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:25.446920 32368 heartbeater.cc:461] Registering TS with master...
08:01:25.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:25.447561 32368 heartbeater.cc:507] Master 127.31.45.254:33973 requested a full tablet report, sending...
08:01:25.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:25.450479 31972 ts_manager.cc:194] Registered new tserver with Master: 2949848f49e243ac999493cc0c83ae21 (127.31.45.193:42409)
08:01:25.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:25.734248 32367 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:01:25.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:25.734766 32367 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:01:25.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:25.735361 32367 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:01:25.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:25.768237 32367 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:01:25.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:25.769186 32367 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.31.45.194
08:01:25.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:25.808873 32367 tablet_server_runner.cc:78] Tablet server non-default flags:
08:01:25.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:01:25.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.31.45.212:43675
08:01:25.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:01:25.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:01:25.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/ts-1/data
08:01:25.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/ts-1/wal
08:01:25.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:01:25.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:01:25.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.31.45.194:0
08:01:25.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:01:25.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:01:25.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:01:25.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/ts-1/data/info.pb
08:01:25.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.31.45.194
08:01:25.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:01:25.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.31.45.254:33973,127.31.45.253:44911,127.31.45.252:43307
08:01:25.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:01:25.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:01:25.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:01:25.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:01:25.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:01:25.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.31.45.194
08:01:25.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/ts-1/logs
08:01:25.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:01:25.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:01:25.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:01:25.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
08:01:25.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:01:25.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
08:01:25.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:01:25.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 07:43:22 UTC on e7f111948823
08:01:25.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12771
08:01:25.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:01:25.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:25.810595 32367 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:01:25.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:25.812556 32367 file_cache.cc:504] Constructed file cache file cache with capacity 419430
08:01:25.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:25.825786 32377 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:01:26.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:26.445495 32361 heartbeater.cc:499] Master 127.31.45.252:43307 was elected leader, sending a full tablet report...
08:01:27.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:25.828892 32378 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:01:27.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:27.177304 32379 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1346 milliseconds
08:01:27.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:27.182802 32380 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:01:27.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:27.185940 32367 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.353s	user 0.003s	sys 0.004s
08:01:27.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:27.186515 32367 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.354s	user 0.005s	sys 0.005s
08:01:27.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:27.186960 32367 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:01:27.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:27.188496 32367 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:01:27.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:27.196938 32367 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:01:27.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:27.198642 32367 hybrid_clock.cc:648] HybridClock initialized: now 1783497687198568 us; error 86 us; skew 500 ppm
08:01:27.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:27.200302 32367 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:01:27.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:27.216444 32367 webserver.cc:533] Webserver started at http://127.31.45.194:43143/ using document root <none> and password file <none>
08:01:27.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:27.217468 32367 fs_manager.cc:362] Metadata directory not provided
08:01:27.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:27.217700 32367 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:01:27.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:27.218189 32367 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:01:27.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:27.222882 32367 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/ts-1/data/instance:
08:01:27.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "5fe32233c7fa4a55bd8424505aa63261"
08:01:27.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 08:01:27 on dist-test-slave-ltj1"
08:01:27.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:27.224115 32367 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/ts-1/wal/instance:
08:01:27.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "5fe32233c7fa4a55bd8424505aa63261"
08:01:27.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 08:01:27 on dist-test-slave-ltj1"
08:01:27.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:27.232436 32367 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.007s	sys 0.001s
08:01:27.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:27.238330 32389 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:01:27.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:27.239574 32367 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
08:01:27.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:27.239916 32367 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/ts-1/data,/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/ts-1/wal
08:01:27.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "5fe32233c7fa4a55bd8424505aa63261"
08:01:27.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 08:01:27 on dist-test-slave-ltj1"
08:01:27.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:27.240263 32367 fs_report.cc:389] FS layout report
08:01:27.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:01:27.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/ts-1/wal
08:01:27.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/ts-1/wal
08:01:27.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/ts-1/data/data
08:01:27.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:01:27.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:01:27.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:01:27.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:01:27.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:01:27.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:01:27.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:01:27.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:01:27.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:01:27.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:01:27.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:01:27.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:27.313426 32367 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:01:27.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:27.314970 32367 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:01:27.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:27.315475 32367 kserver.cc:163] Server-wide thread pool size limit: 3276
08:01:27.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:27.318413 32367 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
08:01:27.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:27.323364 32367 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
08:01:27.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:27.323571 32367 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
08:01:27.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:27.323863 32367 ts_tablet_manager.cc:616] Registered 0 tablets
08:01:27.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:27.324038 32367 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
08:01:27.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:27.500362 32367 rpc_server.cc:307] RPC server started. Bound to: 127.31.45.194:43651
08:01:27.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:27.500463 32501 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.45.194:43651 every 8 connection(s)
08:01:27.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:27.503489 32367 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/ts-1/data/info.pb
08:01:27.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:27.511768 31927 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasktDuNhD/build/tsan/bin/kudu as pid 32367
08:01:27.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:27.512416 31927 external_mini_cluster.cc:1448] Reading /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/ts-1/wal/instance
08:01:27.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:27.534195 31927 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasktDuNhD/build/tsan/bin/kudu
08:01:27.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-tasktDuNhD/build/tsan/bin/kudu
08:01:27.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/ts-2/wal
08:01:27.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/ts-2/data
08:01:27.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:01:27.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:01:27.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:01:27.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:01:27.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:01:27.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:01:27.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/ts-2/logs
08:01:27.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/ts-2/data/info.pb
08:01:27.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:01:27.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:01:27.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:01:27.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:01:27.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:01:27.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:01:27.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:01:27.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:01:27.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
08:01:27.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:01:27.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.31.45.195:0
08:01:27.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.31.45.195
08:01:27.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.31.45.195
08:01:27.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:01:27.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.31.45.254:33973,127.31.45.253:44911,127.31.45.252:43307
08:01:27.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.31.45.212:43675
08:01:27.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:01:27.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:01:27.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
08:01:27.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:27.560249 32504 heartbeater.cc:344] Connected to a master server at 127.31.45.254:33973
08:01:27.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:27.560753 32504 heartbeater.cc:461] Registering TS with master...
08:01:27.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:27.562026 32504 heartbeater.cc:507] Master 127.31.45.254:33973 requested a full tablet report, sending...
08:01:27.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:27.562561 32503 heartbeater.cc:344] Connected to a master server at 127.31.45.253:44911
08:01:27.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:27.562892 32503 heartbeater.cc:461] Registering TS with master...
08:01:27.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:27.563722 32503 heartbeater.cc:507] Master 127.31.45.253:44911 requested a full tablet report, sending...
08:01:27.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:27.563988 32502 heartbeater.cc:344] Connected to a master server at 127.31.45.252:43307
08:01:27.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:27.564288 32502 heartbeater.cc:461] Registering TS with master...
08:01:27.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:27.565106 32502 heartbeater.cc:507] Master 127.31.45.252:43307 requested a full tablet report, sending...
08:01:27.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:27.565107 31972 ts_manager.cc:194] Registered new tserver with Master: 5fe32233c7fa4a55bd8424505aa63261 (127.31.45.194:43651)
08:01:27.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:27.567176 32047 ts_manager.cc:194] Registered new tserver with Master: 5fe32233c7fa4a55bd8424505aa63261 (127.31.45.194:43651)
08:01:27.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:27.567225 32128 ts_manager.cc:194] Registered new tserver with Master: 5fe32233c7fa4a55bd8424505aa63261 (127.31.45.194:43651)
08:01:27.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:27.568871 32128 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.31.45.194:36261
08:01:27.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:27.846933 32512 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:01:27.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:27.847448 32512 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:01:27.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:27.847864 32512 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:01:27.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:27.880223 32512 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:01:27.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:27.881031 32512 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.31.45.195
08:01:27.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:27.917217 32512 tablet_server_runner.cc:78] Tablet server non-default flags:
08:01:27.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:01:27.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.31.45.212:43675
08:01:27.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:01:27.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:01:27.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/ts-2/data
08:01:27.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/ts-2/wal
08:01:27.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:01:27.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:01:27.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.31.45.195:0
08:01:27.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:01:27.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:01:27.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:01:27.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/ts-2/data/info.pb
08:01:27.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.31.45.195
08:01:27.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:01:27.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.31.45.254:33973,127.31.45.253:44911,127.31.45.252:43307
08:01:27.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:01:27.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:01:27.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:01:27.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:01:27.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:01:27.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.31.45.195
08:01:27.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/ts-2/logs
08:01:27.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:01:27.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:01:27.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:01:27.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
08:01:27.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:01:27.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
08:01:27.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:01:27.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 07:43:22 UTC on e7f111948823
08:01:27.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12771
08:01:27.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:01:27.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:27.918548 32512 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:01:27.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:27.920413 32512 file_cache.cc:504] Constructed file cache file cache with capacity 419430
08:01:27.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:27.932777 32518 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:01:28.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:28.571681 32502 heartbeater.cc:499] Master 127.31.45.252:43307 was elected leader, sending a full tablet report...
08:01:29.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:27.933168 32519 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:01:29.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:29.087782 32521 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:01:29.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:29.095283 32520 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1152 milliseconds
08:01:29.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.095422 32512 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:01:29.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.096673 32512 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:01:29.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.099341 32512 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:01:29.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.100993 32512 hybrid_clock.cc:648] HybridClock initialized: now 1783497689100914 us; error 95 us; skew 500 ppm
08:01:29.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.102051 32512 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:01:29.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.108470 32512 webserver.cc:533] Webserver started at http://127.31.45.195:43403/ using document root <none> and password file <none>
08:01:29.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.109475 32512 fs_manager.cc:362] Metadata directory not provided
08:01:29.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.109715 32512 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:01:29.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.110227 32512 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:01:29.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.114593 32512 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/ts-2/data/instance:
08:01:29.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "259f6fe7649f435b899f20f027b2cdb6"
08:01:29.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 08:01:29 on dist-test-slave-ltj1"
08:01:29.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.115868 32512 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/ts-2/wal/instance:
08:01:29.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "259f6fe7649f435b899f20f027b2cdb6"
08:01:29.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 08:01:29 on dist-test-slave-ltj1"
08:01:29.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.123270 32512 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.007s	sys 0.001s
08:01:29.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.129658 32529 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:01:29.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.130802 32512 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.001s
08:01:29.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.131155 32512 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/ts-2/data,/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/ts-2/wal
08:01:29.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "259f6fe7649f435b899f20f027b2cdb6"
08:01:29.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 08:01:29 on dist-test-slave-ltj1"
08:01:29.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.131479 32512 fs_report.cc:389] FS layout report
08:01:29.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:01:29.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/ts-2/wal
08:01:29.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/ts-2/wal
08:01:29.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/ts-2/data/data
08:01:29.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:01:29.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:01:29.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:01:29.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:01:29.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:01:29.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:01:29.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:01:29.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:01:29.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:01:29.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:01:29.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:01:29.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.176863 32512 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:01:29.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.178386 32512 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:01:29.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.178884 32512 kserver.cc:163] Server-wide thread pool size limit: 3276
08:01:29.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.181596 32512 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
08:01:29.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.186079 32512 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
08:01:29.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.186287 32512 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
08:01:29.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.186589 32512 ts_tablet_manager.cc:616] Registered 0 tablets
08:01:29.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.186785 32512 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
08:01:29.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.314136 32512 rpc_server.cc:307] RPC server started. Bound to: 127.31.45.195:37139
08:01:29.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.314242 32641 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.45.195:37139 every 8 connection(s)
08:01:29.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.316785 32512 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/ts-2/data/info.pb
08:01:29.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.326596 31927 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasktDuNhD/build/tsan/bin/kudu as pid 32512
08:01:29.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.327071 31927 external_mini_cluster.cc:1448] Reading /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/ts-2/wal/instance
08:01:29.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.356803 32642 heartbeater.cc:344] Connected to a master server at 127.31.45.252:43307
08:01:29.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.357316 32642 heartbeater.cc:461] Registering TS with master...
08:01:29.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.358665 32642 heartbeater.cc:507] Master 127.31.45.252:43307 requested a full tablet report, sending...
08:01:29.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.359931 32643 heartbeater.cc:344] Connected to a master server at 127.31.45.253:44911
08:01:29.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.360292 32643 heartbeater.cc:461] Registering TS with master...
08:01:29.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.361131 32643 heartbeater.cc:507] Master 127.31.45.253:44911 requested a full tablet report, sending...
08:01:29.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.361399 32128 ts_manager.cc:194] Registered new tserver with Master: 259f6fe7649f435b899f20f027b2cdb6 (127.31.45.195:37139)
08:01:29.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.363121 32128 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.31.45.195:53929
08:01:29.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.364307 32047 ts_manager.cc:194] Registered new tserver with Master: 259f6fe7649f435b899f20f027b2cdb6 (127.31.45.195:37139)
08:01:29.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.366657 32644 heartbeater.cc:344] Connected to a master server at 127.31.45.254:33973
08:01:29.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.367027 32644 heartbeater.cc:461] Registering TS with master...
08:01:29.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.367686 32644 heartbeater.cc:507] Master 127.31.45.254:33973 requested a full tablet report, sending...
08:01:29.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.370306 31971 ts_manager.cc:194] Registered new tserver with Master: 259f6fe7649f435b899f20f027b2cdb6 (127.31.45.195:37139)
08:01:29.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.376886 31927 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
08:01:29.388 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
08:01:29.388 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

08:01:29.391 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.31.45.254"
      port: 33973
    }
    bound_http_address {
      host: "127.31.45.254"
      port: 44275
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.31.45.253"
      port: 44911
    }
    bound_http_address {
      host: "127.31.45.253"
      port: 42263
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.31.45.252"
      port: 43307
    }
    bound_http_address {
      host: "127.31.45.252"
      port: 41469
    }
  }
}

08:01:29.391 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

08:01:29.392 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.31.45.193"
      port: 42409
    }
    bound_http_address {
      host: "127.31.45.193"
      port: 38913
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.31.45.194"
      port: 43651
    }
    bound_http_address {
      host: "127.31.45.194"
      port: 43143
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.31.45.195"
      port: 37139
    }
    bound_http_address {
      host: "127.31.45.195"
      port: 43403
    }
  }
}

08:01:29.393 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
08:01:29.395 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:01:29.397 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.31.45.254:33973(127.31.45.254:33973)] connecting to peer
08:01:29.399 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.31.45.252:43307(127.31.45.252:43307)] connecting to peer
08:01:29.399 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.31.45.254:33973(127.31.45.254:33973)] Successfully connected to peer
08:01:29.400 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.31.45.253:44911(127.31.45.253:44911)] connecting to peer
08:01:29.402 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.31.45.252:43307(127.31.45.252:43307)] Successfully connected to peer
08:01:29.403 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.31.45.253:44911(127.31.45.253:44911)] Successfully connected to peer
08:01:29.405 [DEBUG - kudu-nio-0] (Negotiator.java:528) SASL mechanism PLAIN chosen for peer 127.31.45.254
08:01:29.407 [DEBUG - kudu-nio-1] (Negotiator.java:528) SASL mechanism PLAIN chosen for peer 127.31.45.252
08:01:29.407 [DEBUG - kudu-nio-2] (Negotiator.java:528) SASL mechanism PLAIN chosen for peer 127.31.45.253
08:01:29.436 [DEBUG - kudu-nio-1] (Negotiator.java:918) Authenticated connection [id: 0xa709dec3, L:/127.0.0.1:59018 - R:/127.31.45.252:43307] using SASL/PLAIN
08:01:29.439 [DEBUG - kudu-nio-2] (Negotiator.java:918) Authenticated connection [id: 0xb615f843, L:/127.0.0.1:37558 - R:/127.31.45.253:44911] using SASL/PLAIN
08:01:29.441 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:01:29.442 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=45), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.45.254:33973, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.45.252:43307, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.45.253:44911, [45ms] Sub RPC ConnectToMaster: received response from server master-127.31.45.252:43307: OK, deferred=null) after lookup
08:01:29.443 [DEBUG - kudu-nio-0] (Negotiator.java:918) Authenticated connection [id: 0x934c0bf2, L:/127.0.0.1:54528 - R:/127.31.45.254:33973] using SASL/PLAIN
08:01:29.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.444782 32128 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59018:
08:01:29.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "org.apache.kudu.client.TestClientFailoverSupport-RESTART"
08:01:29.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
08:01:29.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:01:29.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key"
08:01:29.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
08:01:29.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
08:01:29.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:01:29.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:01:29.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:01:29.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:01:29.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:01:29.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:01:29.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column1_i"
08:01:29.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
08:01:29.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
08:01:29.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:01:29.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:01:29.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:01:29.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:01:29.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:01:29.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:01:29.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column2_i"
08:01:29.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
08:01:29.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
08:01:29.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:01:29.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:01:29.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:01:29.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:01:29.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:01:29.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:01:29.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column3_s"
08:01:29.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
08:01:29.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
08:01:29.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: true
08:01:29.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: DICT_ENCODING
08:01:29.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: LZ4
08:01:29.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 4096
08:01:29.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:01:29.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:01:29.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:01:29.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:01:29.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column4_b"
08:01:29.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BOOL
08:01:29.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
08:01:29.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:01:29.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:01:29.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:01:29.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:01:29.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:01:29.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
08:01:29.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
08:01:29.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
08:01:29.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
08:01:29.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key"
08:01:29.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
08:01:29.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:01:29.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
08:01:29.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:29.449819 32128 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table org.apache.kudu.client.TestClientFailoverSupport-RESTART in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
08:01:29.504 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table e07975edb34744a9b7abb7ca4ba17c15
08:01:29.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.550230 32437 tablet_service.cc:1511] Processing CreateTablet for tablet 736c34109533446c835514f293c21af9 (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-RESTART [id=e07975edb34744a9b7abb7ca4ba17c15]), partition=RANGE (key) PARTITION UNBOUNDED
08:01:29.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.552587 32437 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 736c34109533446c835514f293c21af9. 1 dirs total, 0 dirs full, 0 dirs failed
08:01:29.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.561033 32577 tablet_service.cc:1511] Processing CreateTablet for tablet 736c34109533446c835514f293c21af9 (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-RESTART [id=e07975edb34744a9b7abb7ca4ba17c15]), partition=RANGE (key) PARTITION UNBOUNDED
08:01:29.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.562179 32296 tablet_service.cc:1511] Processing CreateTablet for tablet 736c34109533446c835514f293c21af9 (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-RESTART [id=e07975edb34744a9b7abb7ca4ba17c15]), partition=RANGE (key) PARTITION UNBOUNDED
08:01:29.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.563164 32577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 736c34109533446c835514f293c21af9. 1 dirs total, 0 dirs full, 0 dirs failed
08:01:29.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.563889 32296 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 736c34109533446c835514f293c21af9. 1 dirs total, 0 dirs full, 0 dirs failed
08:01:29.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.576658 32674 tablet_bootstrap.cc:492] T 736c34109533446c835514f293c21af9 P 5fe32233c7fa4a55bd8424505aa63261: Bootstrap starting.
08:01:29.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.585142 32674 tablet_bootstrap.cc:654] T 736c34109533446c835514f293c21af9 P 5fe32233c7fa4a55bd8424505aa63261: Neither blocks nor log segments found. Creating new log.
08:01:29.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.586860 32674 log.cc:826] T 736c34109533446c835514f293c21af9 P 5fe32233c7fa4a55bd8424505aa63261: Log is configured to *not* fsync() on all Append() calls
08:01:29.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.589803 32675 tablet_bootstrap.cc:492] T 736c34109533446c835514f293c21af9 P 2949848f49e243ac999493cc0c83ae21: Bootstrap starting.
08:01:29.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.592926 32674 tablet_bootstrap.cc:492] T 736c34109533446c835514f293c21af9 P 5fe32233c7fa4a55bd8424505aa63261: No bootstrap required, opened a new log
08:01:29.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.593454 32674 ts_tablet_manager.cc:1403] T 736c34109533446c835514f293c21af9 P 5fe32233c7fa4a55bd8424505aa63261: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.004s
08:01:29.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.596410 32677 tablet_bootstrap.cc:492] T 736c34109533446c835514f293c21af9 P 259f6fe7649f435b899f20f027b2cdb6: Bootstrap starting.
08:01:29.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.597009 32675 tablet_bootstrap.cc:654] T 736c34109533446c835514f293c21af9 P 2949848f49e243ac999493cc0c83ae21: Neither blocks nor log segments found. Creating new log.
08:01:29.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.600535 32675 log.cc:826] T 736c34109533446c835514f293c21af9 P 2949848f49e243ac999493cc0c83ae21: Log is configured to *not* fsync() on all Append() calls
08:01:29.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.603024 32677 tablet_bootstrap.cc:654] T 736c34109533446c835514f293c21af9 P 259f6fe7649f435b899f20f027b2cdb6: Neither blocks nor log segments found. Creating new log.
08:01:29.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.604801 32677 log.cc:826] T 736c34109533446c835514f293c21af9 P 259f6fe7649f435b899f20f027b2cdb6: Log is configured to *not* fsync() on all Append() calls
08:01:29.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.608923 32675 tablet_bootstrap.cc:492] T 736c34109533446c835514f293c21af9 P 2949848f49e243ac999493cc0c83ae21: No bootstrap required, opened a new log
08:01:29.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.609455 32675 ts_tablet_manager.cc:1403] T 736c34109533446c835514f293c21af9 P 2949848f49e243ac999493cc0c83ae21: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.005s
08:01:29.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.609968 32677 tablet_bootstrap.cc:492] T 736c34109533446c835514f293c21af9 P 259f6fe7649f435b899f20f027b2cdb6: No bootstrap required, opened a new log
08:01:29.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.610388 32677 ts_tablet_manager.cc:1403] T 736c34109533446c835514f293c21af9 P 259f6fe7649f435b899f20f027b2cdb6: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.002s
08:01:29.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.623265 32674 raft_consensus.cc:359] T 736c34109533446c835514f293c21af9 P 5fe32233c7fa4a55bd8424505aa63261 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fe32233c7fa4a55bd8424505aa63261" member_type: VOTER last_known_addr { host: "127.31.45.194" port: 43651 } } peers { permanent_uuid: "2949848f49e243ac999493cc0c83ae21" member_type: VOTER last_known_addr { host: "127.31.45.193" port: 42409 } } peers { permanent_uuid: "259f6fe7649f435b899f20f027b2cdb6" member_type: VOTER last_known_addr { host: "127.31.45.195" port: 37139 } }
08:01:29.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.624184 32674 raft_consensus.cc:385] T 736c34109533446c835514f293c21af9 P 5fe32233c7fa4a55bd8424505aa63261 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:01:29.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.624500 32674 raft_consensus.cc:740] T 736c34109533446c835514f293c21af9 P 5fe32233c7fa4a55bd8424505aa63261 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5fe32233c7fa4a55bd8424505aa63261, State: Initialized, Role: FOLLOWER
08:01:29.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.625447 32674 consensus_queue.cc:260] T 736c34109533446c835514f293c21af9 P 5fe32233c7fa4a55bd8424505aa63261 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fe32233c7fa4a55bd8424505aa63261" member_type: VOTER last_known_addr { host: "127.31.45.194" port: 43651 } } peers { permanent_uuid: "2949848f49e243ac999493cc0c83ae21" member_type: VOTER last_known_addr { host: "127.31.45.193" port: 42409 } } peers { permanent_uuid: "259f6fe7649f435b899f20f027b2cdb6" member_type: VOTER last_known_addr { host: "127.31.45.195" port: 37139 } }
08:01:29.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.629714 32674 ts_tablet_manager.cc:1434] T 736c34109533446c835514f293c21af9 P 5fe32233c7fa4a55bd8424505aa63261: Time spent starting tablet: real 0.036s	user 0.026s	sys 0.008s
08:01:29.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.629779 32677 raft_consensus.cc:359] T 736c34109533446c835514f293c21af9 P 259f6fe7649f435b899f20f027b2cdb6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fe32233c7fa4a55bd8424505aa63261" member_type: VOTER last_known_addr { host: "127.31.45.194" port: 43651 } } peers { permanent_uuid: "2949848f49e243ac999493cc0c83ae21" member_type: VOTER last_known_addr { host: "127.31.45.193" port: 42409 } } peers { permanent_uuid: "259f6fe7649f435b899f20f027b2cdb6" member_type: VOTER last_known_addr { host: "127.31.45.195" port: 37139 } }
08:01:29.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.630738 32677 raft_consensus.cc:385] T 736c34109533446c835514f293c21af9 P 259f6fe7649f435b899f20f027b2cdb6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:01:29.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.631028 32677 raft_consensus.cc:740] T 736c34109533446c835514f293c21af9 P 259f6fe7649f435b899f20f027b2cdb6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 259f6fe7649f435b899f20f027b2cdb6, State: Initialized, Role: FOLLOWER
08:01:29.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.631529 32681 raft_consensus.cc:493] T 736c34109533446c835514f293c21af9 P 5fe32233c7fa4a55bd8424505aa63261 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:01:29.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.632030 32681 raft_consensus.cc:515] T 736c34109533446c835514f293c21af9 P 5fe32233c7fa4a55bd8424505aa63261 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fe32233c7fa4a55bd8424505aa63261" member_type: VOTER last_known_addr { host: "127.31.45.194" port: 43651 } } peers { permanent_uuid: "2949848f49e243ac999493cc0c83ae21" member_type: VOTER last_known_addr { host: "127.31.45.193" port: 42409 } } peers { permanent_uuid: "259f6fe7649f435b899f20f027b2cdb6" member_type: VOTER last_known_addr { host: "127.31.45.195" port: 37139 } }
08:01:29.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.632073 32677 consensus_queue.cc:260] T 736c34109533446c835514f293c21af9 P 259f6fe7649f435b899f20f027b2cdb6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fe32233c7fa4a55bd8424505aa63261" member_type: VOTER last_known_addr { host: "127.31.45.194" port: 43651 } } peers { permanent_uuid: "2949848f49e243ac999493cc0c83ae21" member_type: VOTER last_known_addr { host: "127.31.45.193" port: 42409 } } peers { permanent_uuid: "259f6fe7649f435b899f20f027b2cdb6" member_type: VOTER last_known_addr { host: "127.31.45.195" port: 37139 } }
08:01:29.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.635321 32681 leader_election.cc:290] T 736c34109533446c835514f293c21af9 P 5fe32233c7fa4a55bd8424505aa63261 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2949848f49e243ac999493cc0c83ae21 (127.31.45.193:42409), 259f6fe7649f435b899f20f027b2cdb6 (127.31.45.195:37139)
08:01:29.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.647490 32675 raft_consensus.cc:359] T 736c34109533446c835514f293c21af9 P 2949848f49e243ac999493cc0c83ae21 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fe32233c7fa4a55bd8424505aa63261" member_type: VOTER last_known_addr { host: "127.31.45.194" port: 43651 } } peers { permanent_uuid: "2949848f49e243ac999493cc0c83ae21" member_type: VOTER last_known_addr { host: "127.31.45.193" port: 42409 } } peers { permanent_uuid: "259f6fe7649f435b899f20f027b2cdb6" member_type: VOTER last_known_addr { host: "127.31.45.195" port: 37139 } }
08:01:29.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.648505 32675 raft_consensus.cc:385] T 736c34109533446c835514f293c21af9 P 2949848f49e243ac999493cc0c83ae21 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:01:29.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.648815 32675 raft_consensus.cc:740] T 736c34109533446c835514f293c21af9 P 2949848f49e243ac999493cc0c83ae21 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2949848f49e243ac999493cc0c83ae21, State: Initialized, Role: FOLLOWER
08:01:29.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.649865 32675 consensus_queue.cc:260] T 736c34109533446c835514f293c21af9 P 2949848f49e243ac999493cc0c83ae21 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fe32233c7fa4a55bd8424505aa63261" member_type: VOTER last_known_addr { host: "127.31.45.194" port: 43651 } } peers { permanent_uuid: "2949848f49e243ac999493cc0c83ae21" member_type: VOTER last_known_addr { host: "127.31.45.193" port: 42409 } } peers { permanent_uuid: "259f6fe7649f435b899f20f027b2cdb6" member_type: VOTER last_known_addr { host: "127.31.45.195" port: 37139 } }
08:01:29.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.663798 32642 heartbeater.cc:499] Master 127.31.45.252:43307 was elected leader, sending a full tablet report...
08:01:29.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.663987 32675 ts_tablet_manager.cc:1434] T 736c34109533446c835514f293c21af9 P 2949848f49e243ac999493cc0c83ae21: Time spent starting tablet: real 0.054s	user 0.040s	sys 0.006s
08:01:29.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.674286 32316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736c34109533446c835514f293c21af9" candidate_uuid: "5fe32233c7fa4a55bd8424505aa63261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2949848f49e243ac999493cc0c83ae21" is_pre_election: true
08:01:29.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.675240 32316 raft_consensus.cc:2468] T 736c34109533446c835514f293c21af9 P 2949848f49e243ac999493cc0c83ae21 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5fe32233c7fa4a55bd8424505aa63261 in term 0.
08:01:29.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:29.676447 32371 tablet.cc:2406] T 736c34109533446c835514f293c21af9 P 2949848f49e243ac999493cc0c83ae21: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:01:29.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.677054 32390 leader_election.cc:304] T 736c34109533446c835514f293c21af9 P 5fe32233c7fa4a55bd8424505aa63261 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2949848f49e243ac999493cc0c83ae21, 5fe32233c7fa4a55bd8424505aa63261; no voters: 
08:01:29.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.678220 32680 raft_consensus.cc:2804] T 736c34109533446c835514f293c21af9 P 5fe32233c7fa4a55bd8424505aa63261 [term 0 FOLLOWER]: Leader pre-election won for term 1
08:01:29.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.678622 32680 raft_consensus.cc:493] T 736c34109533446c835514f293c21af9 P 5fe32233c7fa4a55bd8424505aa63261 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:01:29.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.678941 32680 raft_consensus.cc:3060] T 736c34109533446c835514f293c21af9 P 5fe32233c7fa4a55bd8424505aa63261 [term 0 FOLLOWER]: Advancing to term 1
08:01:29.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.680452 32677 ts_tablet_manager.cc:1434] T 736c34109533446c835514f293c21af9 P 259f6fe7649f435b899f20f027b2cdb6: Time spent starting tablet: real 0.070s	user 0.035s	sys 0.016s
08:01:29.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.690461 32597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736c34109533446c835514f293c21af9" candidate_uuid: "5fe32233c7fa4a55bd8424505aa63261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "259f6fe7649f435b899f20f027b2cdb6" is_pre_election: true
08:01:29.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.691411 32597 raft_consensus.cc:2468] T 736c34109533446c835514f293c21af9 P 259f6fe7649f435b899f20f027b2cdb6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5fe32233c7fa4a55bd8424505aa63261 in term 0.
08:01:29.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.692476 32680 raft_consensus.cc:515] T 736c34109533446c835514f293c21af9 P 5fe32233c7fa4a55bd8424505aa63261 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fe32233c7fa4a55bd8424505aa63261" member_type: VOTER last_known_addr { host: "127.31.45.194" port: 43651 } } peers { permanent_uuid: "2949848f49e243ac999493cc0c83ae21" member_type: VOTER last_known_addr { host: "127.31.45.193" port: 42409 } } peers { permanent_uuid: "259f6fe7649f435b899f20f027b2cdb6" member_type: VOTER last_known_addr { host: "127.31.45.195" port: 37139 } }
08:01:29.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.694051 32680 leader_election.cc:290] T 736c34109533446c835514f293c21af9 P 5fe32233c7fa4a55bd8424505aa63261 [CANDIDATE]: Term 1 election: Requested vote from peers 2949848f49e243ac999493cc0c83ae21 (127.31.45.193:42409), 259f6fe7649f435b899f20f027b2cdb6 (127.31.45.195:37139)
08:01:29.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.694804 32316 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736c34109533446c835514f293c21af9" candidate_uuid: "5fe32233c7fa4a55bd8424505aa63261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2949848f49e243ac999493cc0c83ae21"
08:01:29.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.694939 32597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736c34109533446c835514f293c21af9" candidate_uuid: "5fe32233c7fa4a55bd8424505aa63261" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "259f6fe7649f435b899f20f027b2cdb6"
08:01:29.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.695297 32316 raft_consensus.cc:3060] T 736c34109533446c835514f293c21af9 P 2949848f49e243ac999493cc0c83ae21 [term 0 FOLLOWER]: Advancing to term 1
08:01:29.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.695396 32597 raft_consensus.cc:3060] T 736c34109533446c835514f293c21af9 P 259f6fe7649f435b899f20f027b2cdb6 [term 0 FOLLOWER]: Advancing to term 1
08:01:29.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.699596 32316 raft_consensus.cc:2468] T 736c34109533446c835514f293c21af9 P 2949848f49e243ac999493cc0c83ae21 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5fe32233c7fa4a55bd8424505aa63261 in term 1.
08:01:29.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.699813 32597 raft_consensus.cc:2468] T 736c34109533446c835514f293c21af9 P 259f6fe7649f435b899f20f027b2cdb6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5fe32233c7fa4a55bd8424505aa63261 in term 1.
08:01:29.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.700507 32390 leader_election.cc:304] T 736c34109533446c835514f293c21af9 P 5fe32233c7fa4a55bd8424505aa63261 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2949848f49e243ac999493cc0c83ae21, 5fe32233c7fa4a55bd8424505aa63261; no voters: 
08:01:29.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.701121 32680 raft_consensus.cc:2804] T 736c34109533446c835514f293c21af9 P 5fe32233c7fa4a55bd8424505aa63261 [term 1 FOLLOWER]: Leader election won for term 1
08:01:29.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.701529 32680 raft_consensus.cc:697] T 736c34109533446c835514f293c21af9 P 5fe32233c7fa4a55bd8424505aa63261 [term 1 LEADER]: Becoming Leader. State: Replica: 5fe32233c7fa4a55bd8424505aa63261, State: Running, Role: LEADER
08:01:29.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.702478 32680 consensus_queue.cc:237] T 736c34109533446c835514f293c21af9 P 5fe32233c7fa4a55bd8424505aa63261 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fe32233c7fa4a55bd8424505aa63261" member_type: VOTER last_known_addr { host: "127.31.45.194" port: 43651 } } peers { permanent_uuid: "2949848f49e243ac999493cc0c83ae21" member_type: VOTER last_known_addr { host: "127.31.45.193" port: 42409 } } peers { permanent_uuid: "259f6fe7649f435b899f20f027b2cdb6" member_type: VOTER last_known_addr { host: "127.31.45.195" port: 37139 } }
08:01:29.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.714205 32127 catalog_manager.cc:5697] T 736c34109533446c835514f293c21af9 P 5fe32233c7fa4a55bd8424505aa63261 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5fe32233c7fa4a55bd8424505aa63261 (127.31.45.194). New cstate: current_term: 1 leader_uuid: "5fe32233c7fa4a55bd8424505aa63261" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fe32233c7fa4a55bd8424505aa63261" member_type: VOTER last_known_addr { host: "127.31.45.194" port: 43651 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2949848f49e243ac999493cc0c83ae21" member_type: VOTER last_known_addr { host: "127.31.45.193" port: 42409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "259f6fe7649f435b899f20f027b2cdb6" member_type: VOTER last_known_addr { host: "127.31.45.195" port: 37139 } health_report { overall_health: UNKNOWN } } }
08:01:29.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:29.777235 32509 tablet.cc:2406] T 736c34109533446c835514f293c21af9 P 5fe32233c7fa4a55bd8424505aa63261: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:01:29.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:29.830758 32647 tablet.cc:2406] T 736c34109533446c835514f293c21af9 P 259f6fe7649f435b899f20f027b2cdb6: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:01:29.925 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table e07975edb34744a9b7abb7ca4ba17c15
08:01:29.930 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 736c34109533446c835514f293c21af9 for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
08:01:29.930 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=736c34109533446c835514f293c21af9@[259f6fe7649f435b899f20f027b2cdb6(127.31.45.195:37139),2949848f49e243ac999493cc0c83ae21(127.31.45.193:42409),5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651)[L]]}]
08:01:29.931 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=5), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.252:43307, [5ms] Sub RPC GetTableLocations: received response from server master-127.31.45.252:43307: OK, deferred=null) after lookup
08:01:29.931 [DEBUG - kudu-nio-1] (Connection.java:748) [peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651)] connecting to peer
08:01:29.933 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651)] Successfully connected to peer
08:01:29.955 [DEBUG - kudu-nio-3] (Negotiator.java:918) Authenticated connection [id: 0xf3b18818, L:/127.0.0.1:44422 - R:/127.31.45.194:43651] using TOKEN/null
08:01:29.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.971558 32597 raft_consensus.cc:1275] T 736c34109533446c835514f293c21af9 P 259f6fe7649f435b899f20f027b2cdb6 [term 1 FOLLOWER]: Refusing update from remote peer 5fe32233c7fa4a55bd8424505aa63261: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
08:01:29.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.972971 32316 raft_consensus.cc:1275] T 736c34109533446c835514f293c21af9 P 2949848f49e243ac999493cc0c83ae21 [term 1 FOLLOWER]: Refusing update from remote peer 5fe32233c7fa4a55bd8424505aa63261: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
08:01:29.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.974189 32680 consensus_queue.cc:1048] T 736c34109533446c835514f293c21af9 P 5fe32233c7fa4a55bd8424505aa63261 [LEADER]: Connected to new peer: Peer: permanent_uuid: "259f6fe7649f435b899f20f027b2cdb6" member_type: VOTER last_known_addr { host: "127.31.45.195" port: 37139 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
08:01:29.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:29.974819 32681 consensus_queue.cc:1048] T 736c34109533446c835514f293c21af9 P 5fe32233c7fa4a55bd8424505aa63261 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2949848f49e243ac999493cc0c83ae21" member_type: VOTER last_known_addr { host: "127.31.45.193" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
08:01:30.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:30.010759 32689 mvcc.cc:204] Tried to move back new op lower bound from 7305206538106163200 to 7305206537029050368. Current Snapshot: MvccSnapshot[applied={T|T < 7305206538106163200}]
08:01:30.222 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 10 rows, more = false) for scanner KuduScanner(table=org.apache.kudu.client.TestClientFailoverSupport-RESTART, tablet=736c34109533446c835514f293c21af9, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:01:30.223 [INFO - Time-limited test] (MiniKuduCluster.java:399) Killing master server 127.31.45.252:43307
08:01:30.223 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: stop_daemon {
  id {
    type: MASTER
    index: 2
  }
}

08:01:30.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:30.224258 31927 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasktDuNhD/build/tsan/bin/kudu with pid 32084
08:01:30.251 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
08:01:30.251 [INFO - Time-limited test] (MiniKuduCluster.java:380) Starting master server 127.31.45.252:43307
08:01:30.252 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.31.45.252:43307(127.31.45.252:43307)] handling channelInactive
08:01:30.252 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.45.252:43307(127.31.45.252:43307)] cleaning up while in state READY due to: connection closed
08:01:30.254 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: start_daemon {
  id {
    type: MASTER
    index: 2
  }
}

08:01:30.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:30.256244 31927 external_mini_cluster.cc:1372] Running /tmp/dist-test-tasktDuNhD/build/tsan/bin/kudu
08:01:30.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-tasktDuNhD/build/tsan/bin/kudu
08:01:30.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/master-2/wal
08:01:30.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/master-2/data
08:01:30.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:01:30.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:01:30.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:01:30.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:01:30.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:01:30.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:01:30.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/master-2/logs
08:01:30.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/master-2/data/info.pb
08:01:30.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:01:30.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:01:30.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:01:30.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:01:30.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:01:30.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:01:30.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:01:30.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:01:30.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
08:01:30.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:01:30.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:01:30.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:01:30.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.31.45.252:43307
08:01:30.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.31.45.252
08:01:30.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=41469
08:01:30.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.31.45.212:43675
08:01:30.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:01:30.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:01:30.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:01:30.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:01:30.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.31.45.254:33973,127.31.45.253:44911,127.31.45.252:43307
08:01:30.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:01:30.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:35551/jwks.json with env {}
08:01:30.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:30.610913 32699 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:01:30.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:30.611541 32699 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:01:30.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:30.612061 32699 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:01:30.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:30.646042 32699 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
08:01:30.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:30.646324 32699 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:01:30.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:30.646535 32699 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
08:01:30.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:30.646731 32699 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
08:01:30.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:30.646929 32699 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
08:01:30.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:30.647094 32699 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:35551/jwks.json
08:01:30.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:30.686283 32699 master_runner.cc:387] Master server non-default flags:
08:01:30.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:01:30.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.31.45.212:43675
08:01:30.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:01:30.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:01:30.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/master-2/data
08:01:30.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/master-2/wal
08:01:30.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:01:30.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.31.45.254:33973,127.31.45.253:44911,127.31.45.252:43307
08:01:30.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:01:30.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:01:30.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:01:30.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.31.45.252:43307
08:01:30.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:01:30.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:01:30.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:01:30.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:35551/jwks.json
08:01:30.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:01:30.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:01:30.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/master-2/data/info.pb
08:01:30.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.31.45.252
08:01:30.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=41469
08:01:30.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:01:30.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:01:30.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:01:30.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:01:30.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:01:30.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/master-2/logs
08:01:30.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:01:30.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:01:30.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:01:30.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
08:01:30.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:01:30.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
08:01:30.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:01:30.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 07:43:22 UTC on e7f111948823
08:01:30.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12771
08:01:30.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:01:30.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:30.688107 32699 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:01:30.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:30.689839 32699 file_cache.cc:504] Constructed file cache file cache with capacity 419430
08:01:30.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:30.702101 32705 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:01:31.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:31.050016 32642 heartbeater.cc:646] Failed to heartbeat to 127.31.45.252:43307 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.31.45.252:43307: connect: Connection refused (error 111)
08:01:31.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:31.061061 32361 heartbeater.cc:646] Failed to heartbeat to 127.31.45.252:43307 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.31.45.252:43307: connect: Connection refused (error 111)
08:01:31.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:31.063828 32502 heartbeater.cc:646] Failed to heartbeat to 127.31.45.252:43307 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.31.45.252:43307: connect: Connection refused (error 111)
08:01:31.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:31.615975 32714 raft_consensus.cc:493] T 00000000000000000000000000000000 P ef18df293cb04df6bf01c1ea6a46276a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 848132dc045348b0a0c92ef5ea20b5b8)
08:01:31.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:31.617038 32714 raft_consensus.cc:515] T 00000000000000000000000000000000 P ef18df293cb04df6bf01c1ea6a46276a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef18df293cb04df6bf01c1ea6a46276a" member_type: VOTER last_known_addr { host: "127.31.45.254" port: 33973 } } peers { permanent_uuid: "f3092cb366824c8f881fcffd79b1e9e0" member_type: VOTER last_known_addr { host: "127.31.45.253" port: 44911 } } peers { permanent_uuid: "848132dc045348b0a0c92ef5ea20b5b8" member_type: VOTER last_known_addr { host: "127.31.45.252" port: 43307 } }
08:01:31.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:31.620034 32714 leader_election.cc:290] T 00000000000000000000000000000000 P ef18df293cb04df6bf01c1ea6a46276a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f3092cb366824c8f881fcffd79b1e9e0 (127.31.45.253:44911), 848132dc045348b0a0c92ef5ea20b5b8 (127.31.45.252:43307)
08:01:31.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:31.621001 32057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ef18df293cb04df6bf01c1ea6a46276a" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "f3092cb366824c8f881fcffd79b1e9e0" is_pre_election: true
08:01:31.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:31.645248 31957 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.31.45.252:43307: connect: Connection refused (error 111) [suppressed 13 similar messages]
08:01:31.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:31.657372 31957 leader_election.cc:336] T 00000000000000000000000000000000 P ef18df293cb04df6bf01c1ea6a46276a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 848132dc045348b0a0c92ef5ea20b5b8 (127.31.45.252:43307): Network error: Client connection negotiation failed: client connection to 127.31.45.252:43307: connect: Connection refused (error 111)
08:01:31.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:31.658342 31957 leader_election.cc:304] T 00000000000000000000000000000000 P ef18df293cb04df6bf01c1ea6a46276a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef18df293cb04df6bf01c1ea6a46276a; no voters: 848132dc045348b0a0c92ef5ea20b5b8, f3092cb366824c8f881fcffd79b1e9e0
08:01:31.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:31.659574 32714 raft_consensus.cc:2749] T 00000000000000000000000000000000 P ef18df293cb04df6bf01c1ea6a46276a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
08:01:31.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:31.704242 32717 raft_consensus.cc:493] T 00000000000000000000000000000000 P f3092cb366824c8f881fcffd79b1e9e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 848132dc045348b0a0c92ef5ea20b5b8)
08:01:31.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:31.705464 32717 raft_consensus.cc:515] T 00000000000000000000000000000000 P f3092cb366824c8f881fcffd79b1e9e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef18df293cb04df6bf01c1ea6a46276a" member_type: VOTER last_known_addr { host: "127.31.45.254" port: 33973 } } peers { permanent_uuid: "f3092cb366824c8f881fcffd79b1e9e0" member_type: VOTER last_known_addr { host: "127.31.45.253" port: 44911 } } peers { permanent_uuid: "848132dc045348b0a0c92ef5ea20b5b8" member_type: VOTER last_known_addr { host: "127.31.45.252" port: 43307 } }
08:01:31.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:31.716022 31981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f3092cb366824c8f881fcffd79b1e9e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "ef18df293cb04df6bf01c1ea6a46276a" is_pre_election: true
08:01:31.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:31.716720 31981 raft_consensus.cc:2468] T 00000000000000000000000000000000 P ef18df293cb04df6bf01c1ea6a46276a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f3092cb366824c8f881fcffd79b1e9e0 in term 1.
08:01:31.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:31.718178 32034 leader_election.cc:304] T 00000000000000000000000000000000 P f3092cb366824c8f881fcffd79b1e9e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef18df293cb04df6bf01c1ea6a46276a, f3092cb366824c8f881fcffd79b1e9e0; no voters: 
08:01:31.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:31.719934 32719 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f3092cb366824c8f881fcffd79b1e9e0 [term 1 FOLLOWER]: Leader pre-election won for term 2
08:01:31.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:31.719998 32032 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.31.45.252:43307: connect: Connection refused (error 111) [suppressed 6 similar messages]
08:01:31.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:31.720495 32717 leader_election.cc:290] T 00000000000000000000000000000000 P f3092cb366824c8f881fcffd79b1e9e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ef18df293cb04df6bf01c1ea6a46276a (127.31.45.254:33973), 848132dc045348b0a0c92ef5ea20b5b8 (127.31.45.252:43307)
08:01:31.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:31.733629 32719 raft_consensus.cc:493] T 00000000000000000000000000000000 P f3092cb366824c8f881fcffd79b1e9e0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 848132dc045348b0a0c92ef5ea20b5b8)
08:01:31.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:31.735579 32719 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f3092cb366824c8f881fcffd79b1e9e0 [term 1 FOLLOWER]: Advancing to term 2
08:01:31.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:31.740047 32032 leader_election.cc:336] T 00000000000000000000000000000000 P f3092cb366824c8f881fcffd79b1e9e0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 848132dc045348b0a0c92ef5ea20b5b8 (127.31.45.252:43307): Network error: Client connection negotiation failed: client connection to 127.31.45.252:43307: connect: Connection refused (error 111)
08:01:31.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:31.748313 32719 raft_consensus.cc:515] T 00000000000000000000000000000000 P f3092cb366824c8f881fcffd79b1e9e0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef18df293cb04df6bf01c1ea6a46276a" member_type: VOTER last_known_addr { host: "127.31.45.254" port: 33973 } } peers { permanent_uuid: "f3092cb366824c8f881fcffd79b1e9e0" member_type: VOTER last_known_addr { host: "127.31.45.253" port: 44911 } } peers { permanent_uuid: "848132dc045348b0a0c92ef5ea20b5b8" member_type: VOTER last_known_addr { host: "127.31.45.252" port: 43307 } }
08:01:31.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:31.762003 31981 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f3092cb366824c8f881fcffd79b1e9e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "ef18df293cb04df6bf01c1ea6a46276a"
08:01:31.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:31.762704 31981 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ef18df293cb04df6bf01c1ea6a46276a [term 1 FOLLOWER]: Advancing to term 2
08:01:31.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:31.771709 31981 raft_consensus.cc:2468] T 00000000000000000000000000000000 P ef18df293cb04df6bf01c1ea6a46276a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f3092cb366824c8f881fcffd79b1e9e0 in term 2.
08:01:31.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:31.773684 32034 leader_election.cc:304] T 00000000000000000000000000000000 P f3092cb366824c8f881fcffd79b1e9e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ef18df293cb04df6bf01c1ea6a46276a, f3092cb366824c8f881fcffd79b1e9e0; no voters: 
08:01:31.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:31.775362 32717 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f3092cb366824c8f881fcffd79b1e9e0 [term 2 FOLLOWER]: Leader election won for term 2
08:01:31.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:31.780768 32032 leader_election.cc:336] T 00000000000000000000000000000000 P f3092cb366824c8f881fcffd79b1e9e0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 848132dc045348b0a0c92ef5ea20b5b8 (127.31.45.252:43307): Network error: Client connection negotiation failed: client connection to 127.31.45.252:43307: connect: Connection refused (error 111)
08:01:31.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:31.777568 32719 leader_election.cc:290] T 00000000000000000000000000000000 P f3092cb366824c8f881fcffd79b1e9e0 [CANDIDATE]: Term 2 election: Requested vote from peers ef18df293cb04df6bf01c1ea6a46276a (127.31.45.254:33973), 848132dc045348b0a0c92ef5ea20b5b8 (127.31.45.252:43307)
08:01:31.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:31.784462 32717 raft_consensus.cc:697] T 00000000000000000000000000000000 P f3092cb366824c8f881fcffd79b1e9e0 [term 2 LEADER]: Becoming Leader. State: Replica: f3092cb366824c8f881fcffd79b1e9e0, State: Running, Role: LEADER
08:01:31.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:31.786368 32717 consensus_queue.cc:237] T 00000000000000000000000000000000 P f3092cb366824c8f881fcffd79b1e9e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef18df293cb04df6bf01c1ea6a46276a" member_type: VOTER last_known_addr { host: "127.31.45.254" port: 33973 } } peers { permanent_uuid: "f3092cb366824c8f881fcffd79b1e9e0" member_type: VOTER last_known_addr { host: "127.31.45.253" port: 44911 } } peers { permanent_uuid: "848132dc045348b0a0c92ef5ea20b5b8" member_type: VOTER last_known_addr { host: "127.31.45.252" port: 43307 } }
08:01:31.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:31.810082 32719 sys_catalog.cc:455] T 00000000000000000000000000000000 P f3092cb366824c8f881fcffd79b1e9e0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f3092cb366824c8f881fcffd79b1e9e0. Latest consensus state: current_term: 2 leader_uuid: "f3092cb366824c8f881fcffd79b1e9e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef18df293cb04df6bf01c1ea6a46276a" member_type: VOTER last_known_addr { host: "127.31.45.254" port: 33973 } } peers { permanent_uuid: "f3092cb366824c8f881fcffd79b1e9e0" member_type: VOTER last_known_addr { host: "127.31.45.253" port: 44911 } } peers { permanent_uuid: "848132dc045348b0a0c92ef5ea20b5b8" member_type: VOTER last_known_addr { host: "127.31.45.252" port: 43307 } } }
08:01:31.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:31.810951 32719 sys_catalog.cc:458] T 00000000000000000000000000000000 P f3092cb366824c8f881fcffd79b1e9e0 [sys.catalog]: This master's current role is: LEADER
08:01:31.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:31.826606 32723 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
08:01:31.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:31.843614 32723 catalog_manager.cc:679] Loaded metadata for table org.apache.kudu.client.TestClientFailoverSupport-RESTART [id=e07975edb34744a9b7abb7ca4ba17c15]
08:01:31.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:31.854031 32723 tablet_loader.cc:96] loaded metadata for tablet 736c34109533446c835514f293c21af9 (table org.apache.kudu.client.TestClientFailoverSupport-RESTART [id=e07975edb34744a9b7abb7ca4ba17c15])
08:01:31.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:31.863243 32723 catalog_manager.cc:1520] Initializing Kudu cluster ID...
08:01:31.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:31.870040 32723 catalog_manager.cc:1295] Loaded cluster ID: c7af2609f986426c9115f07b7ee9755c
08:01:31.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:31.875504 32723 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
08:01:31.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:31.882524 32723 catalog_manager.cc:1540] Loading token signing keys...
08:01:31.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:31.892232 32723 catalog_manager.cc:6081] T 00000000000000000000000000000000 P f3092cb366824c8f881fcffd79b1e9e0: Loaded TSK: 0
08:01:31.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:31.898895 32723 catalog_manager.cc:1550] Initializing in-progress tserver states...
08:01:32.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:32.189134 32032 consensus_peers.cc:597] T 00000000000000000000000000000000 P f3092cb366824c8f881fcffd79b1e9e0 -> Peer 848132dc045348b0a0c92ef5ea20b5b8 (127.31.45.252:43307): Couldn't send request to peer 848132dc045348b0a0c92ef5ea20b5b8. Status: Network error: Client connection negotiation failed: client connection to 127.31.45.252:43307: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
08:01:32.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:32.371706 31981 raft_consensus.cc:1275] T 00000000000000000000000000000000 P ef18df293cb04df6bf01c1ea6a46276a [term 2 FOLLOWER]: Refusing update from remote peer f3092cb366824c8f881fcffd79b1e9e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 2 index: 8. (index mismatch)
08:01:32.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:32.376700 32719 consensus_queue.cc:1048] T 00000000000000000000000000000000 P f3092cb366824c8f881fcffd79b1e9e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef18df293cb04df6bf01c1ea6a46276a" member_type: VOTER last_known_addr { host: "127.31.45.254" port: 33973 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
08:01:32.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:32.409132 32727 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef18df293cb04df6bf01c1ea6a46276a [sys.catalog]: SysCatalogTable state changed. Reason: New leader f3092cb366824c8f881fcffd79b1e9e0. Latest consensus state: current_term: 2 leader_uuid: "f3092cb366824c8f881fcffd79b1e9e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef18df293cb04df6bf01c1ea6a46276a" member_type: VOTER last_known_addr { host: "127.31.45.254" port: 33973 } } peers { permanent_uuid: "f3092cb366824c8f881fcffd79b1e9e0" member_type: VOTER last_known_addr { host: "127.31.45.253" port: 44911 } } peers { permanent_uuid: "848132dc045348b0a0c92ef5ea20b5b8" member_type: VOTER last_known_addr { host: "127.31.45.252" port: 43307 } } }
08:01:32.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:32.411022 32727 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef18df293cb04df6bf01c1ea6a46276a [sys.catalog]: This master's current role is: FOLLOWER
08:01:32.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:32.438712 32727 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef18df293cb04df6bf01c1ea6a46276a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "f3092cb366824c8f881fcffd79b1e9e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef18df293cb04df6bf01c1ea6a46276a" member_type: VOTER last_known_addr { host: "127.31.45.254" port: 33973 } } peers { permanent_uuid: "f3092cb366824c8f881fcffd79b1e9e0" member_type: VOTER last_known_addr { host: "127.31.45.253" port: 44911 } } peers { permanent_uuid: "848132dc045348b0a0c92ef5ea20b5b8" member_type: VOTER last_known_addr { host: "127.31.45.252" port: 43307 } } }
08:01:32.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:32.439796 32727 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef18df293cb04df6bf01c1ea6a46276a [sys.catalog]: This master's current role is: FOLLOWER
08:01:32.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:32.444379 32719 sys_catalog.cc:455] T 00000000000000000000000000000000 P f3092cb366824c8f881fcffd79b1e9e0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "f3092cb366824c8f881fcffd79b1e9e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef18df293cb04df6bf01c1ea6a46276a" member_type: VOTER last_known_addr { host: "127.31.45.254" port: 33973 } } peers { permanent_uuid: "f3092cb366824c8f881fcffd79b1e9e0" member_type: VOTER last_known_addr { host: "127.31.45.253" port: 44911 } } peers { permanent_uuid: "848132dc045348b0a0c92ef5ea20b5b8" member_type: VOTER last_known_addr { host: "127.31.45.252" port: 43307 } } }
08:01:32.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:32.445319 32719 sys_catalog.cc:458] T 00000000000000000000000000000000 P f3092cb366824c8f881fcffd79b1e9e0 [sys.catalog]: This master's current role is: LEADER
08:01:32.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:30.703442 32706 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:01:32.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:32.103139 32704 debug-util.cc:398] Leaking SignalData structure 0x7b0800028020 after lost signal to thread 32699
08:01:32.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:32.594065 32704 kernel_stack_watchdog.cc:198] Thread 32699 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 397ms:
08:01:32.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
08:01:32.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
08:01:32.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
08:01:32.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
08:01:32.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:32.595150 32708 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:01:32.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:32.595705 32699 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.892s	user 0.643s	sys 0.984s
08:01:32.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:32.596062 32699 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.893s	user 0.644s	sys 0.984s
08:01:32.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:32.599673 32707 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1892 milliseconds
08:01:32.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:32.599682 32699 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:01:32.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:32.601153 32699 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:01:32.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:32.603688 32699 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:01:32.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:32.605041 32699 hybrid_clock.cc:648] HybridClock initialized: now 1783497692605002 us; error 60 us; skew 500 ppm
08:01:32.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:32.605950 32699 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:01:32.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:32.612651 32699 webserver.cc:533] Webserver started at http://127.31.45.252:41469/ using document root <none> and password file <none>
08:01:32.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:32.613677 32699 fs_manager.cc:362] Metadata directory not provided
08:01:32.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:32.613926 32699 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:01:32.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:32.621980 32699 fs_manager.cc:714] Time spent opening directory manager: real 0.005s	user 0.005s	sys 0.000s
08:01:32.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:32.626880 32737 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:01:32.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:32.628118 32699 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
08:01:32.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:32.628496 32699 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/master-2/data,/tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/master-2/wal
08:01:32.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "848132dc045348b0a0c92ef5ea20b5b8"
08:01:32.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 08:01:21 on dist-test-slave-ltj1"
08:01:32.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:32.630492 32699 fs_report.cc:389] FS layout report
08:01:32.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:01:32.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/master-2/wal
08:01:32.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/master-2/wal
08:01:32.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/master-2/data/data
08:01:32.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:01:32.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:01:32.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:01:32.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:01:32.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:01:32.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:01:32.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:01:32.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:01:32.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:01:32.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:01:32.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:01:32.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:32.681322 32699 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:01:32.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:32.682899 32699 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:01:32.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:32.683574 32699 kserver.cc:163] Server-wide thread pool size limit: 3276
08:01:32.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:32.767930 32699 rpc_server.cc:307] RPC server started. Bound to: 127.31.45.252:43307
08:01:32.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:32.768007   320 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.45.252:43307 every 8 connection(s)
08:01:32.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:32.770812 32699 server_base.cc:1193] Dumped server information to /tmp/dist-test-tasktDuNhD/test-tmp/mini-kudu-cluster15744846690083502881/master-2/data/info.pb
08:01:32.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:32.771963 31927 external_mini_cluster.cc:1434] Started /tmp/dist-test-tasktDuNhD/build/tsan/bin/kudu as pid 32699
08:01:32.773 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
08:01:32.773 [INFO - Time-limited test] (MiniKuduCluster.java:475) Killing tablet server 127.31.45.194:43651
08:01:32.773 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: stop_daemon {
  id {
    type: TSERVER
    index: 1
  }
}

08:01:32.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:32.774499 31927 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasktDuNhD/build/tsan/bin/kudu with pid 32367
08:01:32.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:32.783788   321 sys_catalog.cc:263] Verifying existing consensus state
08:01:32.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:32.789433   321 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 848132dc045348b0a0c92ef5ea20b5b8: Bootstrap starting.
08:01:32.802 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651)] handling channelInactive
08:01:32.802 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651)] cleaning up while in state READY due to: connection closed
08:01:32.803 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
08:01:32.804 [DEBUG - Time-limited test] (Connection.java:748) [peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651)] connecting to peer
08:01:32.806 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651): Connection refused: /127.31.45.194:43651
08:01:32.806 [DEBUG - kudu-nio-4] (Connection.java:709) [peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651)] cleaning up while in state CONNECTING due to: Failed to connect to peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651): Connection refused: /127.31.45.194:43651
08:01:32.806 [INFO - kudu-nio-4] (AsyncKuduClient.java:2355) Invalidating location 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651) for tablet 736c34109533446c835514f293c21af9: Failed to connect to peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651): Connection refused: /127.31.45.194:43651
08:01:32.818 [DEBUG - pool-4-thread-1] (Connection.java:748) [peer master-127.31.45.252:43307(127.31.45.252:43307)] connecting to peer
08:01:32.820 [DEBUG - kudu-nio-5] (Connection.java:757) [peer master-127.31.45.252:43307(127.31.45.252:43307)] Successfully connected to peer
08:01:32.832 [DEBUG - kudu-nio-5] (Negotiator.java:528) SASL mechanism PLAIN chosen for peer 127.31.45.252
08:01:32.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:32.834175   321 log.cc:826] T 00000000000000000000000000000000 P 848132dc045348b0a0c92ef5ea20b5b8: Log is configured to *not* fsync() on all Append() calls
08:01:32.855 [DEBUG - kudu-nio-5] (Negotiator.java:918) Authenticated connection [id: 0xefeaac91, L:/127.0.0.1:59116 - R:/127.31.45.252:43307] using SASL/PLAIN
08:01:32.860 [DEBUG - kudu-nio-5] (RemoteTablet.java:167) master-127.31.45.252:43307 was demoted as the leader for Kudu Master
08:01:32.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:32.867704   321 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 848132dc045348b0a0c92ef5ea20b5b8: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=5 ignored=0} mutations{seen=2 ignored=0} orphaned_commits=0. Pending: 0 replicates
08:01:32.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:32.868835   321 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 848132dc045348b0a0c92ef5ea20b5b8: Bootstrap complete.
08:01:32.882 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.31.45.252:43307: Catalog manager is not initialized. State: Starting
08:01:32.886 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:01:32.886 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableLocations, tablet=Kudu Master, attempt=2, TimeoutTracker(timeout=29987, elapsed=68), Traces: [0ms] sending RPC to server master-127.31.45.252:43307, [43ms] delaying RPC due to: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [43ms] received response from server master-127.31.45.252:43307: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [60ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.45.254:33973, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.45.252:43307, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.45.253:44911, [64ms] Sub RPC ConnectToMaster: received response from server master-127.31.45.252:43307: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [65ms] Sub RPC ConnectToMaster: received response from server master-127.31.45.254:33973: OK, [68ms] Sub RPC ConnectToMaster: received response from server master-127.31.45.253:44911: OK, deferred=Deferred@2058226329(state=PENDING, result=null, callback=get tablet locations from the master for table org.apache.kudu.client.TestClientFailoverSupport-RESTART -> release master lookup permit -> retry RPC, errback=passthrough -> release master lookup permit -> retry RPC after error)) after lookup
08:01:32.892 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 736c34109533446c835514f293c21af9 for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
08:01:32.893 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=736c34109533446c835514f293c21af9@[259f6fe7649f435b899f20f027b2cdb6(127.31.45.195:37139),2949848f49e243ac999493cc0c83ae21(127.31.45.193:42409),5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651)[L]]}]
08:01:32.893 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=736c34109533446c835514f293c21af9, attempt=2, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=89), Traces: [0ms] sending RPC to server 5fe32233c7fa4a55bd8424505aa63261, [3ms] received response from server 5fe32233c7fa4a55bd8424505aa63261: Network error: Failed to connect to peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651): Connection refused: /127.31.45.194:43651, [3ms] delaying RPC due to: Network error: Failed to connect to peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651): Connection refused: /127.31.45.194:43651, [14ms] refreshing cache from master, [14ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.252:43307, [57ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [57ms] Sub RPC GetTableLocations: received response from server master-127.31.45.252:43307: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [74ms] Sub RPC GetTableLocations: refreshing cache from master, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.45.254:33973, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.45.252:43307, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.45.253:44911, [78ms] Sub RPC ConnectToMaster: received response from server master-127.31.45.252:43307: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [79ms] Sub RPC ConnectToMaster: received response from server master-127.31.45.254:33973: OK, [82ms] Sub RPC ConnectToMaster: received response from server master-127.31.45.253:44911: OK, [84ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.253:44911, [89ms] Sub RPC GetTableLocations: received response from server master-127.31.45.253:44911: OK, deferred=Deferred@1268691259(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$230/0x00007fd8d03349f8@1071df83 -> passthrough -> wakeup thread Time-limited test, errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@1a81f5d6 -> wakeup thread Time-limited test)) after lookup
08:01:32.894 [DEBUG - kudu-nio-2] (Connection.java:748) [peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651)] connecting to peer
08:01:32.897 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651): Connection refused: /127.31.45.194:43651
08:01:32.897 [DEBUG - kudu-nio-6] (Connection.java:709) [peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651)] cleaning up while in state CONNECTING due to: Failed to connect to peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651): Connection refused: /127.31.45.194:43651
08:01:32.897 [INFO - kudu-nio-6] (AsyncKuduClient.java:2355) Invalidating location 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651) for tablet 736c34109533446c835514f293c21af9: Failed to connect to peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651): Connection refused: /127.31.45.194:43651
08:01:32.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:32.895885   321 raft_consensus.cc:359] T 00000000000000000000000000000000 P 848132dc045348b0a0c92ef5ea20b5b8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef18df293cb04df6bf01c1ea6a46276a" member_type: VOTER last_known_addr { host: "127.31.45.254" port: 33973 } } peers { permanent_uuid: "f3092cb366824c8f881fcffd79b1e9e0" member_type: VOTER last_known_addr { host: "127.31.45.253" port: 44911 } } peers { permanent_uuid: "848132dc045348b0a0c92ef5ea20b5b8" member_type: VOTER last_known_addr { host: "127.31.45.252" port: 43307 } }
08:01:32.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:32.898838   321 raft_consensus.cc:740] T 00000000000000000000000000000000 P 848132dc045348b0a0c92ef5ea20b5b8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 848132dc045348b0a0c92ef5ea20b5b8, State: Initialized, Role: FOLLOWER
08:01:32.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:32.899659   321 consensus_queue.cc:260] T 00000000000000000000000000000000 P 848132dc045348b0a0c92ef5ea20b5b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef18df293cb04df6bf01c1ea6a46276a" member_type: VOTER last_known_addr { host: "127.31.45.254" port: 33973 } } peers { permanent_uuid: "f3092cb366824c8f881fcffd79b1e9e0" member_type: VOTER last_known_addr { host: "127.31.45.253" port: 44911 } } peers { permanent_uuid: "848132dc045348b0a0c92ef5ea20b5b8" member_type: VOTER last_known_addr { host: "127.31.45.252" port: 43307 } }
08:01:32.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:32.902532   328 sys_catalog.cc:455] T 00000000000000000000000000000000 P 848132dc045348b0a0c92ef5ea20b5b8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef18df293cb04df6bf01c1ea6a46276a" member_type: VOTER last_known_addr { host: "127.31.45.254" port: 33973 } } peers { permanent_uuid: "f3092cb366824c8f881fcffd79b1e9e0" member_type: VOTER last_known_addr { host: "127.31.45.253" port: 44911 } } peers { permanent_uuid: "848132dc045348b0a0c92ef5ea20b5b8" member_type: VOTER last_known_addr { host: "127.31.45.252" port: 43307 } } }
08:01:32.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:32.903330   328 sys_catalog.cc:458] T 00000000000000000000000000000000 P 848132dc045348b0a0c92ef5ea20b5b8 [sys.catalog]: This master's current role is: FOLLOWER
08:01:32.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:32.904207   321 sys_catalog.cc:565] T 00000000000000000000000000000000 P 848132dc045348b0a0c92ef5ea20b5b8 [sys.catalog]: configured and running, proceeding with master startup.
08:01:32.922 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 736c34109533446c835514f293c21af9 for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
08:01:32.922 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=736c34109533446c835514f293c21af9@[259f6fe7649f435b899f20f027b2cdb6(127.31.45.195:37139),2949848f49e243ac999493cc0c83ae21(127.31.45.193:42409),5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651)[L]]}]
08:01:32.924 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=736c34109533446c835514f293c21af9, attempt=4, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=120), Traces: [0ms] sending RPC to server 5fe32233c7fa4a55bd8424505aa63261, [3ms] received response from server 5fe32233c7fa4a55bd8424505aa63261: Network error: Failed to connect to peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651): Connection refused: /127.31.45.194:43651, [3ms] delaying RPC due to: Network error: Failed to connect to peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651): Connection refused: /127.31.45.194:43651, [14ms] refreshing cache from master, [14ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.252:43307, [57ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [57ms] Sub RPC GetTableLocations: received response from server master-127.31.45.252:43307: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [74ms] Sub RPC GetTableLocations: refreshing cache from master, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.45.254:33973, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.45.252:43307, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.45.253:44911, [78ms] Sub RPC ConnectToMaster: received response from server master-127.31.45.252:43307: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [79ms] Sub RPC ConnectToMaster: received response from server master-127.31.45.254:33973: OK, [82ms] Sub RPC ConnectToMaster: received response from server master-127.31.45.253:44911: OK, [84ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.253:44911, [89ms] Sub RPC GetTableLocations: received response from server master-127.31.45.253:44911: OK, [91ms] sending RPC to server 5fe32233c7fa4a55bd8424505aa63261, [94ms] received response from server 5fe32233c7fa4a55bd8424505aa63261: Network error: Failed to connect to peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651): Connection refused: /127.31.45.194:43651, [94ms] delaying RPC due to: Network error: Failed to connect to peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651): Connection refused: /127.31.45.194:43651, [114ms] refreshing cache from master, [114ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.253:44911, [118ms] Sub RPC GetTableLocations: received response from server master-127.31.45.253:44911: OK, deferred=Deferred@1268691259(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$230/0x00007fd8d03349f8@1071df83 -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@2058226329 after retry RPC@516885486), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@1a81f5d6 -> wakeup thread Time-limited test -> (continuation of Deferred@2058226329 after retry RPC@516885486))) after lookup
08:01:32.925 [DEBUG - kudu-nio-2] (Connection.java:748) [peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651)] connecting to peer
08:01:32.927 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651): Connection refused: /127.31.45.194:43651
08:01:32.927 [DEBUG - kudu-nio-7] (Connection.java:709) [peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651)] cleaning up while in state CONNECTING due to: Failed to connect to peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651): Connection refused: /127.31.45.194:43651
08:01:32.928 [INFO - kudu-nio-7] (AsyncKuduClient.java:2355) Invalidating location 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651) for tablet 736c34109533446c835514f293c21af9: Failed to connect to peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651): Connection refused: /127.31.45.194:43651
08:01:32.943 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 736c34109533446c835514f293c21af9 for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
08:01:32.943 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=736c34109533446c835514f293c21af9@[259f6fe7649f435b899f20f027b2cdb6(127.31.45.195:37139),2949848f49e243ac999493cc0c83ae21(127.31.45.193:42409),5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651)[L]]}]
08:01:32.944 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=736c34109533446c835514f293c21af9, attempt=6, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=140), Traces: [0ms] sending RPC to server 5fe32233c7fa4a55bd8424505aa63261, [3ms] received response from server 5fe32233c7fa4a55bd8424505aa63261: Network error: Failed to connect to peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651): Connection refused: /127.31.45.194:43651, [3ms] delaying RPC due to: Network error: Failed to connect to peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651): Connection refused: /127.31.45.194:43651, [14ms] refreshing cache from master, [14ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.252:43307, [57ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [57ms] Sub RPC GetTableLocations: received response from server master-127.31.45.252:43307: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [74ms] Sub RPC GetTableLocations: refreshing cache from master, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.45.254:33973, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.45.252:43307, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.45.253:44911, [78ms] Sub RPC ConnectToMaster: received response from server master-127.31.45.252:43307: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [79ms] Sub RPC ConnectToMaster: received response from server master-127.31.45.254:33973: OK, [82ms] Sub RPC ConnectToMaster: received response from server master-127.31.45.253:44911: OK, [84ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.253:44911, [89ms] Sub RPC GetTableLocations: received response from server master-127.31.45.253:44911: OK, [91ms] sending RPC to server 5fe32233c7fa4a55bd8424505aa63261, [94ms] received response from server 5fe32233c7fa4a55bd8424505aa63261: Network error: Failed to connect to peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651): Connection refused: /127.31.45.194:43651, [94ms] delaying RPC due to: Network error: Failed to connect to peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651): Connection refused: /127.31.45.194:43651, [114ms] refreshing cache from master, [114ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.253:44911, [118ms] Sub RPC GetTableLocations: received response from server master-127.31.45.253:44911: OK, [121ms] sending RPC to server 5fe32233c7fa4a55bd8424505aa63261, [124ms] received response from server 5fe32233c7fa4a55bd8424505aa63261: Network error: Failed to connect to peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651): Connection refused: /127.31.45.194:43651, [125ms] delaying RPC due to: Network error: Failed to connect to peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651): Connection refused: /127.31.45.194:43651, [135ms] refreshing cache from master, [135ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.253:44911, [140ms] Sub RPC GetTableLocations: received response from server master-127.31.45.253:44911: OK, deferred=Deferred@1268691259(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$230/0x00007fd8d03349f8@1071df83 -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@2058226329 after retry RPC@516885486) -> (continuation of Deferred@770285730 after retry RPC@507544977), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@1a81f5d6 -> wakeup thread Time-limited test -> (continuation of Deferred@2058226329 after retry RPC@516885486) -> (continuation of Deferred@770285730 after retry RPC@507544977))) after lookup
08:01:32.946 [DEBUG - kudu-nio-2] (Connection.java:748) [peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651)] connecting to peer
08:01:32.949 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651): Connection refused: /127.31.45.194:43651
08:01:32.949 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651)] cleaning up while in state CONNECTING due to: Failed to connect to peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651): Connection refused: /127.31.45.194:43651
08:01:32.950 [INFO - kudu-nio-0] (AsyncKuduClient.java:2355) Invalidating location 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651) for tablet 736c34109533446c835514f293c21af9: Failed to connect to peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651): Connection refused: /127.31.45.194:43651
08:01:32.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:32.953471   340 catalog_manager.cc:1295] Loaded cluster ID: c7af2609f986426c9115f07b7ee9755c
08:01:32.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:32.953744   340 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 848132dc045348b0a0c92ef5ea20b5b8: loading cluster ID for follower catalog manager: success
08:01:32.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:32.960013   340 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 848132dc045348b0a0c92ef5ea20b5b8: acquiring CA information for follower catalog manager: success
08:01:32.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:32.965301   340 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 848132dc045348b0a0c92ef5ea20b5b8: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
08:01:33.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:33.049304 32643 heartbeater.cc:499] Master 127.31.45.253:44911 was elected leader, sending a full tablet report...
08:01:33.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:33.058009 32362 heartbeater.cc:499] Master 127.31.45.253:44911 was elected leader, sending a full tablet report...
08:01:33.081 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 736c34109533446c835514f293c21af9 for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
08:01:33.082 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=736c34109533446c835514f293c21af9@[259f6fe7649f435b899f20f027b2cdb6(127.31.45.195:37139),2949848f49e243ac999493cc0c83ae21(127.31.45.193:42409),5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651)[L]]}]
08:01:33.082 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=736c34109533446c835514f293c21af9, attempt=8, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=278), Traces: [0ms] sending RPC to server 5fe32233c7fa4a55bd8424505aa63261, [3ms] received response from server 5fe32233c7fa4a55bd8424505aa63261: Network error: Failed to connect to peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651): Connection refused: /127.31.45.194:43651, [3ms] delaying RPC due to: Network error: Failed to connect to peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651): Connection refused: /127.31.45.194:43651, [14ms] refreshing cache from master, [14ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.252:43307, [57ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [57ms] Sub RPC GetTableLocations: received response from server master-127.31.45.252:43307: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [74ms] Sub RPC GetTableLocations: refreshing cache from master, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.45.254:33973, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.45.252:43307, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.45.253:44911, [78ms] Sub RPC ConnectToMaster: received response from server master-127.31.45.252:43307: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [79ms] Sub RPC ConnectToMaster: received response from server master-127.31.45.254:33973: OK, [82ms] Sub RPC ConnectToMaster: received response from server master-127.31.45.253:44911: OK, [84ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.253:44911, [89ms] Sub RPC GetTableLocations: received response from server master-127.31.45.253:44911: OK, [91ms] sending RPC to server 5fe32233c7fa4a55bd8424505aa63261, [94ms] received response from server 5fe32233c7fa4a55bd8424505aa63261: Network error: Failed to connect to peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651): Connection refused: /127.31.45.194:43651, [94ms] delaying RPC due to: Network error: Failed to connect to peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651): Connection refused: /127.31.45.194:43651, [114ms] refreshing cache from master, [114ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.253:44911, [118ms] Sub RPC GetTableLocations: received response from server master-127.31.45.253:44911: OK, [121ms] sending RPC to server 5fe32233c7fa4a55bd8424505aa63261, [124ms] received response from server 5fe32233c7fa4a55bd8424505aa63261: Network error: Failed to connect to peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651): Connection refused: /127.31.45.194:43651, [125ms] delaying RPC due to: Network error: Failed to connect to peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651): Connection refused: /127.31.45.194:43651, [135ms] refreshing cache from master, [135ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.253:44911, [140ms] Sub RPC GetTableLocations: received response from server master-127.31.45.253:44911: OK, [143ms] sending RPC to server 5fe32233c7fa4a55bd8424505aa63261, [146ms] received response from server 5fe32233c7fa4a55bd8424505aa63261: Network error: Failed to connect to peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651): Connection refused: /127.31.45.194:43651, [147ms] delaying RPC due to: Network error: Failed to connect to peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651): Connection refused: /127.31.45.194:43651, [274ms] refreshing cache from master, [274ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.253:44911, [278ms] Sub RPC GetTableLocations: received response from server master-127.31.45.253:44911: OK, deferred=Deferred@1268691259(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$230/0x00007fd8d03349f8@1071df83 -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@2058226329 after retry RPC@516885486) -> (continuation of Deferred@770285730 after retry RPC@507544977) -> (continuation of Deferred@1981124094 after retry RPC@1826874016), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@1a81f5d6 -> wakeup thread Time-limited test -> (continuation of Deferred@2058226329 after retry RPC@516885486) -> (continuation of Deferred@770285730 after retry RPC@507544977) -> (continuation of Deferred@1981124094 after retry RPC@1826874016))) after lookup
08:01:33.083 [DEBUG - kudu-nio-2] (Connection.java:748) [peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651)] connecting to peer
08:01:33.089 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651): Connection refused: /127.31.45.194:43651
08:01:33.089 [DEBUG - kudu-nio-1] (Connection.java:709) [peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651)] cleaning up while in state CONNECTING due to: Failed to connect to peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651): Connection refused: /127.31.45.194:43651
08:01:33.089 [INFO - kudu-nio-1] (AsyncKuduClient.java:2355) Invalidating location 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651) for tablet 736c34109533446c835514f293c21af9: Failed to connect to peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651): Connection refused: /127.31.45.194:43651
08:01:33.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:33.108559 32642 heartbeater.cc:344] Connected to a master server at 127.31.45.252:43307
08:01:33.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:33.115228 32754 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "259f6fe7649f435b899f20f027b2cdb6" instance_seqno: 1783497689285673) as {username='slave'} at 127.31.45.195:38729; Asking this server to re-register.
08:01:33.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:33.116878 32642 heartbeater.cc:461] Registering TS with master...
08:01:33.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:33.120803 32361 heartbeater.cc:344] Connected to a master server at 127.31.45.252:43307
08:01:33.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:33.120992 32754 ts_manager.cc:194] Registered new tserver with Master: 259f6fe7649f435b899f20f027b2cdb6 (127.31.45.195:37139)
08:01:33.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:33.124089 32754 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "2949848f49e243ac999493cc0c83ae21" instance_seqno: 1783497685317544) as {username='slave'} at 127.31.45.193:37359; Asking this server to re-register.
08:01:33.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:33.125520 32361 heartbeater.cc:461] Registering TS with master...
08:01:33.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:33.127949 32754 ts_manager.cc:194] Registered new tserver with Master: 2949848f49e243ac999493cc0c83ae21 (127.31.45.193:42409)
08:01:33.141 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 736c34109533446c835514f293c21af9 for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
08:01:33.141 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=736c34109533446c835514f293c21af9@[259f6fe7649f435b899f20f027b2cdb6(127.31.45.195:37139),2949848f49e243ac999493cc0c83ae21(127.31.45.193:42409),5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651)[L]]}]
08:01:33.142 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=736c34109533446c835514f293c21af9, attempt=10, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=338), Traces: [0ms] sending RPC to server 5fe32233c7fa4a55bd8424505aa63261, [3ms] received response from server 5fe32233c7fa4a55bd8424505aa63261: Network error: Failed to connect to peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651): Connection refused: /127.31.45.194:43651, [3ms] delaying RPC due to: Network error: Failed to connect to peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651): Connection refused: /127.31.45.194:43651, [14ms] refreshing cache from master, [14ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.252:43307, [57ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [57ms] Sub RPC GetTableLocations: received response from server master-127.31.45.252:43307: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [74ms] Sub RPC GetTableLocations: refreshing cache from master, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.45.254:33973, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.45.252:43307, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.45.253:44911, [78ms] Sub RPC ConnectToMaster: received response from server master-127.31.45.252:43307: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [79ms] Sub RPC ConnectToMaster: received response from server master-127.31.45.254:33973: OK, [82ms] Sub RPC ConnectToMaster: received response from server master-127.31.45.253:44911: OK, [84ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.253:44911, [89ms] Sub RPC GetTableLocations: received response from server master-127.31.45.253:44911: OK, [91ms] sending RPC to server 5fe32233c7fa4a55bd8424505aa63261, [94ms] received response from server 5fe32233c7fa4a55bd8424505aa63261: Network error: Failed to connect to peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651): Connection refused: /127.31.45.194:43651, [94ms] delaying RPC due to: Network error: Failed to connect to peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651): Connection refused: /127.31.45.194:43651, [114ms] refreshing cache from master, [114ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.253:44911, [118ms] Sub RPC GetTableLocations: received response from server master-127.31.45.253:44911: OK, [121ms] sending RPC to server 5fe32233c7fa4a55bd8424505aa63261, [124ms] received response from server 5fe32233c7fa4a55bd8424505aa63261: Network error: Failed to connect to peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651): Connection refused: /127.31.45.194:43651, [125ms] delaying RPC due to: Network error: Failed to connect to peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651): Connection refused: /127.31.45.194:43651, [135ms] refreshing cache from master, [135ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.253:44911, [140ms] Sub RPC GetTableLocations: received response from server master-127.31.45.253:44911: OK, [143ms] sending RPC to server 5fe32233c7fa4a55bd8424505aa63261, [146ms] received response from server 5fe32233c7fa4a55bd8424505aa63261: Network error: Failed to connect to peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651): Connection refused: /127.31.45.194:43651, [147ms] delaying RPC due to: Network error: Failed to connect to peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651): Connection refused: /127.31.45.194:43651, [274ms] refreshing cache from master, [274ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.253:44911, [278ms] Sub RPC GetTableLocations: received response from server master-127.31.45.253:44911: OK, [280ms] sending RPC to server 5fe32233c7fa4a55bd8424505aa63261, [286ms] received response from server 5fe32233c7fa4a55bd8424505aa63261: Network error: Failed to connect to peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651): Connection refused: /127.31.45.194:43651, [286ms] delaying RPC due to: Network error: Failed to connect to peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651): Connection refused: /127.31.45.194:43651, [334ms] refreshing cache from master, [334ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.253:44911, [337ms] Sub RPC GetTableLocations: received response from server master-127.31.45.253:44911: OK, deferred=Deferred@1268691259(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$230/0x00007fd8d03349f8@1071df83 -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@2058226329 after retry RPC@516885486) -> (continuation of Deferred@770285730 after retry RPC@507544977) -> (continuation of Deferred@1981124094 after retry RPC@1826874016) -> (continuation of Deferred@1618210461 after retry RPC@326563537), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@1a81f5d6 -> wakeup thread Time-limited test -> (continuation of Deferred@2058226329 after retry RPC@516885486) -> (continuation of Deferred@770285730 after retry RPC@507544977) -> (continuation of Deferred@1981124094 after retry RPC@1826874016) -> (continuation of Deferred@1618210461 after retry RPC@326563537))) after lookup
08:01:33.143 [DEBUG - kudu-nio-2] (Connection.java:748) [peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651)] connecting to peer
08:01:33.144 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651): Connection refused: /127.31.45.194:43651
08:01:33.144 [DEBUG - kudu-nio-2] (Connection.java:709) [peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651)] cleaning up while in state CONNECTING due to: Failed to connect to peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651): Connection refused: /127.31.45.194:43651
08:01:33.144 [INFO - kudu-nio-2] (AsyncKuduClient.java:2355) Invalidating location 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651) for tablet 736c34109533446c835514f293c21af9: Failed to connect to peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651): Connection refused: /127.31.45.194:43651
08:01:33.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:33.224606 32764 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 848132dc045348b0a0c92ef5ea20b5b8 [term 1 FOLLOWER]: Advancing to term 2
08:01:33.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:33.243919   352 sys_catalog.cc:455] T 00000000000000000000000000000000 P 848132dc045348b0a0c92ef5ea20b5b8 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "f3092cb366824c8f881fcffd79b1e9e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef18df293cb04df6bf01c1ea6a46276a" member_type: VOTER last_known_addr { host: "127.31.45.254" port: 33973 } } peers { permanent_uuid: "f3092cb366824c8f881fcffd79b1e9e0" member_type: VOTER last_known_addr { host: "127.31.45.253" port: 44911 } } peers { permanent_uuid: "848132dc045348b0a0c92ef5ea20b5b8" member_type: VOTER last_known_addr { host: "127.31.45.252" port: 43307 } } }
08:01:33.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:33.244952   352 sys_catalog.cc:458] T 00000000000000000000000000000000 P 848132dc045348b0a0c92ef5ea20b5b8 [sys.catalog]: This master's current role is: FOLLOWER
08:01:33.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:33.247992   328 sys_catalog.cc:455] T 00000000000000000000000000000000 P 848132dc045348b0a0c92ef5ea20b5b8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f3092cb366824c8f881fcffd79b1e9e0. Latest consensus state: current_term: 2 leader_uuid: "f3092cb366824c8f881fcffd79b1e9e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef18df293cb04df6bf01c1ea6a46276a" member_type: VOTER last_known_addr { host: "127.31.45.254" port: 33973 } } peers { permanent_uuid: "f3092cb366824c8f881fcffd79b1e9e0" member_type: VOTER last_known_addr { host: "127.31.45.253" port: 44911 } } peers { permanent_uuid: "848132dc045348b0a0c92ef5ea20b5b8" member_type: VOTER last_known_addr { host: "127.31.45.252" port: 43307 } } }
08:01:33.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:33.248485   328 sys_catalog.cc:458] T 00000000000000000000000000000000 P 848132dc045348b0a0c92ef5ea20b5b8 [sys.catalog]: This master's current role is: FOLLOWER
08:01:33.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:33.826881 32719 sys_catalog.cc:455] T 00000000000000000000000000000000 P f3092cb366824c8f881fcffd79b1e9e0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "f3092cb366824c8f881fcffd79b1e9e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef18df293cb04df6bf01c1ea6a46276a" member_type: VOTER last_known_addr { host: "127.31.45.254" port: 33973 } } peers { permanent_uuid: "f3092cb366824c8f881fcffd79b1e9e0" member_type: VOTER last_known_addr { host: "127.31.45.253" port: 44911 } } peers { permanent_uuid: "848132dc045348b0a0c92ef5ea20b5b8" member_type: VOTER last_known_addr { host: "127.31.45.252" port: 43307 } } }
08:01:33.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:33.827705 32719 sys_catalog.cc:458] T 00000000000000000000000000000000 P f3092cb366824c8f881fcffd79b1e9e0 [sys.catalog]: This master's current role is: LEADER
08:01:34.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:34.047336   356 raft_consensus.cc:493] T 736c34109533446c835514f293c21af9 P 2949848f49e243ac999493cc0c83ae21 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5fe32233c7fa4a55bd8424505aa63261)
08:01:34.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:34.047948   356 raft_consensus.cc:515] T 736c34109533446c835514f293c21af9 P 2949848f49e243ac999493cc0c83ae21 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fe32233c7fa4a55bd8424505aa63261" member_type: VOTER last_known_addr { host: "127.31.45.194" port: 43651 } } peers { permanent_uuid: "2949848f49e243ac999493cc0c83ae21" member_type: VOTER last_known_addr { host: "127.31.45.193" port: 42409 } } peers { permanent_uuid: "259f6fe7649f435b899f20f027b2cdb6" member_type: VOTER last_known_addr { host: "127.31.45.195" port: 37139 } }
08:01:34.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:34.050850   356 leader_election.cc:290] T 736c34109533446c835514f293c21af9 P 2949848f49e243ac999493cc0c83ae21 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5fe32233c7fa4a55bd8424505aa63261 (127.31.45.194:43651), 259f6fe7649f435b899f20f027b2cdb6 (127.31.45.195:37139)
08:01:34.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:34.058745 32251 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.31.45.194:43651: connect: Connection refused (error 111)
08:01:34.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:34.066804 32251 leader_election.cc:336] T 736c34109533446c835514f293c21af9 P 2949848f49e243ac999493cc0c83ae21 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5fe32233c7fa4a55bd8424505aa63261 (127.31.45.194:43651): Network error: Client connection negotiation failed: client connection to 127.31.45.194:43651: connect: Connection refused (error 111)
08:01:34.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:34.071372 32597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736c34109533446c835514f293c21af9" candidate_uuid: "2949848f49e243ac999493cc0c83ae21" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "259f6fe7649f435b899f20f027b2cdb6" is_pre_election: true
08:01:34.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:34.072786 32251 leader_election.cc:304] T 736c34109533446c835514f293c21af9 P 2949848f49e243ac999493cc0c83ae21 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2949848f49e243ac999493cc0c83ae21; no voters: 259f6fe7649f435b899f20f027b2cdb6, 5fe32233c7fa4a55bd8424505aa63261
08:01:34.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:34.073515   356 raft_consensus.cc:2749] T 736c34109533446c835514f293c21af9 P 2949848f49e243ac999493cc0c83ae21 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
08:01:34.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:34.259676   361 raft_consensus.cc:493] T 736c34109533446c835514f293c21af9 P 259f6fe7649f435b899f20f027b2cdb6 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5fe32233c7fa4a55bd8424505aa63261)
08:01:34.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:34.260090   361 raft_consensus.cc:515] T 736c34109533446c835514f293c21af9 P 259f6fe7649f435b899f20f027b2cdb6 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fe32233c7fa4a55bd8424505aa63261" member_type: VOTER last_known_addr { host: "127.31.45.194" port: 43651 } } peers { permanent_uuid: "2949848f49e243ac999493cc0c83ae21" member_type: VOTER last_known_addr { host: "127.31.45.193" port: 42409 } } peers { permanent_uuid: "259f6fe7649f435b899f20f027b2cdb6" member_type: VOTER last_known_addr { host: "127.31.45.195" port: 37139 } }
08:01:34.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:34.262557   361 leader_election.cc:290] T 736c34109533446c835514f293c21af9 P 259f6fe7649f435b899f20f027b2cdb6 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5fe32233c7fa4a55bd8424505aa63261 (127.31.45.194:43651), 2949848f49e243ac999493cc0c83ae21 (127.31.45.193:42409)
08:01:34.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:34.266659 32532 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.31.45.194:43651: connect: Connection refused (error 111)
08:01:34.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:34.271009 32532 leader_election.cc:336] T 736c34109533446c835514f293c21af9 P 259f6fe7649f435b899f20f027b2cdb6 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5fe32233c7fa4a55bd8424505aa63261 (127.31.45.194:43651): Network error: Client connection negotiation failed: client connection to 127.31.45.194:43651: connect: Connection refused (error 111)
08:01:34.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:34.277179 32315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736c34109533446c835514f293c21af9" candidate_uuid: "259f6fe7649f435b899f20f027b2cdb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "2949848f49e243ac999493cc0c83ae21" is_pre_election: true
08:01:34.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:34.277922 32315 raft_consensus.cc:2468] T 736c34109533446c835514f293c21af9 P 2949848f49e243ac999493cc0c83ae21 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 259f6fe7649f435b899f20f027b2cdb6 in term 1.
08:01:34.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:34.279266 32530 leader_election.cc:304] T 736c34109533446c835514f293c21af9 P 259f6fe7649f435b899f20f027b2cdb6 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 259f6fe7649f435b899f20f027b2cdb6, 2949848f49e243ac999493cc0c83ae21; no voters: 5fe32233c7fa4a55bd8424505aa63261
08:01:34.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:34.280049   361 raft_consensus.cc:2804] T 736c34109533446c835514f293c21af9 P 259f6fe7649f435b899f20f027b2cdb6 [term 1 FOLLOWER]: Leader pre-election won for term 2
08:01:34.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:34.280370   361 raft_consensus.cc:493] T 736c34109533446c835514f293c21af9 P 259f6fe7649f435b899f20f027b2cdb6 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5fe32233c7fa4a55bd8424505aa63261)
08:01:34.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:34.280694   361 raft_consensus.cc:3060] T 736c34109533446c835514f293c21af9 P 259f6fe7649f435b899f20f027b2cdb6 [term 1 FOLLOWER]: Advancing to term 2
08:01:34.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:34.287384   361 raft_consensus.cc:515] T 736c34109533446c835514f293c21af9 P 259f6fe7649f435b899f20f027b2cdb6 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fe32233c7fa4a55bd8424505aa63261" member_type: VOTER last_known_addr { host: "127.31.45.194" port: 43651 } } peers { permanent_uuid: "2949848f49e243ac999493cc0c83ae21" member_type: VOTER last_known_addr { host: "127.31.45.193" port: 42409 } } peers { permanent_uuid: "259f6fe7649f435b899f20f027b2cdb6" member_type: VOTER last_known_addr { host: "127.31.45.195" port: 37139 } }
08:01:34.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:34.289364   361 leader_election.cc:290] T 736c34109533446c835514f293c21af9 P 259f6fe7649f435b899f20f027b2cdb6 [CANDIDATE]: Term 2 election: Requested vote from peers 5fe32233c7fa4a55bd8424505aa63261 (127.31.45.194:43651), 2949848f49e243ac999493cc0c83ae21 (127.31.45.193:42409)
08:01:34.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:34.290521 32315 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "736c34109533446c835514f293c21af9" candidate_uuid: "259f6fe7649f435b899f20f027b2cdb6" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "2949848f49e243ac999493cc0c83ae21"
08:01:34.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:34.291109 32315 raft_consensus.cc:3060] T 736c34109533446c835514f293c21af9 P 2949848f49e243ac999493cc0c83ae21 [term 1 FOLLOWER]: Advancing to term 2
08:01:34.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:34.292768 32532 leader_election.cc:336] T 736c34109533446c835514f293c21af9 P 259f6fe7649f435b899f20f027b2cdb6 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5fe32233c7fa4a55bd8424505aa63261 (127.31.45.194:43651): Network error: Client connection negotiation failed: client connection to 127.31.45.194:43651: connect: Connection refused (error 111)
08:01:34.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:34.297900 32315 raft_consensus.cc:2468] T 736c34109533446c835514f293c21af9 P 2949848f49e243ac999493cc0c83ae21 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 259f6fe7649f435b899f20f027b2cdb6 in term 2.
08:01:34.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:34.299031 32530 leader_election.cc:304] T 736c34109533446c835514f293c21af9 P 259f6fe7649f435b899f20f027b2cdb6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 259f6fe7649f435b899f20f027b2cdb6, 2949848f49e243ac999493cc0c83ae21; no voters: 5fe32233c7fa4a55bd8424505aa63261
08:01:34.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:34.299795   361 raft_consensus.cc:2804] T 736c34109533446c835514f293c21af9 P 259f6fe7649f435b899f20f027b2cdb6 [term 2 FOLLOWER]: Leader election won for term 2
08:01:34.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:34.301512   361 raft_consensus.cc:697] T 736c34109533446c835514f293c21af9 P 259f6fe7649f435b899f20f027b2cdb6 [term 2 LEADER]: Becoming Leader. State: Replica: 259f6fe7649f435b899f20f027b2cdb6, State: Running, Role: LEADER
08:01:34.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:34.302268   361 consensus_queue.cc:237] T 736c34109533446c835514f293c21af9 P 259f6fe7649f435b899f20f027b2cdb6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 1.11, Last appended by leader: 11, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fe32233c7fa4a55bd8424505aa63261" member_type: VOTER last_known_addr { host: "127.31.45.194" port: 43651 } } peers { permanent_uuid: "2949848f49e243ac999493cc0c83ae21" member_type: VOTER last_known_addr { host: "127.31.45.193" port: 42409 } } peers { permanent_uuid: "259f6fe7649f435b899f20f027b2cdb6" member_type: VOTER last_known_addr { host: "127.31.45.195" port: 37139 } }
08:01:34.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:34.312461 32047 catalog_manager.cc:5697] T 736c34109533446c835514f293c21af9 P 259f6fe7649f435b899f20f027b2cdb6 reported cstate change: term changed from 1 to 2, leader changed from 5fe32233c7fa4a55bd8424505aa63261 (127.31.45.194) to 259f6fe7649f435b899f20f027b2cdb6 (127.31.45.195). New cstate: current_term: 2 leader_uuid: "259f6fe7649f435b899f20f027b2cdb6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5fe32233c7fa4a55bd8424505aa63261" member_type: VOTER last_known_addr { host: "127.31.45.194" port: 43651 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2949848f49e243ac999493cc0c83ae21" member_type: VOTER last_known_addr { host: "127.31.45.193" port: 42409 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "259f6fe7649f435b899f20f027b2cdb6" member_type: VOTER last_known_addr { host: "127.31.45.195" port: 37139 } health_report { overall_health: HEALTHY } } }
08:01:34.681 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 736c34109533446c835514f293c21af9 for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
08:01:34.681 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=736c34109533446c835514f293c21af9@[259f6fe7649f435b899f20f027b2cdb6(127.31.45.195:37139)[L],2949848f49e243ac999493cc0c83ae21(127.31.45.193:42409),5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651)]}]
08:01:34.682 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=736c34109533446c835514f293c21af9, attempt=12, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=1878), Traces: [0ms] sending RPC to server 5fe32233c7fa4a55bd8424505aa63261, [3ms] received response from server 5fe32233c7fa4a55bd8424505aa63261: Network error: Failed to connect to peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651): Connection refused: /127.31.45.194:43651, [3ms] delaying RPC due to: Network error: Failed to connect to peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651): Connection refused: /127.31.45.194:43651, [14ms] refreshing cache from master, [14ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.252:43307, [57ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [57ms] Sub RPC GetTableLocations: received response from server master-127.31.45.252:43307: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [74ms] Sub RPC GetTableLocations: refreshing cache from master, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.45.254:33973, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.45.252:43307, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.45.253:44911, [78ms] Sub RPC ConnectToMaster: received response from server master-127.31.45.252:43307: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [79ms] Sub RPC ConnectToMaster: received response from server master-127.31.45.254:33973: OK, [82ms] Sub RPC ConnectToMaster: received response from server master-127.31.45.253:44911: OK, [84ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.253:44911, [89ms] Sub RPC GetTableLocations: received response from server master-127.31.45.253:44911: OK, [91ms] sending RPC to server 5fe32233c7fa4a55bd8424505aa63261, [94ms] received response from server 5fe32233c7fa4a55bd8424505aa63261: Network error: Failed to connect to peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651): Connection refused: /127.31.45.194:43651, [94ms] delaying RPC due to: Network error: Failed to connect to peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651): Connection refused: /127.31.45.194:43651, [114ms] refreshing cache from master, [114ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.253:44911, [118ms] Sub RPC GetTableLocations: received response from server master-127.31.45.253:44911: OK, [121ms] sending RPC to server 5fe32233c7fa4a55bd8424505aa63261, [124ms] received response from server 5fe32233c7fa4a55bd8424505aa63261: Network error: Failed to connect to peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651): Connection refused: /127.31.45.194:43651, [125ms] delaying RPC due to: Network error: Failed to connect to peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651): Connection refused: /127.31.45.194:43651, [135ms] refreshing cache from master, [135ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.253:44911, [140ms] Sub RPC GetTableLocations: received response from server master-127.31.45.253:44911: OK, [143ms] sending RPC to server 5fe32233c7fa4a55bd8424505aa63261, [146ms] received response from server 5fe32233c7fa4a55bd8424505aa63261: Network error: Failed to connect to peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651): Connection refused: /127.31.45.194:43651, [147ms] delaying RPC due to: Network error: Failed to connect to peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651): Connection refused: /127.31.45.194:43651, [274ms] refreshing cache from master, [274ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.253:44911, [278ms] Sub RPC GetTableLocations: received response from server master-127.31.45.253:44911: OK, [280ms] sending RPC to server 5fe32233c7fa4a55bd8424505aa63261, [286ms] received response from server 5fe32233c7fa4a55bd8424505aa63261: Network error: Failed to connect to peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651): Connection refused: /127.31.45.194:43651, [286ms] delaying RPC due to: Network error: Failed to connect to peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651): Connection refused: /127.31.45.194:43651, [334ms] refreshing cache from master, [334ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.253:44911, [337ms] Sub RPC GetTableLocations: received response from server master-127.31.45.253:44911: OK, [340ms] sending RPC to server 5fe32233c7fa4a55bd8424505aa63261, [341ms] received response from server 5fe32233c7fa4a55bd8424505aa63261: Network error: Failed to connect to peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651): Connection refused: /127.31.45.194:43651, [342ms] delaying RPC due to: Network error: Failed to connect to peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651): Connection refused: /127.31.45.194:43651, [1874ms] refreshing cache from master, [1874ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.45.253:44911, [1878ms] Sub RPC GetTableLocations: received response from server master-127.31.45.253:44911: OK, deferred=Deferred@1268691259(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$230/0x00007fd8d03349f8@1071df83 -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@2058226329 after retry RPC@516885486) -> (continuation of Deferred@770285730 after retry RPC@507544977) -> (continuation of Deferred@1981124094 after retry RPC@1826874016) -> (continuation of Deferred@1618210461 after retry RPC@326563537) -> (continuation of Deferred@894141980 after retry RPC@1405404445), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@1a81f5d6 -> wakeup thread Time-limited test -> (continuation of Deferred@2058226329 after retry RPC@516885486) -> (continuation of Deferred@770285730 after retry RPC@507544977) -> (continuation of Deferred@1981124094 after retry RPC@1826874016) -> (continuation of Deferred@1618210461 after retry RPC@326563537) -> (continuation of Deferred@894141980 after retry RPC@1405404445))) after lookup
08:01:34.683 [DEBUG - kudu-nio-2] (Connection.java:748) [peer 259f6fe7649f435b899f20f027b2cdb6(127.31.45.195:37139)] connecting to peer
08:01:34.684 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 259f6fe7649f435b899f20f027b2cdb6(127.31.45.195:37139)] Successfully connected to peer
08:01:34.709 [DEBUG - kudu-nio-3] (Negotiator.java:918) Authenticated connection [id: 0x42798e00, L:/127.0.0.1:40990 - R:/127.31.45.195:37139] using TOKEN/null
08:01:34.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:34.720108 32315 raft_consensus.cc:1275] T 736c34109533446c835514f293c21af9 P 2949848f49e243ac999493cc0c83ae21 [term 2 FOLLOWER]: Refusing update from remote peer 259f6fe7649f435b899f20f027b2cdb6: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 2 index: 13. (index mismatch)
08:01:34.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:34.722198   366 consensus_queue.cc:1048] T 736c34109533446c835514f293c21af9 P 259f6fe7649f435b899f20f027b2cdb6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2949848f49e243ac999493cc0c83ae21" member_type: VOTER last_known_addr { host: "127.31.45.193" port: 42409 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
08:01:34.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:34.723114 32532 consensus_peers.cc:597] T 736c34109533446c835514f293c21af9 P 259f6fe7649f435b899f20f027b2cdb6 -> Peer 5fe32233c7fa4a55bd8424505aa63261 (127.31.45.194:43651): Couldn't send request to peer 5fe32233c7fa4a55bd8424505aa63261. Status: Network error: Client connection negotiation failed: client connection to 127.31.45.194:43651: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
08:01:34.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:34.741037   379 mvcc.cc:204] Tried to move back new op lower bound from 7305206557558145024 to 7305206555872530432. Current Snapshot: MvccSnapshot[applied={T|T < 7305206557558145024}]
08:01:34.928 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 20 rows, more = false) for scanner KuduScanner(table=org.apache.kudu.client.TestClientFailoverSupport-RESTART, tablet=736c34109533446c835514f293c21af9, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:01:34.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:34.930774 32047 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:37558:
08:01:34.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "org.apache.kudu.client.TestClientFailoverSupport-RESTART" }
08:01:34.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:34.931418 32047 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:37558:
08:01:34.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "org.apache.kudu.client.TestClientFailoverSupport-RESTART" }
08:01:34.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:34.956272 32047 catalog_manager.cc:5984] T 00000000000000000000000000000000 P f3092cb366824c8f881fcffd79b1e9e0: Sending DeleteTablet for 3 replicas of tablet 736c34109533446c835514f293c21af9
08:01:34.966 [DEBUG - main] (Connection.java:575) [peer master-127.31.45.253:44911(127.31.45.253:44911)] disconnecting while in state READY
08:01:34.966 [DEBUG - main] (Connection.java:575) [peer master-127.31.45.252:43307(127.31.45.252:43307)] disconnecting while in state READY
08:01:34.967 [DEBUG - main] (Connection.java:575) [peer 259f6fe7649f435b899f20f027b2cdb6(127.31.45.195:37139)] disconnecting while in state READY
08:01:34.967 [DEBUG - main] (Connection.java:575) [peer 5fe32233c7fa4a55bd8424505aa63261(127.31.45.194:43651)] disconnecting while in state TERMINATED
08:01:34.967 [DEBUG - main] (Connection.java:575) [peer master-127.31.45.254:33973(127.31.45.254:33973)] disconnecting while in state READY
08:01:34.968 [DEBUG - kudu-nio-5] (Connection.java:239) [peer master-127.31.45.252:43307(127.31.45.252:43307)] handling channelInactive
08:01:34.968 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.31.45.252:43307(127.31.45.252:43307)] cleaning up while in state READY due to: connection closed
08:01:34.968 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 259f6fe7649f435b899f20f027b2cdb6(127.31.45.195:37139)] handling channelInactive
08:01:34.968 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 259f6fe7649f435b899f20f027b2cdb6(127.31.45.195:37139)] cleaning up while in state READY due to: connection closed
08:01:34.969 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.31.45.254:33973(127.31.45.254:33973)] handling channelInactive
08:01:34.969 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.45.254:33973(127.31.45.254:33973)] cleaning up while in state READY due to: connection closed
08:01:34.972 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:01:34.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:34.975391 31927 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasktDuNhD/build/tsan/bin/kudu with pid 32208
08:01:34.979 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.31.45.253:44911(127.31.45.253:44911)] handling channelInactive
08:01:34.979 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.45.253:44911(127.31.45.253:44911)] cleaning up while in state READY due to: connection closed
08:01:34.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:34.996199 32577 tablet_service.cc:1558] Processing DeleteTablet for tablet 736c34109533446c835514f293c21af9 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-07-08 08:01:34 UTC) from {username='slave'} at 127.0.0.1:40994
08:01:34.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:34.998306 32033 catalog_manager.cc:4755] TS 5fe32233c7fa4a55bd8424505aa63261 (127.31.45.194:43651): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 736c34109533446c835514f293c21af9: Network error: Client connection negotiation failed: client connection to 127.31.45.194:43651: connect: Connection refused (error 111)
08:01:35.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:35.000726   401 tablet_replica.cc:333] T 736c34109533446c835514f293c21af9 P 259f6fe7649f435b899f20f027b2cdb6: stopping tablet replica
08:01:35.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:35.001523   401 raft_consensus.cc:2243] T 736c34109533446c835514f293c21af9 P 259f6fe7649f435b899f20f027b2cdb6 [term 2 LEADER]: Raft consensus shutting down.
08:01:35.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:35.003042   401 raft_consensus.cc:2272] T 736c34109533446c835514f293c21af9 P 259f6fe7649f435b899f20f027b2cdb6 [term 2 FOLLOWER]: Raft consensus is shut down!
08:01:35.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:35.006084   401 ts_tablet_manager.cc:1916] T 736c34109533446c835514f293c21af9 P 259f6fe7649f435b899f20f027b2cdb6: Deleting tablet data with delete state TABLET_DATA_DELETED
08:01:35.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 08:01:35.009984 32031 connection.cc:573] client connection to 127.31.45.193:42409 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
08:01:35.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:35.012498 31927 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasktDuNhD/build/tsan/bin/kudu with pid 32512
08:01:35.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:35.040915 31927 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasktDuNhD/build/tsan/bin/kudu with pid 31939
08:01:35.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:35.066102 31927 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasktDuNhD/build/tsan/bin/kudu with pid 32009
08:01:35.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 08:01:35.087350 31927 external_mini_cluster.cc:1664] Killing /tmp/dist-test-tasktDuNhD/build/tsan/bin/kudu with pid 32699
08:01:36.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T08:01:36Z chronyd exiting

Time: 43.922

OK (2 tests)

