JUnit version 4.13.2
.12:12:05.290 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1783512725281
12:12:05.356 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
12:12:05.399 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
12:12:05.414 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskZI_19V/test-tmp
12:12:05.446 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
12:12:05.450 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskZI_19V/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
12:12:05.670 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

12:12:05.883 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
12:12:05.884 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

12:12:05.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:05.888273 32516 mini_oidc.cc:150] Starting JWKS server
12:12:05.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:05.892467 32516 webserver.cc:533] Webserver started at http://127.0.0.1:44985/ using document root <none> and password file <none>
12:12:05.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:05.893025 32516 mini_oidc.cc:186] Starting OIDC Discovery server
12:12:05.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:05.897333 32516 webserver.cc:533] Webserver started at http://127.0.0.1:45671/ using document root <none> and password file <none>
12:12:05.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T12:12:05Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
12:12:05.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T12:12:05Z Disabled control of system clock
12:12:05.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:05.959404 32516 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZI_19V/build/tsan/bin/kudu
12:12:05.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZI_19V/build/tsan/bin/kudu
12:12:05.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/master-0/wal
12:12:05.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/master-0/data
12:12:05.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:12:05.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:12:05.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:12:05.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:12:05.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:12:05.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:12:05.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/master-0/logs
12:12:05.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/master-0/data/info.pb
12:12:05.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:12:05.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:12:05.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:12:05.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:12:05.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:12:05.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:12:05.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:12:05.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:12:05.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
12:12:05.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:12:05.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:12:05.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:12:05.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.31.193.62:43699
12:12:05.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.31.193.62
12:12:05.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:12:05.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.31.193.20:42773
12:12:05.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:12:05.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:12:05.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:12:05.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:12:05.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.31.193.62:43699,127.31.193.61:44677,127.31.193.60:44177
12:12:05.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:12:05.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:44985/jwks.json with env {}
12:12:06.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:06.263790 32528 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:12:06.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:06.264401 32528 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:12:06.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:06.264860 32528 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:12:06.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:06.297714 32528 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
12:12:06.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:06.298031 32528 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:12:06.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:06.298238 32528 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
12:12:06.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:06.298429 32528 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
12:12:06.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:06.298610 32528 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
12:12:06.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:06.298756 32528 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:44985/jwks.json
12:12:06.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.337127 32528 master_runner.cc:387] Master server non-default flags:
12:12:06.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:12:06.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.31.193.20:42773
12:12:06.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:12:06.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:12:06.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/master-0/data
12:12:06.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/master-0/wal
12:12:06.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:12:06.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.31.193.62:43699,127.31.193.61:44677,127.31.193.60:44177
12:12:06.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:12:06.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:12:06.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:12:06.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.31.193.62:43699
12:12:06.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:12:06.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:12:06.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:12:06.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:44985/jwks.json
12:12:06.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:12:06.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:12:06.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/master-0/data/info.pb
12:12:06.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.31.193.62
12:12:06.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:12:06.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:12:06.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:12:06.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:12:06.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:12:06.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:12:06.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/master-0/logs
12:12:06.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:12:06.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:12:06.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:12:06.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
12:12:06.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:12:06.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:12:06.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:12:06.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:12:06.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:12:06.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:12:06.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.338784 32528 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:12:06.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:06.340859 32528 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:12:06.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:06.353783 32534 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:08.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:07.756711 32533 debug-util.cc:398] Leaking SignalData structure 0x7b0800028020 after lost signal to thread 32528
12:12:08.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:08.218559 32528 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.865s	user 0.620s	sys 1.241s
12:12:08.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:08.220113 32528 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.867s	user 0.620s	sys 1.241s
12:12:08.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:06.354252 32535 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:08.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:08.220643 32536 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1865 milliseconds
12:12:08.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:08.222357 32537 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:08.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:08.222855 32528 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
12:12:08.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:08.225158 32528 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:12:08.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:08.227803 32528 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:12:08.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:08.229159 32528 hybrid_clock.cc:648] HybridClock initialized: now 1783512728229122 us; error 38 us; skew 500 ppm
12:12:08.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:08.230116 32528 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:12:08.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:08.236778 32528 webserver.cc:533] Webserver started at http://127.31.193.62:43661/ using document root <none> and password file <none>
12:12:08.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:08.237840 32528 fs_manager.cc:362] Metadata directory not provided
12:12:08.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:08.238083 32528 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:12:08.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:08.238797 32528 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:12:08.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:08.243767 32528 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/master-0/data/instance:
12:12:08.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "69776d9211f54a8d843f89abe587ccb9"
12:12:08.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:08 on dist-test-slave-q56p"
12:12:08.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:08.245311 32528 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/master-0/wal/instance:
12:12:08.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "69776d9211f54a8d843f89abe587ccb9"
12:12:08.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:08 on dist-test-slave-q56p"
12:12:08.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:08.253860 32528 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.004s	sys 0.005s
12:12:08.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:08.260286 32544 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:12:08.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:08.261541 32528 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.002s
12:12:08.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:08.261945 32528 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/master-0/data,/tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/master-0/wal
12:12:08.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "69776d9211f54a8d843f89abe587ccb9"
12:12:08.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:08 on dist-test-slave-q56p"
12:12:08.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:08.262415 32528 fs_report.cc:389] FS layout report
12:12:08.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:12:08.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/master-0/wal
12:12:08.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/master-0/wal
12:12:08.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/master-0/data/data
12:12:08.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:12:08.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:12:08.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:12:08.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:12:08.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:12:08.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:12:08.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:12:08.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:12:08.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:12:08.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:12:08.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:12:08.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:08.330440 32528 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:12:08.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:08.332396 32528 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:12:08.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:08.332995 32528 kserver.cc:163] Server-wide thread pool size limit: 3276
12:12:08.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:08.419291 32528 rpc_server.cc:307] RPC server started. Bound to: 127.31.193.62:43699
12:12:08.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:08.419416 32595 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.193.62:43699 every 8 connection(s)
12:12:08.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:08.422592 32528 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/master-0/data/info.pb
12:12:08.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:08.429435 32596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
12:12:08.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:08.430815 32516 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZI_19V/build/tsan/bin/kudu as pid 32528
12:12:08.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:08.431212 32516 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/master-0/wal/instance
12:12:08.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:08.437093 32516 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZI_19V/build/tsan/bin/kudu
12:12:08.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZI_19V/build/tsan/bin/kudu
12:12:08.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/master-1/wal
12:12:08.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/master-1/data
12:12:08.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:12:08.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:12:08.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:12:08.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:12:08.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:12:08.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:12:08.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/master-1/logs
12:12:08.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/master-1/data/info.pb
12:12:08.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:12:08.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:12:08.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:12:08.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:12:08.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:12:08.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:12:08.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:12:08.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:12:08.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
12:12:08.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:12:08.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:12:08.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:12:08.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.31.193.61:44677
12:12:08.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.31.193.61
12:12:08.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:12:08.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.31.193.20:42773
12:12:08.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:12:08.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:12:08.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:12:08.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:12:08.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.31.193.62:43699,127.31.193.61:44677,127.31.193.60:44177
12:12:08.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:12:08.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:44985/jwks.json with env {}
12:12:08.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:08.448565 32596 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.31.193.62" port: 43699 } has no permanent_uuid. Determining permanent_uuid...
12:12:08.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:08.483738 32596 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.31.193.61" port: 44677 } has no permanent_uuid. Determining permanent_uuid...
12:12:08.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:08.486222 32545 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.31.193.61:44677: connect: Connection refused (error 111)
12:12:08.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:08.491204 32596 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.193.61:44677: Network error: Client connection negotiation failed: client connection to 127.31.193.61:44677: connect: Connection refused (error 111)
12:12:08.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:08.540740 32596 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.193.61" port: 44677 } attempt: 1
12:12:08.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:08.545791 32596 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.193.61:44677: Network error: Client connection negotiation failed: client connection to 127.31.193.61:44677: connect: Connection refused (error 111)
12:12:08.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:08.614246 32596 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.193.61" port: 44677 } attempt: 2
12:12:08.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:08.619347 32596 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.193.61:44677: Network error: Client connection negotiation failed: client connection to 127.31.193.61:44677: connect: Connection refused (error 111)
12:12:08.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:08.710808 32596 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.193.61" port: 44677 } attempt: 3
12:12:08.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:08.715101 32596 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.193.61:44677: Network error: Client connection negotiation failed: client connection to 127.31.193.61:44677: connect: Connection refused (error 111)
12:12:08.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:08.767485 32598 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:12:08.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:08.768061 32598 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:12:08.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:08.768507 32598 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:12:08.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:08.800971 32598 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
12:12:08.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:08.801271 32598 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:12:08.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:08.801565 32598 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
12:12:08.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:08.801887 32598 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
12:12:08.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:08.802362 32598 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
12:12:08.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:08.803005 32598 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:44985/jwks.json
12:12:08.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:08.851112 32598 master_runner.cc:387] Master server non-default flags:
12:12:08.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:12:08.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.31.193.20:42773
12:12:08.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:12:08.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:12:08.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/master-1/data
12:12:08.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/master-1/wal
12:12:08.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:12:08.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.31.193.62:43699,127.31.193.61:44677,127.31.193.60:44177
12:12:08.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:12:08.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:12:08.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:12:08.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.31.193.61:44677
12:12:08.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:12:08.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:12:08.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:12:08.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:44985/jwks.json
12:12:08.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:12:08.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:12:08.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/master-1/data/info.pb
12:12:08.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.31.193.61
12:12:08.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:12:08.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:12:08.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:12:08.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:12:08.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:12:08.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:12:08.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/master-1/logs
12:12:08.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:12:08.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:12:08.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:12:08.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
12:12:08.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:12:08.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:12:08.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:12:08.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:12:08.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:12:08.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:12:08.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:08.852530 32598 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:12:08.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:08.854295 32598 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:12:08.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:08.858505 32596 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.193.61" port: 44677 } attempt: 4
12:12:08.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:08.863557 32596 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.193.61:44677: Network error: Client connection negotiation failed: client connection to 127.31.193.61:44677: connect: Connection refused (error 111)
12:12:08.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:08.869781 32607 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:09.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:09.163089 32596 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.193.61" port: 44677 } attempt: 5
12:12:09.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:09.173439 32596 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.193.61:44677: Network error: Client connection negotiation failed: client connection to 127.31.193.61:44677: connect: Connection refused (error 111)
12:12:09.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:09.721010 32596 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.193.61" port: 44677 } attempt: 6
12:12:09.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:09.764497 32596 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.193.61:44677: Network error: Client connection negotiation failed: client connection to 127.31.193.61:44677: connect: Connection refused (error 111)
12:12:10.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:10.271641 32606 debug-util.cc:398] Leaking SignalData structure 0x7b0800028020 after lost signal to thread 32598
12:12:10.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:10.529323 32606 kernel_stack_watchdog.cc:198] Thread 32598 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 396ms:
12:12:10.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
12:12:10.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
12:12:10.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
12:12:10.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
12:12:10.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:10.532033 32598 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.659s	user 0.610s	sys 1.044s
12:12:10.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:10.534457 32598 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.662s	user 0.610s	sys 1.044s
12:12:10.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:08.872720 32608 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:10.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:10.537766 32610 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:10.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:10.541731 32609 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1662 milliseconds
12:12:10.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:10.541746 32598 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
12:12:10.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:10.543366 32598 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:12:10.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:10.546840 32598 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:12:10.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:10.548378 32598 hybrid_clock.cc:648] HybridClock initialized: now 1783512730548320 us; error 72 us; skew 500 ppm
12:12:10.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:10.549417 32598 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:12:10.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:10.562373 32598 webserver.cc:533] Webserver started at http://127.31.193.61:42995/ using document root <none> and password file <none>
12:12:10.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:10.563452 32598 fs_manager.cc:362] Metadata directory not provided
12:12:10.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:10.563827 32598 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:12:10.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:10.564502 32598 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:12:10.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:10.570003 32598 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/master-1/data/instance:
12:12:10.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "97e44eb6786f4724aafc1b37e0992de4"
12:12:10.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:10 on dist-test-slave-q56p"
12:12:10.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:10.571702 32598 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/master-1/wal/instance:
12:12:10.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "97e44eb6786f4724aafc1b37e0992de4"
12:12:10.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:10 on dist-test-slave-q56p"
12:12:10.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:10.582774 32598 fs_manager.cc:696] Time spent creating directory manager: real 0.010s	user 0.005s	sys 0.005s
12:12:10.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:10.593286 32619 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:12:10.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:10.594651 32598 fs_manager.cc:730] Time spent opening block manager: real 0.008s	user 0.006s	sys 0.003s
12:12:10.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:10.595047 32598 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/master-1/data,/tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/master-1/wal
12:12:10.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "97e44eb6786f4724aafc1b37e0992de4"
12:12:10.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:10 on dist-test-slave-q56p"
12:12:10.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:10.595666 32598 fs_report.cc:389] FS layout report
12:12:10.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:12:10.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/master-1/wal
12:12:10.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/master-1/wal
12:12:10.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/master-1/data/data
12:12:10.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:12:10.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:12:10.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:12:10.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:12:10.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:12:10.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:12:10.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:12:10.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:12:10.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:12:10.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:12:10.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:12:10.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:10.661639 32598 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:12:10.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:10.664244 32598 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:12:10.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:10.664964 32598 kserver.cc:163] Server-wide thread pool size limit: 3276
12:12:10.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:10.760526 32598 rpc_server.cc:307] RPC server started. Bound to: 127.31.193.61:44677
12:12:10.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:10.760609 32670 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.193.61:44677 every 8 connection(s)
12:12:10.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:10.763490 32598 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/master-1/data/info.pb
12:12:10.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:10.769546 32671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
12:12:10.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:10.772595 32516 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZI_19V/build/tsan/bin/kudu as pid 32598
12:12:10.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:10.773049 32516 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/master-1/wal/instance
12:12:10.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:10.775981 32516 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZI_19V/build/tsan/bin/kudu
12:12:10.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZI_19V/build/tsan/bin/kudu
12:12:10.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/master-2/wal
12:12:10.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/master-2/data
12:12:10.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:12:10.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:12:10.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:12:10.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:12:10.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:12:10.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:12:10.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/master-2/logs
12:12:10.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/master-2/data/info.pb
12:12:10.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:12:10.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:12:10.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:12:10.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:12:10.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:12:10.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:12:10.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:12:10.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:12:10.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
12:12:10.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:12:10.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:12:10.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:12:10.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.31.193.60:44177
12:12:10.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.31.193.60
12:12:10.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:12:10.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.31.193.20:42773
12:12:10.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:12:10.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:12:10.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:12:10.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:12:10.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.31.193.62:43699,127.31.193.61:44677,127.31.193.60:44177
12:12:10.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:12:10.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:44985/jwks.json with env {}
12:12:10.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:10.784437 32671 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.31.193.62" port: 43699 } has no permanent_uuid. Determining permanent_uuid...
12:12:10.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:10.807552 32671 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.31.193.61" port: 44677 } has no permanent_uuid. Determining permanent_uuid...
12:12:10.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:10.825135 32596 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.193.61" port: 44677 } attempt: 7
12:12:10.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:10.825492 32671 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.31.193.60" port: 44177 } has no permanent_uuid. Determining permanent_uuid...
12:12:10.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:10.829197 32620 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.31.193.60:44177: connect: Connection refused (error 111)
12:12:10.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:10.835309 32671 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.193.60:44177: Network error: Client connection negotiation failed: client connection to 127.31.193.60:44177: connect: Connection refused (error 111)
12:12:10.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:10.839723 32596 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.31.193.60" port: 44177 } has no permanent_uuid. Determining permanent_uuid...
12:12:10.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:10.846045 32596 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.193.60:44177: Network error: Client connection negotiation failed: client connection to 127.31.193.60:44177: connect: Connection refused (error 111)
12:12:10.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:10.884939 32671 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.193.60" port: 44177 } attempt: 1
12:12:10.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:10.889549 32671 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.193.60:44177: Network error: Client connection negotiation failed: client connection to 127.31.193.60:44177: connect: Connection refused (error 111)
12:12:10.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:10.904511 32596 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.193.60" port: 44177 } attempt: 1
12:12:10.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:10.909451 32596 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.193.60:44177: Network error: Client connection negotiation failed: client connection to 127.31.193.60:44177: connect: Connection refused (error 111)
12:12:10.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:10.957983 32671 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.193.60" port: 44177 } attempt: 2
12:12:10.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:10.962392 32671 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.193.60:44177: Network error: Client connection negotiation failed: client connection to 127.31.193.60:44177: connect: Connection refused (error 111)
12:12:10.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:10.990877 32596 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.193.60" port: 44177 } attempt: 2
12:12:10.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:10.995602 32596 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.193.60:44177: Network error: Client connection negotiation failed: client connection to 127.31.193.60:44177: connect: Connection refused (error 111)
12:12:11.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:11.053851 32671 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.193.60" port: 44177 } attempt: 3
12:12:11.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:11.058709 32671 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.193.60:44177: Network error: Client connection negotiation failed: client connection to 127.31.193.60:44177: connect: Connection refused (error 111)
12:12:11.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:11.081368 32596 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.193.60" port: 44177 } attempt: 3
12:12:11.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:11.085688 32596 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.193.60:44177: Network error: Client connection negotiation failed: client connection to 127.31.193.60:44177: connect: Connection refused (error 111)
12:12:11.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:11.115618 32673 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:12:11.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:11.116158 32673 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:12:11.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:11.116590 32673 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:12:11.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:11.150030 32673 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
12:12:11.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:11.150339 32673 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:12:11.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:11.150660 32673 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
12:12:11.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:11.150967 32673 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
12:12:11.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:11.151292 32673 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
12:12:11.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:11.151563 32673 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:44985/jwks.json
12:12:11.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:11.190572 32673 master_runner.cc:387] Master server non-default flags:
12:12:11.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:12:11.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.31.193.20:42773
12:12:11.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:12:11.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:12:11.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/master-2/data
12:12:11.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/master-2/wal
12:12:11.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
12:12:11.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.31.193.62:43699,127.31.193.61:44677,127.31.193.60:44177
12:12:11.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:12:11.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:12:11.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
12:12:11.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.31.193.60:44177
12:12:11.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
12:12:11.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:12:11.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
12:12:11.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:44985/jwks.json
12:12:11.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:12:11.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:12:11.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/master-2/data/info.pb
12:12:11.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.31.193.60
12:12:11.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:12:11.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:12:11.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:12:11.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:12:11.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:12:11.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:12:11.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/master-2/logs
12:12:11.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:12:11.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:12:11.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:12:11.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
12:12:11.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:12:11.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:12:11.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:12:11.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:12:11.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:12:11.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:12:11.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:11.192050 32673 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:12:11.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:11.194247 32673 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:12:11.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:11.202188 32671 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.193.60" port: 44177 } attempt: 4
12:12:11.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:11.209095 32671 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.193.60:44177: Network error: Client connection negotiation failed: client connection to 127.31.193.60:44177: connect: Connection refused (error 111)
12:12:11.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:11.209237 32685 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:11.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:11.226186 32596 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.193.60" port: 44177 } attempt: 4
12:12:11.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:11.234614 32596 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.193.60:44177: Network error: Client connection negotiation failed: client connection to 127.31.193.60:44177: connect: Connection refused (error 111)
12:12:11.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:11.508561 32671 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.193.60" port: 44177 } attempt: 5
12:12:11.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:11.518154 32671 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.193.60:44177: Network error: Client connection negotiation failed: client connection to 127.31.193.60:44177: connect: Connection refused (error 111)
12:12:11.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:11.518194 32596 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.193.60" port: 44177 } attempt: 5
12:12:11.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:11.526590 32596 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.193.60:44177: Network error: Client connection negotiation failed: client connection to 127.31.193.60:44177: connect: Connection refused (error 111)
12:12:12.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:12.065613 32671 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.193.60" port: 44177 } attempt: 6
12:12:12.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:12.079196 32596 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.193.60" port: 44177 } attempt: 6
12:12:12.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:12.089833 32671 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.193.60:44177: Network error: Client connection negotiation failed: client connection to 127.31.193.60:44177: connect: Connection refused (error 111)
12:12:12.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:12.105363 32596 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.31.193.60:44177: Network error: Client connection negotiation failed: client connection to 127.31.193.60:44177: connect: Connection refused (error 111)
12:12:12.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:11.210105 32686 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:12.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:12.517989 32687 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1304 milliseconds
12:12:12.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:12.519388 32688 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:12.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:12.522743 32673 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.313s	user 0.482s	sys 0.820s
12:12:12.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:12.523121 32673 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.313s	user 0.482s	sys 0.820s
12:12:12.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:12.523424 32673 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
12:12:12.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:12.524909 32673 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:12:12.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:12.528998 32673 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:12:12.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:12.530972 32673 hybrid_clock.cc:648] HybridClock initialized: now 1783512732530893 us; error 92 us; skew 500 ppm
12:12:12.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:12.532389 32673 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:12:12.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:12.542023 32673 webserver.cc:533] Webserver started at http://127.31.193.60:42115/ using document root <none> and password file <none>
12:12:12.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:12.543617 32673 fs_manager.cc:362] Metadata directory not provided
12:12:12.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:12.543839 32673 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:12:12.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:12.544265 32673 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:12:12.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:12.549193 32673 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/master-2/data/instance:
12:12:12.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1b1c5a9580d74012951facb33106b357"
12:12:12.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:12 on dist-test-slave-q56p"
12:12:12.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:12.550374 32673 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/master-2/wal/instance:
12:12:12.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1b1c5a9580d74012951facb33106b357"
12:12:12.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:12 on dist-test-slave-q56p"
12:12:12.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:12.559743 32673 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.007s	sys 0.003s
12:12:12.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:12.567194 32699 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:12:12.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:12.569293 32673 fs_manager.cc:730] Time spent opening block manager: real 0.006s	user 0.003s	sys 0.000s
12:12:12.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:12.569715 32673 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/master-2/data,/tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/master-2/wal
12:12:12.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1b1c5a9580d74012951facb33106b357"
12:12:12.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:12 on dist-test-slave-q56p"
12:12:12.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:12.570431 32673 fs_report.cc:389] FS layout report
12:12:12.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:12:12.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/master-2/wal
12:12:12.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/master-2/wal
12:12:12.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/master-2/data/data
12:12:12.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:12:12.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:12:12.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:12:12.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:12:12.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:12:12.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:12:12.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:12:12.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:12:12.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:12:12.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:12:12.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:12:12.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:12.655889 32673 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:12:12.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:12.657347 32673 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:12:12.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:12.657827 32673 kserver.cc:163] Server-wide thread pool size limit: 3276
12:12:12.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:12.742444 32673 rpc_server.cc:307] RPC server started. Bound to: 127.31.193.60:44177
12:12:12.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:12.742548 32750 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.193.60:44177 every 8 connection(s)
12:12:12.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:12.746836 32673 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/master-2/data/info.pb
12:12:12.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:12.753023 32516 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZI_19V/build/tsan/bin/kudu as pid 32673
12:12:12.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:12.753474 32516 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/master-2/wal/instance
12:12:12.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:12.753985 32751 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
12:12:12.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:12.786371 32751 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.31.193.62" port: 43699 } has no permanent_uuid. Determining permanent_uuid...
12:12:12.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:12.819525 32751 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.31.193.61" port: 44677 } has no permanent_uuid. Determining permanent_uuid...
12:12:12.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:12.838806 32751 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.31.193.60" port: 44177 } has no permanent_uuid. Determining permanent_uuid...
12:12:12.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:12.857635 32751 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b1c5a9580d74012951facb33106b357: Bootstrap starting.
12:12:12.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:12.865104 32751 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1b1c5a9580d74012951facb33106b357: Neither blocks nor log segments found. Creating new log.
12:12:12.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:12.867298 32751 log.cc:826] T 00000000000000000000000000000000 P 1b1c5a9580d74012951facb33106b357: Log is configured to *not* fsync() on all Append() calls
12:12:12.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:12.872644 32751 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1b1c5a9580d74012951facb33106b357: No bootstrap required, opened a new log
12:12:12.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:12.892242 32751 raft_consensus.cc:359] T 00000000000000000000000000000000 P 1b1c5a9580d74012951facb33106b357 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69776d9211f54a8d843f89abe587ccb9" member_type: VOTER last_known_addr { host: "127.31.193.62" port: 43699 } } peers { permanent_uuid: "97e44eb6786f4724aafc1b37e0992de4" member_type: VOTER last_known_addr { host: "127.31.193.61" port: 44677 } } peers { permanent_uuid: "1b1c5a9580d74012951facb33106b357" member_type: VOTER last_known_addr { host: "127.31.193.60" port: 44177 } }
12:12:12.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:12.892882 32751 raft_consensus.cc:385] T 00000000000000000000000000000000 P 1b1c5a9580d74012951facb33106b357 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:12:12.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:12.893083 32751 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1b1c5a9580d74012951facb33106b357 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b1c5a9580d74012951facb33106b357, State: Initialized, Role: FOLLOWER
12:12:12.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:12.893754 32751 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1b1c5a9580d74012951facb33106b357 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69776d9211f54a8d843f89abe587ccb9" member_type: VOTER last_known_addr { host: "127.31.193.62" port: 43699 } } peers { permanent_uuid: "97e44eb6786f4724aafc1b37e0992de4" member_type: VOTER last_known_addr { host: "127.31.193.61" port: 44677 } } peers { permanent_uuid: "1b1c5a9580d74012951facb33106b357" member_type: VOTER last_known_addr { host: "127.31.193.60" port: 44177 } }
12:12:12.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:12.896533 32760 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b1c5a9580d74012951facb33106b357 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69776d9211f54a8d843f89abe587ccb9" member_type: VOTER last_known_addr { host: "127.31.193.62" port: 43699 } } peers { permanent_uuid: "97e44eb6786f4724aafc1b37e0992de4" member_type: VOTER last_known_addr { host: "127.31.193.61" port: 44677 } } peers { permanent_uuid: "1b1c5a9580d74012951facb33106b357" member_type: VOTER last_known_addr { host: "127.31.193.60" port: 44177 } } }
12:12:12.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:12.897753 32760 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b1c5a9580d74012951facb33106b357 [sys.catalog]: This master's current role is: FOLLOWER
12:12:12.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:12.898960 32751 sys_catalog.cc:565] T 00000000000000000000000000000000 P 1b1c5a9580d74012951facb33106b357 [sys.catalog]: configured and running, proceeding with master startup.
12:12:12.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:12.914137 32705 tablet.cc:2406] T 00000000000000000000000000000000 P 1b1c5a9580d74012951facb33106b357: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:12:12.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:12.927920   303 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 1b1c5a9580d74012951facb33106b357: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
12:12:12.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:12.928301   303 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
12:12:12.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:12.922045 32673 master_runner.cc:187] Error getting master registration for 127.31.193.62:43699: OK, instance_id { permanent_uuid: "69776d9211f54a8d843f89abe587ccb9" instance_seqno: 1783512728396968 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
12:12:12.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:12.954402 32673 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
12:12:13.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.138954 32596 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.193.60" port: 44177 } attempt: 7
12:12:13.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.150451 32671 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.31.193.60" port: 44177 } attempt: 7
12:12:13.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.162283 32596 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 69776d9211f54a8d843f89abe587ccb9: Bootstrap starting.
12:12:13.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.171674 32596 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 69776d9211f54a8d843f89abe587ccb9: Neither blocks nor log segments found. Creating new log.
12:12:13.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.174583 32596 log.cc:826] T 00000000000000000000000000000000 P 69776d9211f54a8d843f89abe587ccb9: Log is configured to *not* fsync() on all Append() calls
12:12:13.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.177490 32671 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 97e44eb6786f4724aafc1b37e0992de4: Bootstrap starting.
12:12:13.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.180787 32596 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 69776d9211f54a8d843f89abe587ccb9: No bootstrap required, opened a new log
12:12:13.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.185441 32671 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 97e44eb6786f4724aafc1b37e0992de4: Neither blocks nor log segments found. Creating new log.
12:12:13.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.188372 32671 log.cc:826] T 00000000000000000000000000000000 P 97e44eb6786f4724aafc1b37e0992de4: Log is configured to *not* fsync() on all Append() calls
12:12:13.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.197157 32671 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 97e44eb6786f4724aafc1b37e0992de4: No bootstrap required, opened a new log
12:12:13.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.213286 32596 raft_consensus.cc:359] T 00000000000000000000000000000000 P 69776d9211f54a8d843f89abe587ccb9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69776d9211f54a8d843f89abe587ccb9" member_type: VOTER last_known_addr { host: "127.31.193.62" port: 43699 } } peers { permanent_uuid: "97e44eb6786f4724aafc1b37e0992de4" member_type: VOTER last_known_addr { host: "127.31.193.61" port: 44677 } } peers { permanent_uuid: "1b1c5a9580d74012951facb33106b357" member_type: VOTER last_known_addr { host: "127.31.193.60" port: 44177 } }
12:12:13.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.214187 32596 raft_consensus.cc:385] T 00000000000000000000000000000000 P 69776d9211f54a8d843f89abe587ccb9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:12:13.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.214493 32596 raft_consensus.cc:740] T 00000000000000000000000000000000 P 69776d9211f54a8d843f89abe587ccb9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 69776d9211f54a8d843f89abe587ccb9, State: Initialized, Role: FOLLOWER
12:12:13.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.215416 32596 consensus_queue.cc:260] T 00000000000000000000000000000000 P 69776d9211f54a8d843f89abe587ccb9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69776d9211f54a8d843f89abe587ccb9" member_type: VOTER last_known_addr { host: "127.31.193.62" port: 43699 } } peers { permanent_uuid: "97e44eb6786f4724aafc1b37e0992de4" member_type: VOTER last_known_addr { host: "127.31.193.61" port: 44677 } } peers { permanent_uuid: "1b1c5a9580d74012951facb33106b357" member_type: VOTER last_known_addr { host: "127.31.193.60" port: 44177 } }
12:12:13.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.228291   309 sys_catalog.cc:455] T 00000000000000000000000000000000 P 69776d9211f54a8d843f89abe587ccb9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69776d9211f54a8d843f89abe587ccb9" member_type: VOTER last_known_addr { host: "127.31.193.62" port: 43699 } } peers { permanent_uuid: "97e44eb6786f4724aafc1b37e0992de4" member_type: VOTER last_known_addr { host: "127.31.193.61" port: 44677 } } peers { permanent_uuid: "1b1c5a9580d74012951facb33106b357" member_type: VOTER last_known_addr { host: "127.31.193.60" port: 44177 } } }
12:12:13.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.231067   309 sys_catalog.cc:458] T 00000000000000000000000000000000 P 69776d9211f54a8d843f89abe587ccb9 [sys.catalog]: This master's current role is: FOLLOWER
12:12:13.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.230702 32671 raft_consensus.cc:359] T 00000000000000000000000000000000 P 97e44eb6786f4724aafc1b37e0992de4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69776d9211f54a8d843f89abe587ccb9" member_type: VOTER last_known_addr { host: "127.31.193.62" port: 43699 } } peers { permanent_uuid: "97e44eb6786f4724aafc1b37e0992de4" member_type: VOTER last_known_addr { host: "127.31.193.61" port: 44677 } } peers { permanent_uuid: "1b1c5a9580d74012951facb33106b357" member_type: VOTER last_known_addr { host: "127.31.193.60" port: 44177 } }
12:12:13.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.231571 32671 raft_consensus.cc:385] T 00000000000000000000000000000000 P 97e44eb6786f4724aafc1b37e0992de4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:12:13.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.231865 32671 raft_consensus.cc:740] T 00000000000000000000000000000000 P 97e44eb6786f4724aafc1b37e0992de4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 97e44eb6786f4724aafc1b37e0992de4, State: Initialized, Role: FOLLOWER
12:12:13.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.230665 32596 sys_catalog.cc:565] T 00000000000000000000000000000000 P 69776d9211f54a8d843f89abe587ccb9 [sys.catalog]: configured and running, proceeding with master startup.
12:12:13.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.232867 32671 consensus_queue.cc:260] T 00000000000000000000000000000000 P 97e44eb6786f4724aafc1b37e0992de4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69776d9211f54a8d843f89abe587ccb9" member_type: VOTER last_known_addr { host: "127.31.193.62" port: 43699 } } peers { permanent_uuid: "97e44eb6786f4724aafc1b37e0992de4" member_type: VOTER last_known_addr { host: "127.31.193.61" port: 44677 } } peers { permanent_uuid: "1b1c5a9580d74012951facb33106b357" member_type: VOTER last_known_addr { host: "127.31.193.60" port: 44177 } }
12:12:13.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.236460   310 sys_catalog.cc:455] T 00000000000000000000000000000000 P 97e44eb6786f4724aafc1b37e0992de4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69776d9211f54a8d843f89abe587ccb9" member_type: VOTER last_known_addr { host: "127.31.193.62" port: 43699 } } peers { permanent_uuid: "97e44eb6786f4724aafc1b37e0992de4" member_type: VOTER last_known_addr { host: "127.31.193.61" port: 44677 } } peers { permanent_uuid: "1b1c5a9580d74012951facb33106b357" member_type: VOTER last_known_addr { host: "127.31.193.60" port: 44177 } } }
12:12:13.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.238765 32671 sys_catalog.cc:565] T 00000000000000000000000000000000 P 97e44eb6786f4724aafc1b37e0992de4 [sys.catalog]: configured and running, proceeding with master startup.
12:12:13.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.239841   310 sys_catalog.cc:458] T 00000000000000000000000000000000 P 97e44eb6786f4724aafc1b37e0992de4 [sys.catalog]: This master's current role is: FOLLOWER
12:12:13.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.246870 32760 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1b1c5a9580d74012951facb33106b357 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:12:13.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.247452 32760 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1b1c5a9580d74012951facb33106b357 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69776d9211f54a8d843f89abe587ccb9" member_type: VOTER last_known_addr { host: "127.31.193.62" port: 43699 } } peers { permanent_uuid: "97e44eb6786f4724aafc1b37e0992de4" member_type: VOTER last_known_addr { host: "127.31.193.61" port: 44677 } } peers { permanent_uuid: "1b1c5a9580d74012951facb33106b357" member_type: VOTER last_known_addr { host: "127.31.193.60" port: 44177 } }
12:12:13.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.254191 32646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1b1c5a9580d74012951facb33106b357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e44eb6786f4724aafc1b37e0992de4" is_pre_election: true
12:12:13.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.254331 32571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1b1c5a9580d74012951facb33106b357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69776d9211f54a8d843f89abe587ccb9" is_pre_election: true
12:12:13.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.255541 32646 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 97e44eb6786f4724aafc1b37e0992de4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b1c5a9580d74012951facb33106b357 in term 0.
12:12:13.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.255999 32571 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 69776d9211f54a8d843f89abe587ccb9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b1c5a9580d74012951facb33106b357 in term 0.
12:12:13.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.263710 32701 leader_election.cc:304] T 00000000000000000000000000000000 P 1b1c5a9580d74012951facb33106b357 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b1c5a9580d74012951facb33106b357, 69776d9211f54a8d843f89abe587ccb9; no voters: 
12:12:13.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.268317   318 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1b1c5a9580d74012951facb33106b357 [term 0 FOLLOWER]: Leader pre-election won for term 1
12:12:13.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.269778 32760 leader_election.cc:290] T 00000000000000000000000000000000 P 1b1c5a9580d74012951facb33106b357 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 69776d9211f54a8d843f89abe587ccb9 (127.31.193.62:43699), 97e44eb6786f4724aafc1b37e0992de4 (127.31.193.61:44677)
12:12:13.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.271567   318 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1b1c5a9580d74012951facb33106b357 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
12:12:13.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.272234   318 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1b1c5a9580d74012951facb33106b357 [term 0 FOLLOWER]: Advancing to term 1
12:12:13.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.280252   318 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1b1c5a9580d74012951facb33106b357 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69776d9211f54a8d843f89abe587ccb9" member_type: VOTER last_known_addr { host: "127.31.193.62" port: 43699 } } peers { permanent_uuid: "97e44eb6786f4724aafc1b37e0992de4" member_type: VOTER last_known_addr { host: "127.31.193.61" port: 44677 } } peers { permanent_uuid: "1b1c5a9580d74012951facb33106b357" member_type: VOTER last_known_addr { host: "127.31.193.60" port: 44177 } }
12:12:13.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.284118 32571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1b1c5a9580d74012951facb33106b357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "69776d9211f54a8d843f89abe587ccb9"
12:12:13.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.284855 32571 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 69776d9211f54a8d843f89abe587ccb9 [term 0 FOLLOWER]: Advancing to term 1
12:12:13.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.290486 32646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1b1c5a9580d74012951facb33106b357" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "97e44eb6786f4724aafc1b37e0992de4"
12:12:13.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.291045 32646 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 97e44eb6786f4724aafc1b37e0992de4 [term 0 FOLLOWER]: Advancing to term 1
12:12:13.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.296521 32571 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 69776d9211f54a8d843f89abe587ccb9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b1c5a9580d74012951facb33106b357 in term 1.
12:12:13.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.298014 32701 leader_election.cc:304] T 00000000000000000000000000000000 P 1b1c5a9580d74012951facb33106b357 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b1c5a9580d74012951facb33106b357, 69776d9211f54a8d843f89abe587ccb9; no voters: 
12:12:13.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.300256 32760 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1b1c5a9580d74012951facb33106b357 [term 1 FOLLOWER]: Leader election won for term 1
12:12:13.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.308017 32760 raft_consensus.cc:697] T 00000000000000000000000000000000 P 1b1c5a9580d74012951facb33106b357 [term 1 LEADER]: Becoming Leader. State: Replica: 1b1c5a9580d74012951facb33106b357, State: Running, Role: LEADER
12:12:13.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.309048 32760 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1b1c5a9580d74012951facb33106b357 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69776d9211f54a8d843f89abe587ccb9" member_type: VOTER last_known_addr { host: "127.31.193.62" port: 43699 } } peers { permanent_uuid: "97e44eb6786f4724aafc1b37e0992de4" member_type: VOTER last_known_addr { host: "127.31.193.61" port: 44677 } } peers { permanent_uuid: "1b1c5a9580d74012951facb33106b357" member_type: VOTER last_known_addr { host: "127.31.193.60" port: 44177 } }
12:12:13.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.315495 32646 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 97e44eb6786f4724aafc1b37e0992de4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b1c5a9580d74012951facb33106b357 in term 1.
12:12:13.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.316633   318 leader_election.cc:290] T 00000000000000000000000000000000 P 1b1c5a9580d74012951facb33106b357 [CANDIDATE]: Term 1 election: Requested vote from peers 69776d9211f54a8d843f89abe587ccb9 (127.31.193.62:43699), 97e44eb6786f4724aafc1b37e0992de4 (127.31.193.61:44677)
12:12:13.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.327698   328 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b1c5a9580d74012951facb33106b357 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1b1c5a9580d74012951facb33106b357. Latest consensus state: current_term: 1 leader_uuid: "1b1c5a9580d74012951facb33106b357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69776d9211f54a8d843f89abe587ccb9" member_type: VOTER last_known_addr { host: "127.31.193.62" port: 43699 } } peers { permanent_uuid: "97e44eb6786f4724aafc1b37e0992de4" member_type: VOTER last_known_addr { host: "127.31.193.61" port: 44677 } } peers { permanent_uuid: "1b1c5a9580d74012951facb33106b357" member_type: VOTER last_known_addr { host: "127.31.193.60" port: 44177 } } }
12:12:13.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.329912   328 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b1c5a9580d74012951facb33106b357 [sys.catalog]: This master's current role is: LEADER
12:12:13.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:13.345636 32550 tablet.cc:2406] T 00000000000000000000000000000000 P 69776d9211f54a8d843f89abe587ccb9: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:12:13.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.365653   336 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
12:12:13.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:13.370471   334 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 69776d9211f54a8d843f89abe587ccb9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
12:12:13.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:13.374244   334 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
12:12:13.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.376209   336 catalog_manager.cc:1520] Initializing Kudu cluster ID...
12:12:13.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:13.395450   335 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 97e44eb6786f4724aafc1b37e0992de4: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
12:12:13.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:13.395826   335 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
12:12:13.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.401453 32646 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 97e44eb6786f4724aafc1b37e0992de4 [term 1 FOLLOWER]: Refusing update from remote peer 1b1c5a9580d74012951facb33106b357: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
12:12:13.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.405121 32571 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 69776d9211f54a8d843f89abe587ccb9 [term 1 FOLLOWER]: Refusing update from remote peer 1b1c5a9580d74012951facb33106b357: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
12:12:13.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.407081   328 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 1b1c5a9580d74012951facb33106b357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "97e44eb6786f4724aafc1b37e0992de4" member_type: VOTER last_known_addr { host: "127.31.193.61" port: 44677 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:12:13.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.411185   328 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 1b1c5a9580d74012951facb33106b357 [LEADER]: Connected to new peer: Peer: permanent_uuid: "69776d9211f54a8d843f89abe587ccb9" member_type: VOTER last_known_addr { host: "127.31.193.62" port: 43699 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:12:13.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:13.429904 32625 tablet.cc:2406] T 00000000000000000000000000000000 P 97e44eb6786f4724aafc1b37e0992de4: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:12:13.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.328967 32598 master_runner.cc:187] Error getting master registration for 127.31.193.62:43699: OK, instance_id { permanent_uuid: "69776d9211f54a8d843f89abe587ccb9" instance_seqno: 1783512728396968 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
12:12:13.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.451164 32598 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
12:12:13.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.482110   310 sys_catalog.cc:455] T 00000000000000000000000000000000 P 97e44eb6786f4724aafc1b37e0992de4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1b1c5a9580d74012951facb33106b357. Latest consensus state: current_term: 1 leader_uuid: "1b1c5a9580d74012951facb33106b357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69776d9211f54a8d843f89abe587ccb9" member_type: VOTER last_known_addr { host: "127.31.193.62" port: 43699 } } peers { permanent_uuid: "97e44eb6786f4724aafc1b37e0992de4" member_type: VOTER last_known_addr { host: "127.31.193.61" port: 44677 } } peers { permanent_uuid: "1b1c5a9580d74012951facb33106b357" member_type: VOTER last_known_addr { host: "127.31.193.60" port: 44177 } } }
12:12:13.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.482834   310 sys_catalog.cc:458] T 00000000000000000000000000000000 P 97e44eb6786f4724aafc1b37e0992de4 [sys.catalog]: This master's current role is: FOLLOWER
12:12:13.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.478665   309 sys_catalog.cc:455] T 00000000000000000000000000000000 P 69776d9211f54a8d843f89abe587ccb9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1b1c5a9580d74012951facb33106b357. Latest consensus state: current_term: 1 leader_uuid: "1b1c5a9580d74012951facb33106b357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69776d9211f54a8d843f89abe587ccb9" member_type: VOTER last_known_addr { host: "127.31.193.62" port: 43699 } } peers { permanent_uuid: "97e44eb6786f4724aafc1b37e0992de4" member_type: VOTER last_known_addr { host: "127.31.193.61" port: 44677 } } peers { permanent_uuid: "1b1c5a9580d74012951facb33106b357" member_type: VOTER last_known_addr { host: "127.31.193.60" port: 44177 } } }
12:12:13.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.483469   309 sys_catalog.cc:458] T 00000000000000000000000000000000 P 69776d9211f54a8d843f89abe587ccb9 [sys.catalog]: This master's current role is: FOLLOWER
12:12:13.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.485643   339 mvcc.cc:204] Tried to move back new op lower bound from 7305268155987283968 to 7305268155648806912. Current Snapshot: MvccSnapshot[applied={T|T < 7305268155987283968}]
12:12:13.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.491827   340 mvcc.cc:204] Tried to move back new op lower bound from 7305268155987283968 to 7305268155648806912. Current Snapshot: MvccSnapshot[applied={T|T < 7305268155987283968}]
12:12:13.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.494576   309 sys_catalog.cc:455] T 00000000000000000000000000000000 P 69776d9211f54a8d843f89abe587ccb9 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1b1c5a9580d74012951facb33106b357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69776d9211f54a8d843f89abe587ccb9" member_type: VOTER last_known_addr { host: "127.31.193.62" port: 43699 } } peers { permanent_uuid: "97e44eb6786f4724aafc1b37e0992de4" member_type: VOTER last_known_addr { host: "127.31.193.61" port: 44677 } } peers { permanent_uuid: "1b1c5a9580d74012951facb33106b357" member_type: VOTER last_known_addr { host: "127.31.193.60" port: 44177 } } }
12:12:13.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.497485   309 sys_catalog.cc:458] T 00000000000000000000000000000000 P 69776d9211f54a8d843f89abe587ccb9 [sys.catalog]: This master's current role is: FOLLOWER
12:12:13.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.501153   310 sys_catalog.cc:455] T 00000000000000000000000000000000 P 97e44eb6786f4724aafc1b37e0992de4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1b1c5a9580d74012951facb33106b357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69776d9211f54a8d843f89abe587ccb9" member_type: VOTER last_known_addr { host: "127.31.193.62" port: 43699 } } peers { permanent_uuid: "97e44eb6786f4724aafc1b37e0992de4" member_type: VOTER last_known_addr { host: "127.31.193.61" port: 44677 } } peers { permanent_uuid: "1b1c5a9580d74012951facb33106b357" member_type: VOTER last_known_addr { host: "127.31.193.60" port: 44177 } } }
12:12:13.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.502243   310 sys_catalog.cc:458] T 00000000000000000000000000000000 P 97e44eb6786f4724aafc1b37e0992de4 [sys.catalog]: This master's current role is: FOLLOWER
12:12:13.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.503346   328 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b1c5a9580d74012951facb33106b357 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1b1c5a9580d74012951facb33106b357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69776d9211f54a8d843f89abe587ccb9" member_type: VOTER last_known_addr { host: "127.31.193.62" port: 43699 } } peers { permanent_uuid: "97e44eb6786f4724aafc1b37e0992de4" member_type: VOTER last_known_addr { host: "127.31.193.61" port: 44677 } } peers { permanent_uuid: "1b1c5a9580d74012951facb33106b357" member_type: VOTER last_known_addr { host: "127.31.193.60" port: 44177 } } }
12:12:13.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.504058   328 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b1c5a9580d74012951facb33106b357 [sys.catalog]: This master's current role is: LEADER
12:12:13.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.505194   318 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1b1c5a9580d74012951facb33106b357 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1b1c5a9580d74012951facb33106b357" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "69776d9211f54a8d843f89abe587ccb9" member_type: VOTER last_known_addr { host: "127.31.193.62" port: 43699 } } peers { permanent_uuid: "97e44eb6786f4724aafc1b37e0992de4" member_type: VOTER last_known_addr { host: "127.31.193.61" port: 44677 } } peers { permanent_uuid: "1b1c5a9580d74012951facb33106b357" member_type: VOTER last_known_addr { host: "127.31.193.60" port: 44177 } } }
12:12:13.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.505841   318 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1b1c5a9580d74012951facb33106b357 [sys.catalog]: This master's current role is: LEADER
12:12:13.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.507277   336 catalog_manager.cc:1383] Generated new cluster ID: 507f24c506594ea98750e5e56db1464c
12:12:13.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.507586   336 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
12:12:13.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.568027   336 catalog_manager.cc:1406] Generated new certificate authority record
12:12:13.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.572535   336 catalog_manager.cc:1540] Loading token signing keys...
12:12:13.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.613850   336 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 1b1c5a9580d74012951facb33106b357: Generated new TSK 0
12:12:13.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.614984   336 catalog_manager.cc:1550] Initializing in-progress tserver states...
12:12:13.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:13.658145 32516 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZI_19V/build/tsan/bin/kudu
12:12:13.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZI_19V/build/tsan/bin/kudu
12:12:13.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/ts-0/wal
12:12:13.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/ts-0/data
12:12:13.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:12:13.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:12:13.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:12:13.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:12:13.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:12:13.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:12:13.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/ts-0/logs
12:12:13.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/ts-0/data/info.pb
12:12:13.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:12:13.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:12:13.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:12:13.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:12:13.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:12:13.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:12:13.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:12:13.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:12:13.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
12:12:13.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:12:13.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.31.193.1:0
12:12:13.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.31.193.1
12:12:13.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.31.193.1
12:12:13.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:12:13.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.31.193.62:43699,127.31.193.61:44677,127.31.193.60:44177
12:12:13.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.31.193.20:42773
12:12:13.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:12:13.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:12:13.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
12:12:14.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:14.260516   347 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:12:14.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:14.261771   347 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:12:14.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:14.262969   347 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:12:14.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:14.324049   347 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:12:14.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:14.325881   347 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.31.193.1
12:12:14.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:14.380595   334 catalog_manager.cc:1295] Loaded cluster ID: 507f24c506594ea98750e5e56db1464c
12:12:14.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:14.381500   334 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 69776d9211f54a8d843f89abe587ccb9: loading cluster ID for follower catalog manager: success
12:12:14.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:14.389261   334 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 69776d9211f54a8d843f89abe587ccb9: acquiring CA information for follower catalog manager: success
12:12:14.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:14.401576   335 catalog_manager.cc:1295] Loaded cluster ID: 507f24c506594ea98750e5e56db1464c
12:12:14.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:14.402364   335 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 97e44eb6786f4724aafc1b37e0992de4: loading cluster ID for follower catalog manager: success
12:12:14.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:14.408885   334 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 69776d9211f54a8d843f89abe587ccb9: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
12:12:14.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:14.410370   347 tablet_server_runner.cc:78] Tablet server non-default flags:
12:12:14.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:12:14.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.31.193.20:42773
12:12:14.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:12:14.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:12:14.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/ts-0/data
12:12:14.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/ts-0/wal
12:12:14.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:12:14.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:12:14.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.31.193.1:0
12:12:14.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:12:14.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:12:14.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:12:14.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/ts-0/data/info.pb
12:12:14.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.31.193.1
12:12:14.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:12:14.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.31.193.62:43699,127.31.193.61:44677,127.31.193.60:44177
12:12:14.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:12:14.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:12:14.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:12:14.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:12:14.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:12:14.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.31.193.1
12:12:14.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/ts-0/logs
12:12:14.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:12:14.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:12:14.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:12:14.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
12:12:14.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:12:14.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:12:14.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:12:14.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:12:14.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:12:14.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:12:14.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:14.430907   347 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:12:14.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:14.441762   347 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:12:14.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:14.433645   335 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 97e44eb6786f4724aafc1b37e0992de4: acquiring CA information for follower catalog manager: success
12:12:14.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:14.468215   335 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 97e44eb6786f4724aafc1b37e0992de4: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
12:12:14.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:14.516310   353 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:16.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:15.897521   352 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 347
12:12:16.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:16.092346   347 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.567s	user 0.002s	sys 0.000s
12:12:16.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:16.096735   347 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.572s	user 0.002s	sys 0.000s
12:12:16.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:16.094681   356 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:16.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:14.524000   354 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:16.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.109092   347 server_base.cc:1061] running on GCE node
12:12:16.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.111174   347 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:12:16.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.121306   347 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:12:16.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.125635   347 hybrid_clock.cc:648] HybridClock initialized: now 1783512736125528 us; error 99 us; skew 500 ppm
12:12:16.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.127656   347 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:12:16.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.160059   347 webserver.cc:533] Webserver started at http://127.31.193.1:43801/ using document root <none> and password file <none>
12:12:16.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.161872   347 fs_manager.cc:362] Metadata directory not provided
12:12:16.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.162585   347 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:12:16.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.163440   347 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:12:16.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.170670   347 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/ts-0/data/instance:
12:12:16.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "070e7db59797490fac59134d126c1b1d"
12:12:16.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:16 on dist-test-slave-q56p"
12:12:16.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.173019   347 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/ts-0/wal/instance:
12:12:16.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "070e7db59797490fac59134d126c1b1d"
12:12:16.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:16 on dist-test-slave-q56p"
12:12:16.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.190371   347 fs_manager.cc:696] Time spent creating directory manager: real 0.016s	user 0.005s	sys 0.008s
12:12:16.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.204707   364 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:12:16.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.206621   347 fs_manager.cc:730] Time spent opening block manager: real 0.011s	user 0.002s	sys 0.009s
12:12:16.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.207438   347 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/ts-0/data,/tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/ts-0/wal
12:12:16.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "070e7db59797490fac59134d126c1b1d"
12:12:16.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:16 on dist-test-slave-q56p"
12:12:16.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.208356   347 fs_report.cc:389] FS layout report
12:12:16.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:12:16.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/ts-0/wal
12:12:16.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/ts-0/wal
12:12:16.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/ts-0/data/data
12:12:16.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:12:16.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:12:16.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:12:16.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:12:16.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:12:16.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:12:16.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:12:16.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:12:16.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:12:16.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:12:16.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:12:16.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.348842   347 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:12:16.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.353314   347 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:12:16.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.354406   347 kserver.cc:163] Server-wide thread pool size limit: 3276
12:12:16.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.364305   347 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
12:12:16.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.376772   347 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
12:12:16.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.377514   347 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s	user 0.001s	sys 0.000s
12:12:16.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.378077   347 ts_tablet_manager.cc:616] Registered 0 tablets
12:12:16.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.378559   347 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
12:12:16.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.678259   347 rpc_server.cc:307] RPC server started. Bound to: 127.31.193.1:35623
12:12:16.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.678453   477 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.193.1:35623 every 8 connection(s)
12:12:16.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.682578   347 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/ts-0/data/info.pb
12:12:16.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.689774 32516 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZI_19V/build/tsan/bin/kudu as pid 347
12:12:16.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.690433 32516 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/ts-0/wal/instance
12:12:16.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.717597 32516 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZI_19V/build/tsan/bin/kudu
12:12:16.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZI_19V/build/tsan/bin/kudu
12:12:16.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/ts-1/wal
12:12:16.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/ts-1/data
12:12:16.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:12:16.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:12:16.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:12:16.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:12:16.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:12:16.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:12:16.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/ts-1/logs
12:12:16.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/ts-1/data/info.pb
12:12:16.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:12:16.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:12:16.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:12:16.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:12:16.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:12:16.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:12:16.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:12:16.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:12:16.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
12:12:16.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:12:16.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.31.193.2:0
12:12:16.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.31.193.2
12:12:16.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.31.193.2
12:12:16.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:12:16.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.31.193.62:43699,127.31.193.61:44677,127.31.193.60:44177
12:12:16.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.31.193.20:42773
12:12:16.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:12:16.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:12:16.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
12:12:16.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.753871   478 heartbeater.cc:344] Connected to a master server at 127.31.193.60:44177
12:12:16.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.754391   478 heartbeater.cc:461] Registering TS with master...
12:12:16.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.755749   478 heartbeater.cc:507] Master 127.31.193.60:44177 requested a full tablet report, sending...
12:12:16.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.759575 32716 ts_manager.cc:194] Registered new tserver with Master: 070e7db59797490fac59134d126c1b1d (127.31.193.1:35623)
12:12:16.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.762219 32716 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.31.193.1:39441
12:12:16.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.769589   482 heartbeater.cc:344] Connected to a master server at 127.31.193.62:43699
12:12:16.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.769999   482 heartbeater.cc:461] Registering TS with master...
12:12:16.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.770633   482 heartbeater.cc:507] Master 127.31.193.62:43699 requested a full tablet report, sending...
12:12:16.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.774356 32561 ts_manager.cc:194] Registered new tserver with Master: 070e7db59797490fac59134d126c1b1d (127.31.193.1:35623)
12:12:16.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.780643   479 heartbeater.cc:344] Connected to a master server at 127.31.193.61:44677
12:12:16.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.781054   479 heartbeater.cc:461] Registering TS with master...
12:12:16.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.781677   479 heartbeater.cc:507] Master 127.31.193.61:44677 requested a full tablet report, sending...
12:12:16.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:16.784866 32636 ts_manager.cc:194] Registered new tserver with Master: 070e7db59797490fac59134d126c1b1d (127.31.193.1:35623)
12:12:17.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:17.192505   486 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:12:17.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:17.193135   486 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:12:17.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:17.193838   486 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:12:17.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:17.228238   486 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:12:17.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:17.229353   486 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.31.193.2
12:12:17.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:17.267185   486 tablet_server_runner.cc:78] Tablet server non-default flags:
12:12:17.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:12:17.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.31.193.20:42773
12:12:17.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:12:17.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:12:17.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/ts-1/data
12:12:17.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/ts-1/wal
12:12:17.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:12:17.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:12:17.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.31.193.2:0
12:12:17.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:12:17.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:12:17.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:12:17.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/ts-1/data/info.pb
12:12:17.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.31.193.2
12:12:17.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:12:17.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.31.193.62:43699,127.31.193.61:44677,127.31.193.60:44177
12:12:17.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:12:17.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:12:17.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:12:17.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:12:17.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:12:17.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.31.193.2
12:12:17.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/ts-1/logs
12:12:17.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:12:17.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:12:17.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:12:17.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
12:12:17.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:12:17.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:12:17.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:12:17.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:12:17.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:12:17.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:12:17.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:17.268929   486 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:12:17.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:17.271215   486 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:12:17.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:17.286585   494 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:17.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:17.771723   478 heartbeater.cc:499] Master 127.31.193.60:44177 was elected leader, sending a full tablet report...
12:12:18.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:17.288618   495 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:18.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:17.290634   497 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:18.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:18.558177   496 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1268 milliseconds
12:12:18.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.558341   486 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
12:12:18.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.559787   486 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:12:18.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.562574   486 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:12:18.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.564031   486 hybrid_clock.cc:648] HybridClock initialized: now 1783512738563999 us; error 41 us; skew 500 ppm
12:12:18.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.564992   486 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:12:18.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.572939   486 webserver.cc:533] Webserver started at http://127.31.193.2:34437/ using document root <none> and password file <none>
12:12:18.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.574172   486 fs_manager.cc:362] Metadata directory not provided
12:12:18.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.574469   486 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:12:18.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.575052   486 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:12:18.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.580207   486 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/ts-1/data/instance:
12:12:18.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "689fcffa87c4466aa407c24ad2d47763"
12:12:18.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:18 on dist-test-slave-q56p"
12:12:18.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.581787   486 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/ts-1/wal/instance:
12:12:18.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "689fcffa87c4466aa407c24ad2d47763"
12:12:18.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:18 on dist-test-slave-q56p"
12:12:18.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.589666   486 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.009s	sys 0.000s
12:12:18.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.596400   504 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:12:18.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.597678   486 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.002s
12:12:18.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.597975   486 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/ts-1/data,/tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/ts-1/wal
12:12:18.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "689fcffa87c4466aa407c24ad2d47763"
12:12:18.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:18 on dist-test-slave-q56p"
12:12:18.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.598311   486 fs_report.cc:389] FS layout report
12:12:18.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:12:18.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/ts-1/wal
12:12:18.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/ts-1/wal
12:12:18.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/ts-1/data/data
12:12:18.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:12:18.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:12:18.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:12:18.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:12:18.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:12:18.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:12:18.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:12:18.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:12:18.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:12:18.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:12:18.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:12:18.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.650279   486 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:12:18.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.651841   486 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:12:18.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.652257   486 kserver.cc:163] Server-wide thread pool size limit: 3276
12:12:18.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.655149   486 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
12:12:18.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.659152   486 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
12:12:18.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.659343   486 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
12:12:18.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.659622   486 ts_tablet_manager.cc:616] Registered 0 tablets
12:12:18.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.659775   486 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
12:12:18.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.849748   486 rpc_server.cc:307] RPC server started. Bound to: 127.31.193.2:37917
12:12:18.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.849879   617 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.193.2:37917 every 8 connection(s)
12:12:18.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.852804   486 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/ts-1/data/info.pb
12:12:18.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.863013 32516 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZI_19V/build/tsan/bin/kudu as pid 486
12:12:18.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.864244 32516 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/ts-1/wal/instance
12:12:18.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.894109 32516 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskZI_19V/build/tsan/bin/kudu
12:12:18.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskZI_19V/build/tsan/bin/kudu
12:12:18.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/ts-2/wal
12:12:18.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/ts-2/data
12:12:18.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
12:12:18.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
12:12:18.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
12:12:18.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:12:18.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:12:18.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:12:18.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/ts-2/logs
12:12:18.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/ts-2/data/info.pb
12:12:18.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:12:18.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
12:12:18.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
12:12:18.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
12:12:18.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
12:12:18.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:12:18.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:12:18.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:12:18.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
12:12:18.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
12:12:18.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.31.193.3:0
12:12:18.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.31.193.3
12:12:18.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.31.193.3
12:12:18.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:12:18.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.31.193.62:43699,127.31.193.61:44677,127.31.193.60:44177
12:12:18.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.31.193.20:42773
12:12:18.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:12:18.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:12:18.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
12:12:18.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.907280   618 heartbeater.cc:344] Connected to a master server at 127.31.193.60:44177
12:12:18.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.907367   620 heartbeater.cc:344] Connected to a master server at 127.31.193.62:43699
12:12:18.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.907830   618 heartbeater.cc:461] Registering TS with master...
12:12:18.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.907931   620 heartbeater.cc:461] Registering TS with master...
12:12:18.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.909509   620 heartbeater.cc:507] Master 127.31.193.62:43699 requested a full tablet report, sending...
12:12:18.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.909643   618 heartbeater.cc:507] Master 127.31.193.60:44177 requested a full tablet report, sending...
12:12:18.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.912145   619 heartbeater.cc:344] Connected to a master server at 127.31.193.61:44677
12:12:18.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.912376 32716 ts_manager.cc:194] Registered new tserver with Master: 689fcffa87c4466aa407c24ad2d47763 (127.31.193.2:37917)
12:12:18.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.912500   619 heartbeater.cc:461] Registering TS with master...
12:12:18.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.912827 32561 ts_manager.cc:194] Registered new tserver with Master: 689fcffa87c4466aa407c24ad2d47763 (127.31.193.2:37917)
12:12:18.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.913499   619 heartbeater.cc:507] Master 127.31.193.61:44677 requested a full tablet report, sending...
12:12:18.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.914182 32716 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.31.193.2:41191
12:12:18.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:18.917163 32636 ts_manager.cc:194] Registered new tserver with Master: 689fcffa87c4466aa407c24ad2d47763 (127.31.193.2:37917)
12:12:19.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:19.236419   628 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
12:12:19.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:19.236989   628 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
12:12:19.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:19.237558   628 flags.cc:432] Enabled unsafe flag: --never_fsync=true
12:12:19.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:19.270063   628 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
12:12:19.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:19.271062   628 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.31.193.3
12:12:19.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:19.307261   628 tablet_server_runner.cc:78] Tablet server non-default flags:
12:12:19.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
12:12:19.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.31.193.20:42773
12:12:19.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
12:12:19.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
12:12:19.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/ts-2/data
12:12:19.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/ts-2/wal
12:12:19.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
12:12:19.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
12:12:19.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.31.193.3:0
12:12:19.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
12:12:19.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
12:12:19.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
12:12:19.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/ts-2/data/info.pb
12:12:19.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.31.193.3
12:12:19.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
12:12:19.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.31.193.62:43699,127.31.193.61:44677,127.31.193.60:44177
12:12:19.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
12:12:19.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
12:12:19.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
12:12:19.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
12:12:19.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
12:12:19.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.31.193.3
12:12:19.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/ts-2/logs
12:12:19.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
12:12:19.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
12:12:19.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
12:12:19.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
12:12:19.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
12:12:19.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 8aadabe0236da0a312e7e3764fada9dc81e70c40
12:12:19.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
12:12:19.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 11:49:08 UTC on e7f111948823
12:12:19.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16857
12:12:19.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
12:12:19.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:19.309111   628 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
12:12:19.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:19.310917   628 file_cache.cc:492] Constructed file cache file cache with capacity 419430
12:12:19.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:19.325984   634 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:19.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:19.924044   618 heartbeater.cc:499] Master 127.31.193.60:44177 was elected leader, sending a full tablet report...
12:12:20.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:20.727674   633 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 628
12:12:20.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:20.894296   628 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.568s	user 0.564s	sys 0.963s
12:12:20.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:20.894683   628 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.569s	user 0.564s	sys 0.963s
12:12:20.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:19.327217   635 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:20.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:20.897980   637 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
12:12:20.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:20.900983   636 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1568 milliseconds
12:12:20.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:20.901007   628 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
12:12:20.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:20.902271   628 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
12:12:20.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:20.904727   628 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
12:12:20.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:20.906122   628 hybrid_clock.cc:648] HybridClock initialized: now 1783512740906088 us; error 36 us; skew 500 ppm
12:12:20.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:20.906945   628 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
12:12:20.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:20.913424   628 webserver.cc:533] Webserver started at http://127.31.193.3:43351/ using document root <none> and password file <none>
12:12:20.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:20.914378   628 fs_manager.cc:362] Metadata directory not provided
12:12:20.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:20.914624   628 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
12:12:20.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:20.915153   628 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
12:12:20.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:20.919421   628 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/ts-2/data/instance:
12:12:20.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "4aed21764419472082baa376679878ff"
12:12:20.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:20 on dist-test-slave-q56p"
12:12:20.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:20.920641   628 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/ts-2/wal/instance:
12:12:20.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "4aed21764419472082baa376679878ff"
12:12:20.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:20 on dist-test-slave-q56p"
12:12:20.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:20.928932   628 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.008s	sys 0.000s
12:12:20.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:20.935957   644 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
12:12:20.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:20.937211   628 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.003s	sys 0.001s
12:12:20.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:20.937510   628 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/ts-2/data,/tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/ts-2/wal
12:12:20.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "4aed21764419472082baa376679878ff"
12:12:20.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 12:12:20 on dist-test-slave-q56p"
12:12:20.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:20.937824   628 fs_report.cc:389] FS layout report
12:12:20.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
12:12:20.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/ts-2/wal
12:12:20.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/ts-2/wal
12:12:20.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/ts-2/data/data
12:12:20.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
12:12:20.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
12:12:20.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
12:12:20.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
12:12:20.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
12:12:20.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
12:12:20.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
12:12:20.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
12:12:20.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
12:12:20.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
12:12:20.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
12:12:20.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:20.994730   628 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
12:12:20.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:20.996186   628 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
12:12:20.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:20.996618   628 kserver.cc:163] Server-wide thread pool size limit: 3276
12:12:20.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:20.999550   628 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
12:12:21.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.004029   628 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
12:12:21.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.004231   628 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
12:12:21.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.004575   628 ts_tablet_manager.cc:616] Registered 0 tablets
12:12:21.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.004792   628 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
12:12:21.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.160168   628 rpc_server.cc:307] RPC server started. Bound to: 127.31.193.3:41701
12:12:21.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.160322   757 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.31.193.3:41701 every 8 connection(s)
12:12:21.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.162698   628 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/ts-2/data/info.pb
12:12:21.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.163890 32516 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskZI_19V/build/tsan/bin/kudu as pid 628
12:12:21.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.164398 32516 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskZI_19V/test-tmp/mini-kudu-cluster5690854071644545161/ts-2/wal/instance
12:12:21.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.202067   758 heartbeater.cc:344] Connected to a master server at 127.31.193.60:44177
12:12:21.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.202374   760 heartbeater.cc:344] Connected to a master server at 127.31.193.62:43699
12:12:21.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.202427   759 heartbeater.cc:344] Connected to a master server at 127.31.193.61:44677
12:12:21.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.202632   758 heartbeater.cc:461] Registering TS with master...
12:12:21.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.202837   759 heartbeater.cc:461] Registering TS with master...
12:12:21.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.202849   760 heartbeater.cc:461] Registering TS with master...
12:12:21.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.204082   760 heartbeater.cc:507] Master 127.31.193.62:43699 requested a full tablet report, sending...
12:12:21.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.204250   759 heartbeater.cc:507] Master 127.31.193.61:44677 requested a full tablet report, sending...
12:12:21.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.204263   758 heartbeater.cc:507] Master 127.31.193.60:44177 requested a full tablet report, sending...
12:12:21.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.207971 32716 ts_manager.cc:194] Registered new tserver with Master: 4aed21764419472082baa376679878ff (127.31.193.3:41701)
12:12:21.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.208309 32561 ts_manager.cc:194] Registered new tserver with Master: 4aed21764419472082baa376679878ff (127.31.193.3:41701)
12:12:21.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.208819 32636 ts_manager.cc:194] Registered new tserver with Master: 4aed21764419472082baa376679878ff (127.31.193.3:41701)
12:12:21.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.210246 32716 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.31.193.3:54673
12:12:21.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:21.221627 32516 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
12:12:21.233 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
12:12:21.235 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

12:12:21.245 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.31.193.62"
      port: 43699
    }
    bound_http_address {
      host: "127.31.193.62"
      port: 43661
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.31.193.61"
      port: 44677
    }
    bound_http_address {
      host: "127.31.193.61"
      port: 42995
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.31.193.60"
      port: 44177
    }
    bound_http_address {
      host: "127.31.193.60"
      port: 42115
    }
  }
}

12:12:21.248 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

12:12:21.251 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.31.193.1"
      port: 35623
    }
    bound_http_address {
      host: "127.31.193.1"
      port: 43801
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.31.193.2"
      port: 37917
    }
    bound_http_address {
      host: "127.31.193.2"
      port: 34437
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.31.193.3"
      port: 41701
    }
    bound_http_address {
      host: "127.31.193.3"
      port: 43351
    }
  }
}

12:12:21.251 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
12:12:21.427 [DEBUG - main] (CompositeStrategy.java:59) Unable to load modern Subject methods, relying only on legacy methods
java.lang.NoSuchMethodException: javax.security.auth.Subject.current()
	at java.base/java.lang.Class.getDeclaredMethod(Class.java:2677)
	at org.apache.kudu.client.internals.ModernStrategy.<init>(ModernStrategy.java:51)
	at org.apache.kudu.client.internals.CompositeStrategy.<init>(CompositeStrategy.java:52)
	at org.apache.kudu.client.internals.CompositeStrategy.<clinit>(CompositeStrategy.java:41)
	at org.apache.kudu.client.internals.SecurityManagerCompatibility.get(SecurityManagerCompatibility.java:43)
	at org.apache.kudu.client.SecurityContext.setupSubject(SecurityContext.java:155)
	at org.apache.kudu.client.SecurityContext.<init>(SecurityContext.java:138)
	at org.apache.kudu.client.AsyncKuduClient.<init>(AsyncKuduClient.java:431)
	at org.apache.kudu.client.AsyncKuduClient$AsyncKuduClientBuilder.build(AsyncKuduClient.java:3109)
	at org.apache.kudu.test.KuduTestHarness.before(KuduTestHarness.java:161)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:50)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.doOneAttempt(RetryRule.java:225)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.evaluate(RetryRule.java:246)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runners.Suite.runChild(Suite.java:128)
	at org.junit.runners.Suite.runChild(Suite.java:27)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
	at org.junit.runner.JUnitCore.runMain(JUnitCore.java:77)
	at org.junit.runner.JUnitCore.main(JUnitCore.java:36)
12:12:21.489 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
12:12:21.642 [DEBUG - main] (Connection.java:748) [peer master-127.31.193.61:44677(127.31.193.61:44677)] connecting to peer
12:12:21.699 [DEBUG - main] (Connection.java:748) [peer master-127.31.193.62:43699(127.31.193.62:43699)] connecting to peer
12:12:21.701 [DEBUG - main] (Connection.java:748) [peer master-127.31.193.60:44177(127.31.193.60:44177)] connecting to peer
12:12:21.721 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.31.193.61:44677(127.31.193.61:44677)] Successfully connected to peer
12:12:21.721 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.31.193.62:43699(127.31.193.62:43699)] Successfully connected to peer
12:12:21.734 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.31.193.60:44177(127.31.193.60:44177)] Successfully connected to peer
12:12:21.838 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.31.193.61
12:12:21.838 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.31.193.62
12:12:21.840 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.31.193.60
12:12:22.070 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xd9015109, L:/127.0.0.1:42132 - R:/127.31.193.61:44677] using SASL/PLAIN
12:12:22.070 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x3bbcdedf, L:/127.0.0.1:47090 - R:/127.31.193.60:44177] using SASL/PLAIN
12:12:22.070 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x3307c551, L:/127.0.0.1:55026 - R:/127.31.193.62:43699] using SASL/PLAIN
12:12:22.107 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
12:12:22.108 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=505), Traces: [0ms] refreshing cache from master, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.193.61:44677, [92ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.193.62:43699, [95ms] Sub RPC ConnectToMaster: sending RPC to server master-127.31.193.60:44177, [479ms] Sub RPC ConnectToMaster: received response from server master-127.31.193.61:44677: OK, [479ms] Sub RPC ConnectToMaster: received response from server master-127.31.193.62:43699: OK, [480ms] Sub RPC ConnectToMaster: received response from server master-127.31.193.60:44177: OK, deferred=null) after lookup
12:12:22.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.156539 32716 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47090:
12:12:22.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "org.apache.kudu.client.TestLeaderFailover-1783512724564"
12:12:22.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
12:12:22.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:12:22.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key"
12:12:22.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
12:12:22.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
12:12:22.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:12:22.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:12:22.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:12:22.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:12:22.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:12:22.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:12:22.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column1_i"
12:12:22.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
12:12:22.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
12:12:22.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:12:22.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:12:22.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:12:22.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:12:22.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:12:22.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:12:22.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column2_i"
12:12:22.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
12:12:22.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
12:12:22.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:12:22.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:12:22.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:12:22.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:12:22.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:12:22.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:12:22.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column3_s"
12:12:22.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
12:12:22.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
12:12:22.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: true
12:12:22.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: DICT_ENCODING
12:12:22.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: LZ4
12:12:22.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 4096
12:12:22.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:12:22.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:12:22.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:12:22.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
12:12:22.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column4_b"
12:12:22.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BOOL
12:12:22.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
12:12:22.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
12:12:22.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
12:12:22.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
12:12:22.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
12:12:22.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:12:22.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
12:12:22.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
12:12:22.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
12:12:22.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
12:12:22.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key"
12:12:22.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
12:12:22.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
12:12:22.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
12:12:22.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:22.161299 32716 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table org.apache.kudu.client.TestLeaderFailover-1783512724564 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
12:12:22.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.214854   758 heartbeater.cc:499] Master 127.31.193.60:44177 was elected leader, sending a full tablet report...
12:12:22.237 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 4b67ef1095484cbe87215d495b18a974
12:12:22.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.270071   552 tablet_service.cc:1511] Processing CreateTablet for tablet d36b4fb4e49f42a093d1b247f6c081a1 (DEFAULT_TABLE table=org.apache.kudu.client.TestLeaderFailover-1783512724564 [id=4b67ef1095484cbe87215d495b18a974]), partition=RANGE (key) PARTITION UNBOUNDED
12:12:22.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.274295   552 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d36b4fb4e49f42a093d1b247f6c081a1. 1 dirs total, 0 dirs full, 0 dirs failed
12:12:22.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.305825   791 tablet_bootstrap.cc:492] T d36b4fb4e49f42a093d1b247f6c081a1 P 689fcffa87c4466aa407c24ad2d47763: Bootstrap starting.
12:12:22.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.312645   692 tablet_service.cc:1511] Processing CreateTablet for tablet d36b4fb4e49f42a093d1b247f6c081a1 (DEFAULT_TABLE table=org.apache.kudu.client.TestLeaderFailover-1783512724564 [id=4b67ef1095484cbe87215d495b18a974]), partition=RANGE (key) PARTITION UNBOUNDED
12:12:22.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.315599   692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d36b4fb4e49f42a093d1b247f6c081a1. 1 dirs total, 0 dirs full, 0 dirs failed
12:12:22.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.317219   791 tablet_bootstrap.cc:654] T d36b4fb4e49f42a093d1b247f6c081a1 P 689fcffa87c4466aa407c24ad2d47763: Neither blocks nor log segments found. Creating new log.
12:12:22.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.320607   791 log.cc:826] T d36b4fb4e49f42a093d1b247f6c081a1 P 689fcffa87c4466aa407c24ad2d47763: Log is configured to *not* fsync() on all Append() calls
12:12:22.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.322983   413 tablet_service.cc:1511] Processing CreateTablet for tablet d36b4fb4e49f42a093d1b247f6c081a1 (DEFAULT_TABLE table=org.apache.kudu.client.TestLeaderFailover-1783512724564 [id=4b67ef1095484cbe87215d495b18a974]), partition=RANGE (key) PARTITION UNBOUNDED
12:12:22.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.324914   413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d36b4fb4e49f42a093d1b247f6c081a1. 1 dirs total, 0 dirs full, 0 dirs failed
12:12:22.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.334054   791 tablet_bootstrap.cc:492] T d36b4fb4e49f42a093d1b247f6c081a1 P 689fcffa87c4466aa407c24ad2d47763: No bootstrap required, opened a new log
12:12:22.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.334635   791 ts_tablet_manager.cc:1403] T d36b4fb4e49f42a093d1b247f6c081a1 P 689fcffa87c4466aa407c24ad2d47763: Time spent bootstrapping tablet: real 0.029s	user 0.004s	sys 0.018s
12:12:22.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.357889   793 tablet_bootstrap.cc:492] T d36b4fb4e49f42a093d1b247f6c081a1 P 4aed21764419472082baa376679878ff: Bootstrap starting.
12:12:22.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.366205   791 raft_consensus.cc:359] T d36b4fb4e49f42a093d1b247f6c081a1 P 689fcffa87c4466aa407c24ad2d47763 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4aed21764419472082baa376679878ff" member_type: VOTER last_known_addr { host: "127.31.193.3" port: 41701 } } peers { permanent_uuid: "689fcffa87c4466aa407c24ad2d47763" member_type: VOTER last_known_addr { host: "127.31.193.2" port: 37917 } } peers { permanent_uuid: "070e7db59797490fac59134d126c1b1d" member_type: VOTER last_known_addr { host: "127.31.193.1" port: 35623 } }
12:12:22.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.369186   791 raft_consensus.cc:385] T d36b4fb4e49f42a093d1b247f6c081a1 P 689fcffa87c4466aa407c24ad2d47763 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:12:22.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.369521   791 raft_consensus.cc:740] T d36b4fb4e49f42a093d1b247f6c081a1 P 689fcffa87c4466aa407c24ad2d47763 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 689fcffa87c4466aa407c24ad2d47763, State: Initialized, Role: FOLLOWER
12:12:22.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.371702   794 tablet_bootstrap.cc:492] T d36b4fb4e49f42a093d1b247f6c081a1 P 070e7db59797490fac59134d126c1b1d: Bootstrap starting.
12:12:22.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.370702   791 consensus_queue.cc:260] T d36b4fb4e49f42a093d1b247f6c081a1 P 689fcffa87c4466aa407c24ad2d47763 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4aed21764419472082baa376679878ff" member_type: VOTER last_known_addr { host: "127.31.193.3" port: 41701 } } peers { permanent_uuid: "689fcffa87c4466aa407c24ad2d47763" member_type: VOTER last_known_addr { host: "127.31.193.2" port: 37917 } } peers { permanent_uuid: "070e7db59797490fac59134d126c1b1d" member_type: VOTER last_known_addr { host: "127.31.193.1" port: 35623 } }
12:12:22.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.373088   793 tablet_bootstrap.cc:654] T d36b4fb4e49f42a093d1b247f6c081a1 P 4aed21764419472082baa376679878ff: Neither blocks nor log segments found. Creating new log.
12:12:22.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.375627   793 log.cc:826] T d36b4fb4e49f42a093d1b247f6c081a1 P 4aed21764419472082baa376679878ff: Log is configured to *not* fsync() on all Append() calls
12:12:22.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.381327   791 ts_tablet_manager.cc:1434] T d36b4fb4e49f42a093d1b247f6c081a1 P 689fcffa87c4466aa407c24ad2d47763: Time spent starting tablet: real 0.046s	user 0.024s	sys 0.015s
12:12:22.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.385658   793 tablet_bootstrap.cc:492] T d36b4fb4e49f42a093d1b247f6c081a1 P 4aed21764419472082baa376679878ff: No bootstrap required, opened a new log
12:12:22.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.386195   793 ts_tablet_manager.cc:1403] T d36b4fb4e49f42a093d1b247f6c081a1 P 4aed21764419472082baa376679878ff: Time spent bootstrapping tablet: real 0.029s	user 0.001s	sys 0.018s
12:12:22.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:22.391088   622 tablet.cc:2406] T d36b4fb4e49f42a093d1b247f6c081a1 P 689fcffa87c4466aa407c24ad2d47763: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:12:22.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.392161   794 tablet_bootstrap.cc:654] T d36b4fb4e49f42a093d1b247f6c081a1 P 070e7db59797490fac59134d126c1b1d: Neither blocks nor log segments found. Creating new log.
12:12:22.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.394852   794 log.cc:826] T d36b4fb4e49f42a093d1b247f6c081a1 P 070e7db59797490fac59134d126c1b1d: Log is configured to *not* fsync() on all Append() calls
12:12:22.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.411471   794 tablet_bootstrap.cc:492] T d36b4fb4e49f42a093d1b247f6c081a1 P 070e7db59797490fac59134d126c1b1d: No bootstrap required, opened a new log
12:12:22.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.412103   794 ts_tablet_manager.cc:1403] T d36b4fb4e49f42a093d1b247f6c081a1 P 070e7db59797490fac59134d126c1b1d: Time spent bootstrapping tablet: real 0.041s	user 0.009s	sys 0.019s
12:12:22.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.414669   793 raft_consensus.cc:359] T d36b4fb4e49f42a093d1b247f6c081a1 P 4aed21764419472082baa376679878ff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4aed21764419472082baa376679878ff" member_type: VOTER last_known_addr { host: "127.31.193.3" port: 41701 } } peers { permanent_uuid: "689fcffa87c4466aa407c24ad2d47763" member_type: VOTER last_known_addr { host: "127.31.193.2" port: 37917 } } peers { permanent_uuid: "070e7db59797490fac59134d126c1b1d" member_type: VOTER last_known_addr { host: "127.31.193.1" port: 35623 } }
12:12:22.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.415329   793 raft_consensus.cc:385] T d36b4fb4e49f42a093d1b247f6c081a1 P 4aed21764419472082baa376679878ff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:12:22.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.415699   793 raft_consensus.cc:740] T d36b4fb4e49f42a093d1b247f6c081a1 P 4aed21764419472082baa376679878ff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4aed21764419472082baa376679878ff, State: Initialized, Role: FOLLOWER
12:12:22.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.416618   793 consensus_queue.cc:260] T d36b4fb4e49f42a093d1b247f6c081a1 P 4aed21764419472082baa376679878ff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4aed21764419472082baa376679878ff" member_type: VOTER last_known_addr { host: "127.31.193.3" port: 41701 } } peers { permanent_uuid: "689fcffa87c4466aa407c24ad2d47763" member_type: VOTER last_known_addr { host: "127.31.193.2" port: 37917 } } peers { permanent_uuid: "070e7db59797490fac59134d126c1b1d" member_type: VOTER last_known_addr { host: "127.31.193.1" port: 35623 } }
12:12:22.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.421839   793 ts_tablet_manager.cc:1434] T d36b4fb4e49f42a093d1b247f6c081a1 P 4aed21764419472082baa376679878ff: Time spent starting tablet: real 0.035s	user 0.034s	sys 0.000s
12:12:22.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:22.426482   761 tablet.cc:2406] T d36b4fb4e49f42a093d1b247f6c081a1 P 4aed21764419472082baa376679878ff: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:12:22.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.447578   794 raft_consensus.cc:359] T d36b4fb4e49f42a093d1b247f6c081a1 P 070e7db59797490fac59134d126c1b1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4aed21764419472082baa376679878ff" member_type: VOTER last_known_addr { host: "127.31.193.3" port: 41701 } } peers { permanent_uuid: "689fcffa87c4466aa407c24ad2d47763" member_type: VOTER last_known_addr { host: "127.31.193.2" port: 37917 } } peers { permanent_uuid: "070e7db59797490fac59134d126c1b1d" member_type: VOTER last_known_addr { host: "127.31.193.1" port: 35623 } }
12:12:22.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.448310   794 raft_consensus.cc:385] T d36b4fb4e49f42a093d1b247f6c081a1 P 070e7db59797490fac59134d126c1b1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
12:12:22.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.448602   794 raft_consensus.cc:740] T d36b4fb4e49f42a093d1b247f6c081a1 P 070e7db59797490fac59134d126c1b1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 070e7db59797490fac59134d126c1b1d, State: Initialized, Role: FOLLOWER
12:12:22.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.449559   794 consensus_queue.cc:260] T d36b4fb4e49f42a093d1b247f6c081a1 P 070e7db59797490fac59134d126c1b1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4aed21764419472082baa376679878ff" member_type: VOTER last_known_addr { host: "127.31.193.3" port: 41701 } } peers { permanent_uuid: "689fcffa87c4466aa407c24ad2d47763" member_type: VOTER last_known_addr { host: "127.31.193.2" port: 37917 } } peers { permanent_uuid: "070e7db59797490fac59134d126c1b1d" member_type: VOTER last_known_addr { host: "127.31.193.1" port: 35623 } }
12:12:22.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.457489   794 ts_tablet_manager.cc:1434] T d36b4fb4e49f42a093d1b247f6c081a1 P 070e7db59797490fac59134d126c1b1d: Time spent starting tablet: real 0.045s	user 0.030s	sys 0.002s
12:12:22.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.472122   798 raft_consensus.cc:493] T d36b4fb4e49f42a093d1b247f6c081a1 P 4aed21764419472082baa376679878ff [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
12:12:22.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.472714   798 raft_consensus.cc:515] T d36b4fb4e49f42a093d1b247f6c081a1 P 4aed21764419472082baa376679878ff [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4aed21764419472082baa376679878ff" member_type: VOTER last_known_addr { host: "127.31.193.3" port: 41701 } } peers { permanent_uuid: "689fcffa87c4466aa407c24ad2d47763" member_type: VOTER last_known_addr { host: "127.31.193.2" port: 37917 } } peers { permanent_uuid: "070e7db59797490fac59134d126c1b1d" member_type: VOTER last_known_addr { host: "127.31.193.1" port: 35623 } }
12:12:22.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.477973   798 leader_election.cc:290] T d36b4fb4e49f42a093d1b247f6c081a1 P 4aed21764419472082baa376679878ff [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 689fcffa87c4466aa407c24ad2d47763 (127.31.193.2:37917), 070e7db59797490fac59134d126c1b1d (127.31.193.1:35623)
12:12:22.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:22.479122   485 tablet.cc:2406] T d36b4fb4e49f42a093d1b247f6c081a1 P 070e7db59797490fac59134d126c1b1d: Can't schedule compaction. Clean time has not been advanced past its initial value.
12:12:22.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.497444   573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36b4fb4e49f42a093d1b247f6c081a1" candidate_uuid: "4aed21764419472082baa376679878ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "689fcffa87c4466aa407c24ad2d47763" is_pre_election: true
12:12:22.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.498354   573 raft_consensus.cc:2468] T d36b4fb4e49f42a093d1b247f6c081a1 P 689fcffa87c4466aa407c24ad2d47763 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4aed21764419472082baa376679878ff in term 0.
12:12:22.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.500190   647 leader_election.cc:304] T d36b4fb4e49f42a093d1b247f6c081a1 P 4aed21764419472082baa376679878ff [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4aed21764419472082baa376679878ff, 689fcffa87c4466aa407c24ad2d47763; no voters: 
12:12:22.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.501077   798 raft_consensus.cc:2804] T d36b4fb4e49f42a093d1b247f6c081a1 P 4aed21764419472082baa376679878ff [term 0 FOLLOWER]: Leader pre-election won for term 1
12:12:22.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.501453   798 raft_consensus.cc:493] T d36b4fb4e49f42a093d1b247f6c081a1 P 4aed21764419472082baa376679878ff [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
12:12:22.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.501785   798 raft_consensus.cc:3060] T d36b4fb4e49f42a093d1b247f6c081a1 P 4aed21764419472082baa376679878ff [term 0 FOLLOWER]: Advancing to term 1
12:12:22.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.508849   433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36b4fb4e49f42a093d1b247f6c081a1" candidate_uuid: "4aed21764419472082baa376679878ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "070e7db59797490fac59134d126c1b1d" is_pre_election: true
12:12:22.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.509240   798 raft_consensus.cc:515] T d36b4fb4e49f42a093d1b247f6c081a1 P 4aed21764419472082baa376679878ff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4aed21764419472082baa376679878ff" member_type: VOTER last_known_addr { host: "127.31.193.3" port: 41701 } } peers { permanent_uuid: "689fcffa87c4466aa407c24ad2d47763" member_type: VOTER last_known_addr { host: "127.31.193.2" port: 37917 } } peers { permanent_uuid: "070e7db59797490fac59134d126c1b1d" member_type: VOTER last_known_addr { host: "127.31.193.1" port: 35623 } }
12:12:22.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.509714   433 raft_consensus.cc:2468] T d36b4fb4e49f42a093d1b247f6c081a1 P 070e7db59797490fac59134d126c1b1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4aed21764419472082baa376679878ff in term 0.
12:12:22.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.511868   573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36b4fb4e49f42a093d1b247f6c081a1" candidate_uuid: "4aed21764419472082baa376679878ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "689fcffa87c4466aa407c24ad2d47763"
12:12:22.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.512095   798 leader_election.cc:290] T d36b4fb4e49f42a093d1b247f6c081a1 P 4aed21764419472082baa376679878ff [CANDIDATE]: Term 1 election: Requested vote from peers 689fcffa87c4466aa407c24ad2d47763 (127.31.193.2:37917), 070e7db59797490fac59134d126c1b1d (127.31.193.1:35623)
12:12:22.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.512427   573 raft_consensus.cc:3060] T d36b4fb4e49f42a093d1b247f6c081a1 P 689fcffa87c4466aa407c24ad2d47763 [term 0 FOLLOWER]: Advancing to term 1
12:12:22.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.514480   433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36b4fb4e49f42a093d1b247f6c081a1" candidate_uuid: "4aed21764419472082baa376679878ff" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "070e7db59797490fac59134d126c1b1d"
12:12:22.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.515023   433 raft_consensus.cc:3060] T d36b4fb4e49f42a093d1b247f6c081a1 P 070e7db59797490fac59134d126c1b1d [term 0 FOLLOWER]: Advancing to term 1
12:12:22.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.520468   573 raft_consensus.cc:2468] T d36b4fb4e49f42a093d1b247f6c081a1 P 689fcffa87c4466aa407c24ad2d47763 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4aed21764419472082baa376679878ff in term 1.
12:12:22.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.521574   647 leader_election.cc:304] T d36b4fb4e49f42a093d1b247f6c081a1 P 4aed21764419472082baa376679878ff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4aed21764419472082baa376679878ff, 689fcffa87c4466aa407c24ad2d47763; no voters: 
12:12:22.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.521935   433 raft_consensus.cc:2468] T d36b4fb4e49f42a093d1b247f6c081a1 P 070e7db59797490fac59134d126c1b1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4aed21764419472082baa376679878ff in term 1.
12:12:22.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.522527   798 raft_consensus.cc:2804] T d36b4fb4e49f42a093d1b247f6c081a1 P 4aed21764419472082baa376679878ff [term 1 FOLLOWER]: Leader election won for term 1
12:12:22.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.525331   798 raft_consensus.cc:697] T d36b4fb4e49f42a093d1b247f6c081a1 P 4aed21764419472082baa376679878ff [term 1 LEADER]: Becoming Leader. State: Replica: 4aed21764419472082baa376679878ff, State: Running, Role: LEADER
12:12:22.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.526299   798 consensus_queue.cc:237] T d36b4fb4e49f42a093d1b247f6c081a1 P 4aed21764419472082baa376679878ff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4aed21764419472082baa376679878ff" member_type: VOTER last_known_addr { host: "127.31.193.3" port: 41701 } } peers { permanent_uuid: "689fcffa87c4466aa407c24ad2d47763" member_type: VOTER last_known_addr { host: "127.31.193.2" port: 37917 } } peers { permanent_uuid: "070e7db59797490fac59134d126c1b1d" member_type: VOTER last_known_addr { host: "127.31.193.1" port: 35623 } }
12:12:22.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.541863 32716 catalog_manager.cc:5697] T d36b4fb4e49f42a093d1b247f6c081a1 P 4aed21764419472082baa376679878ff reported cstate change: term changed from 0 to 1, leader changed from <none> to 4aed21764419472082baa376679878ff (127.31.193.3). New cstate: current_term: 1 leader_uuid: "4aed21764419472082baa376679878ff" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4aed21764419472082baa376679878ff" member_type: VOTER last_known_addr { host: "127.31.193.3" port: 41701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "689fcffa87c4466aa407c24ad2d47763" member_type: VOTER last_known_addr { host: "127.31.193.2" port: 37917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "070e7db59797490fac59134d126c1b1d" member_type: VOTER last_known_addr { host: "127.31.193.1" port: 35623 } health_report { overall_health: UNKNOWN } } }
12:12:22.713 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 4b67ef1095484cbe87215d495b18a974
12:12:22.737 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet d36b4fb4e49f42a093d1b247f6c081a1 for table 'org.apache.kudu.client.TestLeaderFailover-1783512724564' with partition [<start>, <end>)
12:12:22.745 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299993, tablet=d36b4fb4e49f42a093d1b247f6c081a1@[070e7db59797490fac59134d126c1b1d(127.31.193.1:35623),4aed21764419472082baa376679878ff(127.31.193.3:41701)[L],689fcffa87c4466aa407c24ad2d47763(127.31.193.2:37917)]}]
12:12:22.746 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=21), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.193.60:44177, [11ms] Sub RPC GetTableLocations: received response from server master-127.31.193.60:44177: OK, deferred=null) after lookup
12:12:22.767 [DEBUG - kudu-nio-2] (Connection.java:748) [peer 4aed21764419472082baa376679878ff(127.31.193.3:41701)] connecting to peer
12:12:22.774 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 4aed21764419472082baa376679878ff(127.31.193.3:41701)] Successfully connected to peer
12:12:22.873 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0xda4098e4, L:/127.0.0.1:52962 - R:/127.31.193.3:41701] using TOKEN/null
12:12:22.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.890431   573 raft_consensus.cc:1275] T d36b4fb4e49f42a093d1b247f6c081a1 P 689fcffa87c4466aa407c24ad2d47763 [term 1 FOLLOWER]: Refusing update from remote peer 4aed21764419472082baa376679878ff: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
12:12:22.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.890424   433 raft_consensus.cc:1275] T d36b4fb4e49f42a093d1b247f6c081a1 P 070e7db59797490fac59134d126c1b1d [term 1 FOLLOWER]: Refusing update from remote peer 4aed21764419472082baa376679878ff: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
12:12:22.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.893160   802 consensus_queue.cc:1048] T d36b4fb4e49f42a093d1b247f6c081a1 P 4aed21764419472082baa376679878ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "689fcffa87c4466aa407c24ad2d47763" member_type: VOTER last_known_addr { host: "127.31.193.2" port: 37917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
12:12:22.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.894021   798 consensus_queue.cc:1048] T d36b4fb4e49f42a093d1b247f6c081a1 P 4aed21764419472082baa376679878ff [LEADER]: Connected to new peer: Peer: permanent_uuid: "070e7db59797490fac59134d126c1b1d" member_type: VOTER last_known_addr { host: "127.31.193.1" port: 35623 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
12:12:22.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.920713   807 mvcc.cc:204] Tried to move back new op lower bound from 7305268194861350912 to 7305268193396957184. Current Snapshot: MvccSnapshot[applied={T|T < 7305268194861350912}]
12:12:22.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:22.921774   809 mvcc.cc:204] Tried to move back new op lower bound from 7305268194861350912 to 7305268193396957184. Current Snapshot: MvccSnapshot[applied={T|T < 7305268194861350912}]
12:12:23.066 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=org.apache.kudu.client.TestLeaderFailover-1783512724564, tablet=d36b4fb4e49f42a093d1b247f6c081a1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:12:23.068 [INFO - Time-limited test] (MiniKuduCluster.java:475) Killing tablet server 127.31.193.3:41701
12:12:23.070 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: stop_daemon {
  id {
    type: TSERVER
    index: 2
  }
}

12:12:23.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:23.070919 32516 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZI_19V/build/tsan/bin/kudu with pid 628
12:12:23.099 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
12:12:23.101 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 4aed21764419472082baa376679878ff(127.31.193.3:41701)] handling channelInactive
12:12:23.102 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 4aed21764419472082baa376679878ff(127.31.193.3:41701)] cleaning up while in state READY due to: connection closed
12:12:23.102 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location 4aed21764419472082baa376679878ff(127.31.193.3:41701) for tablet d36b4fb4e49f42a093d1b247f6c081a1: connection closed
12:12:23.129 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet d36b4fb4e49f42a093d1b247f6c081a1 for table 'org.apache.kudu.client.TestLeaderFailover-1783512724564' with partition [<start>, <end>)
12:12:23.129 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=d36b4fb4e49f42a093d1b247f6c081a1@[070e7db59797490fac59134d126c1b1d(127.31.193.1:35623),4aed21764419472082baa376679878ff(127.31.193.3:41701)[L],689fcffa87c4466aa407c24ad2d47763(127.31.193.2:37917)]}]
12:12:23.130 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=d36b4fb4e49f42a093d1b247f6c081a1, attempt=2, sequence_id=4, TimeoutTracker(timeout=30000, elapsed=30), Traces: [0ms] sending RPC to server 4aed21764419472082baa376679878ff, [3ms] received response from server 4aed21764419472082baa376679878ff: Network error: connection closed, [3ms] delaying RPC due to: Network error: connection closed, [25ms] refreshing cache from master, [26ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.193.60:44177, [30ms] Sub RPC GetTableLocations: received response from server master-127.31.193.60:44177: OK, deferred=Deferred@662147702(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$236/0x00007f12a036e058@810ca40 -> passthrough -> wakeup thread Time-limited test, errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@c3b9140 -> wakeup thread Time-limited test)) after lookup
12:12:23.131 [DEBUG - kudu-nio-2] (Connection.java:748) [peer 4aed21764419472082baa376679878ff(127.31.193.3:41701)] connecting to peer
12:12:23.133 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701
12:12:23.134 [DEBUG - kudu-nio-4] (Connection.java:709) [peer 4aed21764419472082baa376679878ff(127.31.193.3:41701)] cleaning up while in state CONNECTING due to: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701
12:12:23.134 [INFO - kudu-nio-4] (AsyncKuduClient.java:2355) Invalidating location 4aed21764419472082baa376679878ff(127.31.193.3:41701) for tablet d36b4fb4e49f42a093d1b247f6c081a1: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701
12:12:23.149 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet d36b4fb4e49f42a093d1b247f6c081a1 for table 'org.apache.kudu.client.TestLeaderFailover-1783512724564' with partition [<start>, <end>)
12:12:23.149 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=d36b4fb4e49f42a093d1b247f6c081a1@[070e7db59797490fac59134d126c1b1d(127.31.193.1:35623),4aed21764419472082baa376679878ff(127.31.193.3:41701)[L],689fcffa87c4466aa407c24ad2d47763(127.31.193.2:37917)]}]
12:12:23.150 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=d36b4fb4e49f42a093d1b247f6c081a1, attempt=4, sequence_id=4, TimeoutTracker(timeout=30000, elapsed=50), Traces: [0ms] sending RPC to server 4aed21764419472082baa376679878ff, [3ms] received response from server 4aed21764419472082baa376679878ff: Network error: connection closed, [3ms] delaying RPC due to: Network error: connection closed, [25ms] refreshing cache from master, [26ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.193.60:44177, [30ms] Sub RPC GetTableLocations: received response from server master-127.31.193.60:44177: OK, [31ms] sending RPC to server 4aed21764419472082baa376679878ff, [35ms] received response from server 4aed21764419472082baa376679878ff: Network error: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701, [35ms] delaying RPC due to: Network error: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701, [45ms] refreshing cache from master, [45ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.193.60:44177, [50ms] Sub RPC GetTableLocations: received response from server master-127.31.193.60:44177: OK, deferred=Deferred@662147702(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$236/0x00007f12a036e058@810ca40 -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@601300529 after retry RPC@1853236137), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@c3b9140 -> wakeup thread Time-limited test -> (continuation of Deferred@601300529 after retry RPC@1853236137))) after lookup
12:12:23.150 [DEBUG - kudu-nio-2] (Connection.java:748) [peer 4aed21764419472082baa376679878ff(127.31.193.3:41701)] connecting to peer
12:12:23.152 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701
12:12:23.152 [DEBUG - kudu-nio-5] (Connection.java:709) [peer 4aed21764419472082baa376679878ff(127.31.193.3:41701)] cleaning up while in state CONNECTING due to: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701
12:12:23.153 [INFO - kudu-nio-5] (AsyncKuduClient.java:2355) Invalidating location 4aed21764419472082baa376679878ff(127.31.193.3:41701) for tablet d36b4fb4e49f42a093d1b247f6c081a1: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701
12:12:23.189 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet d36b4fb4e49f42a093d1b247f6c081a1 for table 'org.apache.kudu.client.TestLeaderFailover-1783512724564' with partition [<start>, <end>)
12:12:23.189 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=d36b4fb4e49f42a093d1b247f6c081a1@[070e7db59797490fac59134d126c1b1d(127.31.193.1:35623),4aed21764419472082baa376679878ff(127.31.193.3:41701)[L],689fcffa87c4466aa407c24ad2d47763(127.31.193.2:37917)]}]
12:12:23.189 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=d36b4fb4e49f42a093d1b247f6c081a1, attempt=6, sequence_id=4, TimeoutTracker(timeout=30000, elapsed=90), Traces: [0ms] sending RPC to server 4aed21764419472082baa376679878ff, [3ms] received response from server 4aed21764419472082baa376679878ff: Network error: connection closed, [3ms] delaying RPC due to: Network error: connection closed, [25ms] refreshing cache from master, [26ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.193.60:44177, [30ms] Sub RPC GetTableLocations: received response from server master-127.31.193.60:44177: OK, [31ms] sending RPC to server 4aed21764419472082baa376679878ff, [35ms] received response from server 4aed21764419472082baa376679878ff: Network error: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701, [35ms] delaying RPC due to: Network error: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701, [45ms] refreshing cache from master, [45ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.193.60:44177, [50ms] Sub RPC GetTableLocations: received response from server master-127.31.193.60:44177: OK, [51ms] sending RPC to server 4aed21764419472082baa376679878ff, [53ms] received response from server 4aed21764419472082baa376679878ff: Network error: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701, [54ms] delaying RPC due to: Network error: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701, [85ms] refreshing cache from master, [85ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.193.60:44177, [89ms] Sub RPC GetTableLocations: received response from server master-127.31.193.60:44177: OK, deferred=Deferred@662147702(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$236/0x00007f12a036e058@810ca40 -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@601300529 after retry RPC@1853236137) -> (continuation of Deferred@1080086316 after retry RPC@1279457221), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@c3b9140 -> wakeup thread Time-limited test -> (continuation of Deferred@601300529 after retry RPC@1853236137) -> (continuation of Deferred@1080086316 after retry RPC@1279457221))) after lookup
12:12:23.190 [DEBUG - kudu-nio-2] (Connection.java:748) [peer 4aed21764419472082baa376679878ff(127.31.193.3:41701)] connecting to peer
12:12:23.192 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701
12:12:23.192 [DEBUG - kudu-nio-6] (Connection.java:709) [peer 4aed21764419472082baa376679878ff(127.31.193.3:41701)] cleaning up while in state CONNECTING due to: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701
12:12:23.193 [INFO - kudu-nio-6] (AsyncKuduClient.java:2355) Invalidating location 4aed21764419472082baa376679878ff(127.31.193.3:41701) for tablet d36b4fb4e49f42a093d1b247f6c081a1: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701
12:12:23.248 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet d36b4fb4e49f42a093d1b247f6c081a1 for table 'org.apache.kudu.client.TestLeaderFailover-1783512724564' with partition [<start>, <end>)
12:12:23.249 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=d36b4fb4e49f42a093d1b247f6c081a1@[070e7db59797490fac59134d126c1b1d(127.31.193.1:35623),4aed21764419472082baa376679878ff(127.31.193.3:41701)[L],689fcffa87c4466aa407c24ad2d47763(127.31.193.2:37917)]}]
12:12:23.249 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=d36b4fb4e49f42a093d1b247f6c081a1, attempt=8, sequence_id=4, TimeoutTracker(timeout=30000, elapsed=149), Traces: [0ms] sending RPC to server 4aed21764419472082baa376679878ff, [3ms] received response from server 4aed21764419472082baa376679878ff: Network error: connection closed, [3ms] delaying RPC due to: Network error: connection closed, [25ms] refreshing cache from master, [26ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.193.60:44177, [30ms] Sub RPC GetTableLocations: received response from server master-127.31.193.60:44177: OK, [31ms] sending RPC to server 4aed21764419472082baa376679878ff, [35ms] received response from server 4aed21764419472082baa376679878ff: Network error: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701, [35ms] delaying RPC due to: Network error: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701, [45ms] refreshing cache from master, [45ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.193.60:44177, [50ms] Sub RPC GetTableLocations: received response from server master-127.31.193.60:44177: OK, [51ms] sending RPC to server 4aed21764419472082baa376679878ff, [53ms] received response from server 4aed21764419472082baa376679878ff: Network error: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701, [54ms] delaying RPC due to: Network error: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701, [85ms] refreshing cache from master, [85ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.193.60:44177, [89ms] Sub RPC GetTableLocations: received response from server master-127.31.193.60:44177: OK, [91ms] sending RPC to server 4aed21764419472082baa376679878ff, [93ms] received response from server 4aed21764419472082baa376679878ff: Network error: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701, [94ms] delaying RPC due to: Network error: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701, [145ms] refreshing cache from master, [145ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.193.60:44177, [149ms] Sub RPC GetTableLocations: received response from server master-127.31.193.60:44177: OK, deferred=Deferred@662147702(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$236/0x00007f12a036e058@810ca40 -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@601300529 after retry RPC@1853236137) -> (continuation of Deferred@1080086316 after retry RPC@1279457221) -> (continuation of Deferred@661663653 after retry RPC@252341158), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@c3b9140 -> wakeup thread Time-limited test -> (continuation of Deferred@601300529 after retry RPC@1853236137) -> (continuation of Deferred@1080086316 after retry RPC@1279457221) -> (continuation of Deferred@661663653 after retry RPC@252341158))) after lookup
12:12:23.250 [DEBUG - kudu-nio-2] (Connection.java:748) [peer 4aed21764419472082baa376679878ff(127.31.193.3:41701)] connecting to peer
12:12:23.252 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701
12:12:23.252 [DEBUG - kudu-nio-7] (Connection.java:709) [peer 4aed21764419472082baa376679878ff(127.31.193.3:41701)] cleaning up while in state CONNECTING due to: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701
12:12:23.252 [INFO - kudu-nio-7] (AsyncKuduClient.java:2355) Invalidating location 4aed21764419472082baa376679878ff(127.31.193.3:41701) for tablet d36b4fb4e49f42a093d1b247f6c081a1: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701
12:12:23.648 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet d36b4fb4e49f42a093d1b247f6c081a1 for table 'org.apache.kudu.client.TestLeaderFailover-1783512724564' with partition [<start>, <end>)
12:12:23.649 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=d36b4fb4e49f42a093d1b247f6c081a1@[070e7db59797490fac59134d126c1b1d(127.31.193.1:35623),4aed21764419472082baa376679878ff(127.31.193.3:41701)[L],689fcffa87c4466aa407c24ad2d47763(127.31.193.2:37917)]}]
12:12:23.650 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=d36b4fb4e49f42a093d1b247f6c081a1, attempt=10, sequence_id=4, TimeoutTracker(timeout=30000, elapsed=550), Traces: [0ms] sending RPC to server 4aed21764419472082baa376679878ff, [3ms] received response from server 4aed21764419472082baa376679878ff: Network error: connection closed, [3ms] delaying RPC due to: Network error: connection closed, [25ms] refreshing cache from master, [26ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.193.60:44177, [30ms] Sub RPC GetTableLocations: received response from server master-127.31.193.60:44177: OK, [31ms] sending RPC to server 4aed21764419472082baa376679878ff, [35ms] received response from server 4aed21764419472082baa376679878ff: Network error: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701, [35ms] delaying RPC due to: Network error: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701, [45ms] refreshing cache from master, [45ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.193.60:44177, [50ms] Sub RPC GetTableLocations: received response from server master-127.31.193.60:44177: OK, [51ms] sending RPC to server 4aed21764419472082baa376679878ff, [53ms] received response from server 4aed21764419472082baa376679878ff: Network error: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701, [54ms] delaying RPC due to: Network error: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701, [85ms] refreshing cache from master, [85ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.193.60:44177, [89ms] Sub RPC GetTableLocations: received response from server master-127.31.193.60:44177: OK, [91ms] sending RPC to server 4aed21764419472082baa376679878ff, [93ms] received response from server 4aed21764419472082baa376679878ff: Network error: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701, [94ms] delaying RPC due to: Network error: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701, [145ms] refreshing cache from master, [145ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.193.60:44177, [149ms] Sub RPC GetTableLocations: received response from server master-127.31.193.60:44177: OK, [151ms] sending RPC to server 4aed21764419472082baa376679878ff, [153ms] received response from server 4aed21764419472082baa376679878ff: Network error: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701, [153ms] delaying RPC due to: Network error: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701, [545ms] refreshing cache from master, [545ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.193.60:44177, [549ms] Sub RPC GetTableLocations: received response from server master-127.31.193.60:44177: OK, deferred=Deferred@662147702(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$236/0x00007f12a036e058@810ca40 -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@601300529 after retry RPC@1853236137) -> (continuation of Deferred@1080086316 after retry RPC@1279457221) -> (continuation of Deferred@661663653 after retry RPC@252341158) -> (continuation of Deferred@1312855603 after retry RPC@1844487022), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@c3b9140 -> wakeup thread Time-limited test -> (continuation of Deferred@601300529 after retry RPC@1853236137) -> (continuation of Deferred@1080086316 after retry RPC@1279457221) -> (continuation of Deferred@661663653 after retry RPC@252341158) -> (continuation of Deferred@1312855603 after retry RPC@1844487022))) after lookup
12:12:23.651 [DEBUG - kudu-nio-2] (Connection.java:748) [peer 4aed21764419472082baa376679878ff(127.31.193.3:41701)] connecting to peer
12:12:23.652 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701
12:12:23.652 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 4aed21764419472082baa376679878ff(127.31.193.3:41701)] cleaning up while in state CONNECTING due to: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701
12:12:23.652 [INFO - kudu-nio-0] (AsyncKuduClient.java:2355) Invalidating location 4aed21764419472082baa376679878ff(127.31.193.3:41701) for tablet d36b4fb4e49f42a093d1b247f6c081a1: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701
12:12:23.969 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet d36b4fb4e49f42a093d1b247f6c081a1 for table 'org.apache.kudu.client.TestLeaderFailover-1783512724564' with partition [<start>, <end>)
12:12:23.969 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=d36b4fb4e49f42a093d1b247f6c081a1@[070e7db59797490fac59134d126c1b1d(127.31.193.1:35623),4aed21764419472082baa376679878ff(127.31.193.3:41701)[L],689fcffa87c4466aa407c24ad2d47763(127.31.193.2:37917)]}]
12:12:23.970 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=d36b4fb4e49f42a093d1b247f6c081a1, attempt=12, sequence_id=4, TimeoutTracker(timeout=30000, elapsed=870), Traces: [0ms] sending RPC to server 4aed21764419472082baa376679878ff, [3ms] received response from server 4aed21764419472082baa376679878ff: Network error: connection closed, [3ms] delaying RPC due to: Network error: connection closed, [25ms] refreshing cache from master, [26ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.193.60:44177, [30ms] Sub RPC GetTableLocations: received response from server master-127.31.193.60:44177: OK, [31ms] sending RPC to server 4aed21764419472082baa376679878ff, [35ms] received response from server 4aed21764419472082baa376679878ff: Network error: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701, [35ms] delaying RPC due to: Network error: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701, [45ms] refreshing cache from master, [45ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.193.60:44177, [50ms] Sub RPC GetTableLocations: received response from server master-127.31.193.60:44177: OK, [51ms] sending RPC to server 4aed21764419472082baa376679878ff, [53ms] received response from server 4aed21764419472082baa376679878ff: Network error: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701, [54ms] delaying RPC due to: Network error: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701, [85ms] refreshing cache from master, [85ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.193.60:44177, [89ms] Sub RPC GetTableLocations: received response from server master-127.31.193.60:44177: OK, [91ms] sending RPC to server 4aed21764419472082baa376679878ff, [93ms] received response from server 4aed21764419472082baa376679878ff: Network error: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701, [94ms] delaying RPC due to: Network error: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701, [145ms] refreshing cache from master, [145ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.193.60:44177, [149ms] Sub RPC GetTableLocations: received response from server master-127.31.193.60:44177: OK, [151ms] sending RPC to server 4aed21764419472082baa376679878ff, [153ms] received response from server 4aed21764419472082baa376679878ff: Network error: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701, [153ms] delaying RPC due to: Network error: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701, [545ms] refreshing cache from master, [545ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.193.60:44177, [549ms] Sub RPC GetTableLocations: received response from server master-127.31.193.60:44177: OK, [551ms] sending RPC to server 4aed21764419472082baa376679878ff, [553ms] received response from server 4aed21764419472082baa376679878ff: Network error: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701, [553ms] delaying RPC due to: Network error: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701, [865ms] refreshing cache from master, [865ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.193.60:44177, [869ms] Sub RPC GetTableLocations: received response from server master-127.31.193.60:44177: OK, deferred=Deferred@662147702(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$236/0x00007f12a036e058@810ca40 -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@601300529 after retry RPC@1853236137) -> (continuation of Deferred@1080086316 after retry RPC@1279457221) -> (continuation of Deferred@661663653 after retry RPC@252341158) -> (continuation of Deferred@1312855603 after retry RPC@1844487022) -> (continuation of Deferred@1509912311 after retry RPC@838622581), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@c3b9140 -> wakeup thread Time-limited test -> (continuation of Deferred@601300529 after retry RPC@1853236137) -> (continuation of Deferred@1080086316 after retry RPC@1279457221) -> (continuation of Deferred@661663653 after retry RPC@252341158) -> (continuation of Deferred@1312855603 after retry RPC@1844487022) -> (continuation of Deferred@1509912311 after retry RPC@838622581))) after lookup
12:12:23.971 [DEBUG - kudu-nio-2] (Connection.java:748) [peer 4aed21764419472082baa376679878ff(127.31.193.3:41701)] connecting to peer
12:12:23.972 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701
12:12:23.972 [DEBUG - kudu-nio-1] (Connection.java:709) [peer 4aed21764419472082baa376679878ff(127.31.193.3:41701)] cleaning up while in state CONNECTING due to: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701
12:12:23.973 [INFO - kudu-nio-1] (AsyncKuduClient.java:2355) Invalidating location 4aed21764419472082baa376679878ff(127.31.193.3:41701) for tablet d36b4fb4e49f42a093d1b247f6c081a1: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701
12:12:24.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:24.514802   823 raft_consensus.cc:493] T d36b4fb4e49f42a093d1b247f6c081a1 P 070e7db59797490fac59134d126c1b1d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4aed21764419472082baa376679878ff)
12:12:24.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:24.515648   823 raft_consensus.cc:515] T d36b4fb4e49f42a093d1b247f6c081a1 P 070e7db59797490fac59134d126c1b1d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4aed21764419472082baa376679878ff" member_type: VOTER last_known_addr { host: "127.31.193.3" port: 41701 } } peers { permanent_uuid: "689fcffa87c4466aa407c24ad2d47763" member_type: VOTER last_known_addr { host: "127.31.193.2" port: 37917 } } peers { permanent_uuid: "070e7db59797490fac59134d126c1b1d" member_type: VOTER last_known_addr { host: "127.31.193.1" port: 35623 } }
12:12:24.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:24.518980   823 leader_election.cc:290] T d36b4fb4e49f42a093d1b247f6c081a1 P 070e7db59797490fac59134d126c1b1d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4aed21764419472082baa376679878ff (127.31.193.3:41701), 689fcffa87c4466aa407c24ad2d47763 (127.31.193.2:37917)
12:12:24.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:24.523118   366 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.31.193.3:41701: connect: Connection refused (error 111)
12:12:24.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:24.528299   828 raft_consensus.cc:493] T d36b4fb4e49f42a093d1b247f6c081a1 P 689fcffa87c4466aa407c24ad2d47763 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4aed21764419472082baa376679878ff)
12:12:24.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:24.529160   828 raft_consensus.cc:515] T d36b4fb4e49f42a093d1b247f6c081a1 P 689fcffa87c4466aa407c24ad2d47763 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4aed21764419472082baa376679878ff" member_type: VOTER last_known_addr { host: "127.31.193.3" port: 41701 } } peers { permanent_uuid: "689fcffa87c4466aa407c24ad2d47763" member_type: VOTER last_known_addr { host: "127.31.193.2" port: 37917 } } peers { permanent_uuid: "070e7db59797490fac59134d126c1b1d" member_type: VOTER last_known_addr { host: "127.31.193.1" port: 35623 } }
12:12:24.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:24.529992   366 leader_election.cc:336] T d36b4fb4e49f42a093d1b247f6c081a1 P 070e7db59797490fac59134d126c1b1d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4aed21764419472082baa376679878ff (127.31.193.3:41701): Network error: Client connection negotiation failed: client connection to 127.31.193.3:41701: connect: Connection refused (error 111)
12:12:24.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:24.532577   828 leader_election.cc:290] T d36b4fb4e49f42a093d1b247f6c081a1 P 689fcffa87c4466aa407c24ad2d47763 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4aed21764419472082baa376679878ff (127.31.193.3:41701), 070e7db59797490fac59134d126c1b1d (127.31.193.1:35623)
12:12:24.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:24.541452   505 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.31.193.3:41701: connect: Connection refused (error 111)
12:12:24.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:24.541669   573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36b4fb4e49f42a093d1b247f6c081a1" candidate_uuid: "070e7db59797490fac59134d126c1b1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "689fcffa87c4466aa407c24ad2d47763" is_pre_election: true
12:12:24.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:24.542279   573 raft_consensus.cc:2468] T d36b4fb4e49f42a093d1b247f6c081a1 P 689fcffa87c4466aa407c24ad2d47763 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 070e7db59797490fac59134d126c1b1d in term 1.
12:12:24.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:24.544147   368 leader_election.cc:304] T d36b4fb4e49f42a093d1b247f6c081a1 P 070e7db59797490fac59134d126c1b1d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 070e7db59797490fac59134d126c1b1d, 689fcffa87c4466aa407c24ad2d47763; no voters: 4aed21764419472082baa376679878ff
12:12:24.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:24.545091   823 raft_consensus.cc:2804] T d36b4fb4e49f42a093d1b247f6c081a1 P 070e7db59797490fac59134d126c1b1d [term 1 FOLLOWER]: Leader pre-election won for term 2
12:12:24.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:24.545454   823 raft_consensus.cc:493] T d36b4fb4e49f42a093d1b247f6c081a1 P 070e7db59797490fac59134d126c1b1d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4aed21764419472082baa376679878ff)
12:12:24.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:24.545779   823 raft_consensus.cc:3060] T d36b4fb4e49f42a093d1b247f6c081a1 P 070e7db59797490fac59134d126c1b1d [term 1 FOLLOWER]: Advancing to term 2
12:12:24.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:24.548074   505 leader_election.cc:336] T d36b4fb4e49f42a093d1b247f6c081a1 P 689fcffa87c4466aa407c24ad2d47763 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4aed21764419472082baa376679878ff (127.31.193.3:41701): Network error: Client connection negotiation failed: client connection to 127.31.193.3:41701: connect: Connection refused (error 111)
12:12:24.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:24.551437   823 raft_consensus.cc:515] T d36b4fb4e49f42a093d1b247f6c081a1 P 070e7db59797490fac59134d126c1b1d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4aed21764419472082baa376679878ff" member_type: VOTER last_known_addr { host: "127.31.193.3" port: 41701 } } peers { permanent_uuid: "689fcffa87c4466aa407c24ad2d47763" member_type: VOTER last_known_addr { host: "127.31.193.2" port: 37917 } } peers { permanent_uuid: "070e7db59797490fac59134d126c1b1d" member_type: VOTER last_known_addr { host: "127.31.193.1" port: 35623 } }
12:12:24.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:24.553220   823 leader_election.cc:290] T d36b4fb4e49f42a093d1b247f6c081a1 P 070e7db59797490fac59134d126c1b1d [CANDIDATE]: Term 2 election: Requested vote from peers 4aed21764419472082baa376679878ff (127.31.193.3:41701), 689fcffa87c4466aa407c24ad2d47763 (127.31.193.2:37917)
12:12:24.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:24.554451   433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36b4fb4e49f42a093d1b247f6c081a1" candidate_uuid: "689fcffa87c4466aa407c24ad2d47763" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "070e7db59797490fac59134d126c1b1d" is_pre_election: true
12:12:24.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:24.555341   573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d36b4fb4e49f42a093d1b247f6c081a1" candidate_uuid: "070e7db59797490fac59134d126c1b1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "689fcffa87c4466aa407c24ad2d47763"
12:12:24.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:24.555583   433 raft_consensus.cc:2393] T d36b4fb4e49f42a093d1b247f6c081a1 P 070e7db59797490fac59134d126c1b1d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 689fcffa87c4466aa407c24ad2d47763 in current term 2: Already voted for candidate 070e7db59797490fac59134d126c1b1d in this term.
12:12:24.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:24.555912   573 raft_consensus.cc:3060] T d36b4fb4e49f42a093d1b247f6c081a1 P 689fcffa87c4466aa407c24ad2d47763 [term 1 FOLLOWER]: Advancing to term 2
12:12:24.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:24.557889   366 leader_election.cc:336] T d36b4fb4e49f42a093d1b247f6c081a1 P 070e7db59797490fac59134d126c1b1d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 4aed21764419472082baa376679878ff (127.31.193.3:41701): Network error: Client connection negotiation failed: client connection to 127.31.193.3:41701: connect: Connection refused (error 111)
12:12:24.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:24.558049   506 leader_election.cc:304] T d36b4fb4e49f42a093d1b247f6c081a1 P 689fcffa87c4466aa407c24ad2d47763 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 689fcffa87c4466aa407c24ad2d47763; no voters: 070e7db59797490fac59134d126c1b1d, 4aed21764419472082baa376679878ff
12:12:24.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:24.561026   573 raft_consensus.cc:2468] T d36b4fb4e49f42a093d1b247f6c081a1 P 689fcffa87c4466aa407c24ad2d47763 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 070e7db59797490fac59134d126c1b1d in term 2.
12:12:24.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:24.561441   828 raft_consensus.cc:2749] T d36b4fb4e49f42a093d1b247f6c081a1 P 689fcffa87c4466aa407c24ad2d47763 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
12:12:24.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:24.562047   368 leader_election.cc:304] T d36b4fb4e49f42a093d1b247f6c081a1 P 070e7db59797490fac59134d126c1b1d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 070e7db59797490fac59134d126c1b1d, 689fcffa87c4466aa407c24ad2d47763; no voters: 4aed21764419472082baa376679878ff
12:12:24.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:24.562821   823 raft_consensus.cc:2804] T d36b4fb4e49f42a093d1b247f6c081a1 P 070e7db59797490fac59134d126c1b1d [term 2 FOLLOWER]: Leader election won for term 2
12:12:24.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:24.564496   823 raft_consensus.cc:697] T d36b4fb4e49f42a093d1b247f6c081a1 P 070e7db59797490fac59134d126c1b1d [term 2 LEADER]: Becoming Leader. State: Replica: 070e7db59797490fac59134d126c1b1d, State: Running, Role: LEADER
12:12:24.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:24.565589   823 consensus_queue.cc:237] T d36b4fb4e49f42a093d1b247f6c081a1 P 070e7db59797490fac59134d126c1b1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4aed21764419472082baa376679878ff" member_type: VOTER last_known_addr { host: "127.31.193.3" port: 41701 } } peers { permanent_uuid: "689fcffa87c4466aa407c24ad2d47763" member_type: VOTER last_known_addr { host: "127.31.193.2" port: 37917 } } peers { permanent_uuid: "070e7db59797490fac59134d126c1b1d" member_type: VOTER last_known_addr { host: "127.31.193.1" port: 35623 } }
12:12:24.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:24.576284 32716 catalog_manager.cc:5697] T d36b4fb4e49f42a093d1b247f6c081a1 P 070e7db59797490fac59134d126c1b1d reported cstate change: term changed from 1 to 2, leader changed from 4aed21764419472082baa376679878ff (127.31.193.3) to 070e7db59797490fac59134d126c1b1d (127.31.193.1). New cstate: current_term: 2 leader_uuid: "070e7db59797490fac59134d126c1b1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4aed21764419472082baa376679878ff" member_type: VOTER last_known_addr { host: "127.31.193.3" port: 41701 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "689fcffa87c4466aa407c24ad2d47763" member_type: VOTER last_known_addr { host: "127.31.193.2" port: 37917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "070e7db59797490fac59134d126c1b1d" member_type: VOTER last_known_addr { host: "127.31.193.1" port: 35623 } health_report { overall_health: HEALTHY } } }
12:12:24.591 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet d36b4fb4e49f42a093d1b247f6c081a1 for table 'org.apache.kudu.client.TestLeaderFailover-1783512724564' with partition [<start>, <end>)
12:12:24.592 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=d36b4fb4e49f42a093d1b247f6c081a1@[070e7db59797490fac59134d126c1b1d(127.31.193.1:35623),4aed21764419472082baa376679878ff(127.31.193.3:41701)[L],689fcffa87c4466aa407c24ad2d47763(127.31.193.2:37917)]}]
12:12:24.593 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=d36b4fb4e49f42a093d1b247f6c081a1, attempt=14, sequence_id=4, TimeoutTracker(timeout=30000, elapsed=1493), Traces: [0ms] sending RPC to server 4aed21764419472082baa376679878ff, [3ms] received response from server 4aed21764419472082baa376679878ff: Network error: connection closed, [3ms] delaying RPC due to: Network error: connection closed, [25ms] refreshing cache from master, [26ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.193.60:44177, [30ms] Sub RPC GetTableLocations: received response from server master-127.31.193.60:44177: OK, [31ms] sending RPC to server 4aed21764419472082baa376679878ff, [35ms] received response from server 4aed21764419472082baa376679878ff: Network error: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701, [35ms] delaying RPC due to: Network error: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701, [45ms] refreshing cache from master, [45ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.193.60:44177, [50ms] Sub RPC GetTableLocations: received response from server master-127.31.193.60:44177: OK, [51ms] sending RPC to server 4aed21764419472082baa376679878ff, [53ms] received response from server 4aed21764419472082baa376679878ff: Network error: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701, [54ms] delaying RPC due to: Network error: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701, [85ms] refreshing cache from master, [85ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.193.60:44177, [89ms] Sub RPC GetTableLocations: received response from server master-127.31.193.60:44177: OK, [91ms] sending RPC to server 4aed21764419472082baa376679878ff, [93ms] received response from server 4aed21764419472082baa376679878ff: Network error: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701, [94ms] delaying RPC due to: Network error: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701, [145ms] refreshing cache from master, [145ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.193.60:44177, [149ms] Sub RPC GetTableLocations: received response from server master-127.31.193.60:44177: OK, [151ms] sending RPC to server 4aed21764419472082baa376679878ff, [153ms] received response from server 4aed21764419472082baa376679878ff: Network error: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701, [153ms] delaying RPC due to: Network error: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701, [545ms] refreshing cache from master, [545ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.193.60:44177, [549ms] Sub RPC GetTableLocations: received response from server master-127.31.193.60:44177: OK, [551ms] sending RPC to server 4aed21764419472082baa376679878ff, [553ms] received response from server 4aed21764419472082baa376679878ff: Network error: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701, [553ms] delaying RPC due to: Network error: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701, [865ms] refreshing cache from master, [865ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.193.60:44177, [869ms] Sub RPC GetTableLocations: received response from server master-127.31.193.60:44177: OK, [871ms] sending RPC to server 4aed21764419472082baa376679878ff, [874ms] received response from server 4aed21764419472082baa376679878ff: Network error: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701, [874ms] delaying RPC due to: Network error: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701, [1486ms] refreshing cache from master, [1486ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.193.60:44177, [1492ms] Sub RPC GetTableLocations: received response from server master-127.31.193.60:44177: OK, deferred=Deferred@662147702(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$236/0x00007f12a036e058@810ca40 -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@601300529 after retry RPC@1853236137) -> (continuation of Deferred@1080086316 after retry RPC@1279457221) -> (continuation of Deferred@661663653 after retry RPC@252341158) -> (continuation of Deferred@1312855603 after retry RPC@1844487022) -> (continuation of Deferred@1509912311 after retry RPC@838622581) -> (continuation of Deferred@1349840397 after retry RPC@53483139), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@c3b9140 -> wakeup thread Time-limited test -> (continuation of Deferred@601300529 after retry RPC@1853236137) -> (continuation of Deferred@1080086316 after retry RPC@1279457221) -> (continuation of Deferred@661663653 after retry RPC@252341158) -> (continuation of Deferred@1312855603 after retry RPC@1844487022) -> (continuation of Deferred@1509912311 after retry RPC@838622581) -> (continuation of Deferred@1349840397 after retry RPC@53483139))) after lookup
12:12:24.595 [DEBUG - kudu-nio-2] (Connection.java:748) [peer 4aed21764419472082baa376679878ff(127.31.193.3:41701)] connecting to peer
12:12:24.597 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701
12:12:24.597 [DEBUG - kudu-nio-2] (Connection.java:709) [peer 4aed21764419472082baa376679878ff(127.31.193.3:41701)] cleaning up while in state CONNECTING due to: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701
12:12:24.598 [INFO - kudu-nio-2] (AsyncKuduClient.java:2355) Invalidating location 4aed21764419472082baa376679878ff(127.31.193.3:41701) for tablet d36b4fb4e49f42a093d1b247f6c081a1: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701
12:12:25.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:25.016325   366 consensus_peers.cc:597] T d36b4fb4e49f42a093d1b247f6c081a1 P 070e7db59797490fac59134d126c1b1d -> Peer 4aed21764419472082baa376679878ff (127.31.193.3:41701): Couldn't send request to peer 4aed21764419472082baa376679878ff. Status: Network error: Client connection negotiation failed: client connection to 127.31.193.3:41701: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
12:12:25.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:25.136313   573 raft_consensus.cc:1275] T d36b4fb4e49f42a093d1b247f6c081a1 P 689fcffa87c4466aa407c24ad2d47763 [term 2 FOLLOWER]: Refusing update from remote peer 070e7db59797490fac59134d126c1b1d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
12:12:25.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:25.137701   823 consensus_queue.cc:1048] T d36b4fb4e49f42a093d1b247f6c081a1 P 070e7db59797490fac59134d126c1b1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "689fcffa87c4466aa407c24ad2d47763" member_type: VOTER last_known_addr { host: "127.31.193.2" port: 37917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
12:12:26.209 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet d36b4fb4e49f42a093d1b247f6c081a1 for table 'org.apache.kudu.client.TestLeaderFailover-1783512724564' with partition [<start>, <end>)
12:12:26.210 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=d36b4fb4e49f42a093d1b247f6c081a1@[070e7db59797490fac59134d126c1b1d(127.31.193.1:35623)[L],4aed21764419472082baa376679878ff(127.31.193.3:41701),689fcffa87c4466aa407c24ad2d47763(127.31.193.2:37917)]}]
12:12:26.211 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=d36b4fb4e49f42a093d1b247f6c081a1, attempt=16, sequence_id=4, TimeoutTracker(timeout=30000, elapsed=3111), Traces: [0ms] sending RPC to server 4aed21764419472082baa376679878ff, [3ms] received response from server 4aed21764419472082baa376679878ff: Network error: connection closed, [3ms] delaying RPC due to: Network error: connection closed, [25ms] refreshing cache from master, [26ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.193.60:44177, [30ms] Sub RPC GetTableLocations: received response from server master-127.31.193.60:44177: OK, [31ms] sending RPC to server 4aed21764419472082baa376679878ff, [35ms] received response from server 4aed21764419472082baa376679878ff: Network error: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701, [35ms] delaying RPC due to: Network error: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701, [45ms] refreshing cache from master, [45ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.193.60:44177, [50ms] Sub RPC GetTableLocations: received response from server master-127.31.193.60:44177: OK, [51ms] sending RPC to server 4aed21764419472082baa376679878ff, [53ms] received response from server 4aed21764419472082baa376679878ff: Network error: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701, [54ms] delaying RPC due to: Network error: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701, [85ms] refreshing cache from master, [85ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.193.60:44177, [89ms] Sub RPC GetTableLocations: received response from server master-127.31.193.60:44177: OK, [91ms] sending RPC to server 4aed21764419472082baa376679878ff, [93ms] received response from server 4aed21764419472082baa376679878ff: Network error: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701, [94ms] delaying RPC due to: Network error: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701, [145ms] refreshing cache from master, [145ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.193.60:44177, [149ms] Sub RPC GetTableLocations: received response from server master-127.31.193.60:44177: OK, [151ms] sending RPC to server 4aed21764419472082baa376679878ff, [153ms] received response from server 4aed21764419472082baa376679878ff: Network error: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701, [153ms] delaying RPC due to: Network error: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701, [545ms] refreshing cache from master, [545ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.193.60:44177, [549ms] Sub RPC GetTableLocations: received response from server master-127.31.193.60:44177: OK, [551ms] sending RPC to server 4aed21764419472082baa376679878ff, [553ms] received response from server 4aed21764419472082baa376679878ff: Network error: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701, [553ms] delaying RPC due to: Network error: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701, [865ms] refreshing cache from master, [865ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.193.60:44177, [869ms] Sub RPC GetTableLocations: received response from server master-127.31.193.60:44177: OK, [871ms] sending RPC to server 4aed21764419472082baa376679878ff, [874ms] received response from server 4aed21764419472082baa376679878ff: Network error: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701, [874ms] delaying RPC due to: Network error: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701, [1486ms] refreshing cache from master, [1486ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.193.60:44177, [1492ms] Sub RPC GetTableLocations: received response from server master-127.31.193.60:44177: OK, [1495ms] sending RPC to server 4aed21764419472082baa376679878ff, [1499ms] received response from server 4aed21764419472082baa376679878ff: Network error: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701, [1499ms] delaying RPC due to: Network error: Failed to connect to peer 4aed21764419472082baa376679878ff(127.31.193.3:41701): Connection refused: /127.31.193.3:41701, [3105ms] refreshing cache from master, [3105ms] Sub RPC GetTableLocations: sending RPC to server master-127.31.193.60:44177, [3110ms] Sub RPC GetTableLocations: received response from server master-127.31.193.60:44177: OK, deferred=Deferred@662147702(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$236/0x00007f12a036e058@810ca40 -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@601300529 after retry RPC@1853236137) -> (continuation of Deferred@1080086316 after retry RPC@1279457221) -> (continuation of Deferred@661663653 after retry RPC@252341158) -> (continuation of Deferred@1312855603 after retry RPC@1844487022) -> (continuation of Deferred@1509912311 after retry RPC@838622581) -> (continuation of Deferred@1349840397 after retry RPC@53483139) -> (continuation of Deferred@1582904583 after retry RPC@1679403534), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@c3b9140 -> wakeup thread Time-limited test -> (continuation of Deferred@601300529 after retry RPC@1853236137) -> (continuation of Deferred@1080086316 after retry RPC@1279457221) -> (continuation of Deferred@661663653 after retry RPC@252341158) -> (continuation of Deferred@1312855603 after retry RPC@1844487022) -> (continuation of Deferred@1509912311 after retry RPC@838622581) -> (continuation of Deferred@1349840397 after retry RPC@53483139) -> (continuation of Deferred@1582904583 after retry RPC@1679403534))) after lookup
12:12:26.212 [DEBUG - kudu-nio-2] (Connection.java:748) [peer 070e7db59797490fac59134d126c1b1d(127.31.193.1:35623)] connecting to peer
12:12:26.213 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 070e7db59797490fac59134d126c1b1d(127.31.193.1:35623)] Successfully connected to peer
12:12:26.235 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0xf319401c, L:/127.0.0.1:48106 - R:/127.31.193.1:35623] using TOKEN/null
12:12:26.300 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 6 rows, more = false) for scanner KuduScanner(table=org.apache.kudu.client.TestLeaderFailover-1783512724564, tablet=d36b4fb4e49f42a093d1b247f6c081a1, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
12:12:26.306 [DEBUG - main] (Connection.java:575) [peer master-127.31.193.62:43699(127.31.193.62:43699)] disconnecting while in state READY
12:12:26.307 [DEBUG - main] (Connection.java:575) [peer master-127.31.193.61:44677(127.31.193.61:44677)] disconnecting while in state READY
12:12:26.307 [DEBUG - main] (Connection.java:575) [peer 4aed21764419472082baa376679878ff(127.31.193.3:41701)] disconnecting while in state TERMINATED
12:12:26.307 [DEBUG - main] (Connection.java:575) [peer 070e7db59797490fac59134d126c1b1d(127.31.193.1:35623)] disconnecting while in state READY
12:12:26.307 [DEBUG - main] (Connection.java:575) [peer master-127.31.193.60:44177(127.31.193.60:44177)] disconnecting while in state READY
12:12:26.310 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.31.193.60:44177(127.31.193.60:44177)] handling channelInactive
12:12:26.310 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.31.193.61:44677(127.31.193.61:44677)] handling channelInactive
12:12:26.310 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.31.193.60:44177(127.31.193.60:44177)] cleaning up while in state READY due to: connection closed
12:12:26.310 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.31.193.61:44677(127.31.193.61:44677)] cleaning up while in state READY due to: connection closed
12:12:26.310 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
12:12:26.310 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 070e7db59797490fac59134d126c1b1d(127.31.193.1:35623)] handling channelInactive
12:12:26.312 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.31.193.62:43699(127.31.193.62:43699)] handling channelInactive
12:12:26.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:26.313349 32516 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZI_19V/build/tsan/bin/kudu with pid 347
12:12:26.314 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.31.193.62:43699(127.31.193.62:43699)] cleaning up while in state READY due to: connection closed
12:12:26.312 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 070e7db59797490fac59134d126c1b1d(127.31.193.1:35623)] cleaning up while in state READY due to: connection closed
12:12:26.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:26.349110 32516 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZI_19V/build/tsan/bin/kudu with pid 486
12:12:26.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:26.379397 32516 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZI_19V/build/tsan/bin/kudu with pid 32528
12:12:26.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:26.405779 32701 connection.cc:573] client connection to 127.31.193.62:43699 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
12:12:26.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:26.406298 32701 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
12:12:26.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:26.407759 32516 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZI_19V/build/tsan/bin/kudu with pid 32598
12:12:26.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 12:12:26.412181 32701 consensus_peers.cc:597] T 00000000000000000000000000000000 P 1b1c5a9580d74012951facb33106b357 -> Peer 69776d9211f54a8d843f89abe587ccb9 (127.31.193.62:43699): Couldn't send request to peer 69776d9211f54a8d843f89abe587ccb9. Status: Network error: Client connection negotiation failed: client connection to 127.31.193.62:43699: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
12:12:26.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 12:12:26.434319 32516 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskZI_19V/build/tsan/bin/kudu with pid 32673
12:12:27.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T12:12:27Z chronyd exiting

Time: 23.882

OK (1 test)

