JUnit version 4.13.2
.18:29:10.340 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1783535350333
18:29:10.393 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
18:29:10.425 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
18:29:10.432 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskRlQDJI/test-tmp
18:29:10.457 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/asan/bin
18:29:10.460 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskRlQDJI/java/build/dist-test/../../../build/asan/bin/kudu, test, mini_cluster, --serialization=pb]
18:29:10.674 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

18:29:10.870 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
18:29:10.872 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

18:29:10.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:10.875154  3448 mini_oidc.cc:150] Starting JWKS server
18:29:10.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:10.877753  3448 webserver.cc:534] Webserver started at http://127.0.0.1:46825/ using document root <none> and password file <none>
18:29:10.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:10.878070  3448 mini_oidc.cc:186] Starting OIDC Discovery server
18:29:10.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:10.878741  3448 webserver.cc:534] Webserver started at http://127.0.0.1:34221/ using document root <none> and password file <none>
18:29:10.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T18:29:10Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
18:29:10.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T18:29:10Z Disabled control of system clock
18:29:10.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:10.911163  3448 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskRlQDJI/build/asan/bin/kudu
18:29:10.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskRlQDJI/build/asan/bin/kudu
18:29:10.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/master-0/wal
18:29:10.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/master-0/data
18:29:10.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:29:10.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:29:10.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:29:10.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:29:10.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:29:10.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:29:10.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/master-0/logs
18:29:10.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/master-0/data/info.pb
18:29:10.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:29:10.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:29:10.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:29:10.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:29:10.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:29:10.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:29:10.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:29:10.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:29:10.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
18:29:10.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:29:10.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:29:10.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:29:10.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.94.62:42369
18:29:10.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.94.62
18:29:10.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:29:10.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.94.20:37457
18:29:10.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:29:10.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:29:10.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:29:10.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:29:10.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.3.94.62:42369,127.3.94.61:41619,127.3.94.60:42091
18:29:10.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:29:10.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:46825/jwks.json with env {}
18:29:11.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:11.246727  3459 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:29:11.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:11.247052  3459 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:29:11.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:11.247134  3459 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:29:11.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:11.255633  3459 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
18:29:11.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:11.255738  3459 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:29:11.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:11.255793  3459 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
18:29:11.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:11.255834  3459 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
18:29:11.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:11.255942  3459 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
18:29:11.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:11.255980  3459 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:46825/jwks.json
18:29:11.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:11.266206  3459 master_runner.cc:387] Master server non-default flags:
18:29:11.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:29:11.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.94.20:37457
18:29:11.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:29:11.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:29:11.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/master-0/data
18:29:11.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/master-0/wal
18:29:11.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:29:11.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.3.94.62:42369,127.3.94.61:41619,127.3.94.60:42091
18:29:11.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:29:11.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:29:11.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:29:11.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.94.62:42369
18:29:11.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:29:11.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:29:11.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:29:11.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:46825/jwks.json
18:29:11.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:29:11.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:29:11.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/master-0/data/info.pb
18:29:11.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.94.62
18:29:11.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:29:11.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:29:11.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:29:11.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:29:11.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:29:11.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:29:11.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/master-0/logs
18:29:11.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:29:11.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:29:11.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:29:11.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
18:29:11.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:29:11.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:29:11.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:29:11.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:01:24 UTC on bdcb31816ec0
18:29:11.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16870
18:29:11.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
18:29:11.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:11.268569  3459 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:29:11.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:11.270653  3459 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:29:11.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:11.281927  3465 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:11.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:11.282552  3464 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:11.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:11.283255  3467 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:11.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:11.283867  3459 server_base.cc:1061] running on GCE node
18:29:11.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:11.284683  3459 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:29:11.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:11.286118  3459 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:29:11.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:11.287374  3459 hybrid_clock.cc:648] HybridClock initialized: now 1783535351287309 us; error 49 us; skew 500 ppm
18:29:11.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:11.287864  3459 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:29:11.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:11.290345  3459 webserver.cc:534] Webserver started at http://127.3.94.62:40091/ using document root <none> and password file <none>
18:29:11.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:11.291224  3459 fs_manager.cc:362] Metadata directory not provided
18:29:11.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:11.291369  3459 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:29:11.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:11.291854  3459 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:29:11.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:11.294392  3459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/master-0/data/instance:
18:29:11.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "162486c9e36d45919a959f286cd59d1d"
18:29:11.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:29:11 on dist-test-slave-0d16"
18:29:11.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:11.295333  3459 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/master-0/wal/instance:
18:29:11.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "162486c9e36d45919a959f286cd59d1d"
18:29:11.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:29:11 on dist-test-slave-0d16"
18:29:11.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:11.301367  3459 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.008s	sys 0.000s
18:29:11.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:11.305122  3474 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:29:11.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:11.306633  3459 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
18:29:11.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:11.306788  3459 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/master-0/data,/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/master-0/wal
18:29:11.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "162486c9e36d45919a959f286cd59d1d"
18:29:11.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:29:11 on dist-test-slave-0d16"
18:29:11.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:11.306965  3459 fs_report.cc:389] FS layout report
18:29:11.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:29:11.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/master-0/wal
18:29:11.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/master-0/wal
18:29:11.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/master-0/data/data
18:29:11.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:29:11.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:29:11.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:29:11.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:29:11.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:29:11.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:29:11.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:29:11.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:29:11.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:29:11.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:29:11.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:29:11.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:11.360597  3459 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:29:11.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:11.361704  3459 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:29:11.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:11.361990  3459 kserver.cc:163] Server-wide thread pool size limit: 3276
18:29:11.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:11.382639  3459 rpc_server.cc:307] RPC server started. Bound to: 127.3.94.62:42369
18:29:11.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:11.382661  3525 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.94.62:42369 every 8 connection(s)
18:29:11.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:11.384253  3459 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/master-0/data/info.pb
18:29:11.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:11.388545  3526 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
18:29:11.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:11.391883  3448 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskRlQDJI/build/asan/bin/kudu as pid 3459
18:29:11.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:11.392230  3448 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/master-0/wal/instance
18:29:11.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:11.394585  3448 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskRlQDJI/build/asan/bin/kudu
18:29:11.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskRlQDJI/build/asan/bin/kudu
18:29:11.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/master-1/wal
18:29:11.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/master-1/data
18:29:11.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:29:11.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:29:11.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:29:11.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:29:11.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:29:11.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:29:11.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/master-1/logs
18:29:11.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/master-1/data/info.pb
18:29:11.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:29:11.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:29:11.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:29:11.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:29:11.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:29:11.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:29:11.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:29:11.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:29:11.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
18:29:11.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:29:11.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:29:11.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:29:11.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.94.61:41619
18:29:11.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.94.61
18:29:11.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:29:11.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.94.20:37457
18:29:11.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:29:11.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:29:11.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:29:11.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:29:11.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.3.94.62:42369,127.3.94.61:41619,127.3.94.60:42091
18:29:11.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:29:11.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:46825/jwks.json with env {}
18:29:11.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:11.394418  3526 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.94.62" port: 42369 } has no permanent_uuid. Determining permanent_uuid...
18:29:11.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:11.418597  3526 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.94.61" port: 41619 } has no permanent_uuid. Determining permanent_uuid...
18:29:11.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:11.419858  3475 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.94.61:41619: connect: Connection refused (error 111)
18:29:11.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:11.421608  3526 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.94.61:41619: Network error: Client connection negotiation failed: client connection to 127.3.94.61:41619: connect: Connection refused (error 111)
18:29:11.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:11.470993  3526 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.94.61" port: 41619 } attempt: 1
18:29:11.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:11.473326  3526 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.94.61:41619: Network error: Client connection negotiation failed: client connection to 127.3.94.61:41619: connect: Connection refused (error 111)
18:29:11.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:11.541584  3526 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.94.61" port: 41619 } attempt: 2
18:29:11.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:11.543999  3526 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.94.61:41619: Network error: Client connection negotiation failed: client connection to 127.3.94.61:41619: connect: Connection refused (error 111)
18:29:11.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:11.635298  3526 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.94.61" port: 41619 } attempt: 3
18:29:11.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:11.637521  3526 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.94.61:41619: Network error: Client connection negotiation failed: client connection to 127.3.94.61:41619: connect: Connection refused (error 111)
18:29:11.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:11.735355  3530 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:29:11.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:11.735683  3530 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:29:11.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:11.735764  3530 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:29:11.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:11.743851  3530 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
18:29:11.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:11.743939  3530 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:29:11.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:11.744001  3530 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
18:29:11.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:11.744059  3530 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
18:29:11.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:11.744112  3530 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
18:29:11.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:11.744195  3530 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:46825/jwks.json
18:29:11.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:11.754733  3530 master_runner.cc:387] Master server non-default flags:
18:29:11.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:29:11.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.94.20:37457
18:29:11.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:29:11.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:29:11.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/master-1/data
18:29:11.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/master-1/wal
18:29:11.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:29:11.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.3.94.62:42369,127.3.94.61:41619,127.3.94.60:42091
18:29:11.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:29:11.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:29:11.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:29:11.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.94.61:41619
18:29:11.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:29:11.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:29:11.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:29:11.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:46825/jwks.json
18:29:11.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:29:11.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:29:11.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/master-1/data/info.pb
18:29:11.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.94.61
18:29:11.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:29:11.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:29:11.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:29:11.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:29:11.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:29:11.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:29:11.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/master-1/logs
18:29:11.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:29:11.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:29:11.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:29:11.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
18:29:11.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:29:11.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:29:11.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:29:11.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:01:24 UTC on bdcb31816ec0
18:29:11.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16870
18:29:11.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
18:29:11.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:11.756583  3530 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:29:11.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:11.758737  3530 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:29:11.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:11.767652  3537 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:11.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:11.768792  3536 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:11.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:11.769037  3539 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:11.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:11.772593  3530 server_base.cc:1061] running on GCE node
18:29:11.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:11.773399  3530 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:29:11.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:11.774802  3530 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:29:11.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:11.776033  3530 hybrid_clock.cc:648] HybridClock initialized: now 1783535351775983 us; error 41 us; skew 500 ppm
18:29:11.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:11.776461  3530 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:29:11.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:11.778688  3530 webserver.cc:534] Webserver started at http://127.3.94.61:34363/ using document root <none> and password file <none>
18:29:11.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:11.779546  3530 fs_manager.cc:362] Metadata directory not provided
18:29:11.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:11.779690  3530 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:29:11.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:11.780160  3530 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:29:11.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:11.780771  3526 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.94.61" port: 41619 } attempt: 4
18:29:11.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:11.782701  3526 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.94.61:41619: Network error: Client connection negotiation failed: client connection to 127.3.94.61:41619: connect: Connection refused (error 111)
18:29:11.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:11.783252  3530 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/master-1/data/instance:
18:29:11.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "82e1fad2f97643f6a383e90692f1d83f"
18:29:11.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:29:11 on dist-test-slave-0d16"
18:29:11.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:11.784183  3530 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/master-1/wal/instance:
18:29:11.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "82e1fad2f97643f6a383e90692f1d83f"
18:29:11.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:29:11 on dist-test-slave-0d16"
18:29:11.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:11.789517  3530 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.000s	sys 0.004s
18:29:11.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:11.792776  3545 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:29:11.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:11.794092  3530 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
18:29:11.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:11.794265  3530 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/master-1/data,/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/master-1/wal
18:29:11.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "82e1fad2f97643f6a383e90692f1d83f"
18:29:11.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:29:11 on dist-test-slave-0d16"
18:29:11.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:11.794516  3530 fs_report.cc:389] FS layout report
18:29:11.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:29:11.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/master-1/wal
18:29:11.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/master-1/wal
18:29:11.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/master-1/data/data
18:29:11.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:29:11.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:29:11.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:29:11.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:29:11.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:29:11.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:29:11.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:29:11.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:29:11.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:29:11.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:29:11.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:29:11.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:11.812441  3530 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:29:11.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:11.813625  3530 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:29:11.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:11.813983  3530 kserver.cc:163] Server-wide thread pool size limit: 3276
18:29:11.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:11.833552  3530 rpc_server.cc:307] RPC server started. Bound to: 127.3.94.61:41619
18:29:11.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:11.833576  3597 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.94.61:41619 every 8 connection(s)
18:29:11.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:11.835328  3530 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/master-1/data/info.pb
18:29:11.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:11.838845  3448 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskRlQDJI/build/asan/bin/kudu as pid 3530
18:29:11.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:11.839161  3448 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/master-1/wal/instance
18:29:11.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:11.840075  3598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
18:29:11.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:11.840390  3448 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskRlQDJI/build/asan/bin/kudu
18:29:11.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskRlQDJI/build/asan/bin/kudu
18:29:11.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/master-2/wal
18:29:11.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/master-2/data
18:29:11.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:29:11.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:29:11.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:29:11.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:29:11.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:29:11.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:29:11.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/master-2/logs
18:29:11.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/master-2/data/info.pb
18:29:11.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:29:11.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:29:11.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:29:11.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:29:11.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:29:11.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:29:11.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:29:11.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:29:11.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
18:29:11.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:29:11.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:29:11.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:29:11.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.94.60:42091
18:29:11.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.94.60
18:29:11.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:29:11.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.94.20:37457
18:29:11.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:29:11.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:29:11.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:29:11.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:29:11.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.3.94.62:42369,127.3.94.61:41619,127.3.94.60:42091
18:29:11.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:29:11.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:46825/jwks.json with env {}
18:29:11.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:11.847904  3598 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.94.62" port: 42369 } has no permanent_uuid. Determining permanent_uuid...
18:29:11.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:11.865176  3598 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.94.61" port: 41619 } has no permanent_uuid. Determining permanent_uuid...
18:29:11.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:11.875375  3598 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.94.60" port: 42091 } has no permanent_uuid. Determining permanent_uuid...
18:29:11.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:11.876618  3546 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.94.60:42091: connect: Connection refused (error 111)
18:29:11.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:11.878304  3598 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.94.60:42091: Network error: Client connection negotiation failed: client connection to 127.3.94.60:42091: connect: Connection refused (error 111)
18:29:11.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:11.927630  3598 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.94.60" port: 42091 } attempt: 1
18:29:11.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:11.930181  3598 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.94.60:42091: Network error: Client connection negotiation failed: client connection to 127.3.94.60:42091: connect: Connection refused (error 111)
18:29:11.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:11.998441  3598 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.94.60" port: 42091 } attempt: 2
18:29:12.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:12.000690  3598 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.94.60:42091: Network error: Client connection negotiation failed: client connection to 127.3.94.60:42091: connect: Connection refused (error 111)
18:29:12.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.081948  3526 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.94.61" port: 41619 } attempt: 5
18:29:12.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.089231  3526 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.94.60" port: 42091 } has no permanent_uuid. Determining permanent_uuid...
18:29:12.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:12.091449  3526 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.94.60:42091: Network error: Client connection negotiation failed: client connection to 127.3.94.60:42091: connect: Connection refused (error 111)
18:29:12.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.092011  3598 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.94.60" port: 42091 } attempt: 3
18:29:12.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:12.094038  3598 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.94.60:42091: Network error: Client connection negotiation failed: client connection to 127.3.94.60:42091: connect: Connection refused (error 111)
18:29:12.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.142720  3526 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.94.60" port: 42091 } attempt: 1
18:29:12.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:12.144918  3526 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.94.60:42091: Network error: Client connection negotiation failed: client connection to 127.3.94.60:42091: connect: Connection refused (error 111)
18:29:12.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:12.200950  3600 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:29:12.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:12.201249  3600 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:29:12.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:12.201327  3600 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:29:12.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:12.210479  3600 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
18:29:12.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:12.210584  3600 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:29:12.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:12.210637  3600 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
18:29:12.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:12.210678  3600 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
18:29:12.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:12.210768  3600 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
18:29:12.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:12.210825  3600 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:46825/jwks.json
18:29:12.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.213145  3526 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.94.60" port: 42091 } attempt: 2
18:29:12.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:12.215225  3526 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.94.60:42091: Network error: Client connection negotiation failed: client connection to 127.3.94.60:42091: connect: Connection refused (error 111)
18:29:12.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.222002  3600 master_runner.cc:387] Master server non-default flags:
18:29:12.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:29:12.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.94.20:37457
18:29:12.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:29:12.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:29:12.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/master-2/data
18:29:12.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/master-2/wal
18:29:12.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:29:12.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.3.94.62:42369,127.3.94.61:41619,127.3.94.60:42091
18:29:12.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:29:12.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:29:12.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:29:12.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.94.60:42091
18:29:12.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:29:12.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:29:12.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:29:12.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:46825/jwks.json
18:29:12.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:29:12.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:29:12.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/master-2/data/info.pb
18:29:12.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.94.60
18:29:12.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:29:12.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:29:12.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:29:12.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:29:12.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:29:12.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:29:12.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/master-2/logs
18:29:12.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:29:12.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:29:12.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:29:12.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
18:29:12.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:29:12.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:29:12.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:29:12.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:01:24 UTC on bdcb31816ec0
18:29:12.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16870
18:29:12.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
18:29:12.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.223915  3600 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:29:12.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.226341  3600 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:29:12.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:12.235436  3608 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:12.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:12.235836  3609 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:12.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:12.236757  3611 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:12.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.237257  3598 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.94.60" port: 42091 } attempt: 4
18:29:12.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.237739  3600 server_base.cc:1061] running on GCE node
18:29:12.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.238684  3600 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:29:12.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:12.239265  3598 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.94.60:42091: Network error: Client connection negotiation failed: client connection to 127.3.94.60:42091: connect: Connection refused (error 111)
18:29:12.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.240563  3600 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:29:12.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.241782  3600 hybrid_clock.cc:648] HybridClock initialized: now 1783535352241722 us; error 46 us; skew 500 ppm
18:29:12.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.242202  3600 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:29:12.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.244571  3600 webserver.cc:534] Webserver started at http://127.3.94.60:37517/ using document root <none> and password file <none>
18:29:12.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.245398  3600 fs_manager.cc:362] Metadata directory not provided
18:29:12.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.245535  3600 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:29:12.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.246016  3600 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:29:12.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.248536  3600 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/master-2/data/instance:
18:29:12.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "cf7b21b4baf9454a9a4667a9c6b9c7bc"
18:29:12.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:29:12 on dist-test-slave-0d16"
18:29:12.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.249502  3600 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/master-2/wal/instance:
18:29:12.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "cf7b21b4baf9454a9a4667a9c6b9c7bc"
18:29:12.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:29:12 on dist-test-slave-0d16"
18:29:12.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.255347  3600 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.002s
18:29:12.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.258837  3617 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:29:12.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.260051  3600 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
18:29:12.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.260226  3600 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/master-2/data,/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/master-2/wal
18:29:12.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "cf7b21b4baf9454a9a4667a9c6b9c7bc"
18:29:12.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:29:12 on dist-test-slave-0d16"
18:29:12.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.260522  3600 fs_report.cc:389] FS layout report
18:29:12.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:29:12.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/master-2/wal
18:29:12.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/master-2/wal
18:29:12.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/master-2/data/data
18:29:12.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:29:12.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:29:12.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:29:12.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:29:12.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:29:12.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:29:12.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:29:12.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:29:12.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:29:12.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:29:12.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:29:12.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.291798  3600 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:29:12.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.292922  3600 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:29:12.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.293251  3600 kserver.cc:163] Server-wide thread pool size limit: 3276
18:29:12.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.314062  3600 rpc_server.cc:307] RPC server started. Bound to: 127.3.94.60:42091
18:29:12.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.314085  3668 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.94.60:42091 every 8 connection(s)
18:29:12.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.315908  3600 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/master-2/data/info.pb
18:29:12.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.320663  3669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
18:29:12.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.321480  3526 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.94.60" port: 42091 } attempt: 3
18:29:12.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.323081  3448 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskRlQDJI/build/asan/bin/kudu as pid 3600
18:29:12.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.323308  3448 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/master-2/wal/instance
18:29:12.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.330148  3669 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.94.62" port: 42369 } has no permanent_uuid. Determining permanent_uuid...
18:29:12.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.346112  3526 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 162486c9e36d45919a959f286cd59d1d: Bootstrap starting.
18:29:12.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.349320  3669 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.94.61" port: 41619 } has no permanent_uuid. Determining permanent_uuid...
18:29:12.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.354280  3526 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 162486c9e36d45919a959f286cd59d1d: Neither blocks nor log segments found. Creating new log.
18:29:12.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.356706  3526 log.cc:826] T 00000000000000000000000000000000 P 162486c9e36d45919a959f286cd59d1d: Log is configured to *not* fsync() on all Append() calls
18:29:12.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.368619  3526 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 162486c9e36d45919a959f286cd59d1d: No bootstrap required, opened a new log
18:29:12.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.368602  3669 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.94.60" port: 42091 } has no permanent_uuid. Determining permanent_uuid...
18:29:12.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.375571  3526 raft_consensus.cc:359] T 00000000000000000000000000000000 P 162486c9e36d45919a959f286cd59d1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "162486c9e36d45919a959f286cd59d1d" member_type: VOTER last_known_addr { host: "127.3.94.62" port: 42369 } } peers { permanent_uuid: "82e1fad2f97643f6a383e90692f1d83f" member_type: VOTER last_known_addr { host: "127.3.94.61" port: 41619 } } peers { permanent_uuid: "cf7b21b4baf9454a9a4667a9c6b9c7bc" member_type: VOTER last_known_addr { host: "127.3.94.60" port: 42091 } }
18:29:12.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.375903  3526 raft_consensus.cc:385] T 00000000000000000000000000000000 P 162486c9e36d45919a959f286cd59d1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:29:12.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.376039  3526 raft_consensus.cc:740] T 00000000000000000000000000000000 P 162486c9e36d45919a959f286cd59d1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 162486c9e36d45919a959f286cd59d1d, State: Initialized, Role: FOLLOWER
18:29:12.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.376876  3526 consensus_queue.cc:260] T 00000000000000000000000000000000 P 162486c9e36d45919a959f286cd59d1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "162486c9e36d45919a959f286cd59d1d" member_type: VOTER last_known_addr { host: "127.3.94.62" port: 42369 } } peers { permanent_uuid: "82e1fad2f97643f6a383e90692f1d83f" member_type: VOTER last_known_addr { host: "127.3.94.61" port: 41619 } } peers { permanent_uuid: "cf7b21b4baf9454a9a4667a9c6b9c7bc" member_type: VOTER last_known_addr { host: "127.3.94.60" port: 42091 } }
18:29:12.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.377955  3678 sys_catalog.cc:455] T 00000000000000000000000000000000 P 162486c9e36d45919a959f286cd59d1d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "162486c9e36d45919a959f286cd59d1d" member_type: VOTER last_known_addr { host: "127.3.94.62" port: 42369 } } peers { permanent_uuid: "82e1fad2f97643f6a383e90692f1d83f" member_type: VOTER last_known_addr { host: "127.3.94.61" port: 41619 } } peers { permanent_uuid: "cf7b21b4baf9454a9a4667a9c6b9c7bc" member_type: VOTER last_known_addr { host: "127.3.94.60" port: 42091 } } }
18:29:12.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.379398  3526 sys_catalog.cc:565] T 00000000000000000000000000000000 P 162486c9e36d45919a959f286cd59d1d [sys.catalog]: configured and running, proceeding with master startup.
18:29:12.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.379590  3678 sys_catalog.cc:458] T 00000000000000000000000000000000 P 162486c9e36d45919a959f286cd59d1d [sys.catalog]: This master's current role is: FOLLOWER
18:29:12.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.379906  3669 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cf7b21b4baf9454a9a4667a9c6b9c7bc: Bootstrap starting.
18:29:12.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.383445  3669 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cf7b21b4baf9454a9a4667a9c6b9c7bc: Neither blocks nor log segments found. Creating new log.
18:29:12.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.384851  3669 log.cc:826] T 00000000000000000000000000000000 P cf7b21b4baf9454a9a4667a9c6b9c7bc: Log is configured to *not* fsync() on all Append() calls
18:29:12.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.388567  3669 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cf7b21b4baf9454a9a4667a9c6b9c7bc: No bootstrap required, opened a new log
18:29:12.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.397655  3669 raft_consensus.cc:359] T 00000000000000000000000000000000 P cf7b21b4baf9454a9a4667a9c6b9c7bc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "162486c9e36d45919a959f286cd59d1d" member_type: VOTER last_known_addr { host: "127.3.94.62" port: 42369 } } peers { permanent_uuid: "82e1fad2f97643f6a383e90692f1d83f" member_type: VOTER last_known_addr { host: "127.3.94.61" port: 41619 } } peers { permanent_uuid: "cf7b21b4baf9454a9a4667a9c6b9c7bc" member_type: VOTER last_known_addr { host: "127.3.94.60" port: 42091 } }
18:29:12.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.398742  3669 raft_consensus.cc:385] T 00000000000000000000000000000000 P cf7b21b4baf9454a9a4667a9c6b9c7bc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:29:12.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.399272  3669 raft_consensus.cc:740] T 00000000000000000000000000000000 P cf7b21b4baf9454a9a4667a9c6b9c7bc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cf7b21b4baf9454a9a4667a9c6b9c7bc, State: Initialized, Role: FOLLOWER
18:29:12.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.400624  3669 consensus_queue.cc:260] T 00000000000000000000000000000000 P cf7b21b4baf9454a9a4667a9c6b9c7bc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "162486c9e36d45919a959f286cd59d1d" member_type: VOTER last_known_addr { host: "127.3.94.62" port: 42369 } } peers { permanent_uuid: "82e1fad2f97643f6a383e90692f1d83f" member_type: VOTER last_known_addr { host: "127.3.94.61" port: 41619 } } peers { permanent_uuid: "cf7b21b4baf9454a9a4667a9c6b9c7bc" member_type: VOTER last_known_addr { host: "127.3.94.60" port: 42091 } }
18:29:12.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.396173  3459 master_runner.cc:187] Error getting master registration for 127.3.94.61:41619: OK, instance_id { permanent_uuid: "82e1fad2f97643f6a383e90692f1d83f" instance_seqno: 1783535351828600 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
18:29:12.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.405597  3692 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf7b21b4baf9454a9a4667a9c6b9c7bc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "162486c9e36d45919a959f286cd59d1d" member_type: VOTER last_known_addr { host: "127.3.94.62" port: 42369 } } peers { permanent_uuid: "82e1fad2f97643f6a383e90692f1d83f" member_type: VOTER last_known_addr { host: "127.3.94.61" port: 41619 } } peers { permanent_uuid: "cf7b21b4baf9454a9a4667a9c6b9c7bc" member_type: VOTER last_known_addr { host: "127.3.94.60" port: 42091 } } }
18:29:12.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.406210  3692 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf7b21b4baf9454a9a4667a9c6b9c7bc [sys.catalog]: This master's current role is: FOLLOWER
18:29:12.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:12.404896  3690 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 162486c9e36d45919a959f286cd59d1d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
18:29:12.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:12.406724  3690 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
18:29:12.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.406985  3669 sys_catalog.cc:565] T 00000000000000000000000000000000 P cf7b21b4baf9454a9a4667a9c6b9c7bc [sys.catalog]: configured and running, proceeding with master startup.
18:29:12.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.407539  3459 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
18:29:12.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.420357  3692 raft_consensus.cc:493] T 00000000000000000000000000000000 P cf7b21b4baf9454a9a4667a9c6b9c7bc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:29:12.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.420660  3692 raft_consensus.cc:515] T 00000000000000000000000000000000 P cf7b21b4baf9454a9a4667a9c6b9c7bc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "162486c9e36d45919a959f286cd59d1d" member_type: VOTER last_known_addr { host: "127.3.94.62" port: 42369 } } peers { permanent_uuid: "82e1fad2f97643f6a383e90692f1d83f" member_type: VOTER last_known_addr { host: "127.3.94.61" port: 41619 } } peers { permanent_uuid: "cf7b21b4baf9454a9a4667a9c6b9c7bc" member_type: VOTER last_known_addr { host: "127.3.94.60" port: 42091 } }
18:29:12.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.422449  3692 leader_election.cc:290] T 00000000000000000000000000000000 P cf7b21b4baf9454a9a4667a9c6b9c7bc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 162486c9e36d45919a959f286cd59d1d (127.3.94.62:42369), 82e1fad2f97643f6a383e90692f1d83f (127.3.94.61:41619)
18:29:12.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:12.422703  3703 catalog_manager.cc:1593] T 00000000000000000000000000000000 P cf7b21b4baf9454a9a4667a9c6b9c7bc: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
18:29:12.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:12.422837  3703 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
18:29:12.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.425197  3501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cf7b21b4baf9454a9a4667a9c6b9c7bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "162486c9e36d45919a959f286cd59d1d" is_pre_election: true
18:29:12.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.425686  3501 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 162486c9e36d45919a959f286cd59d1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cf7b21b4baf9454a9a4667a9c6b9c7bc in term 0.
18:29:12.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.420030  3600 master_runner.cc:187] Error getting master registration for 127.3.94.61:41619: OK, instance_id { permanent_uuid: "82e1fad2f97643f6a383e90692f1d83f" instance_seqno: 1783535351828600 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
18:29:12.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.426420  3600 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
18:29:12.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.426494  3618 leader_election.cc:304] T 00000000000000000000000000000000 P cf7b21b4baf9454a9a4667a9c6b9c7bc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 162486c9e36d45919a959f286cd59d1d, cf7b21b4baf9454a9a4667a9c6b9c7bc; no voters: 
18:29:12.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.427134  3692 raft_consensus.cc:2804] T 00000000000000000000000000000000 P cf7b21b4baf9454a9a4667a9c6b9c7bc [term 0 FOLLOWER]: Leader pre-election won for term 1
18:29:12.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.427296  3692 raft_consensus.cc:493] T 00000000000000000000000000000000 P cf7b21b4baf9454a9a4667a9c6b9c7bc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
18:29:12.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.427402  3692 raft_consensus.cc:3060] T 00000000000000000000000000000000 P cf7b21b4baf9454a9a4667a9c6b9c7bc [term 0 FOLLOWER]: Advancing to term 1
18:29:12.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.430706  3692 raft_consensus.cc:515] T 00000000000000000000000000000000 P cf7b21b4baf9454a9a4667a9c6b9c7bc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "162486c9e36d45919a959f286cd59d1d" member_type: VOTER last_known_addr { host: "127.3.94.62" port: 42369 } } peers { permanent_uuid: "82e1fad2f97643f6a383e90692f1d83f" member_type: VOTER last_known_addr { host: "127.3.94.61" port: 41619 } } peers { permanent_uuid: "cf7b21b4baf9454a9a4667a9c6b9c7bc" member_type: VOTER last_known_addr { host: "127.3.94.60" port: 42091 } }
18:29:12.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.431427  3692 leader_election.cc:290] T 00000000000000000000000000000000 P cf7b21b4baf9454a9a4667a9c6b9c7bc [CANDIDATE]: Term 1 election: Requested vote from peers 162486c9e36d45919a959f286cd59d1d (127.3.94.62:42369), 82e1fad2f97643f6a383e90692f1d83f (127.3.94.61:41619)
18:29:12.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.431910  3501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cf7b21b4baf9454a9a4667a9c6b9c7bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "162486c9e36d45919a959f286cd59d1d"
18:29:12.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.432121  3501 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 162486c9e36d45919a959f286cd59d1d [term 0 FOLLOWER]: Advancing to term 1
18:29:12.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.435717  3501 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 162486c9e36d45919a959f286cd59d1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf7b21b4baf9454a9a4667a9c6b9c7bc in term 1.
18:29:12.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.449194  3618 leader_election.cc:304] T 00000000000000000000000000000000 P cf7b21b4baf9454a9a4667a9c6b9c7bc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 162486c9e36d45919a959f286cd59d1d, cf7b21b4baf9454a9a4667a9c6b9c7bc; no voters: 
18:29:12.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.450223  3692 raft_consensus.cc:2804] T 00000000000000000000000000000000 P cf7b21b4baf9454a9a4667a9c6b9c7bc [term 1 FOLLOWER]: Leader election won for term 1
18:29:12.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.466331  3692 raft_consensus.cc:697] T 00000000000000000000000000000000 P cf7b21b4baf9454a9a4667a9c6b9c7bc [term 1 LEADER]: Becoming Leader. State: Replica: cf7b21b4baf9454a9a4667a9c6b9c7bc, State: Running, Role: LEADER
18:29:12.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.467653  3692 consensus_queue.cc:237] T 00000000000000000000000000000000 P cf7b21b4baf9454a9a4667a9c6b9c7bc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "162486c9e36d45919a959f286cd59d1d" member_type: VOTER last_known_addr { host: "127.3.94.62" port: 42369 } } peers { permanent_uuid: "82e1fad2f97643f6a383e90692f1d83f" member_type: VOTER last_known_addr { host: "127.3.94.61" port: 41619 } } peers { permanent_uuid: "cf7b21b4baf9454a9a4667a9c6b9c7bc" member_type: VOTER last_known_addr { host: "127.3.94.60" port: 42091 } }
18:29:12.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.473524  3705 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf7b21b4baf9454a9a4667a9c6b9c7bc [sys.catalog]: SysCatalogTable state changed. Reason: New leader cf7b21b4baf9454a9a4667a9c6b9c7bc. Latest consensus state: current_term: 1 leader_uuid: "cf7b21b4baf9454a9a4667a9c6b9c7bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "162486c9e36d45919a959f286cd59d1d" member_type: VOTER last_known_addr { host: "127.3.94.62" port: 42369 } } peers { permanent_uuid: "82e1fad2f97643f6a383e90692f1d83f" member_type: VOTER last_known_addr { host: "127.3.94.61" port: 41619 } } peers { permanent_uuid: "cf7b21b4baf9454a9a4667a9c6b9c7bc" member_type: VOTER last_known_addr { host: "127.3.94.60" port: 42091 } } }
18:29:12.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.473879  3705 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf7b21b4baf9454a9a4667a9c6b9c7bc [sys.catalog]: This master's current role is: LEADER
18:29:12.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.475020  3707 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
18:29:12.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.477421  3707 catalog_manager.cc:1519] Initializing Kudu cluster ID...
18:29:12.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.489353  3501 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 162486c9e36d45919a959f286cd59d1d [term 1 FOLLOWER]: Refusing update from remote peer cf7b21b4baf9454a9a4667a9c6b9c7bc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
18:29:12.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.490334  3692 consensus_queue.cc:1048] T 00000000000000000000000000000000 P cf7b21b4baf9454a9a4667a9c6b9c7bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "162486c9e36d45919a959f286cd59d1d" member_type: VOTER last_known_addr { host: "127.3.94.62" port: 42369 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:29:12.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.512611  3678 sys_catalog.cc:455] T 00000000000000000000000000000000 P 162486c9e36d45919a959f286cd59d1d [sys.catalog]: SysCatalogTable state changed. Reason: New leader cf7b21b4baf9454a9a4667a9c6b9c7bc. Latest consensus state: current_term: 1 leader_uuid: "cf7b21b4baf9454a9a4667a9c6b9c7bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "162486c9e36d45919a959f286cd59d1d" member_type: VOTER last_known_addr { host: "127.3.94.62" port: 42369 } } peers { permanent_uuid: "82e1fad2f97643f6a383e90692f1d83f" member_type: VOTER last_known_addr { host: "127.3.94.61" port: 41619 } } peers { permanent_uuid: "cf7b21b4baf9454a9a4667a9c6b9c7bc" member_type: VOTER last_known_addr { host: "127.3.94.60" port: 42091 } } }
18:29:12.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.512917  3678 sys_catalog.cc:458] T 00000000000000000000000000000000 P 162486c9e36d45919a959f286cd59d1d [sys.catalog]: This master's current role is: FOLLOWER
18:29:12.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.514025  3709 mvcc.cc:204] Tried to move back new op lower bound from 7305360803777884160 to 7305360803717451776. Current Snapshot: MvccSnapshot[applied={T|T < 7305360803777884160}]
18:29:12.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.519645  3692 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf7b21b4baf9454a9a4667a9c6b9c7bc [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "cf7b21b4baf9454a9a4667a9c6b9c7bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "162486c9e36d45919a959f286cd59d1d" member_type: VOTER last_known_addr { host: "127.3.94.62" port: 42369 } } peers { permanent_uuid: "82e1fad2f97643f6a383e90692f1d83f" member_type: VOTER last_known_addr { host: "127.3.94.61" port: 41619 } } peers { permanent_uuid: "cf7b21b4baf9454a9a4667a9c6b9c7bc" member_type: VOTER last_known_addr { host: "127.3.94.60" port: 42091 } } }
18:29:12.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.519953  3692 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf7b21b4baf9454a9a4667a9c6b9c7bc [sys.catalog]: This master's current role is: LEADER
18:29:12.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.523046  3707 catalog_manager.cc:1382] Generated new cluster ID: c71c60574d754288b9a8937b8a779e28
18:29:12.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.523168  3707 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
18:29:12.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.529067  3678 sys_catalog.cc:455] T 00000000000000000000000000000000 P 162486c9e36d45919a959f286cd59d1d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "cf7b21b4baf9454a9a4667a9c6b9c7bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "162486c9e36d45919a959f286cd59d1d" member_type: VOTER last_known_addr { host: "127.3.94.62" port: 42369 } } peers { permanent_uuid: "82e1fad2f97643f6a383e90692f1d83f" member_type: VOTER last_known_addr { host: "127.3.94.61" port: 41619 } } peers { permanent_uuid: "cf7b21b4baf9454a9a4667a9c6b9c7bc" member_type: VOTER last_known_addr { host: "127.3.94.60" port: 42091 } } }
18:29:12.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.529297  3678 sys_catalog.cc:458] T 00000000000000000000000000000000 P 162486c9e36d45919a959f286cd59d1d [sys.catalog]: This master's current role is: FOLLOWER
18:29:12.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.538455  3598 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.94.60" port: 42091 } attempt: 5
18:29:12.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.555428  3598 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 82e1fad2f97643f6a383e90692f1d83f: Bootstrap starting.
18:29:12.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.562184  3598 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 82e1fad2f97643f6a383e90692f1d83f: Neither blocks nor log segments found. Creating new log.
18:29:12.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.563593  3598 log.cc:826] T 00000000000000000000000000000000 P 82e1fad2f97643f6a383e90692f1d83f: Log is configured to *not* fsync() on all Append() calls
18:29:12.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.564721  3707 catalog_manager.cc:1405] Generated new certificate authority record
18:29:12.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.568912  3707 catalog_manager.cc:1539] Loading token signing keys...
18:29:12.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.584482  3598 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 82e1fad2f97643f6a383e90692f1d83f: No bootstrap required, opened a new log
18:29:12.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.594245  3598 raft_consensus.cc:359] T 00000000000000000000000000000000 P 82e1fad2f97643f6a383e90692f1d83f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "162486c9e36d45919a959f286cd59d1d" member_type: VOTER last_known_addr { host: "127.3.94.62" port: 42369 } } peers { permanent_uuid: "82e1fad2f97643f6a383e90692f1d83f" member_type: VOTER last_known_addr { host: "127.3.94.61" port: 41619 } } peers { permanent_uuid: "cf7b21b4baf9454a9a4667a9c6b9c7bc" member_type: VOTER last_known_addr { host: "127.3.94.60" port: 42091 } }
18:29:12.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.597116  3598 raft_consensus.cc:385] T 00000000000000000000000000000000 P 82e1fad2f97643f6a383e90692f1d83f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:29:12.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.597677  3598 raft_consensus.cc:740] T 00000000000000000000000000000000 P 82e1fad2f97643f6a383e90692f1d83f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 82e1fad2f97643f6a383e90692f1d83f, State: Initialized, Role: FOLLOWER
18:29:12.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.600155  3598 consensus_queue.cc:260] T 00000000000000000000000000000000 P 82e1fad2f97643f6a383e90692f1d83f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "162486c9e36d45919a959f286cd59d1d" member_type: VOTER last_known_addr { host: "127.3.94.62" port: 42369 } } peers { permanent_uuid: "82e1fad2f97643f6a383e90692f1d83f" member_type: VOTER last_known_addr { host: "127.3.94.61" port: 41619 } } peers { permanent_uuid: "cf7b21b4baf9454a9a4667a9c6b9c7bc" member_type: VOTER last_known_addr { host: "127.3.94.60" port: 42091 } }
18:29:12.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.604646  3707 catalog_manager.cc:6069] T 00000000000000000000000000000000 P cf7b21b4baf9454a9a4667a9c6b9c7bc: Generated new TSK 0
18:29:12.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.610996  3707 catalog_manager.cc:1549] Initializing in-progress tserver states...
18:29:12.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.617583  3715 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82e1fad2f97643f6a383e90692f1d83f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "162486c9e36d45919a959f286cd59d1d" member_type: VOTER last_known_addr { host: "127.3.94.62" port: 42369 } } peers { permanent_uuid: "82e1fad2f97643f6a383e90692f1d83f" member_type: VOTER last_known_addr { host: "127.3.94.61" port: 41619 } } peers { permanent_uuid: "cf7b21b4baf9454a9a4667a9c6b9c7bc" member_type: VOTER last_known_addr { host: "127.3.94.60" port: 42091 } } }
18:29:12.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.618770  3573 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cf7b21b4baf9454a9a4667a9c6b9c7bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82e1fad2f97643f6a383e90692f1d83f" is_pre_election: true
18:29:12.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.619167  3571 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 82e1fad2f97643f6a383e90692f1d83f [term 0 FOLLOWER]: Advancing to term 1
18:29:12.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.620801  3598 sys_catalog.cc:565] T 00000000000000000000000000000000 P 82e1fad2f97643f6a383e90692f1d83f [sys.catalog]: configured and running, proceeding with master startup.
18:29:12.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.622920  3571 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 82e1fad2f97643f6a383e90692f1d83f [term 1 FOLLOWER]: Refusing update from remote peer cf7b21b4baf9454a9a4667a9c6b9c7bc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
18:29:12.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.623607  3572 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "cf7b21b4baf9454a9a4667a9c6b9c7bc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "82e1fad2f97643f6a383e90692f1d83f"
18:29:12.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.624292  3692 consensus_queue.cc:1048] T 00000000000000000000000000000000 P cf7b21b4baf9454a9a4667a9c6b9c7bc [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e1fad2f97643f6a383e90692f1d83f" member_type: VOTER last_known_addr { host: "127.3.94.61" port: 41619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:29:12.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.626958  3572 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 82e1fad2f97643f6a383e90692f1d83f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cf7b21b4baf9454a9a4667a9c6b9c7bc in term 1.
18:29:12.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.628998  3715 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82e1fad2f97643f6a383e90692f1d83f [sys.catalog]: This master's current role is: FOLLOWER
18:29:12.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.633014  3448 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskRlQDJI/build/asan/bin/kudu
18:29:12.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskRlQDJI/build/asan/bin/kudu
18:29:12.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/ts-0/wal
18:29:12.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/ts-0/data
18:29:12.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:29:12.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:29:12.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:29:12.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:29:12.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:29:12.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:29:12.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/ts-0/logs
18:29:12.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/ts-0/data/info.pb
18:29:12.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:29:12.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:29:12.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:29:12.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:29:12.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:29:12.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:29:12.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:29:12.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:29:12.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
18:29:12.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:29:12.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.94.1:0
18:29:12.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.3.94.1
18:29:12.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.94.1
18:29:12.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:29:12.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.3.94.62:42369,127.3.94.61:41619,127.3.94.60:42091
18:29:12.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.94.20:37457
18:29:12.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:29:12.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:29:12.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
18:29:12.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.693778  3715 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82e1fad2f97643f6a383e90692f1d83f [sys.catalog]: SysCatalogTable state changed. Reason: New leader cf7b21b4baf9454a9a4667a9c6b9c7bc. Latest consensus state: current_term: 1 leader_uuid: "cf7b21b4baf9454a9a4667a9c6b9c7bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "162486c9e36d45919a959f286cd59d1d" member_type: VOTER last_known_addr { host: "127.3.94.62" port: 42369 } } peers { permanent_uuid: "82e1fad2f97643f6a383e90692f1d83f" member_type: VOTER last_known_addr { host: "127.3.94.61" port: 41619 } } peers { permanent_uuid: "cf7b21b4baf9454a9a4667a9c6b9c7bc" member_type: VOTER last_known_addr { host: "127.3.94.60" port: 42091 } } }
18:29:12.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.694041  3715 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82e1fad2f97643f6a383e90692f1d83f [sys.catalog]: This master's current role is: FOLLOWER
18:29:12.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.694691  3723 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82e1fad2f97643f6a383e90692f1d83f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "cf7b21b4baf9454a9a4667a9c6b9c7bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "162486c9e36d45919a959f286cd59d1d" member_type: VOTER last_known_addr { host: "127.3.94.62" port: 42369 } } peers { permanent_uuid: "82e1fad2f97643f6a383e90692f1d83f" member_type: VOTER last_known_addr { host: "127.3.94.61" port: 41619 } } peers { permanent_uuid: "cf7b21b4baf9454a9a4667a9c6b9c7bc" member_type: VOTER last_known_addr { host: "127.3.94.60" port: 42091 } } }
18:29:12.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.695032  3723 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82e1fad2f97643f6a383e90692f1d83f [sys.catalog]: This master's current role is: FOLLOWER
18:29:12.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.719359  3734 catalog_manager.cc:1294] Loaded cluster ID: c71c60574d754288b9a8937b8a779e28
18:29:12.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.721829  3734 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 82e1fad2f97643f6a383e90692f1d83f: loading cluster ID for follower catalog manager: success
18:29:12.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.726663  3734 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 82e1fad2f97643f6a383e90692f1d83f: acquiring CA information for follower catalog manager: success
18:29:12.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:12.739820  3734 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 82e1fad2f97643f6a383e90692f1d83f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
18:29:13.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.052755  3692 sys_catalog.cc:455] T 00000000000000000000000000000000 P cf7b21b4baf9454a9a4667a9c6b9c7bc [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "cf7b21b4baf9454a9a4667a9c6b9c7bc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "162486c9e36d45919a959f286cd59d1d" member_type: VOTER last_known_addr { host: "127.3.94.62" port: 42369 } } peers { permanent_uuid: "82e1fad2f97643f6a383e90692f1d83f" member_type: VOTER last_known_addr { host: "127.3.94.61" port: 41619 } } peers { permanent_uuid: "cf7b21b4baf9454a9a4667a9c6b9c7bc" member_type: VOTER last_known_addr { host: "127.3.94.60" port: 42091 } } }
18:29:13.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.053059  3692 sys_catalog.cc:458] T 00000000000000000000000000000000 P cf7b21b4baf9454a9a4667a9c6b9c7bc [sys.catalog]: This master's current role is: LEADER
18:29:13.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:13.173772  3719 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:29:13.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:13.174170  3719 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:29:13.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:13.174256  3719 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:29:13.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:13.182711  3719 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:29:13.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:13.182883  3719 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.94.1
18:29:13.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.193424  3719 tablet_server_runner.cc:78] Tablet server non-default flags:
18:29:13.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:29:13.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.94.20:37457
18:29:13.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:29:13.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:29:13.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/ts-0/data
18:29:13.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/ts-0/wal
18:29:13.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:29:13.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:29:13.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.94.1:0
18:29:13.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:29:13.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:29:13.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:29:13.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/ts-0/data/info.pb
18:29:13.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.94.1
18:29:13.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:29:13.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.3.94.62:42369,127.3.94.61:41619,127.3.94.60:42091
18:29:13.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:29:13.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:29:13.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:29:13.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:29:13.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:29:13.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.3.94.1
18:29:13.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/ts-0/logs
18:29:13.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:29:13.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:29:13.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:29:13.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
18:29:13.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:29:13.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:29:13.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:29:13.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:01:24 UTC on bdcb31816ec0
18:29:13.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16870
18:29:13.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
18:29:13.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.195309  3719 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:29:13.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.197857  3719 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:29:13.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:13.210115  3741 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:13.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:13.211006  3742 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:13.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:13.226145  3744 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:13.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.227485  3719 server_base.cc:1061] running on GCE node
18:29:13.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.228672  3719 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:29:13.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.232792  3719 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:29:13.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.234299  3719 hybrid_clock.cc:648] HybridClock initialized: now 1783535353234174 us; error 114 us; skew 500 ppm
18:29:13.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.234889  3719 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:29:13.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.238912  3719 webserver.cc:534] Webserver started at http://127.3.94.1:36479/ using document root <none> and password file <none>
18:29:13.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.239799  3719 fs_manager.cc:362] Metadata directory not provided
18:29:13.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.239941  3719 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:29:13.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.240394  3719 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:29:13.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.243062  3719 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/ts-0/data/instance:
18:29:13.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "77d54c54ba774a17a714cf2fbbb24ee2"
18:29:13.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:29:13 on dist-test-slave-0d16"
18:29:13.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.244010  3719 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/ts-0/wal/instance:
18:29:13.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "77d54c54ba774a17a714cf2fbbb24ee2"
18:29:13.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:29:13 on dist-test-slave-0d16"
18:29:13.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.249765  3719 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.001s
18:29:13.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.253242  3750 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:29:13.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.254650  3719 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
18:29:13.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.254817  3719 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/ts-0/data,/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/ts-0/wal
18:29:13.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "77d54c54ba774a17a714cf2fbbb24ee2"
18:29:13.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:29:13 on dist-test-slave-0d16"
18:29:13.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.254987  3719 fs_report.cc:389] FS layout report
18:29:13.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:29:13.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/ts-0/wal
18:29:13.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/ts-0/wal
18:29:13.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/ts-0/data/data
18:29:13.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:29:13.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:29:13.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:29:13.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:29:13.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:29:13.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:29:13.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:29:13.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:29:13.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:29:13.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:29:13.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:29:13.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.274891  3719 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:29:13.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.275769  3719 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:29:13.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.276013  3719 kserver.cc:163] Server-wide thread pool size limit: 3276
18:29:13.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.276973  3719 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
18:29:13.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.278527  3719 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
18:29:13.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.278615  3719 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
18:29:13.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.278685  3719 ts_tablet_manager.cc:616] Registered 0 tablets
18:29:13.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.278730  3719 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
18:29:13.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.315189  3719 rpc_server.cc:307] RPC server started. Bound to: 127.3.94.1:42025
18:29:13.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.315214  3863 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.94.1:42025 every 8 connection(s)
18:29:13.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.316603  3719 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/ts-0/data/info.pb
18:29:13.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.318400  3448 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskRlQDJI/build/asan/bin/kudu as pid 3719
18:29:13.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.318599  3448 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/ts-0/wal/instance
18:29:13.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.324229  3448 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskRlQDJI/build/asan/bin/kudu
18:29:13.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskRlQDJI/build/asan/bin/kudu
18:29:13.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/ts-1/wal
18:29:13.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/ts-1/data
18:29:13.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:29:13.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:29:13.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:29:13.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:29:13.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:29:13.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:29:13.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/ts-1/logs
18:29:13.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/ts-1/data/info.pb
18:29:13.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:29:13.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:29:13.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:29:13.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:29:13.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:29:13.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:29:13.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:29:13.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:29:13.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
18:29:13.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:29:13.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.94.2:0
18:29:13.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.3.94.2
18:29:13.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.94.2
18:29:13.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:29:13.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.3.94.62:42369,127.3.94.61:41619,127.3.94.60:42091
18:29:13.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.94.20:37457
18:29:13.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:29:13.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:29:13.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
18:29:13.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.343425  3864 heartbeater.cc:344] Connected to a master server at 127.3.94.60:42091
18:29:13.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.344236  3864 heartbeater.cc:461] Registering TS with master...
18:29:13.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.345563  3864 heartbeater.cc:507] Master 127.3.94.60:42091 requested a full tablet report, sending...
18:29:13.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.348214  3634 ts_manager.cc:194] Registered new tserver with Master: 77d54c54ba774a17a714cf2fbbb24ee2 (127.3.94.1:42025)
18:29:13.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.350417  3634 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.3.94.1:46835
18:29:13.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.354951  3865 heartbeater.cc:344] Connected to a master server at 127.3.94.62:42369
18:29:13.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.355098  3865 heartbeater.cc:461] Registering TS with master...
18:29:13.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.355509  3865 heartbeater.cc:507] Master 127.3.94.62:42369 requested a full tablet report, sending...
18:29:13.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.357468  3491 ts_manager.cc:194] Registered new tserver with Master: 77d54c54ba774a17a714cf2fbbb24ee2 (127.3.94.1:42025)
18:29:13.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.358691  3866 heartbeater.cc:344] Connected to a master server at 127.3.94.61:41619
18:29:13.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.358795  3866 heartbeater.cc:461] Registering TS with master...
18:29:13.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.359012  3866 heartbeater.cc:507] Master 127.3.94.61:41619 requested a full tablet report, sending...
18:29:13.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.360452  3562 ts_manager.cc:194] Registered new tserver with Master: 77d54c54ba774a17a714cf2fbbb24ee2 (127.3.94.1:42025)
18:29:13.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.408735  3690 catalog_manager.cc:1294] Loaded cluster ID: c71c60574d754288b9a8937b8a779e28
18:29:13.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.408820  3690 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 162486c9e36d45919a959f286cd59d1d: loading cluster ID for follower catalog manager: success
18:29:13.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.411230  3690 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 162486c9e36d45919a959f286cd59d1d: acquiring CA information for follower catalog manager: success
18:29:13.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.413012  3690 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 162486c9e36d45919a959f286cd59d1d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
18:29:13.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:13.680285  3872 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:29:13.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:13.680699  3872 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:29:13.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:13.680817  3872 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:29:13.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:13.689035  3872 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:29:13.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:13.689260  3872 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.94.2
18:29:13.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.699190  3872 tablet_server_runner.cc:78] Tablet server non-default flags:
18:29:13.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:29:13.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.94.20:37457
18:29:13.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:29:13.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:29:13.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/ts-1/data
18:29:13.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/ts-1/wal
18:29:13.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:29:13.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:29:13.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.94.2:0
18:29:13.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:29:13.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:29:13.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:29:13.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/ts-1/data/info.pb
18:29:13.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.94.2
18:29:13.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:29:13.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.3.94.62:42369,127.3.94.61:41619,127.3.94.60:42091
18:29:13.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:29:13.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:29:13.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:29:13.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:29:13.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:29:13.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.3.94.2
18:29:13.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/ts-1/logs
18:29:13.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:29:13.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:29:13.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:29:13.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
18:29:13.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:29:13.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:29:13.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:29:13.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:01:24 UTC on bdcb31816ec0
18:29:13.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16870
18:29:13.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
18:29:13.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.701416  3872 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:29:13.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.703397  3872 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:29:13.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:13.713187  3878 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:13.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:13.714047  3881 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:13.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.714278  3872 server_base.cc:1061] running on GCE node
18:29:13.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:13.714439  3879 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:13.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.715054  3872 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:29:13.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.715932  3872 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:29:13.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.717114  3872 hybrid_clock.cc:648] HybridClock initialized: now 1783535353717066 us; error 43 us; skew 500 ppm
18:29:13.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.717378  3872 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:29:13.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.719453  3872 webserver.cc:534] Webserver started at http://127.3.94.2:44693/ using document root <none> and password file <none>
18:29:13.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.720217  3872 fs_manager.cc:362] Metadata directory not provided
18:29:13.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.720307  3872 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:29:13.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.720644  3872 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:29:13.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.723088  3872 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/ts-1/data/instance:
18:29:13.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "8c108f9b1b154b3e821195366aea34c8"
18:29:13.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:29:13 on dist-test-slave-0d16"
18:29:13.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.723781  3872 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/ts-1/wal/instance:
18:29:13.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "8c108f9b1b154b3e821195366aea34c8"
18:29:13.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:29:13 on dist-test-slave-0d16"
18:29:13.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.728874  3872 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.002s
18:29:13.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.732167  3887 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:29:13.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.733620  3872 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
18:29:13.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.733772  3872 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/ts-1/data,/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/ts-1/wal
18:29:13.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "8c108f9b1b154b3e821195366aea34c8"
18:29:13.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:29:13 on dist-test-slave-0d16"
18:29:13.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.733942  3872 fs_report.cc:389] FS layout report
18:29:13.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:29:13.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/ts-1/wal
18:29:13.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/ts-1/wal
18:29:13.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/ts-1/data/data
18:29:13.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:29:13.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:29:13.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:29:13.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:29:13.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:29:13.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:29:13.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:29:13.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:29:13.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:29:13.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:29:13.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:29:13.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.746286  3872 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:29:13.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.747105  3872 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:29:13.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.747318  3872 kserver.cc:163] Server-wide thread pool size limit: 3276
18:29:13.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.748222  3872 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
18:29:13.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.749799  3872 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
18:29:13.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.749884  3872 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
18:29:13.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.749949  3872 ts_tablet_manager.cc:616] Registered 0 tablets
18:29:13.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.750032  3872 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
18:29:13.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.783460  3872 rpc_server.cc:307] RPC server started. Bound to: 127.3.94.2:46741
18:29:13.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.783504  3999 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.94.2:46741 every 8 connection(s)
18:29:13.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.785041  3872 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/ts-1/data/info.pb
18:29:13.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.794229  3448 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskRlQDJI/build/asan/bin/kudu as pid 3872
18:29:13.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.794447  3448 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/ts-1/wal/instance
18:29:13.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.798774  3448 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskRlQDJI/build/asan/bin/kudu
18:29:13.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskRlQDJI/build/asan/bin/kudu
18:29:13.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/ts-2/wal
18:29:13.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/ts-2/data
18:29:13.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:29:13.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:29:13.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:29:13.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:29:13.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:29:13.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:29:13.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/ts-2/logs
18:29:13.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/ts-2/data/info.pb
18:29:13.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:29:13.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:29:13.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:29:13.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:29:13.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:29:13.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:29:13.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:29:13.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:29:13.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
18:29:13.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:29:13.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.94.3:0
18:29:13.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.3.94.3
18:29:13.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.94.3
18:29:13.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:29:13.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.3.94.62:42369,127.3.94.61:41619,127.3.94.60:42091
18:29:13.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.94.20:37457
18:29:13.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:29:13.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:29:13.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
18:29:13.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.803376  4001 heartbeater.cc:344] Connected to a master server at 127.3.94.62:42369
18:29:13.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.803553  4002 heartbeater.cc:344] Connected to a master server at 127.3.94.61:41619
18:29:13.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.803586  4000 heartbeater.cc:344] Connected to a master server at 127.3.94.60:42091
18:29:13.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.803872  4002 heartbeater.cc:461] Registering TS with master...
18:29:13.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.803874  4001 heartbeater.cc:461] Registering TS with master...
18:29:13.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.803876  4000 heartbeater.cc:461] Registering TS with master...
18:29:13.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.805199  4000 heartbeater.cc:507] Master 127.3.94.60:42091 requested a full tablet report, sending...
18:29:13.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.805233  4002 heartbeater.cc:507] Master 127.3.94.61:41619 requested a full tablet report, sending...
18:29:13.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.805255  4001 heartbeater.cc:507] Master 127.3.94.62:42369 requested a full tablet report, sending...
18:29:13.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.807184  3562 ts_manager.cc:194] Registered new tserver with Master: 8c108f9b1b154b3e821195366aea34c8 (127.3.94.2:46741)
18:29:13.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.807194  3491 ts_manager.cc:194] Registered new tserver with Master: 8c108f9b1b154b3e821195366aea34c8 (127.3.94.2:46741)
18:29:13.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.807353  3634 ts_manager.cc:194] Registered new tserver with Master: 8c108f9b1b154b3e821195366aea34c8 (127.3.94.2:46741)
18:29:13.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:13.808179  3634 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.3.94.2:36813
18:29:14.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:14.138679  4007 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:29:14.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:14.139031  4007 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:29:14.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:14.139142  4007 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:29:14.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:14.147573  4007 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:29:14.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:14.147825  4007 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.94.3
18:29:14.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:14.157863  4007 tablet_server_runner.cc:78] Tablet server non-default flags:
18:29:14.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:29:14.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.94.20:37457
18:29:14.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:29:14.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:29:14.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/ts-2/data
18:29:14.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/ts-2/wal
18:29:14.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:29:14.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:29:14.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.94.3:0
18:29:14.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:29:14.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:29:14.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:29:14.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/ts-2/data/info.pb
18:29:14.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.94.3
18:29:14.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:29:14.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.3.94.62:42369,127.3.94.61:41619,127.3.94.60:42091
18:29:14.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:29:14.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:29:14.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:29:14.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:29:14.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:29:14.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.3.94.3
18:29:14.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/ts-2/logs
18:29:14.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:29:14.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:29:14.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:29:14.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
18:29:14.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:29:14.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:29:14.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:29:14.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:01:24 UTC on bdcb31816ec0
18:29:14.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16870
18:29:14.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
18:29:14.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:14.160116  4007 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:29:14.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:14.162194  4007 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:29:14.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:14.171595  4014 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:14.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:14.172240  4016 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:14.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:14.171741  4013 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:14.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:14.173187  4007 server_base.cc:1061] running on GCE node
18:29:14.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:14.173786  4007 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:29:14.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:14.174675  4007 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:29:14.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:14.175868  4007 hybrid_clock.cc:648] HybridClock initialized: now 1783535354175813 us; error 48 us; skew 500 ppm
18:29:14.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:14.176137  4007 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:29:14.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:14.178237  4007 webserver.cc:534] Webserver started at http://127.3.94.3:35233/ using document root <none> and password file <none>
18:29:14.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:14.178928  4007 fs_manager.cc:362] Metadata directory not provided
18:29:14.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:14.179019  4007 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:29:14.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:14.179307  4007 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:29:14.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:14.181699  4007 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/ts-2/data/instance:
18:29:14.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "10503043a581460a8f329f09ce44e662"
18:29:14.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:29:14 on dist-test-slave-0d16"
18:29:14.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:14.182420  4007 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/ts-2/wal/instance:
18:29:14.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "10503043a581460a8f329f09ce44e662"
18:29:14.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:29:14 on dist-test-slave-0d16"
18:29:14.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:14.187471  4007 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.001s
18:29:14.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:14.190840  4022 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:29:14.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:14.192175  4007 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
18:29:14.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:14.192394  4007 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/ts-2/data,/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/ts-2/wal
18:29:14.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "10503043a581460a8f329f09ce44e662"
18:29:14.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:29:14 on dist-test-slave-0d16"
18:29:14.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:14.192703  4007 fs_report.cc:389] FS layout report
18:29:14.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:29:14.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/ts-2/wal
18:29:14.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/ts-2/wal
18:29:14.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/ts-2/data/data
18:29:14.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:29:14.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:29:14.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:29:14.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:29:14.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:29:14.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:29:14.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:29:14.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:29:14.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:29:14.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:29:14.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:29:14.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:14.247206  4007 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:29:14.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:14.248267  4007 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:29:14.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:14.248688  4007 kserver.cc:163] Server-wide thread pool size limit: 3276
18:29:14.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:14.249738  4007 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
18:29:14.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:14.251482  4007 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
18:29:14.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:14.251609  4007 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
18:29:14.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:14.251718  4007 ts_tablet_manager.cc:616] Registered 0 tablets
18:29:14.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:14.251794  4007 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
18:29:14.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:14.285830  4007 rpc_server.cc:307] RPC server started. Bound to: 127.3.94.3:35493
18:29:14.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:14.285893  4135 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.94.3:35493 every 8 connection(s)
18:29:14.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:14.287678  4007 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/ts-2/data/info.pb
18:29:14.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:14.294046  3448 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskRlQDJI/build/asan/bin/kudu as pid 4007
18:29:14.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:14.294284  3448 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/ts-2/wal/instance
18:29:14.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:14.308779  4136 heartbeater.cc:344] Connected to a master server at 127.3.94.60:42091
18:29:14.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:14.308909  4137 heartbeater.cc:344] Connected to a master server at 127.3.94.62:42369
18:29:14.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:14.309209  4136 heartbeater.cc:461] Registering TS with master...
18:29:14.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:14.309211  4137 heartbeater.cc:461] Registering TS with master...
18:29:14.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:14.310380  4138 heartbeater.cc:344] Connected to a master server at 127.3.94.61:41619
18:29:14.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:14.310619  4136 heartbeater.cc:507] Master 127.3.94.60:42091 requested a full tablet report, sending...
18:29:14.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:14.310647  4137 heartbeater.cc:507] Master 127.3.94.62:42369 requested a full tablet report, sending...
18:29:14.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:14.310767  4138 heartbeater.cc:461] Registering TS with master...
18:29:14.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:14.311242  4138 heartbeater.cc:507] Master 127.3.94.61:41619 requested a full tablet report, sending...
18:29:14.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:14.312373  3634 ts_manager.cc:194] Registered new tserver with Master: 10503043a581460a8f329f09ce44e662 (127.3.94.3:35493)
18:29:14.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:14.312589  3562 ts_manager.cc:194] Registered new tserver with Master: 10503043a581460a8f329f09ce44e662 (127.3.94.3:35493)
18:29:14.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:14.312695  3491 ts_manager.cc:194] Registered new tserver with Master: 10503043a581460a8f329f09ce44e662 (127.3.94.3:35493)
18:29:14.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:14.313397  3634 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.3.94.3:46255
18:29:14.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:14.323244  3448 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
18:29:14.325 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
18:29:14.326 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

18:29:14.335 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.3.94.62"
      port: 42369
    }
    bound_http_address {
      host: "127.3.94.62"
      port: 40091
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.3.94.61"
      port: 41619
    }
    bound_http_address {
      host: "127.3.94.61"
      port: 34363
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.3.94.60"
      port: 42091
    }
    bound_http_address {
      host: "127.3.94.60"
      port: 37517
    }
  }
}

18:29:14.338 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

18:29:14.340 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.3.94.1"
      port: 42025
    }
    bound_http_address {
      host: "127.3.94.1"
      port: 36479
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.3.94.2"
      port: 46741
    }
    bound_http_address {
      host: "127.3.94.2"
      port: 44693
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.3.94.3"
      port: 35493
    }
    bound_http_address {
      host: "127.3.94.3"
      port: 35233
    }
  }
}

18:29:14.341 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
18:29:14.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:14.354285  3864 heartbeater.cc:499] Master 127.3.94.60:42091 was elected leader, sending a full tablet report...
18:29:14.555 [DEBUG - main] (CompositeStrategy.java:59) Unable to load modern Subject methods, relying only on legacy methods
java.lang.NoSuchMethodException: javax.security.auth.Subject.current()
	at java.base/java.lang.Class.getDeclaredMethod(Class.java:2677)
	at org.apache.kudu.client.internals.ModernStrategy.<init>(ModernStrategy.java:51)
	at org.apache.kudu.client.internals.CompositeStrategy.<init>(CompositeStrategy.java:52)
	at org.apache.kudu.client.internals.CompositeStrategy.<clinit>(CompositeStrategy.java:41)
	at org.apache.kudu.client.internals.SecurityManagerCompatibility.get(SecurityManagerCompatibility.java:43)
	at org.apache.kudu.client.SecurityContext.setupSubject(SecurityContext.java:155)
	at org.apache.kudu.client.SecurityContext.<init>(SecurityContext.java:138)
	at org.apache.kudu.client.AsyncKuduClient.<init>(AsyncKuduClient.java:431)
	at org.apache.kudu.client.AsyncKuduClient$AsyncKuduClientBuilder.build(AsyncKuduClient.java:3109)
	at org.apache.kudu.test.KuduTestHarness.before(KuduTestHarness.java:161)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:50)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.doOneAttempt(RetryRule.java:225)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.evaluate(RetryRule.java:246)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runners.Suite.runChild(Suite.java:128)
	at org.junit.runners.Suite.runChild(Suite.java:27)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
	at org.junit.runner.JUnitCore.runMain(JUnitCore.java:77)
	at org.junit.runner.JUnitCore.main(JUnitCore.java:36)
18:29:14.614 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:29:14.776 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.3.94.60:42091(127.3.94.60:42091)] connecting to peer
18:29:14.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:14.811218  4000 heartbeater.cc:499] Master 127.3.94.60:42091 was elected leader, sending a full tablet report...
18:29:14.831 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.3.94.61:41619(127.3.94.61:41619)] connecting to peer
18:29:14.837 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.3.94.62:42369(127.3.94.62:42369)] connecting to peer
18:29:14.854 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.3.94.61:41619(127.3.94.61:41619)] Successfully connected to peer
18:29:14.854 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.3.94.60:42091(127.3.94.60:42091)] Successfully connected to peer
18:29:14.863 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.3.94.62:42369(127.3.94.62:42369)] Successfully connected to peer
18:29:14.954 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.3.94.60
18:29:14.954 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.3.94.61
18:29:14.954 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.3.94.62
18:29:15.183 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x92c3011e, L:/127.0.0.1:38220 - R:/127.3.94.60:42091] using SASL/PLAIN
18:29:15.184 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x077bbf43, L:/127.0.0.1:49476 - R:/127.3.94.61:41619] using SASL/PLAIN
18:29:15.183 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x9211a04a, L:/127.0.0.1:46876 - R:/127.3.94.62:42369] using SASL/PLAIN
18:29:15.220 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
18:29:15.221 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=492), Traces: [0ms] refreshing cache from master, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.60:42091, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.61:41619, [105ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.62:42369, [466ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.62:42369: OK, [466ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.61:41619: OK, [467ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.60:42091: OK, deferred=null) after lookup
18:29:15.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:15.269550  3634 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38220:
18:29:15.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "org.apache.kudu.client.TestClientFailoverSupport-KILL"
18:29:15.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
18:29:15.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:29:15.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key"
18:29:15.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
18:29:15.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
18:29:15.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:29:15.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:29:15.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:29:15.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:29:15.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:29:15.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:29:15.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column1_i"
18:29:15.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
18:29:15.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
18:29:15.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:29:15.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:29:15.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:29:15.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:29:15.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:29:15.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:29:15.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column2_i"
18:29:15.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
18:29:15.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
18:29:15.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:29:15.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:29:15.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:29:15.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:29:15.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:29:15.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:29:15.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column3_s"
18:29:15.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
18:29:15.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
18:29:15.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: true
18:29:15.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: DICT_ENCODING
18:29:15.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: LZ4
18:29:15.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 4096
18:29:15.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:29:15.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:29:15.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:29:15.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:29:15.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column4_b"
18:29:15.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BOOL
18:29:15.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
18:29:15.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:29:15.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:29:15.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:29:15.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:29:15.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:29:15.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
18:29:15.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
18:29:15.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
18:29:15.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
18:29:15.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key"
18:29:15.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
18:29:15.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:29:15.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
18:29:15.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:15.271237  3634 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table org.apache.kudu.client.TestClientFailoverSupport-KILL in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
18:29:15.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:15.316001  4136 heartbeater.cc:499] Master 127.3.94.60:42091 was elected leader, sending a full tablet report...
18:29:15.324 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 0e7291bdba99489bb33138fa4c6d6526
18:29:15.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:15.351248  3935 tablet_service.cc:1511] Processing CreateTablet for tablet f09ff85014164dfd8026700c75f79e22 (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-KILL [id=0e7291bdba99489bb33138fa4c6d6526]), partition=RANGE (key) PARTITION UNBOUNDED
18:29:15.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:15.353467  3935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f09ff85014164dfd8026700c75f79e22. 1 dirs total, 0 dirs full, 0 dirs failed
18:29:15.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:15.365625  4070 tablet_service.cc:1511] Processing CreateTablet for tablet f09ff85014164dfd8026700c75f79e22 (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-KILL [id=0e7291bdba99489bb33138fa4c6d6526]), partition=RANGE (key) PARTITION UNBOUNDED
18:29:15.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:15.367624  4070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f09ff85014164dfd8026700c75f79e22. 1 dirs total, 0 dirs full, 0 dirs failed
18:29:15.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:15.373428  4168 tablet_bootstrap.cc:492] T f09ff85014164dfd8026700c75f79e22 P 8c108f9b1b154b3e821195366aea34c8: Bootstrap starting.
18:29:15.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:15.377622  4168 tablet_bootstrap.cc:654] T f09ff85014164dfd8026700c75f79e22 P 8c108f9b1b154b3e821195366aea34c8: Neither blocks nor log segments found. Creating new log.
18:29:15.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:15.380821  4168 log.cc:826] T f09ff85014164dfd8026700c75f79e22 P 8c108f9b1b154b3e821195366aea34c8: Log is configured to *not* fsync() on all Append() calls
18:29:15.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:15.387923  4169 tablet_bootstrap.cc:492] T f09ff85014164dfd8026700c75f79e22 P 10503043a581460a8f329f09ce44e662: Bootstrap starting.
18:29:15.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:15.388947  3798 tablet_service.cc:1511] Processing CreateTablet for tablet f09ff85014164dfd8026700c75f79e22 (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-KILL [id=0e7291bdba99489bb33138fa4c6d6526]), partition=RANGE (key) PARTITION UNBOUNDED
18:29:15.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:15.391314  3798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f09ff85014164dfd8026700c75f79e22. 1 dirs total, 0 dirs full, 0 dirs failed
18:29:15.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:15.392565  4168 tablet_bootstrap.cc:492] T f09ff85014164dfd8026700c75f79e22 P 8c108f9b1b154b3e821195366aea34c8: No bootstrap required, opened a new log
18:29:15.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:15.393050  4168 ts_tablet_manager.cc:1403] T f09ff85014164dfd8026700c75f79e22 P 8c108f9b1b154b3e821195366aea34c8: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.004s
18:29:15.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:15.394846  4169 tablet_bootstrap.cc:654] T f09ff85014164dfd8026700c75f79e22 P 10503043a581460a8f329f09ce44e662: Neither blocks nor log segments found. Creating new log.
18:29:15.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:15.396382  4169 log.cc:826] T f09ff85014164dfd8026700c75f79e22 P 10503043a581460a8f329f09ce44e662: Log is configured to *not* fsync() on all Append() calls
18:29:15.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:15.400898  4168 raft_consensus.cc:359] T f09ff85014164dfd8026700c75f79e22 P 8c108f9b1b154b3e821195366aea34c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10503043a581460a8f329f09ce44e662" member_type: VOTER last_known_addr { host: "127.3.94.3" port: 35493 } } peers { permanent_uuid: "77d54c54ba774a17a714cf2fbbb24ee2" member_type: VOTER last_known_addr { host: "127.3.94.1" port: 42025 } } peers { permanent_uuid: "8c108f9b1b154b3e821195366aea34c8" member_type: VOTER last_known_addr { host: "127.3.94.2" port: 46741 } }
18:29:15.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:15.401541  4168 raft_consensus.cc:385] T f09ff85014164dfd8026700c75f79e22 P 8c108f9b1b154b3e821195366aea34c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:29:15.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:15.401786  4168 raft_consensus.cc:740] T f09ff85014164dfd8026700c75f79e22 P 8c108f9b1b154b3e821195366aea34c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8c108f9b1b154b3e821195366aea34c8, State: Initialized, Role: FOLLOWER
18:29:15.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:15.402689  4168 consensus_queue.cc:260] T f09ff85014164dfd8026700c75f79e22 P 8c108f9b1b154b3e821195366aea34c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10503043a581460a8f329f09ce44e662" member_type: VOTER last_known_addr { host: "127.3.94.3" port: 35493 } } peers { permanent_uuid: "77d54c54ba774a17a714cf2fbbb24ee2" member_type: VOTER last_known_addr { host: "127.3.94.1" port: 42025 } } peers { permanent_uuid: "8c108f9b1b154b3e821195366aea34c8" member_type: VOTER last_known_addr { host: "127.3.94.2" port: 46741 } }
18:29:15.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:15.423802  4169 tablet_bootstrap.cc:492] T f09ff85014164dfd8026700c75f79e22 P 10503043a581460a8f329f09ce44e662: No bootstrap required, opened a new log
18:29:15.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:15.424108  4168 ts_tablet_manager.cc:1434] T f09ff85014164dfd8026700c75f79e22 P 8c108f9b1b154b3e821195366aea34c8: Time spent starting tablet: real 0.031s	user 0.013s	sys 0.015s
18:29:15.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:15.424738  4169 ts_tablet_manager.cc:1403] T f09ff85014164dfd8026700c75f79e22 P 10503043a581460a8f329f09ce44e662: Time spent bootstrapping tablet: real 0.037s	user 0.016s	sys 0.014s
18:29:15.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:15.431957  4169 raft_consensus.cc:359] T f09ff85014164dfd8026700c75f79e22 P 10503043a581460a8f329f09ce44e662 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10503043a581460a8f329f09ce44e662" member_type: VOTER last_known_addr { host: "127.3.94.3" port: 35493 } } peers { permanent_uuid: "77d54c54ba774a17a714cf2fbbb24ee2" member_type: VOTER last_known_addr { host: "127.3.94.1" port: 42025 } } peers { permanent_uuid: "8c108f9b1b154b3e821195366aea34c8" member_type: VOTER last_known_addr { host: "127.3.94.2" port: 46741 } }
18:29:15.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:15.432715  4169 raft_consensus.cc:385] T f09ff85014164dfd8026700c75f79e22 P 10503043a581460a8f329f09ce44e662 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:29:15.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:15.432929  4173 tablet_bootstrap.cc:492] T f09ff85014164dfd8026700c75f79e22 P 77d54c54ba774a17a714cf2fbbb24ee2: Bootstrap starting.
18:29:15.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:15.432998  4169 raft_consensus.cc:740] T f09ff85014164dfd8026700c75f79e22 P 10503043a581460a8f329f09ce44e662 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 10503043a581460a8f329f09ce44e662, State: Initialized, Role: FOLLOWER
18:29:15.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:15.433703  4169 consensus_queue.cc:260] T f09ff85014164dfd8026700c75f79e22 P 10503043a581460a8f329f09ce44e662 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10503043a581460a8f329f09ce44e662" member_type: VOTER last_known_addr { host: "127.3.94.3" port: 35493 } } peers { permanent_uuid: "77d54c54ba774a17a714cf2fbbb24ee2" member_type: VOTER last_known_addr { host: "127.3.94.1" port: 42025 } } peers { permanent_uuid: "8c108f9b1b154b3e821195366aea34c8" member_type: VOTER last_known_addr { host: "127.3.94.2" port: 46741 } }
18:29:15.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:15.437898  4173 tablet_bootstrap.cc:654] T f09ff85014164dfd8026700c75f79e22 P 77d54c54ba774a17a714cf2fbbb24ee2: Neither blocks nor log segments found. Creating new log.
18:29:15.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:15.439653  4169 ts_tablet_manager.cc:1434] T f09ff85014164dfd8026700c75f79e22 P 10503043a581460a8f329f09ce44e662: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.006s
18:29:15.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:15.439692  4173 log.cc:826] T f09ff85014164dfd8026700c75f79e22 P 77d54c54ba774a17a714cf2fbbb24ee2: Log is configured to *not* fsync() on all Append() calls
18:29:15.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:15.445739  4173 tablet_bootstrap.cc:492] T f09ff85014164dfd8026700c75f79e22 P 77d54c54ba774a17a714cf2fbbb24ee2: No bootstrap required, opened a new log
18:29:15.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:15.446354  4173 ts_tablet_manager.cc:1403] T f09ff85014164dfd8026700c75f79e22 P 77d54c54ba774a17a714cf2fbbb24ee2: Time spent bootstrapping tablet: real 0.014s	user 0.007s	sys 0.003s
18:29:15.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:15.452127  4173 raft_consensus.cc:359] T f09ff85014164dfd8026700c75f79e22 P 77d54c54ba774a17a714cf2fbbb24ee2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10503043a581460a8f329f09ce44e662" member_type: VOTER last_known_addr { host: "127.3.94.3" port: 35493 } } peers { permanent_uuid: "77d54c54ba774a17a714cf2fbbb24ee2" member_type: VOTER last_known_addr { host: "127.3.94.1" port: 42025 } } peers { permanent_uuid: "8c108f9b1b154b3e821195366aea34c8" member_type: VOTER last_known_addr { host: "127.3.94.2" port: 46741 } }
18:29:15.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:15.452468  4173 raft_consensus.cc:385] T f09ff85014164dfd8026700c75f79e22 P 77d54c54ba774a17a714cf2fbbb24ee2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:29:15.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:15.452618  4173 raft_consensus.cc:740] T f09ff85014164dfd8026700c75f79e22 P 77d54c54ba774a17a714cf2fbbb24ee2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 77d54c54ba774a17a714cf2fbbb24ee2, State: Initialized, Role: FOLLOWER
18:29:15.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:15.453238  4173 consensus_queue.cc:260] T f09ff85014164dfd8026700c75f79e22 P 77d54c54ba774a17a714cf2fbbb24ee2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10503043a581460a8f329f09ce44e662" member_type: VOTER last_known_addr { host: "127.3.94.3" port: 35493 } } peers { permanent_uuid: "77d54c54ba774a17a714cf2fbbb24ee2" member_type: VOTER last_known_addr { host: "127.3.94.1" port: 42025 } } peers { permanent_uuid: "8c108f9b1b154b3e821195366aea34c8" member_type: VOTER last_known_addr { host: "127.3.94.2" port: 46741 } }
18:29:15.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:15.455010  4173 ts_tablet_manager.cc:1434] T f09ff85014164dfd8026700c75f79e22 P 77d54c54ba774a17a714cf2fbbb24ee2: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.006s
18:29:15.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:15.539832  4003 tablet.cc:2406] T f09ff85014164dfd8026700c75f79e22 P 8c108f9b1b154b3e821195366aea34c8: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:29:15.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:15.541927  4139 tablet.cc:2406] T f09ff85014164dfd8026700c75f79e22 P 10503043a581460a8f329f09ce44e662: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:29:15.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:15.583493  3869 tablet.cc:2406] T f09ff85014164dfd8026700c75f79e22 P 77d54c54ba774a17a714cf2fbbb24ee2: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:29:15.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:15.761474  4172 raft_consensus.cc:493] T f09ff85014164dfd8026700c75f79e22 P 8c108f9b1b154b3e821195366aea34c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:29:15.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:15.761826  4172 raft_consensus.cc:515] T f09ff85014164dfd8026700c75f79e22 P 8c108f9b1b154b3e821195366aea34c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10503043a581460a8f329f09ce44e662" member_type: VOTER last_known_addr { host: "127.3.94.3" port: 35493 } } peers { permanent_uuid: "77d54c54ba774a17a714cf2fbbb24ee2" member_type: VOTER last_known_addr { host: "127.3.94.1" port: 42025 } } peers { permanent_uuid: "8c108f9b1b154b3e821195366aea34c8" member_type: VOTER last_known_addr { host: "127.3.94.2" port: 46741 } }
18:29:15.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:15.763906  4172 leader_election.cc:290] T f09ff85014164dfd8026700c75f79e22 P 8c108f9b1b154b3e821195366aea34c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 10503043a581460a8f329f09ce44e662 (127.3.94.3:35493), 77d54c54ba774a17a714cf2fbbb24ee2 (127.3.94.1:42025)
18:29:15.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:15.772174  3819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ff85014164dfd8026700c75f79e22" candidate_uuid: "8c108f9b1b154b3e821195366aea34c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77d54c54ba774a17a714cf2fbbb24ee2" is_pre_election: true
18:29:15.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:15.772305  4090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ff85014164dfd8026700c75f79e22" candidate_uuid: "8c108f9b1b154b3e821195366aea34c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10503043a581460a8f329f09ce44e662" is_pre_election: true
18:29:15.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:15.772684  3819 raft_consensus.cc:2468] T f09ff85014164dfd8026700c75f79e22 P 77d54c54ba774a17a714cf2fbbb24ee2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c108f9b1b154b3e821195366aea34c8 in term 0.
18:29:15.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:15.772856  4090 raft_consensus.cc:2468] T f09ff85014164dfd8026700c75f79e22 P 10503043a581460a8f329f09ce44e662 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8c108f9b1b154b3e821195366aea34c8 in term 0.
18:29:15.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:15.773432  3889 leader_election.cc:304] T f09ff85014164dfd8026700c75f79e22 P 8c108f9b1b154b3e821195366aea34c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 77d54c54ba774a17a714cf2fbbb24ee2, 8c108f9b1b154b3e821195366aea34c8; no voters: 
18:29:15.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:15.773890  4172 raft_consensus.cc:2804] T f09ff85014164dfd8026700c75f79e22 P 8c108f9b1b154b3e821195366aea34c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
18:29:15.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:15.774010  4172 raft_consensus.cc:493] T f09ff85014164dfd8026700c75f79e22 P 8c108f9b1b154b3e821195366aea34c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
18:29:15.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:15.774085  4172 raft_consensus.cc:3060] T f09ff85014164dfd8026700c75f79e22 P 8c108f9b1b154b3e821195366aea34c8 [term 0 FOLLOWER]: Advancing to term 1
18:29:15.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:15.776117  4172 raft_consensus.cc:515] T f09ff85014164dfd8026700c75f79e22 P 8c108f9b1b154b3e821195366aea34c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10503043a581460a8f329f09ce44e662" member_type: VOTER last_known_addr { host: "127.3.94.3" port: 35493 } } peers { permanent_uuid: "77d54c54ba774a17a714cf2fbbb24ee2" member_type: VOTER last_known_addr { host: "127.3.94.1" port: 42025 } } peers { permanent_uuid: "8c108f9b1b154b3e821195366aea34c8" member_type: VOTER last_known_addr { host: "127.3.94.2" port: 46741 } }
18:29:15.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:15.776793  4172 leader_election.cc:290] T f09ff85014164dfd8026700c75f79e22 P 8c108f9b1b154b3e821195366aea34c8 [CANDIDATE]: Term 1 election: Requested vote from peers 10503043a581460a8f329f09ce44e662 (127.3.94.3:35493), 77d54c54ba774a17a714cf2fbbb24ee2 (127.3.94.1:42025)
18:29:15.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:15.777194  4090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ff85014164dfd8026700c75f79e22" candidate_uuid: "8c108f9b1b154b3e821195366aea34c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "10503043a581460a8f329f09ce44e662"
18:29:15.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:15.777287  3819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ff85014164dfd8026700c75f79e22" candidate_uuid: "8c108f9b1b154b3e821195366aea34c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "77d54c54ba774a17a714cf2fbbb24ee2"
18:29:15.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:15.777386  4090 raft_consensus.cc:3060] T f09ff85014164dfd8026700c75f79e22 P 10503043a581460a8f329f09ce44e662 [term 0 FOLLOWER]: Advancing to term 1
18:29:15.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:15.777429  3819 raft_consensus.cc:3060] T f09ff85014164dfd8026700c75f79e22 P 77d54c54ba774a17a714cf2fbbb24ee2 [term 0 FOLLOWER]: Advancing to term 1
18:29:15.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:15.779474  3819 raft_consensus.cc:2468] T f09ff85014164dfd8026700c75f79e22 P 77d54c54ba774a17a714cf2fbbb24ee2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c108f9b1b154b3e821195366aea34c8 in term 1.
18:29:15.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:15.779488  4090 raft_consensus.cc:2468] T f09ff85014164dfd8026700c75f79e22 P 10503043a581460a8f329f09ce44e662 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8c108f9b1b154b3e821195366aea34c8 in term 1.
18:29:15.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:15.779940  3891 leader_election.cc:304] T f09ff85014164dfd8026700c75f79e22 P 8c108f9b1b154b3e821195366aea34c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 10503043a581460a8f329f09ce44e662, 77d54c54ba774a17a714cf2fbbb24ee2, 8c108f9b1b154b3e821195366aea34c8; no voters: 
18:29:15.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:15.780288  4172 raft_consensus.cc:2804] T f09ff85014164dfd8026700c75f79e22 P 8c108f9b1b154b3e821195366aea34c8 [term 1 FOLLOWER]: Leader election won for term 1
18:29:15.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:15.780774  4172 raft_consensus.cc:697] T f09ff85014164dfd8026700c75f79e22 P 8c108f9b1b154b3e821195366aea34c8 [term 1 LEADER]: Becoming Leader. State: Replica: 8c108f9b1b154b3e821195366aea34c8, State: Running, Role: LEADER
18:29:15.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:15.781286  4172 consensus_queue.cc:237] T f09ff85014164dfd8026700c75f79e22 P 8c108f9b1b154b3e821195366aea34c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10503043a581460a8f329f09ce44e662" member_type: VOTER last_known_addr { host: "127.3.94.3" port: 35493 } } peers { permanent_uuid: "77d54c54ba774a17a714cf2fbbb24ee2" member_type: VOTER last_known_addr { host: "127.3.94.1" port: 42025 } } peers { permanent_uuid: "8c108f9b1b154b3e821195366aea34c8" member_type: VOTER last_known_addr { host: "127.3.94.2" port: 46741 } }
18:29:15.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:15.789965  3634 catalog_manager.cc:5696] T f09ff85014164dfd8026700c75f79e22 P 8c108f9b1b154b3e821195366aea34c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8c108f9b1b154b3e821195366aea34c8 (127.3.94.2). New cstate: current_term: 1 leader_uuid: "8c108f9b1b154b3e821195366aea34c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10503043a581460a8f329f09ce44e662" member_type: VOTER last_known_addr { host: "127.3.94.3" port: 35493 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "77d54c54ba774a17a714cf2fbbb24ee2" member_type: VOTER last_known_addr { host: "127.3.94.1" port: 42025 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8c108f9b1b154b3e821195366aea34c8" member_type: VOTER last_known_addr { host: "127.3.94.2" port: 46741 } health_report { overall_health: HEALTHY } } }
18:29:15.958 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 0e7291bdba99489bb33138fa4c6d6526
18:29:15.976 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet f09ff85014164dfd8026700c75f79e22 for table 'org.apache.kudu.client.TestClientFailoverSupport-KILL' with partition [<start>, <end>)
18:29:15.981 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299994, tablet=f09ff85014164dfd8026700c75f79e22@[10503043a581460a8f329f09ce44e662(127.3.94.3:35493),77d54c54ba774a17a714cf2fbbb24ee2(127.3.94.1:42025),8c108f9b1b154b3e821195366aea34c8(127.3.94.2:46741)[L]]}]
18:29:15.982 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=16), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.94.60:42091, [8ms] Sub RPC GetTableLocations: received response from server master-127.3.94.60:42091: OK, deferred=null) after lookup
18:29:15.992 [DEBUG - kudu-nio-0] (Connection.java:748) [peer 8c108f9b1b154b3e821195366aea34c8(127.3.94.2:46741)] connecting to peer
18:29:15.994 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 8c108f9b1b154b3e821195366aea34c8(127.3.94.2:46741)] Successfully connected to peer
18:29:16.055 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x92815da3, L:/127.0.0.1:35630 - R:/127.3.94.2:46741] using TOKEN/null
18:29:16.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:16.065394  4090 raft_consensus.cc:1275] T f09ff85014164dfd8026700c75f79e22 P 10503043a581460a8f329f09ce44e662 [term 1 FOLLOWER]: Refusing update from remote peer 8c108f9b1b154b3e821195366aea34c8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
18:29:16.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:16.065404  3819 raft_consensus.cc:1275] T f09ff85014164dfd8026700c75f79e22 P 77d54c54ba774a17a714cf2fbbb24ee2 [term 1 FOLLOWER]: Refusing update from remote peer 8c108f9b1b154b3e821195366aea34c8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
18:29:16.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:16.066506  4179 consensus_queue.cc:1048] T f09ff85014164dfd8026700c75f79e22 P 8c108f9b1b154b3e821195366aea34c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "10503043a581460a8f329f09ce44e662" member_type: VOTER last_known_addr { host: "127.3.94.3" port: 35493 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:29:16.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:16.066820  4172 consensus_queue.cc:1048] T f09ff85014164dfd8026700c75f79e22 P 8c108f9b1b154b3e821195366aea34c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77d54c54ba774a17a714cf2fbbb24ee2" member_type: VOTER last_known_addr { host: "127.3.94.1" port: 42025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:29:16.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:16.078018  4185 mvcc.cc:204] Tried to move back new op lower bound from 7305360818432552960 to 7305360817283846144. Current Snapshot: MvccSnapshot[applied={T|T < 7305360818432552960}]
18:29:16.227 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 10 rows, more = false) for scanner KuduScanner(table=org.apache.kudu.client.TestClientFailoverSupport-KILL, tablet=f09ff85014164dfd8026700c75f79e22, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:29:16.228 [INFO - Time-limited test] (MiniKuduCluster.java:399) Killing master server 127.3.94.60:42091
18:29:16.229 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: stop_daemon {
  id {
    type: MASTER
    index: 2
  }
}

18:29:16.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:16.230504  3448 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskRlQDJI/build/asan/bin/kudu pid 3600
18:29:16.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:16.232043  3664 generic_service.cc:196] Checking for leaks (request via RPC)
18:29:16.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:16.367874  3448 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskRlQDJI/build/asan/bin/kudu with pid 3600
18:29:16.398 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
18:29:16.399 [INFO - Time-limited test] (MiniKuduCluster.java:475) Killing tablet server 127.3.94.2:46741
18:29:16.399 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: stop_daemon {
  id {
    type: TSERVER
    index: 1
  }
}

18:29:16.399 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.3.94.60:42091(127.3.94.60:42091)] handling channelInactive
18:29:16.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:16.400022  3448 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskRlQDJI/build/asan/bin/kudu pid 3872
18:29:16.400 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.94.60:42091(127.3.94.60:42091)] cleaning up while in state READY due to: connection closed
18:29:16.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:16.411360  3995 generic_service.cc:196] Checking for leaks (request via RPC)
18:29:16.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:16.540287  3448 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskRlQDJI/build/asan/bin/kudu with pid 3872
18:29:16.557 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
18:29:16.557 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 8c108f9b1b154b3e821195366aea34c8(127.3.94.2:46741)] handling channelInactive
18:29:16.557 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 8c108f9b1b154b3e821195366aea34c8(127.3.94.2:46741)] cleaning up while in state READY due to: connection closed
18:29:16.558 [DEBUG - Time-limited test] (Connection.java:748) [peer 8c108f9b1b154b3e821195366aea34c8(127.3.94.2:46741)] connecting to peer
18:29:16.560 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer 8c108f9b1b154b3e821195366aea34c8(127.3.94.2:46741): Connection refused: /127.3.94.2:46741
18:29:16.560 [DEBUG - kudu-nio-4] (Connection.java:709) [peer 8c108f9b1b154b3e821195366aea34c8(127.3.94.2:46741)] cleaning up while in state CONNECTING due to: Failed to connect to peer 8c108f9b1b154b3e821195366aea34c8(127.3.94.2:46741): Connection refused: /127.3.94.2:46741
18:29:16.560 [INFO - kudu-nio-4] (AsyncKuduClient.java:2355) Invalidating location 8c108f9b1b154b3e821195366aea34c8(127.3.94.2:46741) for tablet f09ff85014164dfd8026700c75f79e22: Failed to connect to peer 8c108f9b1b154b3e821195366aea34c8(127.3.94.2:46741): Connection refused: /127.3.94.2:46741
18:29:16.570 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.3.94.60:42091(127.3.94.60:42091)] connecting to peer
18:29:16.572 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091
18:29:16.573 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.94.60:42091(127.3.94.60:42091)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091
18:29:16.573 [INFO - kudu-nio-5] (AsyncKuduClient.java:2355) Invalidating location master-127.3.94.60:42091(127.3.94.60:42091) for tablet Kudu Master: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091
18:29:16.590 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.3.94.60:42091(127.3.94.60:42091)] connecting to peer
18:29:16.592 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091
18:29:16.592 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.94.60:42091(127.3.94.60:42091)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091
18:29:16.593 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.94.60:42091: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091
18:29:16.597 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.94.60:42091,127.3.94.61:41619,127.3.94.62:42369; will retry
18:29:16.610 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.3.94.60:42091(127.3.94.60:42091)] connecting to peer
18:29:16.612 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091
18:29:16.612 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.94.60:42091(127.3.94.60:42091)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091
18:29:16.613 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.94.60:42091: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091
18:29:16.614 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.94.60:42091,127.3.94.61:41619,127.3.94.62:42369; will retry
18:29:16.631 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.3.94.60:42091(127.3.94.60:42091)] connecting to peer
18:29:16.632 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091
18:29:16.632 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.94.60:42091(127.3.94.60:42091)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091
18:29:16.633 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.94.60:42091: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091
18:29:16.634 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.94.60:42091,127.3.94.61:41619,127.3.94.62:42369; will retry
18:29:16.651 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.3.94.60:42091(127.3.94.60:42091)] connecting to peer
18:29:16.653 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091
18:29:16.653 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.94.60:42091(127.3.94.60:42091)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091
18:29:16.653 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.94.60:42091: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091
18:29:16.654 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.94.60:42091,127.3.94.61:41619,127.3.94.62:42369; will retry
18:29:16.671 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.3.94.60:42091(127.3.94.60:42091)] connecting to peer
18:29:16.672 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091
18:29:16.672 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.94.60:42091(127.3.94.60:42091)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091
18:29:16.672 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.94.60:42091: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091
18:29:16.675 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.94.60:42091,127.3.94.61:41619,127.3.94.62:42369; will retry
18:29:16.711 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.3.94.60:42091(127.3.94.60:42091)] connecting to peer
18:29:16.712 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091
18:29:16.712 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.94.60:42091(127.3.94.60:42091)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091
18:29:16.712 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.94.60:42091: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091
18:29:16.714 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.94.60:42091,127.3.94.61:41619,127.3.94.62:42369; will retry
18:29:16.810 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.3.94.60:42091(127.3.94.60:42091)] connecting to peer
18:29:16.812 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091
18:29:16.812 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.94.60:42091(127.3.94.60:42091)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091
18:29:16.812 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.94.60:42091: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091
18:29:16.815 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.94.60:42091,127.3.94.61:41619,127.3.94.62:42369; will retry
18:29:16.830 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.3.94.60:42091(127.3.94.60:42091)] connecting to peer
18:29:16.832 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091
18:29:16.832 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.94.60:42091(127.3.94.60:42091)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091
18:29:16.832 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.94.60:42091: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091
18:29:16.835 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.94.60:42091,127.3.94.61:41619,127.3.94.62:42369; will retry
18:29:17.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:17.091149  3864 heartbeater.cc:646] Failed to heartbeat to 127.3.94.60:42091 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.3.94.60:42091: connect: Connection refused (error 111)
18:29:17.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:17.097692  4136 heartbeater.cc:646] Failed to heartbeat to 127.3.94.60:42091 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.3.94.60:42091: connect: Connection refused (error 111)
18:29:17.151 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.3.94.60:42091(127.3.94.60:42091)] connecting to peer
18:29:17.153 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091
18:29:17.153 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.94.60:42091(127.3.94.60:42091)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091
18:29:17.153 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.94.60:42091: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091
18:29:17.155 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.3.94.60:42091,127.3.94.61:41619,127.3.94.62:42369; will retry
18:29:17.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:17.413648  3459 master_runner.cc:187] Error getting master registration for 127.3.94.60:42091: Network error: Client connection negotiation failed: client connection to 127.3.94.60:42091: connect: Connection refused (error 111), 
18:29:17.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:17.413893  3459 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
18:29:17.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:17.674964  4208 raft_consensus.cc:493] T f09ff85014164dfd8026700c75f79e22 P 10503043a581460a8f329f09ce44e662 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c108f9b1b154b3e821195366aea34c8)
18:29:17.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:17.675170  4208 raft_consensus.cc:515] T f09ff85014164dfd8026700c75f79e22 P 10503043a581460a8f329f09ce44e662 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10503043a581460a8f329f09ce44e662" member_type: VOTER last_known_addr { host: "127.3.94.3" port: 35493 } } peers { permanent_uuid: "77d54c54ba774a17a714cf2fbbb24ee2" member_type: VOTER last_known_addr { host: "127.3.94.1" port: 42025 } } peers { permanent_uuid: "8c108f9b1b154b3e821195366aea34c8" member_type: VOTER last_known_addr { host: "127.3.94.2" port: 46741 } }
18:29:17.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:17.676421  4209 raft_consensus.cc:493] T f09ff85014164dfd8026700c75f79e22 P 77d54c54ba774a17a714cf2fbbb24ee2 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8c108f9b1b154b3e821195366aea34c8)
18:29:17.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:17.676702  4209 raft_consensus.cc:515] T f09ff85014164dfd8026700c75f79e22 P 77d54c54ba774a17a714cf2fbbb24ee2 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10503043a581460a8f329f09ce44e662" member_type: VOTER last_known_addr { host: "127.3.94.3" port: 35493 } } peers { permanent_uuid: "77d54c54ba774a17a714cf2fbbb24ee2" member_type: VOTER last_known_addr { host: "127.3.94.1" port: 42025 } } peers { permanent_uuid: "8c108f9b1b154b3e821195366aea34c8" member_type: VOTER last_known_addr { host: "127.3.94.2" port: 46741 } }
18:29:17.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:17.677122  4208 leader_election.cc:290] T f09ff85014164dfd8026700c75f79e22 P 10503043a581460a8f329f09ce44e662 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 77d54c54ba774a17a714cf2fbbb24ee2 (127.3.94.1:42025), 8c108f9b1b154b3e821195366aea34c8 (127.3.94.2:46741)
18:29:17.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:17.685288  4025 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.94.2:46741: connect: Connection refused (error 111)
18:29:17.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:17.685778  4209 leader_election.cc:290] T f09ff85014164dfd8026700c75f79e22 P 77d54c54ba774a17a714cf2fbbb24ee2 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 10503043a581460a8f329f09ce44e662 (127.3.94.3:35493), 8c108f9b1b154b3e821195366aea34c8 (127.3.94.2:46741)
18:29:17.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:17.687650  3819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ff85014164dfd8026700c75f79e22" candidate_uuid: "10503043a581460a8f329f09ce44e662" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "77d54c54ba774a17a714cf2fbbb24ee2" is_pre_election: true
18:29:17.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:17.687899  3819 raft_consensus.cc:2468] T f09ff85014164dfd8026700c75f79e22 P 77d54c54ba774a17a714cf2fbbb24ee2 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 10503043a581460a8f329f09ce44e662 in term 1.
18:29:17.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:17.687839  3753 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.94.2:46741: connect: Connection refused (error 111)
18:29:17.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:17.688606  4024 leader_election.cc:304] T f09ff85014164dfd8026700c75f79e22 P 10503043a581460a8f329f09ce44e662 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 10503043a581460a8f329f09ce44e662, 77d54c54ba774a17a714cf2fbbb24ee2; no voters: 
18:29:17.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:17.689129  4208 raft_consensus.cc:2804] T f09ff85014164dfd8026700c75f79e22 P 10503043a581460a8f329f09ce44e662 [term 1 FOLLOWER]: Leader pre-election won for term 2
18:29:17.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:17.689265  4208 raft_consensus.cc:493] T f09ff85014164dfd8026700c75f79e22 P 10503043a581460a8f329f09ce44e662 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8c108f9b1b154b3e821195366aea34c8)
18:29:17.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:17.689374  4208 raft_consensus.cc:3060] T f09ff85014164dfd8026700c75f79e22 P 10503043a581460a8f329f09ce44e662 [term 1 FOLLOWER]: Advancing to term 2
18:29:17.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:17.692772  4208 raft_consensus.cc:515] T f09ff85014164dfd8026700c75f79e22 P 10503043a581460a8f329f09ce44e662 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10503043a581460a8f329f09ce44e662" member_type: VOTER last_known_addr { host: "127.3.94.3" port: 35493 } } peers { permanent_uuid: "77d54c54ba774a17a714cf2fbbb24ee2" member_type: VOTER last_known_addr { host: "127.3.94.1" port: 42025 } } peers { permanent_uuid: "8c108f9b1b154b3e821195366aea34c8" member_type: VOTER last_known_addr { host: "127.3.94.2" port: 46741 } }
18:29:17.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:17.694082  3819 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ff85014164dfd8026700c75f79e22" candidate_uuid: "10503043a581460a8f329f09ce44e662" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "77d54c54ba774a17a714cf2fbbb24ee2"
18:29:17.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:17.694545  4208 leader_election.cc:290] T f09ff85014164dfd8026700c75f79e22 P 10503043a581460a8f329f09ce44e662 [CANDIDATE]: Term 2 election: Requested vote from peers 77d54c54ba774a17a714cf2fbbb24ee2 (127.3.94.1:42025), 8c108f9b1b154b3e821195366aea34c8 (127.3.94.2:46741)
18:29:17.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:17.695072  3819 raft_consensus.cc:3060] T f09ff85014164dfd8026700c75f79e22 P 77d54c54ba774a17a714cf2fbbb24ee2 [term 1 FOLLOWER]: Advancing to term 2
18:29:17.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:17.695395  4025 leader_election.cc:336] T f09ff85014164dfd8026700c75f79e22 P 10503043a581460a8f329f09ce44e662 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8c108f9b1b154b3e821195366aea34c8 (127.3.94.2:46741): Network error: Client connection negotiation failed: client connection to 127.3.94.2:46741: connect: Connection refused (error 111)
18:29:17.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:17.696250  3753 leader_election.cc:336] T f09ff85014164dfd8026700c75f79e22 P 77d54c54ba774a17a714cf2fbbb24ee2 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8c108f9b1b154b3e821195366aea34c8 (127.3.94.2:46741): Network error: Client connection negotiation failed: client connection to 127.3.94.2:46741: connect: Connection refused (error 111)
18:29:17.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:17.696308  4090 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f09ff85014164dfd8026700c75f79e22" candidate_uuid: "77d54c54ba774a17a714cf2fbbb24ee2" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "10503043a581460a8f329f09ce44e662" is_pre_election: true
18:29:17.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:17.696595  4090 raft_consensus.cc:2393] T f09ff85014164dfd8026700c75f79e22 P 10503043a581460a8f329f09ce44e662 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 77d54c54ba774a17a714cf2fbbb24ee2 in current term 2: Already voted for candidate 10503043a581460a8f329f09ce44e662 in this term.
18:29:17.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:17.696874  4025 leader_election.cc:336] T f09ff85014164dfd8026700c75f79e22 P 10503043a581460a8f329f09ce44e662 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 8c108f9b1b154b3e821195366aea34c8 (127.3.94.2:46741): Network error: Client connection negotiation failed: client connection to 127.3.94.2:46741: connect: Connection refused (error 111)
18:29:17.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:17.697332  3754 leader_election.cc:304] T f09ff85014164dfd8026700c75f79e22 P 77d54c54ba774a17a714cf2fbbb24ee2 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 77d54c54ba774a17a714cf2fbbb24ee2; no voters: 10503043a581460a8f329f09ce44e662, 8c108f9b1b154b3e821195366aea34c8
18:29:17.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:17.697985  3819 raft_consensus.cc:2468] T f09ff85014164dfd8026700c75f79e22 P 77d54c54ba774a17a714cf2fbbb24ee2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 10503043a581460a8f329f09ce44e662 in term 2.
18:29:17.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:17.698166  4209 raft_consensus.cc:2749] T f09ff85014164dfd8026700c75f79e22 P 77d54c54ba774a17a714cf2fbbb24ee2 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
18:29:17.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:17.698532  4024 leader_election.cc:304] T f09ff85014164dfd8026700c75f79e22 P 10503043a581460a8f329f09ce44e662 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 10503043a581460a8f329f09ce44e662, 77d54c54ba774a17a714cf2fbbb24ee2; no voters: 8c108f9b1b154b3e821195366aea34c8
18:29:17.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:17.698799  4208 raft_consensus.cc:2804] T f09ff85014164dfd8026700c75f79e22 P 10503043a581460a8f329f09ce44e662 [term 2 FOLLOWER]: Leader election won for term 2
18:29:17.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:17.699226  4208 raft_consensus.cc:697] T f09ff85014164dfd8026700c75f79e22 P 10503043a581460a8f329f09ce44e662 [term 2 LEADER]: Becoming Leader. State: Replica: 10503043a581460a8f329f09ce44e662, State: Running, Role: LEADER
18:29:17.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:17.700023  4208 consensus_queue.cc:237] T f09ff85014164dfd8026700c75f79e22 P 10503043a581460a8f329f09ce44e662 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 1.11, Last appended by leader: 11, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10503043a581460a8f329f09ce44e662" member_type: VOTER last_known_addr { host: "127.3.94.3" port: 35493 } } peers { permanent_uuid: "77d54c54ba774a17a714cf2fbbb24ee2" member_type: VOTER last_known_addr { host: "127.3.94.1" port: 42025 } } peers { permanent_uuid: "8c108f9b1b154b3e821195366aea34c8" member_type: VOTER last_known_addr { host: "127.3.94.2" port: 46741 } }
18:29:17.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:17.704246  4220 raft_consensus.cc:493] T 00000000000000000000000000000000 P 82e1fad2f97643f6a383e90692f1d83f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cf7b21b4baf9454a9a4667a9c6b9c7bc)
18:29:17.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:17.704453  4220 raft_consensus.cc:515] T 00000000000000000000000000000000 P 82e1fad2f97643f6a383e90692f1d83f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "162486c9e36d45919a959f286cd59d1d" member_type: VOTER last_known_addr { host: "127.3.94.62" port: 42369 } } peers { permanent_uuid: "82e1fad2f97643f6a383e90692f1d83f" member_type: VOTER last_known_addr { host: "127.3.94.61" port: 41619 } } peers { permanent_uuid: "cf7b21b4baf9454a9a4667a9c6b9c7bc" member_type: VOTER last_known_addr { host: "127.3.94.60" port: 42091 } }
18:29:17.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:17.705647  4220 leader_election.cc:290] T 00000000000000000000000000000000 P 82e1fad2f97643f6a383e90692f1d83f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 162486c9e36d45919a959f286cd59d1d (127.3.94.62:42369), cf7b21b4baf9454a9a4667a9c6b9c7bc (127.3.94.60:42091)
18:29:17.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:17.706243  3501 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "82e1fad2f97643f6a383e90692f1d83f" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "162486c9e36d45919a959f286cd59d1d" is_pre_election: true
18:29:17.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:17.706728  3546 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.94.60:42091: connect: Connection refused (error 111) [suppressed 4 similar messages]
18:29:17.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:17.707832  3546 leader_election.cc:336] T 00000000000000000000000000000000 P 82e1fad2f97643f6a383e90692f1d83f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cf7b21b4baf9454a9a4667a9c6b9c7bc (127.3.94.60:42091): Network error: Client connection negotiation failed: client connection to 127.3.94.60:42091: connect: Connection refused (error 111)
18:29:17.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:17.707985  3546 leader_election.cc:304] T 00000000000000000000000000000000 P 82e1fad2f97643f6a383e90692f1d83f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 82e1fad2f97643f6a383e90692f1d83f; no voters: 162486c9e36d45919a959f286cd59d1d, cf7b21b4baf9454a9a4667a9c6b9c7bc
18:29:17.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:17.708328  4220 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 82e1fad2f97643f6a383e90692f1d83f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
18:29:17.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:17.869086  4223 raft_consensus.cc:493] T 00000000000000000000000000000000 P 162486c9e36d45919a959f286cd59d1d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cf7b21b4baf9454a9a4667a9c6b9c7bc)
18:29:17.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:17.869306  4223 raft_consensus.cc:515] T 00000000000000000000000000000000 P 162486c9e36d45919a959f286cd59d1d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "162486c9e36d45919a959f286cd59d1d" member_type: VOTER last_known_addr { host: "127.3.94.62" port: 42369 } } peers { permanent_uuid: "82e1fad2f97643f6a383e90692f1d83f" member_type: VOTER last_known_addr { host: "127.3.94.61" port: 41619 } } peers { permanent_uuid: "cf7b21b4baf9454a9a4667a9c6b9c7bc" member_type: VOTER last_known_addr { host: "127.3.94.60" port: 42091 } }
18:29:17.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:17.870949  4223 leader_election.cc:290] T 00000000000000000000000000000000 P 162486c9e36d45919a959f286cd59d1d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 82e1fad2f97643f6a383e90692f1d83f (127.3.94.61:41619), cf7b21b4baf9454a9a4667a9c6b9c7bc (127.3.94.60:42091)
18:29:17.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:17.871513  3571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "162486c9e36d45919a959f286cd59d1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "82e1fad2f97643f6a383e90692f1d83f" is_pre_election: true
18:29:17.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:17.871770  3571 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 82e1fad2f97643f6a383e90692f1d83f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 162486c9e36d45919a959f286cd59d1d in term 1.
18:29:17.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:17.871784  3475 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.94.60:42091: connect: Connection refused (error 111) [suppressed 7 similar messages]
18:29:17.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:17.872459  3475 leader_election.cc:304] T 00000000000000000000000000000000 P 162486c9e36d45919a959f286cd59d1d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 162486c9e36d45919a959f286cd59d1d, 82e1fad2f97643f6a383e90692f1d83f; no voters: 
18:29:17.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:17.872872  4223 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 162486c9e36d45919a959f286cd59d1d [term 1 FOLLOWER]: Leader pre-election won for term 2
18:29:17.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:17.873018  4223 raft_consensus.cc:493] T 00000000000000000000000000000000 P 162486c9e36d45919a959f286cd59d1d [term 1 FOLLOWER]: Starting leader election (detected failure of leader cf7b21b4baf9454a9a4667a9c6b9c7bc)
18:29:17.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:17.873124  4223 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 162486c9e36d45919a959f286cd59d1d [term 1 FOLLOWER]: Advancing to term 2
18:29:17.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:17.873490  3475 leader_election.cc:336] T 00000000000000000000000000000000 P 162486c9e36d45919a959f286cd59d1d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cf7b21b4baf9454a9a4667a9c6b9c7bc (127.3.94.60:42091): Network error: Client connection negotiation failed: client connection to 127.3.94.60:42091: connect: Connection refused (error 111)
18:29:17.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:17.875427  4223 raft_consensus.cc:515] T 00000000000000000000000000000000 P 162486c9e36d45919a959f286cd59d1d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "162486c9e36d45919a959f286cd59d1d" member_type: VOTER last_known_addr { host: "127.3.94.62" port: 42369 } } peers { permanent_uuid: "82e1fad2f97643f6a383e90692f1d83f" member_type: VOTER last_known_addr { host: "127.3.94.61" port: 41619 } } peers { permanent_uuid: "cf7b21b4baf9454a9a4667a9c6b9c7bc" member_type: VOTER last_known_addr { host: "127.3.94.60" port: 42091 } }
18:29:17.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:17.876022  4223 leader_election.cc:290] T 00000000000000000000000000000000 P 162486c9e36d45919a959f286cd59d1d [CANDIDATE]: Term 2 election: Requested vote from peers 82e1fad2f97643f6a383e90692f1d83f (127.3.94.61:41619), cf7b21b4baf9454a9a4667a9c6b9c7bc (127.3.94.60:42091)
18:29:17.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:17.876390  3571 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "162486c9e36d45919a959f286cd59d1d" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "82e1fad2f97643f6a383e90692f1d83f"
18:29:17.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:17.876621  3571 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 82e1fad2f97643f6a383e90692f1d83f [term 1 FOLLOWER]: Advancing to term 2
18:29:17.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:17.877300  3475 leader_election.cc:336] T 00000000000000000000000000000000 P 162486c9e36d45919a959f286cd59d1d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer cf7b21b4baf9454a9a4667a9c6b9c7bc (127.3.94.60:42091): Network error: Client connection negotiation failed: client connection to 127.3.94.60:42091: connect: Connection refused (error 111)
18:29:17.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:17.878803  3571 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 82e1fad2f97643f6a383e90692f1d83f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 162486c9e36d45919a959f286cd59d1d in term 2.
18:29:17.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:17.879278  3475 leader_election.cc:304] T 00000000000000000000000000000000 P 162486c9e36d45919a959f286cd59d1d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 162486c9e36d45919a959f286cd59d1d, 82e1fad2f97643f6a383e90692f1d83f; no voters: cf7b21b4baf9454a9a4667a9c6b9c7bc
18:29:17.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:17.879537  4223 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 162486c9e36d45919a959f286cd59d1d [term 2 FOLLOWER]: Leader election won for term 2
18:29:17.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:17.879922  4223 raft_consensus.cc:697] T 00000000000000000000000000000000 P 162486c9e36d45919a959f286cd59d1d [term 2 LEADER]: Becoming Leader. State: Replica: 162486c9e36d45919a959f286cd59d1d, State: Running, Role: LEADER
18:29:17.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:17.880393  4223 consensus_queue.cc:237] T 00000000000000000000000000000000 P 162486c9e36d45919a959f286cd59d1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "162486c9e36d45919a959f286cd59d1d" member_type: VOTER last_known_addr { host: "127.3.94.62" port: 42369 } } peers { permanent_uuid: "82e1fad2f97643f6a383e90692f1d83f" member_type: VOTER last_known_addr { host: "127.3.94.61" port: 41619 } } peers { permanent_uuid: "cf7b21b4baf9454a9a4667a9c6b9c7bc" member_type: VOTER last_known_addr { host: "127.3.94.60" port: 42091 } }
18:29:17.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:17.882076  4225 sys_catalog.cc:455] T 00000000000000000000000000000000 P 162486c9e36d45919a959f286cd59d1d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 162486c9e36d45919a959f286cd59d1d. Latest consensus state: current_term: 2 leader_uuid: "162486c9e36d45919a959f286cd59d1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "162486c9e36d45919a959f286cd59d1d" member_type: VOTER last_known_addr { host: "127.3.94.62" port: 42369 } } peers { permanent_uuid: "82e1fad2f97643f6a383e90692f1d83f" member_type: VOTER last_known_addr { host: "127.3.94.61" port: 41619 } } peers { permanent_uuid: "cf7b21b4baf9454a9a4667a9c6b9c7bc" member_type: VOTER last_known_addr { host: "127.3.94.60" port: 42091 } } }
18:29:17.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:17.882341  4225 sys_catalog.cc:458] T 00000000000000000000000000000000 P 162486c9e36d45919a959f286cd59d1d [sys.catalog]: This master's current role is: LEADER
18:29:17.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:17.883029  4227 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
18:29:17.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:17.885267  4227 catalog_manager.cc:679] Loaded metadata for table org.apache.kudu.client.TestClientFailoverSupport-KILL [id=0e7291bdba99489bb33138fa4c6d6526]
18:29:17.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:17.886904  4227 tablet_loader.cc:96] loaded metadata for tablet f09ff85014164dfd8026700c75f79e22 (table org.apache.kudu.client.TestClientFailoverSupport-KILL [id=0e7291bdba99489bb33138fa4c6d6526])
18:29:17.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:17.887130  4227 catalog_manager.cc:1519] Initializing Kudu cluster ID...
18:29:17.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:17.887871  4227 catalog_manager.cc:1294] Loaded cluster ID: c71c60574d754288b9a8937b8a779e28
18:29:17.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:17.887940  4227 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
18:29:17.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:17.889114  4227 catalog_manager.cc:1539] Loading token signing keys...
18:29:17.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:17.889881  4227 catalog_manager.cc:6080] T 00000000000000000000000000000000 P 162486c9e36d45919a959f286cd59d1d: Loaded TSK: 0
18:29:17.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:17.890725  4227 catalog_manager.cc:1549] Initializing in-progress tserver states...
18:29:17.951 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.3.94.60:42091(127.3.94.60:42091)] connecting to peer
18:29:17.953 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091
18:29:17.953 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.94.60:42091(127.3.94.60:42091)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091
18:29:17.954 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.94.60:42091: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091
18:29:17.957 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
18:29:17.959 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableLocations, tablet=Kudu Master, attempt=11, TimeoutTracker(timeout=29987, elapsed=1387), Traces: [0ms] sending RPC to server master-127.3.94.60:42091, [3ms] received response from server master-127.3.94.60:42091: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [3ms] delaying RPC due to: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [19ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.60:42091, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.61:41619, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.62:42369, [22ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.60:42091: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [24ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.61:41619: OK, [24ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.62:42369: OK, [28ms] delaying RPC due to: Service unavailable: Master config (127.3.94.60:42091,127.3.94.61:41619,127.3.94.62:42369) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [39ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.60:42091, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.61:41619, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.62:42369, [43ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.60:42091: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [44ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.61:41619: OK, [44ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.62:42369: OK, [44ms] delaying RPC due to: Service unavailable: Master config (127.3.94.60:42091,127.3.94.61:41619,127.3.94.62:42369) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [61ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.60:42091, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.61:41619, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.62:42369, [63ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.60:42091: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [64ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.61:41619: OK, [64ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.62:42369: OK, [64ms] delaying RPC due to: Service unavailable: Master config (127.3.94.60:42091,127.3.94.61:41619,127.3.94.62:42369) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.60:42091, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.61:41619, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.62:42369, [83ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.60:42091: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [84ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.62:42369: OK, [84ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.61:41619: OK, [84ms] delaying RPC due to: Service unavailable: Master config (127.3.94.60:42091,127.3.94.61:41619,127.3.94.62:42369) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.60:42091, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.61:41619, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.62:42369, [102ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.60:42091: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [104ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.61:41619: OK, [105ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.62:42369: OK, [105ms] delaying RPC due to: Service unavailable: Master config (127.3.94.60:42091,127.3.94.61:41619,127.3.94.62:42369) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.60:42091, [141ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.61:41619, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.62:42369, [142ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.60:42091: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [144ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.61:41619: OK, [144ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.62:42369: OK, [144ms] delaying RPC due to: Service unavailable: Master config (127.3.94.60:42091,127.3.94.61:41619,127.3.94.62:42369) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.60:42091, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.61:41619, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.62:42369, [242ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.60:42091: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [244ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.62:42369: OK, [244ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.61:41619: OK, [245ms] delaying RPC due to: Service unavailable: Master config (127.3.94.60:42091,127.3.94.61:41619,127.3.94.62:42369) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [260ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.60:42091, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.61:41619, [261ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.62:42369, [262ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.60:42091: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [264ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.62:42369: OK, [264ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.61:41619: OK, [265ms] delaying RPC due to: Service unavailable: Master config (127.3.94.60:42091,127.3.94.61:41619,127.3.94.62:42369) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [580ms] refreshing cache from master, [581ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.60:42091, [582ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.61:41619, [583ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.62:42369, [583ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.60:42091: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [585ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.61:41619: OK, [585ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.62:42369: OK, [585ms] delaying RPC due to: Service unavailable: Master config (127.3.94.60:42091,127.3.94.61:41619,127.3.94.62:42369) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [1380ms] refreshing cache from master, [1381ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.60:42091, [1382ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.61:41619, [1383ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.62:42369, [1383ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.60:42091: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [1385ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.61:41619: OK, [1386ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.62:42369: OK, deferred=Deferred@2074808285(state=PENDING, result=null, callback=get tablet locations from the master for table org.apache.kudu.client.TestClientFailoverSupport-KILL -> release master lookup permit -> retry RPC -> (continuation of Deferred@2075294622 after retry RPC after error@170390861) -> (continuation of Deferred@1419143281 after retry RPC after error@2011189465) -> (continuation of Deferred@535210800 after retry RPC after error@719235100) -> (continuation of Deferred@1307351254 after retry RPC after error@947879722) -> (continuation of Deferred@308997182 after retry RPC after error@1294673959) -> (continuation of Deferred@1688740732 after retry RPC after error@669882092) -> (continuation of Deferred@1646495027 after retry RPC after error@1985864512) -> (continuation of Deferred@1397460276 after retry RPC after error@408562503) -> (continuation of Deferred@1722695522 after retry RPC after error@2146469652), errback=passthrough -> release master lookup permit -> retry RPC after error -> (continuation of Deferred@2075294622 after retry RPC after error@170390861) -> (continuation of Deferred@1419143281 after retry RPC after error@2011189465) -> (continuation of Deferred@535210800 after retry RPC after error@719235100) -> (continuation of Deferred@1307351254 after retry RPC after error@947879722) -> (continuation of Deferred@308997182 after retry RPC after error@1294673959) -> (continuation of Deferred@1688740732 after retry RPC after error@669882092) -> (continuation of Deferred@1646495027 after retry RPC after error@1985864512) -> (continuation of Deferred@1397460276 after retry RPC after error@408562503) -> (continuation of Deferred@1722695522 after retry RPC after error@2146469652))) after lookup
18:29:17.965 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet f09ff85014164dfd8026700c75f79e22 for table 'org.apache.kudu.client.TestClientFailoverSupport-KILL' with partition [<start>, <end>)
18:29:17.965 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=f09ff85014164dfd8026700c75f79e22@[10503043a581460a8f329f09ce44e662(127.3.94.3:35493),77d54c54ba774a17a714cf2fbbb24ee2(127.3.94.1:42025),8c108f9b1b154b3e821195366aea34c8(127.3.94.2:46741)[L]]}]
18:29:17.967 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=f09ff85014164dfd8026700c75f79e22, attempt=2, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=1408), Traces: [0ms] sending RPC to server 8c108f9b1b154b3e821195366aea34c8, [3ms] received response from server 8c108f9b1b154b3e821195366aea34c8: Network error: Failed to connect to peer 8c108f9b1b154b3e821195366aea34c8(127.3.94.2:46741): Connection refused: /127.3.94.2:46741, [3ms] delaying RPC due to: Network error: Failed to connect to peer 8c108f9b1b154b3e821195366aea34c8(127.3.94.2:46741): Connection refused: /127.3.94.2:46741, [13ms] refreshing cache from master, [13ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.94.60:42091, [16ms] Sub RPC GetTableLocations: received response from server master-127.3.94.60:42091: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [16ms] Sub RPC GetTableLocations: delaying RPC due to: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [32ms] Sub RPC GetTableLocations: refreshing cache from master, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.60:42091, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.61:41619, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.62:42369, [35ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.60:42091: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [37ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.61:41619: OK, [37ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.62:42369: OK, [41ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.94.60:42091,127.3.94.61:41619,127.3.94.62:42369) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [52ms] Sub RPC GetTableLocations: refreshing cache from master, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.60:42091, [54ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.61:41619, [54ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.62:42369, [56ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.60:42091: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [57ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.61:41619: OK, [57ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.62:42369: OK, [57ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.94.60:42091,127.3.94.61:41619,127.3.94.62:42369) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [74ms] Sub RPC GetTableLocations: refreshing cache from master, [74ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.60:42091, [74ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.61:41619, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.62:42369, [76ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.60:42091: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [77ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.61:41619: OK, [77ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.62:42369: OK, [77ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.94.60:42091,127.3.94.61:41619,127.3.94.62:42369) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [93ms] Sub RPC GetTableLocations: refreshing cache from master, [93ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.60:42091, [94ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.61:41619, [95ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.62:42369, [96ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.60:42091: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [97ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.62:42369: OK, [97ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.61:41619: OK, [97ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.94.60:42091,127.3.94.61:41619,127.3.94.62:42369) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [113ms] Sub RPC GetTableLocations: refreshing cache from master, [113ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.60:42091, [114ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.61:41619, [114ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.62:42369, [115ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.60:42091: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [117ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.61:41619: OK, [118ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.62:42369: OK, [118ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.94.60:42091,127.3.94.61:41619,127.3.94.62:42369) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [153ms] Sub RPC GetTableLocations: refreshing cache from master, [153ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.60:42091, [154ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.61:41619, [155ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.62:42369, [155ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.60:42091: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [157ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.61:41619: OK, [157ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.62:42369: OK, [157ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.94.60:42091,127.3.94.61:41619,127.3.94.62:42369) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [253ms] Sub RPC GetTableLocations: refreshing cache from master, [253ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.60:42091, [254ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.61:41619, [254ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.62:42369, [255ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.60:42091: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [257ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.62:42369: OK, [257ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.61:41619: OK, [258ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.94.60:42091,127.3.94.61:41619,127.3.94.62:42369) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [273ms] Sub RPC GetTableLocations: refreshing cache from master, [273ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.60:42091, [274ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.61:41619, [274ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.62:42369, [275ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.60:42091: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [277ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.62:42369: OK, [277ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.61:41619: OK, [278ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.94.60:42091,127.3.94.61:41619,127.3.94.62:42369) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [593ms] Sub RPC GetTableLocations: refreshing cache from master, [594ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.60:42091, [595ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.61:41619, [596ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.62:42369, [596ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.60:42091: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [598ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.61:41619: OK, [598ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.62:42369: OK, [598ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.94.60:42091,127.3.94.61:41619,127.3.94.62:42369) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [1393ms] Sub RPC GetTableLocations: refreshing cache from master, [1394ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.60:42091, [1395ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.61:41619, [1396ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.62:42369, [1396ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.60:42091: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [1398ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.61:41619: OK, [1399ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.62:42369: OK, [1403ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.94.62:42369, [1407ms] Sub RPC GetTableLocations: received response from server master-127.3.94.62:42369: OK, deferred=Deferred@957651644(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$238/0x00007fe8483357f8@2ed6e7d3 -> passthrough -> wakeup thread Time-limited test, errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@55651d3a -> wakeup thread Time-limited test)) after lookup
18:29:17.969 [DEBUG - kudu-nio-2] (Connection.java:748) [peer 8c108f9b1b154b3e821195366aea34c8(127.3.94.2:46741)] connecting to peer
18:29:17.970 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer 8c108f9b1b154b3e821195366aea34c8(127.3.94.2:46741): Connection refused: /127.3.94.2:46741
18:29:17.970 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 8c108f9b1b154b3e821195366aea34c8(127.3.94.2:46741)] cleaning up while in state CONNECTING due to: Failed to connect to peer 8c108f9b1b154b3e821195366aea34c8(127.3.94.2:46741): Connection refused: /127.3.94.2:46741
18:29:17.970 [INFO - kudu-nio-0] (AsyncKuduClient.java:2355) Invalidating location 8c108f9b1b154b3e821195366aea34c8(127.3.94.2:46741) for tablet f09ff85014164dfd8026700c75f79e22: Failed to connect to peer 8c108f9b1b154b3e821195366aea34c8(127.3.94.2:46741): Connection refused: /127.3.94.2:46741
18:29:17.993 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet f09ff85014164dfd8026700c75f79e22 for table 'org.apache.kudu.client.TestClientFailoverSupport-KILL' with partition [<start>, <end>)
18:29:17.994 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=f09ff85014164dfd8026700c75f79e22@[10503043a581460a8f329f09ce44e662(127.3.94.3:35493),77d54c54ba774a17a714cf2fbbb24ee2(127.3.94.1:42025),8c108f9b1b154b3e821195366aea34c8(127.3.94.2:46741)[L]]}]
18:29:17.995 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=f09ff85014164dfd8026700c75f79e22, attempt=4, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=1436), Traces: [0ms] sending RPC to server 8c108f9b1b154b3e821195366aea34c8, [3ms] received response from server 8c108f9b1b154b3e821195366aea34c8: Network error: Failed to connect to peer 8c108f9b1b154b3e821195366aea34c8(127.3.94.2:46741): Connection refused: /127.3.94.2:46741, [3ms] delaying RPC due to: Network error: Failed to connect to peer 8c108f9b1b154b3e821195366aea34c8(127.3.94.2:46741): Connection refused: /127.3.94.2:46741, [13ms] refreshing cache from master, [13ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.94.60:42091, [16ms] Sub RPC GetTableLocations: received response from server master-127.3.94.60:42091: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [16ms] Sub RPC GetTableLocations: delaying RPC due to: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [32ms] Sub RPC GetTableLocations: refreshing cache from master, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.60:42091, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.61:41619, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.62:42369, [35ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.60:42091: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [37ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.61:41619: OK, [37ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.62:42369: OK, [41ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.94.60:42091,127.3.94.61:41619,127.3.94.62:42369) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [52ms] Sub RPC GetTableLocations: refreshing cache from master, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.60:42091, [54ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.61:41619, [54ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.62:42369, [56ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.60:42091: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [57ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.61:41619: OK, [57ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.62:42369: OK, [57ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.94.60:42091,127.3.94.61:41619,127.3.94.62:42369) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [74ms] Sub RPC GetTableLocations: refreshing cache from master, [74ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.60:42091, [74ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.61:41619, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.62:42369, [76ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.60:42091: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [77ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.61:41619: OK, [77ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.62:42369: OK, [77ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.94.60:42091,127.3.94.61:41619,127.3.94.62:42369) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [93ms] Sub RPC GetTableLocations: refreshing cache from master, [93ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.60:42091, [94ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.61:41619, [95ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.62:42369, [96ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.60:42091: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [97ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.62:42369: OK, [97ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.61:41619: OK, [97ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.94.60:42091,127.3.94.61:41619,127.3.94.62:42369) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [113ms] Sub RPC GetTableLocations: refreshing cache from master, [113ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.60:42091, [114ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.61:41619, [114ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.62:42369, [115ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.60:42091: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [117ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.61:41619: OK, [118ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.62:42369: OK, [118ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.94.60:42091,127.3.94.61:41619,127.3.94.62:42369) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [153ms] Sub RPC GetTableLocations: refreshing cache from master, [153ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.60:42091, [154ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.61:41619, [155ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.62:42369, [155ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.60:42091: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [157ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.61:41619: OK, [157ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.62:42369: OK, [157ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.94.60:42091,127.3.94.61:41619,127.3.94.62:42369) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [253ms] Sub RPC GetTableLocations: refreshing cache from master, [253ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.60:42091, [254ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.61:41619, [254ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.62:42369, [255ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.60:42091: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [257ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.62:42369: OK, [257ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.61:41619: OK, [258ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.94.60:42091,127.3.94.61:41619,127.3.94.62:42369) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [273ms] Sub RPC GetTableLocations: refreshing cache from master, [273ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.60:42091, [274ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.61:41619, [274ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.62:42369, [275ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.60:42091: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [277ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.62:42369: OK, [277ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.61:41619: OK, [278ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.94.60:42091,127.3.94.61:41619,127.3.94.62:42369) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [593ms] Sub RPC GetTableLocations: refreshing cache from master, [594ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.60:42091, [595ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.61:41619, [596ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.62:42369, [596ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.60:42091: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [598ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.61:41619: OK, [598ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.62:42369: OK, [598ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.94.60:42091,127.3.94.61:41619,127.3.94.62:42369) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [1393ms] Sub RPC GetTableLocations: refreshing cache from master, [1394ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.60:42091, [1395ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.61:41619, [1396ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.62:42369, [1396ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.60:42091: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [1398ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.61:41619: OK, [1399ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.62:42369: OK, [1403ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.94.62:42369, [1407ms] Sub RPC GetTableLocations: received response from server master-127.3.94.62:42369: OK, [1411ms] sending RPC to server 8c108f9b1b154b3e821195366aea34c8, [1413ms] received response from server 8c108f9b1b154b3e821195366aea34c8: Network error: Failed to connect to peer 8c108f9b1b154b3e821195366aea34c8(127.3.94.2:46741): Connection refused: /127.3.94.2:46741, [1413ms] delaying RPC due to: Network error: Failed to connect to peer 8c108f9b1b154b3e821195366aea34c8(127.3.94.2:46741): Connection refused: /127.3.94.2:46741, [1433ms] refreshing cache from master, [1433ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.94.62:42369, [1436ms] Sub RPC GetTableLocations: received response from server master-127.3.94.62:42369: OK, deferred=Deferred@957651644(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$238/0x00007fe8483357f8@2ed6e7d3 -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@2074808285 after retry RPC@1303795115), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@55651d3a -> wakeup thread Time-limited test -> (continuation of Deferred@2074808285 after retry RPC@1303795115))) after lookup
18:29:17.995 [DEBUG - kudu-nio-2] (Connection.java:748) [peer 8c108f9b1b154b3e821195366aea34c8(127.3.94.2:46741)] connecting to peer
18:29:17.996 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer 8c108f9b1b154b3e821195366aea34c8(127.3.94.2:46741): Connection refused: /127.3.94.2:46741
18:29:17.996 [DEBUG - kudu-nio-1] (Connection.java:709) [peer 8c108f9b1b154b3e821195366aea34c8(127.3.94.2:46741)] cleaning up while in state CONNECTING due to: Failed to connect to peer 8c108f9b1b154b3e821195366aea34c8(127.3.94.2:46741): Connection refused: /127.3.94.2:46741
18:29:17.997 [INFO - kudu-nio-1] (AsyncKuduClient.java:2355) Invalidating location 8c108f9b1b154b3e821195366aea34c8(127.3.94.2:46741) for tablet f09ff85014164dfd8026700c75f79e22: Failed to connect to peer 8c108f9b1b154b3e821195366aea34c8(127.3.94.2:46741): Connection refused: /127.3.94.2:46741
18:29:18.013 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet f09ff85014164dfd8026700c75f79e22 for table 'org.apache.kudu.client.TestClientFailoverSupport-KILL' with partition [<start>, <end>)
18:29:18.013 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=f09ff85014164dfd8026700c75f79e22@[10503043a581460a8f329f09ce44e662(127.3.94.3:35493),77d54c54ba774a17a714cf2fbbb24ee2(127.3.94.1:42025),8c108f9b1b154b3e821195366aea34c8(127.3.94.2:46741)[L]]}]
18:29:18.014 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=f09ff85014164dfd8026700c75f79e22, attempt=6, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=1456), Traces: [0ms] sending RPC to server 8c108f9b1b154b3e821195366aea34c8, [3ms] received response from server 8c108f9b1b154b3e821195366aea34c8: Network error: Failed to connect to peer 8c108f9b1b154b3e821195366aea34c8(127.3.94.2:46741): Connection refused: /127.3.94.2:46741, [3ms] delaying RPC due to: Network error: Failed to connect to peer 8c108f9b1b154b3e821195366aea34c8(127.3.94.2:46741): Connection refused: /127.3.94.2:46741, [13ms] refreshing cache from master, [13ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.94.60:42091, [16ms] Sub RPC GetTableLocations: received response from server master-127.3.94.60:42091: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [16ms] Sub RPC GetTableLocations: delaying RPC due to: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [32ms] Sub RPC GetTableLocations: refreshing cache from master, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.60:42091, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.61:41619, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.62:42369, [35ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.60:42091: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [37ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.61:41619: OK, [37ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.62:42369: OK, [41ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.94.60:42091,127.3.94.61:41619,127.3.94.62:42369) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [52ms] Sub RPC GetTableLocations: refreshing cache from master, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.60:42091, [54ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.61:41619, [54ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.62:42369, [56ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.60:42091: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [57ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.61:41619: OK, [57ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.62:42369: OK, [57ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.94.60:42091,127.3.94.61:41619,127.3.94.62:42369) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [74ms] Sub RPC GetTableLocations: refreshing cache from master, [74ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.60:42091, [74ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.61:41619, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.62:42369, [76ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.60:42091: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [77ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.61:41619: OK, [77ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.62:42369: OK, [77ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.94.60:42091,127.3.94.61:41619,127.3.94.62:42369) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [93ms] Sub RPC GetTableLocations: refreshing cache from master, [93ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.60:42091, [94ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.61:41619, [95ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.62:42369, [96ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.60:42091: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [97ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.62:42369: OK, [97ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.61:41619: OK, [97ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.94.60:42091,127.3.94.61:41619,127.3.94.62:42369) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [113ms] Sub RPC GetTableLocations: refreshing cache from master, [113ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.60:42091, [114ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.61:41619, [114ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.62:42369, [115ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.60:42091: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [117ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.61:41619: OK, [118ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.62:42369: OK, [118ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.94.60:42091,127.3.94.61:41619,127.3.94.62:42369) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [153ms] Sub RPC GetTableLocations: refreshing cache from master, [153ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.60:42091, [154ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.61:41619, [155ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.62:42369, [155ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.60:42091: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [157ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.61:41619: OK, [157ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.62:42369: OK, [157ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.94.60:42091,127.3.94.61:41619,127.3.94.62:42369) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [253ms] Sub RPC GetTableLocations: refreshing cache from master, [253ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.60:42091, [254ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.61:41619, [254ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.62:42369, [255ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.60:42091: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [257ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.62:42369: OK, [257ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.61:41619: OK, [258ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.94.60:42091,127.3.94.61:41619,127.3.94.62:42369) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [273ms] Sub RPC GetTableLocations: refreshing cache from master, [273ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.60:42091, [274ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.61:41619, [274ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.62:42369, [275ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.60:42091: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [277ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.62:42369: OK, [277ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.61:41619: OK, [278ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.94.60:42091,127.3.94.61:41619,127.3.94.62:42369) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [593ms] Sub RPC GetTableLocations: refreshing cache from master, [594ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.60:42091, [595ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.61:41619, [596ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.62:42369, [596ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.60:42091: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [598ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.61:41619: OK, [598ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.62:42369: OK, [598ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.94.60:42091,127.3.94.61:41619,127.3.94.62:42369) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [1393ms] Sub RPC GetTableLocations: refreshing cache from master, [1394ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.60:42091, [1395ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.61:41619, [1396ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.62:42369, [1396ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.60:42091: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [1398ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.61:41619: OK, [1399ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.62:42369: OK, [1403ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.94.62:42369, [1407ms] Sub RPC GetTableLocations: received response from server master-127.3.94.62:42369: OK, [1411ms] sending RPC to server 8c108f9b1b154b3e821195366aea34c8, [1413ms] received response from server 8c108f9b1b154b3e821195366aea34c8: Network error: Failed to connect to peer 8c108f9b1b154b3e821195366aea34c8(127.3.94.2:46741): Connection refused: /127.3.94.2:46741, [1413ms] delaying RPC due to: Network error: Failed to connect to peer 8c108f9b1b154b3e821195366aea34c8(127.3.94.2:46741): Connection refused: /127.3.94.2:46741, [1433ms] refreshing cache from master, [1433ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.94.62:42369, [1436ms] Sub RPC GetTableLocations: received response from server master-127.3.94.62:42369: OK, [1438ms] sending RPC to server 8c108f9b1b154b3e821195366aea34c8, [1440ms] received response from server 8c108f9b1b154b3e821195366aea34c8: Network error: Failed to connect to peer 8c108f9b1b154b3e821195366aea34c8(127.3.94.2:46741): Connection refused: /127.3.94.2:46741, [1440ms] delaying RPC due to: Network error: Failed to connect to peer 8c108f9b1b154b3e821195366aea34c8(127.3.94.2:46741): Connection refused: /127.3.94.2:46741, [1453ms] refreshing cache from master, [1453ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.94.62:42369, [1456ms] Sub RPC GetTableLocations: received response from server master-127.3.94.62:42369: OK, deferred=Deferred@957651644(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$238/0x00007fe8483357f8@2ed6e7d3 -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@2074808285 after retry RPC@1303795115) -> (continuation of Deferred@1224007374 after retry RPC@923849078), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@55651d3a -> wakeup thread Time-limited test -> (continuation of Deferred@2074808285 after retry RPC@1303795115) -> (continuation of Deferred@1224007374 after retry RPC@923849078))) after lookup
18:29:18.015 [DEBUG - kudu-nio-2] (Connection.java:748) [peer 8c108f9b1b154b3e821195366aea34c8(127.3.94.2:46741)] connecting to peer
18:29:18.016 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer 8c108f9b1b154b3e821195366aea34c8(127.3.94.2:46741): Connection refused: /127.3.94.2:46741
18:29:18.017 [DEBUG - kudu-nio-2] (Connection.java:709) [peer 8c108f9b1b154b3e821195366aea34c8(127.3.94.2:46741)] cleaning up while in state CONNECTING due to: Failed to connect to peer 8c108f9b1b154b3e821195366aea34c8(127.3.94.2:46741): Connection refused: /127.3.94.2:46741
18:29:18.017 [INFO - kudu-nio-2] (AsyncKuduClient.java:2355) Invalidating location 8c108f9b1b154b3e821195366aea34c8(127.3.94.2:46741) for tablet f09ff85014164dfd8026700c75f79e22: Failed to connect to peer 8c108f9b1b154b3e821195366aea34c8(127.3.94.2:46741): Connection refused: /127.3.94.2:46741
18:29:18.033 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet f09ff85014164dfd8026700c75f79e22 for table 'org.apache.kudu.client.TestClientFailoverSupport-KILL' with partition [<start>, <end>)
18:29:18.034 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=f09ff85014164dfd8026700c75f79e22@[10503043a581460a8f329f09ce44e662(127.3.94.3:35493),77d54c54ba774a17a714cf2fbbb24ee2(127.3.94.1:42025),8c108f9b1b154b3e821195366aea34c8(127.3.94.2:46741)[L]]}]
18:29:18.034 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=f09ff85014164dfd8026700c75f79e22, attempt=8, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=1476), Traces: [0ms] sending RPC to server 8c108f9b1b154b3e821195366aea34c8, [3ms] received response from server 8c108f9b1b154b3e821195366aea34c8: Network error: Failed to connect to peer 8c108f9b1b154b3e821195366aea34c8(127.3.94.2:46741): Connection refused: /127.3.94.2:46741, [3ms] delaying RPC due to: Network error: Failed to connect to peer 8c108f9b1b154b3e821195366aea34c8(127.3.94.2:46741): Connection refused: /127.3.94.2:46741, [13ms] refreshing cache from master, [13ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.94.60:42091, [16ms] Sub RPC GetTableLocations: received response from server master-127.3.94.60:42091: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [16ms] Sub RPC GetTableLocations: delaying RPC due to: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [32ms] Sub RPC GetTableLocations: refreshing cache from master, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.60:42091, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.61:41619, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.62:42369, [35ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.60:42091: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [37ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.61:41619: OK, [37ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.62:42369: OK, [41ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.94.60:42091,127.3.94.61:41619,127.3.94.62:42369) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [52ms] Sub RPC GetTableLocations: refreshing cache from master, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.60:42091, [54ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.61:41619, [54ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.62:42369, [56ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.60:42091: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [57ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.61:41619: OK, [57ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.62:42369: OK, [57ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.94.60:42091,127.3.94.61:41619,127.3.94.62:42369) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [74ms] Sub RPC GetTableLocations: refreshing cache from master, [74ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.60:42091, [74ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.61:41619, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.62:42369, [76ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.60:42091: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [77ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.61:41619: OK, [77ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.62:42369: OK, [77ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.94.60:42091,127.3.94.61:41619,127.3.94.62:42369) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [93ms] Sub RPC GetTableLocations: refreshing cache from master, [93ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.60:42091, [94ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.61:41619, [95ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.62:42369, [96ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.60:42091: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [97ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.62:42369: OK, [97ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.61:41619: OK, [97ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.94.60:42091,127.3.94.61:41619,127.3.94.62:42369) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [113ms] Sub RPC GetTableLocations: refreshing cache from master, [113ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.60:42091, [114ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.61:41619, [114ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.62:42369, [115ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.60:42091: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [117ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.61:41619: OK, [118ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.62:42369: OK, [118ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.94.60:42091,127.3.94.61:41619,127.3.94.62:42369) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [153ms] Sub RPC GetTableLocations: refreshing cache from master, [153ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.60:42091, [154ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.61:41619, [155ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.62:42369, [155ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.60:42091: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [157ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.61:41619: OK, [157ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.62:42369: OK, [157ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.94.60:42091,127.3.94.61:41619,127.3.94.62:42369) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [253ms] Sub RPC GetTableLocations: refreshing cache from master, [253ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.60:42091, [254ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.61:41619, [254ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.62:42369, [255ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.60:42091: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [257ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.62:42369: OK, [257ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.61:41619: OK, [258ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.94.60:42091,127.3.94.61:41619,127.3.94.62:42369) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [273ms] Sub RPC GetTableLocations: refreshing cache from master, [273ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.60:42091, [274ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.61:41619, [274ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.62:42369, [275ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.60:42091: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [277ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.62:42369: OK, [277ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.61:41619: OK, [278ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.94.60:42091,127.3.94.61:41619,127.3.94.62:42369) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [593ms] Sub RPC GetTableLocations: refreshing cache from master, [594ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.60:42091, [595ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.61:41619, [596ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.62:42369, [596ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.60:42091: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [598ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.61:41619: OK, [598ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.62:42369: OK, [598ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.94.60:42091,127.3.94.61:41619,127.3.94.62:42369) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [1393ms] Sub RPC GetTableLocations: refreshing cache from master, [1394ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.60:42091, [1395ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.61:41619, [1396ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.62:42369, [1396ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.60:42091: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [1398ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.61:41619: OK, [1399ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.62:42369: OK, [1403ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.94.62:42369, [1407ms] Sub RPC GetTableLocations: received response from server master-127.3.94.62:42369: OK, [1411ms] sending RPC to server 8c108f9b1b154b3e821195366aea34c8, [1413ms] received response from server 8c108f9b1b154b3e821195366aea34c8: Network error: Failed to connect to peer 8c108f9b1b154b3e821195366aea34c8(127.3.94.2:46741): Connection refused: /127.3.94.2:46741, [1413ms] delaying RPC due to: Network error: Failed to connect to peer 8c108f9b1b154b3e821195366aea34c8(127.3.94.2:46741): Connection refused: /127.3.94.2:46741, [1433ms] refreshing cache from master, [1433ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.94.62:42369, [1436ms] Sub RPC GetTableLocations: received response from server master-127.3.94.62:42369: OK, [1438ms] sending RPC to server 8c108f9b1b154b3e821195366aea34c8, [1440ms] received response from server 8c108f9b1b154b3e821195366aea34c8: Network error: Failed to connect to peer 8c108f9b1b154b3e821195366aea34c8(127.3.94.2:46741): Connection refused: /127.3.94.2:46741, [1440ms] delaying RPC due to: Network error: Failed to connect to peer 8c108f9b1b154b3e821195366aea34c8(127.3.94.2:46741): Connection refused: /127.3.94.2:46741, [1453ms] refreshing cache from master, [1453ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.94.62:42369, [1456ms] Sub RPC GetTableLocations: received response from server master-127.3.94.62:42369: OK, [1458ms] too many traces: truncated at 100 traces, deferred=Deferred@957651644(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$238/0x00007fe8483357f8@2ed6e7d3 -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@2074808285 after retry RPC@1303795115) -> (continuation of Deferred@1224007374 after retry RPC@923849078) -> (continuation of Deferred@334809488 after retry RPC@688352780), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@55651d3a -> wakeup thread Time-limited test -> (continuation of Deferred@2074808285 after retry RPC@1303795115) -> (continuation of Deferred@1224007374 after retry RPC@923849078) -> (continuation of Deferred@334809488 after retry RPC@688352780))) after lookup
18:29:18.035 [DEBUG - kudu-nio-2] (Connection.java:748) [peer 8c108f9b1b154b3e821195366aea34c8(127.3.94.2:46741)] connecting to peer
18:29:18.036 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer 8c108f9b1b154b3e821195366aea34c8(127.3.94.2:46741): Connection refused: /127.3.94.2:46741
18:29:18.036 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 8c108f9b1b154b3e821195366aea34c8(127.3.94.2:46741)] cleaning up while in state CONNECTING due to: Failed to connect to peer 8c108f9b1b154b3e821195366aea34c8(127.3.94.2:46741): Connection refused: /127.3.94.2:46741
18:29:18.036 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location 8c108f9b1b154b3e821195366aea34c8(127.3.94.2:46741) for tablet f09ff85014164dfd8026700c75f79e22: Failed to connect to peer 8c108f9b1b154b3e821195366aea34c8(127.3.94.2:46741): Connection refused: /127.3.94.2:46741
18:29:18.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:18.084131  4025 consensus_peers.cc:597] T f09ff85014164dfd8026700c75f79e22 P 10503043a581460a8f329f09ce44e662 -> Peer 8c108f9b1b154b3e821195366aea34c8 (127.3.94.2:46741): Couldn't send request to peer 8c108f9b1b154b3e821195366aea34c8. Status: Network error: Client connection negotiation failed: client connection to 127.3.94.2:46741: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
18:29:18.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:18.200980  3819 raft_consensus.cc:1275] T f09ff85014164dfd8026700c75f79e22 P 77d54c54ba774a17a714cf2fbbb24ee2 [term 2 FOLLOWER]: Refusing update from remote peer 10503043a581460a8f329f09ce44e662: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 2 index: 12. (index mismatch)
18:29:18.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:18.201740  4208 consensus_queue.cc:1048] T f09ff85014164dfd8026700c75f79e22 P 10503043a581460a8f329f09ce44e662 [LEADER]: Connected to new peer: Peer: permanent_uuid: "77d54c54ba774a17a714cf2fbbb24ee2" member_type: VOTER last_known_addr { host: "127.3.94.1" port: 42025 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
18:29:18.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:18.203362  3865 heartbeater.cc:499] Master 127.3.94.62:42369 was elected leader, sending a full tablet report...
18:29:18.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:18.206383  3491 catalog_manager.cc:5696] T f09ff85014164dfd8026700c75f79e22 P 77d54c54ba774a17a714cf2fbbb24ee2 reported cstate change: term changed from 1 to 2, leader changed from 8c108f9b1b154b3e821195366aea34c8 (127.3.94.2) to 10503043a581460a8f329f09ce44e662 (127.3.94.3). New cstate: current_term: 2 leader_uuid: "10503043a581460a8f329f09ce44e662" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "10503043a581460a8f329f09ce44e662" member_type: VOTER last_known_addr { host: "127.3.94.3" port: 35493 } } peers { permanent_uuid: "77d54c54ba774a17a714cf2fbbb24ee2" member_type: VOTER last_known_addr { host: "127.3.94.1" port: 42025 } } peers { permanent_uuid: "8c108f9b1b154b3e821195366aea34c8" member_type: VOTER last_known_addr { host: "127.3.94.2" port: 46741 } } }
18:29:18.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:18.212371  3571 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 82e1fad2f97643f6a383e90692f1d83f [term 2 FOLLOWER]: Refusing update from remote peer 162486c9e36d45919a959f286cd59d1d: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
18:29:18.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:18.212894  3475 consensus_peers.cc:597] T 00000000000000000000000000000000 P 162486c9e36d45919a959f286cd59d1d -> Peer cf7b21b4baf9454a9a4667a9c6b9c7bc (127.3.94.60:42091): Couldn't send request to peer cf7b21b4baf9454a9a4667a9c6b9c7bc. Status: Network error: Client connection negotiation failed: client connection to 127.3.94.60:42091: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
18:29:18.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:18.213229  4223 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 162486c9e36d45919a959f286cd59d1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "82e1fad2f97643f6a383e90692f1d83f" member_type: VOTER last_known_addr { host: "127.3.94.61" port: 41619 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
18:29:18.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:18.215535  4234 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82e1fad2f97643f6a383e90692f1d83f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 162486c9e36d45919a959f286cd59d1d. Latest consensus state: current_term: 2 leader_uuid: "162486c9e36d45919a959f286cd59d1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "162486c9e36d45919a959f286cd59d1d" member_type: VOTER last_known_addr { host: "127.3.94.62" port: 42369 } } peers { permanent_uuid: "82e1fad2f97643f6a383e90692f1d83f" member_type: VOTER last_known_addr { host: "127.3.94.61" port: 41619 } } peers { permanent_uuid: "cf7b21b4baf9454a9a4667a9c6b9c7bc" member_type: VOTER last_known_addr { host: "127.3.94.60" port: 42091 } } }
18:29:18.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:18.215716  4234 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82e1fad2f97643f6a383e90692f1d83f [sys.catalog]: This master's current role is: FOLLOWER
18:29:18.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:18.217528  4223 sys_catalog.cc:455] T 00000000000000000000000000000000 P 162486c9e36d45919a959f286cd59d1d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "162486c9e36d45919a959f286cd59d1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "162486c9e36d45919a959f286cd59d1d" member_type: VOTER last_known_addr { host: "127.3.94.62" port: 42369 } } peers { permanent_uuid: "82e1fad2f97643f6a383e90692f1d83f" member_type: VOTER last_known_addr { host: "127.3.94.61" port: 41619 } } peers { permanent_uuid: "cf7b21b4baf9454a9a4667a9c6b9c7bc" member_type: VOTER last_known_addr { host: "127.3.94.60" port: 42091 } } }
18:29:18.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:18.217756  4223 sys_catalog.cc:458] T 00000000000000000000000000000000 P 162486c9e36d45919a959f286cd59d1d [sys.catalog]: This master's current role is: LEADER
18:29:18.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:18.218653  4234 sys_catalog.cc:455] T 00000000000000000000000000000000 P 82e1fad2f97643f6a383e90692f1d83f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "162486c9e36d45919a959f286cd59d1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "162486c9e36d45919a959f286cd59d1d" member_type: VOTER last_known_addr { host: "127.3.94.62" port: 42369 } } peers { permanent_uuid: "82e1fad2f97643f6a383e90692f1d83f" member_type: VOTER last_known_addr { host: "127.3.94.61" port: 41619 } } peers { permanent_uuid: "cf7b21b4baf9454a9a4667a9c6b9c7bc" member_type: VOTER last_known_addr { host: "127.3.94.60" port: 42091 } } }
18:29:18.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:18.219059  4234 sys_catalog.cc:458] T 00000000000000000000000000000000 P 82e1fad2f97643f6a383e90692f1d83f [sys.catalog]: This master's current role is: FOLLOWER
18:29:18.294 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet f09ff85014164dfd8026700c75f79e22 for table 'org.apache.kudu.client.TestClientFailoverSupport-KILL' with partition [<start>, <end>)
18:29:18.294 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=f09ff85014164dfd8026700c75f79e22@[10503043a581460a8f329f09ce44e662(127.3.94.3:35493)[L],77d54c54ba774a17a714cf2fbbb24ee2(127.3.94.1:42025),8c108f9b1b154b3e821195366aea34c8(127.3.94.2:46741)]}]
18:29:18.296 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=f09ff85014164dfd8026700c75f79e22, attempt=10, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=1737), Traces: [0ms] sending RPC to server 8c108f9b1b154b3e821195366aea34c8, [3ms] received response from server 8c108f9b1b154b3e821195366aea34c8: Network error: Failed to connect to peer 8c108f9b1b154b3e821195366aea34c8(127.3.94.2:46741): Connection refused: /127.3.94.2:46741, [3ms] delaying RPC due to: Network error: Failed to connect to peer 8c108f9b1b154b3e821195366aea34c8(127.3.94.2:46741): Connection refused: /127.3.94.2:46741, [13ms] refreshing cache from master, [13ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.94.60:42091, [16ms] Sub RPC GetTableLocations: received response from server master-127.3.94.60:42091: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [16ms] Sub RPC GetTableLocations: delaying RPC due to: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [32ms] Sub RPC GetTableLocations: refreshing cache from master, [33ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.60:42091, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.61:41619, [34ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.62:42369, [35ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.60:42091: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [37ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.61:41619: OK, [37ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.62:42369: OK, [41ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.94.60:42091,127.3.94.61:41619,127.3.94.62:42369) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [52ms] Sub RPC GetTableLocations: refreshing cache from master, [53ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.60:42091, [54ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.61:41619, [54ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.62:42369, [56ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.60:42091: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [57ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.61:41619: OK, [57ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.62:42369: OK, [57ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.94.60:42091,127.3.94.61:41619,127.3.94.62:42369) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [74ms] Sub RPC GetTableLocations: refreshing cache from master, [74ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.60:42091, [74ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.61:41619, [75ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.62:42369, [76ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.60:42091: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [77ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.61:41619: OK, [77ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.62:42369: OK, [77ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.94.60:42091,127.3.94.61:41619,127.3.94.62:42369) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [93ms] Sub RPC GetTableLocations: refreshing cache from master, [93ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.60:42091, [94ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.61:41619, [95ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.62:42369, [96ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.60:42091: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [97ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.62:42369: OK, [97ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.61:41619: OK, [97ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.94.60:42091,127.3.94.61:41619,127.3.94.62:42369) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [113ms] Sub RPC GetTableLocations: refreshing cache from master, [113ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.60:42091, [114ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.61:41619, [114ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.62:42369, [115ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.60:42091: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [117ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.61:41619: OK, [118ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.62:42369: OK, [118ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.94.60:42091,127.3.94.61:41619,127.3.94.62:42369) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [153ms] Sub RPC GetTableLocations: refreshing cache from master, [153ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.60:42091, [154ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.61:41619, [155ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.62:42369, [155ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.60:42091: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [157ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.61:41619: OK, [157ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.62:42369: OK, [157ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.94.60:42091,127.3.94.61:41619,127.3.94.62:42369) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [253ms] Sub RPC GetTableLocations: refreshing cache from master, [253ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.60:42091, [254ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.61:41619, [254ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.62:42369, [255ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.60:42091: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [257ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.62:42369: OK, [257ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.61:41619: OK, [258ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.94.60:42091,127.3.94.61:41619,127.3.94.62:42369) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [273ms] Sub RPC GetTableLocations: refreshing cache from master, [273ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.60:42091, [274ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.61:41619, [274ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.62:42369, [275ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.60:42091: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [277ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.62:42369: OK, [277ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.61:41619: OK, [278ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.94.60:42091,127.3.94.61:41619,127.3.94.62:42369) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [593ms] Sub RPC GetTableLocations: refreshing cache from master, [594ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.60:42091, [595ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.61:41619, [596ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.62:42369, [596ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.60:42091: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [598ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.61:41619: OK, [598ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.62:42369: OK, [598ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.94.60:42091,127.3.94.61:41619,127.3.94.62:42369) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [1393ms] Sub RPC GetTableLocations: refreshing cache from master, [1394ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.60:42091, [1395ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.61:41619, [1396ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.94.62:42369, [1396ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.60:42091: Network error: Failed to connect to peer master-127.3.94.60:42091(127.3.94.60:42091): Connection refused: /127.3.94.60:42091, [1398ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.61:41619: OK, [1399ms] Sub RPC ConnectToMaster: received response from server master-127.3.94.62:42369: OK, [1403ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.94.62:42369, [1407ms] Sub RPC GetTableLocations: received response from server master-127.3.94.62:42369: OK, [1411ms] sending RPC to server 8c108f9b1b154b3e821195366aea34c8, [1413ms] received response from server 8c108f9b1b154b3e821195366aea34c8: Network error: Failed to connect to peer 8c108f9b1b154b3e821195366aea34c8(127.3.94.2:46741): Connection refused: /127.3.94.2:46741, [1413ms] delaying RPC due to: Network error: Failed to connect to peer 8c108f9b1b154b3e821195366aea34c8(127.3.94.2:46741): Connection refused: /127.3.94.2:46741, [1433ms] refreshing cache from master, [1433ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.94.62:42369, [1436ms] Sub RPC GetTableLocations: received response from server master-127.3.94.62:42369: OK, [1438ms] sending RPC to server 8c108f9b1b154b3e821195366aea34c8, [1440ms] received response from server 8c108f9b1b154b3e821195366aea34c8: Network error: Failed to connect to peer 8c108f9b1b154b3e821195366aea34c8(127.3.94.2:46741): Connection refused: /127.3.94.2:46741, [1440ms] delaying RPC due to: Network error: Failed to connect to peer 8c108f9b1b154b3e821195366aea34c8(127.3.94.2:46741): Connection refused: /127.3.94.2:46741, [1453ms] refreshing cache from master, [1453ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.94.62:42369, [1456ms] Sub RPC GetTableLocations: received response from server master-127.3.94.62:42369: OK, [1458ms] too many traces: truncated at 100 traces, deferred=Deferred@957651644(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$238/0x00007fe8483357f8@2ed6e7d3 -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@2074808285 after retry RPC@1303795115) -> (continuation of Deferred@1224007374 after retry RPC@923849078) -> (continuation of Deferred@334809488 after retry RPC@688352780) -> (continuation of Deferred@2056156059 after retry RPC@1751848392), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@55651d3a -> wakeup thread Time-limited test -> (continuation of Deferred@2074808285 after retry RPC@1303795115) -> (continuation of Deferred@1224007374 after retry RPC@923849078) -> (continuation of Deferred@334809488 after retry RPC@688352780) -> (continuation of Deferred@2056156059 after retry RPC@1751848392))) after lookup
18:29:18.297 [DEBUG - kudu-nio-2] (Connection.java:748) [peer 10503043a581460a8f329f09ce44e662(127.3.94.3:35493)] connecting to peer
18:29:18.298 [DEBUG - kudu-nio-4] (Connection.java:757) [peer 10503043a581460a8f329f09ce44e662(127.3.94.3:35493)] Successfully connected to peer
18:29:18.327 [DEBUG - kudu-nio-4] (Negotiator.java:919) Authenticated connection [id: 0xba828170, L:/127.0.0.1:57354 - R:/127.3.94.3:35493] using TOKEN/null
18:29:18.428 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 20 rows, more = false) for scanner KuduScanner(table=org.apache.kudu.client.TestClientFailoverSupport-KILL, tablet=f09ff85014164dfd8026700c75f79e22, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:29:18.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:18.433275  3491 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46876:
18:29:18.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "org.apache.kudu.client.TestClientFailoverSupport-KILL" }
18:29:18.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:18.433569  3491 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46876:
18:29:18.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "org.apache.kudu.client.TestClientFailoverSupport-KILL" }
18:29:18.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:18.440068  3491 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 162486c9e36d45919a959f286cd59d1d: Sending DeleteTablet for 3 replicas of tablet f09ff85014164dfd8026700c75f79e22
18:29:18.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:18.451622  3798 tablet_service.cc:1558] Processing DeleteTablet for tablet f09ff85014164dfd8026700c75f79e22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-07-08 18:29:18 UTC) from {username='slave'} at 127.0.0.1:35264
18:29:18.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:18.451777  4070 tablet_service.cc:1558] Processing DeleteTablet for tablet f09ff85014164dfd8026700c75f79e22 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-07-08 18:29:18 UTC) from {username='slave'} at 127.0.0.1:57360
18:29:18.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:18.453909  3477 catalog_manager.cc:4754] TS 8c108f9b1b154b3e821195366aea34c8 (127.3.94.2:46741): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet f09ff85014164dfd8026700c75f79e22: Network error: Client connection negotiation failed: client connection to 127.3.94.2:46741: connect: Connection refused (error 111)
18:29:18.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:18.455193  4249 tablet_replica.cc:333] T f09ff85014164dfd8026700c75f79e22 P 10503043a581460a8f329f09ce44e662: stopping tablet replica
18:29:18.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:18.456069  4249 raft_consensus.cc:2243] T f09ff85014164dfd8026700c75f79e22 P 10503043a581460a8f329f09ce44e662 [term 2 LEADER]: Raft consensus shutting down.
18:29:18.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:18.461087  4248 tablet_replica.cc:333] T f09ff85014164dfd8026700c75f79e22 P 77d54c54ba774a17a714cf2fbbb24ee2: stopping tablet replica
18:29:18.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:18.461753  4248 raft_consensus.cc:2243] T f09ff85014164dfd8026700c75f79e22 P 77d54c54ba774a17a714cf2fbbb24ee2 [term 2 FOLLOWER]: Raft consensus shutting down.
18:29:18.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:18.462652  4249 raft_consensus.cc:2272] T f09ff85014164dfd8026700c75f79e22 P 10503043a581460a8f329f09ce44e662 [term 2 FOLLOWER]: Raft consensus is shut down!
18:29:18.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:18.464377  4249 ts_tablet_manager.cc:1916] T f09ff85014164dfd8026700c75f79e22 P 10503043a581460a8f329f09ce44e662: Deleting tablet data with delete state TABLET_DATA_DELETED
18:29:18.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:18.467907  4248 raft_consensus.cc:2272] T f09ff85014164dfd8026700c75f79e22 P 77d54c54ba774a17a714cf2fbbb24ee2 [term 2 FOLLOWER]: Raft consensus is shut down!
18:29:18.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:18.470206  4248 ts_tablet_manager.cc:1916] T f09ff85014164dfd8026700c75f79e22 P 77d54c54ba774a17a714cf2fbbb24ee2: Deleting tablet data with delete state TABLET_DATA_DELETED
18:29:18.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:18.470836  4249 ts_tablet_manager.cc:1929] T f09ff85014164dfd8026700c75f79e22 P 10503043a581460a8f329f09ce44e662: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.22
18:29:18.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:18.471179  4249 log.cc:1199] T f09ff85014164dfd8026700c75f79e22 P 10503043a581460a8f329f09ce44e662: Deleting WAL directory at /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/ts-2/wal/wals/f09ff85014164dfd8026700c75f79e22
18:29:18.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:18.471997  4249 ts_tablet_manager.cc:1950] T f09ff85014164dfd8026700c75f79e22 P 10503043a581460a8f329f09ce44e662: Deleting consensus metadata
18:29:18.474 [DEBUG - main] (Connection.java:575) [peer master-127.3.94.60:42091(127.3.94.60:42091)] disconnecting while in state TERMINATED
18:29:18.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:18.474287  3478 catalog_manager.cc:5027] TS 10503043a581460a8f329f09ce44e662 (127.3.94.3:35493): tablet f09ff85014164dfd8026700c75f79e22 (table org.apache.kudu.client.TestClientFailoverSupport-KILL [id=0e7291bdba99489bb33138fa4c6d6526]) successfully deleted
18:29:18.475 [DEBUG - main] (Connection.java:575) [peer 8c108f9b1b154b3e821195366aea34c8(127.3.94.2:46741)] disconnecting while in state TERMINATED
18:29:18.475 [DEBUG - main] (Connection.java:575) [peer master-127.3.94.61:41619(127.3.94.61:41619)] disconnecting while in state READY
18:29:18.476 [DEBUG - main] (Connection.java:575) [peer master-127.3.94.62:42369(127.3.94.62:42369)] disconnecting while in state READY
18:29:18.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:18.477538  4248 ts_tablet_manager.cc:1929] T f09ff85014164dfd8026700c75f79e22 P 77d54c54ba774a17a714cf2fbbb24ee2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.22
18:29:18.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:18.477888  4248 log.cc:1199] T f09ff85014164dfd8026700c75f79e22 P 77d54c54ba774a17a714cf2fbbb24ee2: Deleting WAL directory at /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster8281630877687793472/ts-0/wal/wals/f09ff85014164dfd8026700c75f79e22
18:29:18.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:18.478615  4248 ts_tablet_manager.cc:1950] T f09ff85014164dfd8026700c75f79e22 P 77d54c54ba774a17a714cf2fbbb24ee2: Deleting consensus metadata
18:29:18.478 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.3.94.61:41619(127.3.94.61:41619)] handling channelInactive
18:29:18.479 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.94.61:41619(127.3.94.61:41619)] cleaning up while in state READY due to: connection closed
18:29:18.479 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.3.94.62:42369(127.3.94.62:42369)] handling channelInactive
18:29:18.479 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.94.62:42369(127.3.94.62:42369)] cleaning up while in state READY due to: connection closed
18:29:18.480 [DEBUG - main] (Connection.java:575) [peer 10503043a581460a8f329f09ce44e662(127.3.94.3:35493)] disconnecting while in state READY
18:29:18.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:18.480719  3476 catalog_manager.cc:5027] TS 77d54c54ba774a17a714cf2fbbb24ee2 (127.3.94.1:42025): tablet f09ff85014164dfd8026700c75f79e22 (table org.apache.kudu.client.TestClientFailoverSupport-KILL [id=0e7291bdba99489bb33138fa4c6d6526]) successfully deleted
18:29:18.481 [DEBUG - kudu-nio-4] (Connection.java:239) [peer 10503043a581460a8f329f09ce44e662(127.3.94.3:35493)] handling channelInactive
18:29:18.481 [DEBUG - kudu-nio-4] (Connection.java:709) [peer 10503043a581460a8f329f09ce44e662(127.3.94.3:35493)] cleaning up while in state READY due to: connection closed
18:29:18.482 [DEBUG - main] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:29:18.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:18.483002  3448 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskRlQDJI/build/asan/bin/kudu pid 3719
18:29:18.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:18.494632  3859 generic_service.cc:196] Checking for leaks (request via RPC)
18:29:18.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:18.593046  3448 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskRlQDJI/build/asan/bin/kudu with pid 3719
18:29:18.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:18.612708  3448 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskRlQDJI/build/asan/bin/kudu pid 4007
18:29:18.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:18.619975  4131 generic_service.cc:196] Checking for leaks (request via RPC)
18:29:18.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:18.743633  3448 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskRlQDJI/build/asan/bin/kudu with pid 4007
18:29:18.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:18.763285  3448 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskRlQDJI/build/asan/bin/kudu pid 3459
18:29:18.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:18.764459  3521 generic_service.cc:196] Checking for leaks (request via RPC)
18:29:18.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:18.876760  3448 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskRlQDJI/build/asan/bin/kudu with pid 3459
18:29:18.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:18.899088  3448 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskRlQDJI/build/asan/bin/kudu pid 3530
18:29:18.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:18.900482  3593 generic_service.cc:196] Checking for leaks (request via RPC)
18:29:19.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:19.007839  3448 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskRlQDJI/build/asan/bin/kudu with pid 3530
18:29:19.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T18:29:19Z chronyd exiting
.18:29:19.166 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1783535359166
18:29:19.169 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
18:29:19.169 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
18:29:19.169 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskRlQDJI/test-tmp
18:29:19.170 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/asan/bin
18:29:19.170 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskRlQDJI/java/build/dist-test/../../../build/asan/bin/kudu, test, mini_cluster, --serialization=pb]
18:29:19.172 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

18:29:19.501 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
18:29:19.501 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

18:29:19.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:19.504299  4258 mini_oidc.cc:150] Starting JWKS server
18:29:19.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:19.506559  4258 webserver.cc:534] Webserver started at http://127.0.0.1:33613/ using document root <none> and password file <none>
18:29:19.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:19.506778  4258 mini_oidc.cc:186] Starting OIDC Discovery server
18:29:19.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:19.507258  4258 webserver.cc:534] Webserver started at http://127.0.0.1:41463/ using document root <none> and password file <none>
18:29:19.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T18:29:19Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
18:29:19.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T18:29:19Z Disabled control of system clock
18:29:19.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:19.537132  4258 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskRlQDJI/build/asan/bin/kudu
18:29:19.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskRlQDJI/build/asan/bin/kudu
18:29:19.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/master-0/wal
18:29:19.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/master-0/data
18:29:19.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:29:19.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:29:19.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:29:19.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:29:19.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:29:19.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:29:19.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/master-0/logs
18:29:19.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/master-0/data/info.pb
18:29:19.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:29:19.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:29:19.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:29:19.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:29:19.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:29:19.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:29:19.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:29:19.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:29:19.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
18:29:19.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:29:19.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:29:19.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:29:19.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.40.190:39817
18:29:19.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.40.190
18:29:19.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:29:19.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.40.148:32775
18:29:19.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:29:19.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:29:19.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:29:19.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:29:19.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125
18:29:19.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:29:19.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33613/jwks.json with env {}
18:29:19.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:19.865512  4269 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:29:19.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:19.865825  4269 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:29:19.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:19.865929  4269 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:29:19.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:19.874248  4269 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
18:29:19.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:19.874346  4269 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:29:19.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:19.874401  4269 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
18:29:19.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:19.874442  4269 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
18:29:19.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:19.874495  4269 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
18:29:19.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:19.874528  4269 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:33613/jwks.json
18:29:19.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:19.884732  4269 master_runner.cc:387] Master server non-default flags:
18:29:19.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:29:19.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.40.148:32775
18:29:19.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:29:19.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:29:19.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/master-0/data
18:29:19.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/master-0/wal
18:29:19.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:29:19.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125
18:29:19.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:29:19.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:29:19.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:29:19.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.40.190:39817
18:29:19.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:29:19.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:29:19.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:29:19.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33613/jwks.json
18:29:19.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:29:19.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:29:19.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/master-0/data/info.pb
18:29:19.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.40.190
18:29:19.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:29:19.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:29:19.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:29:19.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:29:19.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:29:19.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:29:19.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/master-0/logs
18:29:19.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:29:19.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:29:19.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:29:19.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
18:29:19.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:29:19.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:29:19.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:29:19.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:01:24 UTC on bdcb31816ec0
18:29:19.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16870
18:29:19.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
18:29:19.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:19.886479  4269 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:29:19.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:19.888954  4269 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:29:19.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:19.898984  4274 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:19.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:19.898947  4275 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:19.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:19.900242  4277 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:19.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:19.900296  4269 server_base.cc:1061] running on GCE node
18:29:19.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:19.901113  4269 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:29:19.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:19.902551  4269 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:29:19.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:19.903810  4269 hybrid_clock.cc:648] HybridClock initialized: now 1783535359903719 us; error 73 us; skew 500 ppm
18:29:19.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:19.904294  4269 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:29:19.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:19.906426  4269 webserver.cc:534] Webserver started at http://127.4.40.190:37073/ using document root <none> and password file <none>
18:29:19.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:19.907097  4269 fs_manager.cc:362] Metadata directory not provided
18:29:19.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:19.907203  4269 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:29:19.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:19.907483  4269 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:29:19.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:19.909794  4269 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/master-0/data/instance:
18:29:19.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e9a0c1466df2474b9dbf1cbb1db88b6b"
18:29:19.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:29:19 on dist-test-slave-0d16"
18:29:19.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:19.910518  4269 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/master-0/wal/instance:
18:29:19.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e9a0c1466df2474b9dbf1cbb1db88b6b"
18:29:19.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:29:19 on dist-test-slave-0d16"
18:29:19.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:19.915915  4269 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.001s
18:29:19.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:19.919293  4283 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:29:19.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:19.920581  4269 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.002s
18:29:19.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:19.920718  4269 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/master-0/data,/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/master-0/wal
18:29:19.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e9a0c1466df2474b9dbf1cbb1db88b6b"
18:29:19.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:29:19 on dist-test-slave-0d16"
18:29:19.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:19.920885  4269 fs_report.cc:389] FS layout report
18:29:19.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:29:19.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/master-0/wal
18:29:19.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/master-0/wal
18:29:19.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/master-0/data/data
18:29:19.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:29:19.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:29:19.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:29:19.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:29:19.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:29:19.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:29:19.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:29:19.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:29:19.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:29:19.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:29:19.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:29:19.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:19.948848  4269 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:29:19.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:19.949697  4269 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:29:19.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:19.949930  4269 kserver.cc:163] Server-wide thread pool size limit: 3276
18:29:19.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:19.970420  4269 rpc_server.cc:307] RPC server started. Bound to: 127.4.40.190:39817
18:29:19.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:19.970443  4335 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.40.190:39817 every 8 connection(s)
18:29:19.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:19.972102  4269 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/master-0/data/info.pb
18:29:19.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:19.975059  4258 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskRlQDJI/build/asan/bin/kudu as pid 4269
18:29:19.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:19.975392  4258 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/master-0/wal/instance
18:29:19.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:19.977310  4336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
18:29:19.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:19.978451  4258 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskRlQDJI/build/asan/bin/kudu
18:29:19.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskRlQDJI/build/asan/bin/kudu
18:29:19.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/master-1/wal
18:29:19.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/master-1/data
18:29:19.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:29:19.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:29:19.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:29:19.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:29:19.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:29:19.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:29:19.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/master-1/logs
18:29:19.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/master-1/data/info.pb
18:29:19.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:29:19.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:29:19.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:29:19.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:29:19.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:29:19.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:29:19.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:29:19.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:29:19.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
18:29:19.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:29:19.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:29:19.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:29:19.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.40.189:36729
18:29:19.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.40.189
18:29:19.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:29:19.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.40.148:32775
18:29:19.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:29:19.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:29:19.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:29:19.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:29:19.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125
18:29:19.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:29:19.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33613/jwks.json with env {}
18:29:19.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:19.985462  4336 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.40.190" port: 39817 } has no permanent_uuid. Determining permanent_uuid...
18:29:20.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.001139  4336 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.40.189" port: 36729 } has no permanent_uuid. Determining permanent_uuid...
18:29:20.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:20.002439  4284 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.40.189:36729: connect: Connection refused (error 111)
18:29:20.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:20.004138  4336 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.40.189:36729: Network error: Client connection negotiation failed: client connection to 127.4.40.189:36729: connect: Connection refused (error 111)
18:29:20.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.053499  4336 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.40.189" port: 36729 } attempt: 1
18:29:20.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:20.055857  4336 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.40.189:36729: Network error: Client connection negotiation failed: client connection to 127.4.40.189:36729: connect: Connection refused (error 111)
18:29:20.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.124121  4336 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.40.189" port: 36729 } attempt: 2
18:29:20.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:20.126354  4336 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.40.189:36729: Network error: Client connection negotiation failed: client connection to 127.4.40.189:36729: connect: Connection refused (error 111)
18:29:20.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.217651  4336 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.40.189" port: 36729 } attempt: 3
18:29:20.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:20.219744  4336 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.40.189:36729: Network error: Client connection negotiation failed: client connection to 127.4.40.189:36729: connect: Connection refused (error 111)
18:29:20.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:20.309592  4338 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:29:20.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:20.309921  4338 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:29:20.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:20.310006  4338 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:29:20.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:20.318305  4338 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
18:29:20.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:20.318400  4338 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:29:20.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:20.318456  4338 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
18:29:20.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:20.318496  4338 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
18:29:20.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:20.318547  4338 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
18:29:20.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:20.318581  4338 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:33613/jwks.json
18:29:20.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.328629  4338 master_runner.cc:387] Master server non-default flags:
18:29:20.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:29:20.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.40.148:32775
18:29:20.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:29:20.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:29:20.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/master-1/data
18:29:20.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/master-1/wal
18:29:20.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:29:20.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125
18:29:20.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:29:20.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:29:20.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:29:20.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.40.189:36729
18:29:20.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:29:20.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:29:20.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:29:20.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33613/jwks.json
18:29:20.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:29:20.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:29:20.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/master-1/data/info.pb
18:29:20.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.40.189
18:29:20.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:29:20.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:29:20.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:29:20.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:29:20.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:29:20.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:29:20.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/master-1/logs
18:29:20.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:29:20.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:29:20.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:29:20.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
18:29:20.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:29:20.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:29:20.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:29:20.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:01:24 UTC on bdcb31816ec0
18:29:20.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16870
18:29:20.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
18:29:20.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.330271  4338 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:29:20.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.332000  4338 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:29:20.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:20.339730  4346 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:20.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:20.339710  4347 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:20.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:20.340111  4349 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:20.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.341356  4338 server_base.cc:1061] running on GCE node
18:29:20.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.341974  4338 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:29:20.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.343258  4338 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:29:20.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.344447  4338 hybrid_clock.cc:648] HybridClock initialized: now 1783535360344387 us; error 58 us; skew 500 ppm
18:29:20.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.344815  4338 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:29:20.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.346907  4338 webserver.cc:534] Webserver started at http://127.4.40.189:37505/ using document root <none> and password file <none>
18:29:20.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.347566  4338 fs_manager.cc:362] Metadata directory not provided
18:29:20.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.347656  4338 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:29:20.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.347955  4338 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:29:20.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.350402  4338 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/master-1/data/instance:
18:29:20.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "fc3057f83b274f1b90772ae8607f285b"
18:29:20.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:29:20 on dist-test-slave-0d16"
18:29:20.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.351346  4338 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/master-1/wal/instance:
18:29:20.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "fc3057f83b274f1b90772ae8607f285b"
18:29:20.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:29:20 on dist-test-slave-0d16"
18:29:20.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.357622  4338 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.004s	sys 0.004s
18:29:20.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.361732  4355 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:29:20.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.363014  4336 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.40.189" port: 36729 } attempt: 4
18:29:20.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.363493  4338 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
18:29:20.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.363708  4338 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/master-1/data,/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/master-1/wal
18:29:20.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "fc3057f83b274f1b90772ae8607f285b"
18:29:20.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:29:20 on dist-test-slave-0d16"
18:29:20.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.363979  4338 fs_report.cc:389] FS layout report
18:29:20.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:29:20.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/master-1/wal
18:29:20.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/master-1/wal
18:29:20.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/master-1/data/data
18:29:20.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:29:20.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:29:20.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:29:20.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:29:20.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:29:20.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:29:20.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:29:20.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:29:20.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:29:20.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:29:20.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:29:20.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:20.365175  4336 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.40.189:36729: Network error: Client connection negotiation failed: client connection to 127.4.40.189:36729: connect: Connection refused (error 111)
18:29:20.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.394851  4338 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:29:20.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.397267  4338 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:29:20.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.397744  4338 kserver.cc:163] Server-wide thread pool size limit: 3276
18:29:20.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.421728  4338 rpc_server.cc:307] RPC server started. Bound to: 127.4.40.189:36729
18:29:20.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.422008  4407 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.40.189:36729 every 8 connection(s)
18:29:20.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.423609  4338 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/master-1/data/info.pb
18:29:20.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.428304  4408 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
18:29:20.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.429100  4258 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskRlQDJI/build/asan/bin/kudu as pid 4338
18:29:20.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.429252  4258 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/master-1/wal/instance
18:29:20.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.430230  4258 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskRlQDJI/build/asan/bin/kudu
18:29:20.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskRlQDJI/build/asan/bin/kudu
18:29:20.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/master-2/wal
18:29:20.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/master-2/data
18:29:20.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:29:20.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:29:20.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:29:20.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:29:20.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:29:20.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:29:20.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/master-2/logs
18:29:20.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/master-2/data/info.pb
18:29:20.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:29:20.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:29:20.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:29:20.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:29:20.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:29:20.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:29:20.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:29:20.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:29:20.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
18:29:20.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:29:20.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:29:20.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:29:20.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.40.188:40125
18:29:20.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.40.188
18:29:20.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:29:20.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.40.148:32775
18:29:20.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:29:20.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:29:20.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:29:20.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:29:20.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125
18:29:20.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:29:20.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33613/jwks.json with env {}
18:29:20.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.435091  4408 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.40.190" port: 39817 } has no permanent_uuid. Determining permanent_uuid...
18:29:20.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.449281  4408 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.40.189" port: 36729 } has no permanent_uuid. Determining permanent_uuid...
18:29:20.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.458945  4408 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.40.188" port: 40125 } has no permanent_uuid. Determining permanent_uuid...
18:29:20.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:20.460189  4356 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.40.188:40125: connect: Connection refused (error 111)
18:29:20.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:20.462123  4408 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.40.188:40125: Network error: Client connection negotiation failed: client connection to 127.4.40.188:40125: connect: Connection refused (error 111)
18:29:20.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.511461  4408 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.40.188" port: 40125 } attempt: 1
18:29:20.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:20.513633  4408 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.40.188:40125: Network error: Client connection negotiation failed: client connection to 127.4.40.188:40125: connect: Connection refused (error 111)
18:29:20.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.581915  4408 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.40.188" port: 40125 } attempt: 2
18:29:20.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:20.584009  4408 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.40.188:40125: Network error: Client connection negotiation failed: client connection to 127.4.40.188:40125: connect: Connection refused (error 111)
18:29:20.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.664436  4336 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.40.189" port: 36729 } attempt: 5
18:29:20.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.671211  4336 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.40.188" port: 40125 } has no permanent_uuid. Determining permanent_uuid...
18:29:20.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:20.673345  4336 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.40.188:40125: Network error: Client connection negotiation failed: client connection to 127.4.40.188:40125: connect: Connection refused (error 111)
18:29:20.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.675218  4408 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.40.188" port: 40125 } attempt: 3
18:29:20.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:20.677007  4408 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.40.188:40125: Network error: Client connection negotiation failed: client connection to 127.4.40.188:40125: connect: Connection refused (error 111)
18:29:20.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.724589  4336 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.40.188" port: 40125 } attempt: 1
18:29:20.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:20.726802  4336 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.40.188:40125: Network error: Client connection negotiation failed: client connection to 127.4.40.188:40125: connect: Connection refused (error 111)
18:29:20.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:20.772087  4410 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:29:20.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:20.772398  4410 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:29:20.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:20.772477  4410 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:29:20.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:20.780778  4410 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
18:29:20.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:20.780890  4410 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:29:20.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:20.780947  4410 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
18:29:20.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:20.781001  4410 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
18:29:20.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:20.781054  4410 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
18:29:20.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:20.781086  4410 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:33613/jwks.json
18:29:20.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.791376  4410 master_runner.cc:387] Master server non-default flags:
18:29:20.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:29:20.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.40.148:32775
18:29:20.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:29:20.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:29:20.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/master-2/data
18:29:20.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/master-2/wal
18:29:20.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:29:20.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125
18:29:20.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:29:20.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:29:20.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:29:20.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.40.188:40125
18:29:20.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:29:20.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:29:20.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:29:20.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33613/jwks.json
18:29:20.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:29:20.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:29:20.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/master-2/data/info.pb
18:29:20.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.40.188
18:29:20.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:29:20.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:29:20.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:29:20.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:29:20.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:29:20.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:29:20.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/master-2/logs
18:29:20.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:29:20.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:29:20.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:29:20.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
18:29:20.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:29:20.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:29:20.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:29:20.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:01:24 UTC on bdcb31816ec0
18:29:20.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16870
18:29:20.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
18:29:20.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.793473  4410 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:29:20.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.795043  4336 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.40.188" port: 40125 } attempt: 2
18:29:20.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.795878  4410 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:29:20.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:20.797184  4336 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.40.188:40125: Network error: Client connection negotiation failed: client connection to 127.4.40.188:40125: connect: Connection refused (error 111)
18:29:20.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:20.805126  4419 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:20.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:20.805207  4418 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:20.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:20.806623  4421 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:20.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.807518  4410 server_base.cc:1061] running on GCE node
18:29:20.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.808195  4410 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:29:20.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.809655  4410 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:29:20.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.810883  4410 hybrid_clock.cc:648] HybridClock initialized: now 1783535360810816 us; error 55 us; skew 500 ppm
18:29:20.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.811281  4410 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:29:20.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.813715  4410 webserver.cc:534] Webserver started at http://127.4.40.188:38817/ using document root <none> and password file <none>
18:29:20.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.814514  4410 fs_manager.cc:362] Metadata directory not provided
18:29:20.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.814654  4410 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:29:20.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.815065  4410 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:29:20.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.817541  4410 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/master-2/data/instance:
18:29:20.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "765edd5c23c74b1ebc0ea9420c19e5ed"
18:29:20.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:29:20 on dist-test-slave-0d16"
18:29:20.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.818423  4410 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/master-2/wal/instance:
18:29:20.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "765edd5c23c74b1ebc0ea9420c19e5ed"
18:29:20.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:29:20 on dist-test-slave-0d16"
18:29:20.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.820240  4408 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.40.188" port: 40125 } attempt: 4
18:29:20.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:20.822400  4408 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.40.188:40125: Network error: Client connection negotiation failed: client connection to 127.4.40.188:40125: connect: Connection refused (error 111)
18:29:20.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.824674  4410 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.004s	sys 0.004s
18:29:20.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.828083  4427 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:29:20.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.829473  4410 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
18:29:20.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.829679  4410 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/master-2/data,/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/master-2/wal
18:29:20.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "765edd5c23c74b1ebc0ea9420c19e5ed"
18:29:20.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:29:20 on dist-test-slave-0d16"
18:29:20.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.829955  4410 fs_report.cc:389] FS layout report
18:29:20.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:29:20.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/master-2/wal
18:29:20.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/master-2/wal
18:29:20.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/master-2/data/data
18:29:20.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:29:20.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:29:20.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:29:20.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:29:20.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:29:20.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:29:20.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:29:20.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:29:20.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:29:20.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:29:20.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:29:20.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.857718  4410 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:29:20.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.858701  4410 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:29:20.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.859068  4410 kserver.cc:163] Server-wide thread pool size limit: 3276
18:29:20.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.879709  4410 rpc_server.cc:307] RPC server started. Bound to: 127.4.40.188:40125
18:29:20.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.879726  4478 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.40.188:40125 every 8 connection(s)
18:29:20.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.881366  4410 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/master-2/data/info.pb
18:29:20.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.885614  4479 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
18:29:20.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.888797  4258 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskRlQDJI/build/asan/bin/kudu as pid 4410
18:29:20.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.888947  4258 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/master-2/wal/instance
18:29:20.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.891561  4479 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.40.190" port: 39817 } has no permanent_uuid. Determining permanent_uuid...
18:29:20.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.903399  4336 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.40.188" port: 40125 } attempt: 3
18:29:20.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.906281  4479 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.40.189" port: 36729 } has no permanent_uuid. Determining permanent_uuid...
18:29:20.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.916687  4479 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.40.188" port: 40125 } has no permanent_uuid. Determining permanent_uuid...
18:29:20.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.920295  4336 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e9a0c1466df2474b9dbf1cbb1db88b6b: Bootstrap starting.
18:29:20.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.924059  4336 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e9a0c1466df2474b9dbf1cbb1db88b6b: Neither blocks nor log segments found. Creating new log.
18:29:20.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.925621  4336 log.cc:826] T 00000000000000000000000000000000 P e9a0c1466df2474b9dbf1cbb1db88b6b: Log is configured to *not* fsync() on all Append() calls
18:29:20.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.927136  4479 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 765edd5c23c74b1ebc0ea9420c19e5ed: Bootstrap starting.
18:29:20.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.928643  4336 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e9a0c1466df2474b9dbf1cbb1db88b6b: No bootstrap required, opened a new log
18:29:20.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.930564  4479 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 765edd5c23c74b1ebc0ea9420c19e5ed: Neither blocks nor log segments found. Creating new log.
18:29:20.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.931658  4479 log.cc:826] T 00000000000000000000000000000000 P 765edd5c23c74b1ebc0ea9420c19e5ed: Log is configured to *not* fsync() on all Append() calls
18:29:20.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.934149  4479 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 765edd5c23c74b1ebc0ea9420c19e5ed: No bootstrap required, opened a new log
18:29:20.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.934756  4336 raft_consensus.cc:359] T 00000000000000000000000000000000 P e9a0c1466df2474b9dbf1cbb1db88b6b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a0c1466df2474b9dbf1cbb1db88b6b" member_type: VOTER last_known_addr { host: "127.4.40.190" port: 39817 } } peers { permanent_uuid: "fc3057f83b274f1b90772ae8607f285b" member_type: VOTER last_known_addr { host: "127.4.40.189" port: 36729 } } peers { permanent_uuid: "765edd5c23c74b1ebc0ea9420c19e5ed" member_type: VOTER last_known_addr { host: "127.4.40.188" port: 40125 } }
18:29:20.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.935038  4336 raft_consensus.cc:385] T 00000000000000000000000000000000 P e9a0c1466df2474b9dbf1cbb1db88b6b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:29:20.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.935158  4336 raft_consensus.cc:740] T 00000000000000000000000000000000 P e9a0c1466df2474b9dbf1cbb1db88b6b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9a0c1466df2474b9dbf1cbb1db88b6b, State: Initialized, Role: FOLLOWER
18:29:20.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.935814  4336 consensus_queue.cc:260] T 00000000000000000000000000000000 P e9a0c1466df2474b9dbf1cbb1db88b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a0c1466df2474b9dbf1cbb1db88b6b" member_type: VOTER last_known_addr { host: "127.4.40.190" port: 39817 } } peers { permanent_uuid: "fc3057f83b274f1b90772ae8607f285b" member_type: VOTER last_known_addr { host: "127.4.40.189" port: 36729 } } peers { permanent_uuid: "765edd5c23c74b1ebc0ea9420c19e5ed" member_type: VOTER last_known_addr { host: "127.4.40.188" port: 40125 } }
18:29:20.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.937924  4489 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9a0c1466df2474b9dbf1cbb1db88b6b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a0c1466df2474b9dbf1cbb1db88b6b" member_type: VOTER last_known_addr { host: "127.4.40.190" port: 39817 } } peers { permanent_uuid: "fc3057f83b274f1b90772ae8607f285b" member_type: VOTER last_known_addr { host: "127.4.40.189" port: 36729 } } peers { permanent_uuid: "765edd5c23c74b1ebc0ea9420c19e5ed" member_type: VOTER last_known_addr { host: "127.4.40.188" port: 40125 } } }
18:29:20.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.938192  4336 sys_catalog.cc:565] T 00000000000000000000000000000000 P e9a0c1466df2474b9dbf1cbb1db88b6b [sys.catalog]: configured and running, proceeding with master startup.
18:29:20.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.938467  4489 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9a0c1466df2474b9dbf1cbb1db88b6b [sys.catalog]: This master's current role is: FOLLOWER
18:29:20.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.940214  4479 raft_consensus.cc:359] T 00000000000000000000000000000000 P 765edd5c23c74b1ebc0ea9420c19e5ed [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a0c1466df2474b9dbf1cbb1db88b6b" member_type: VOTER last_known_addr { host: "127.4.40.190" port: 39817 } } peers { permanent_uuid: "fc3057f83b274f1b90772ae8607f285b" member_type: VOTER last_known_addr { host: "127.4.40.189" port: 36729 } } peers { permanent_uuid: "765edd5c23c74b1ebc0ea9420c19e5ed" member_type: VOTER last_known_addr { host: "127.4.40.188" port: 40125 } }
18:29:20.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.940574  4479 raft_consensus.cc:385] T 00000000000000000000000000000000 P 765edd5c23c74b1ebc0ea9420c19e5ed [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:29:20.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.940713  4479 raft_consensus.cc:740] T 00000000000000000000000000000000 P 765edd5c23c74b1ebc0ea9420c19e5ed [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 765edd5c23c74b1ebc0ea9420c19e5ed, State: Initialized, Role: FOLLOWER
18:29:20.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.941383  4479 consensus_queue.cc:260] T 00000000000000000000000000000000 P 765edd5c23c74b1ebc0ea9420c19e5ed [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a0c1466df2474b9dbf1cbb1db88b6b" member_type: VOTER last_known_addr { host: "127.4.40.190" port: 39817 } } peers { permanent_uuid: "fc3057f83b274f1b90772ae8607f285b" member_type: VOTER last_known_addr { host: "127.4.40.189" port: 36729 } } peers { permanent_uuid: "765edd5c23c74b1ebc0ea9420c19e5ed" member_type: VOTER last_known_addr { host: "127.4.40.188" port: 40125 } }
18:29:20.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.942690  4494 sys_catalog.cc:455] T 00000000000000000000000000000000 P 765edd5c23c74b1ebc0ea9420c19e5ed [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a0c1466df2474b9dbf1cbb1db88b6b" member_type: VOTER last_known_addr { host: "127.4.40.190" port: 39817 } } peers { permanent_uuid: "fc3057f83b274f1b90772ae8607f285b" member_type: VOTER last_known_addr { host: "127.4.40.189" port: 36729 } } peers { permanent_uuid: "765edd5c23c74b1ebc0ea9420c19e5ed" member_type: VOTER last_known_addr { host: "127.4.40.188" port: 40125 } } }
18:29:20.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.943301  4494 sys_catalog.cc:458] T 00000000000000000000000000000000 P 765edd5c23c74b1ebc0ea9420c19e5ed [sys.catalog]: This master's current role is: FOLLOWER
18:29:20.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.943818  4479 sys_catalog.cc:565] T 00000000000000000000000000000000 P 765edd5c23c74b1ebc0ea9420c19e5ed [sys.catalog]: configured and running, proceeding with master startup.
18:29:20.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:20.952853  4289 tablet.cc:2406] T 00000000000000000000000000000000 P e9a0c1466df2474b9dbf1cbb1db88b6b: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:29:20.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:20.959810  4506 catalog_manager.cc:1593] T 00000000000000000000000000000000 P e9a0c1466df2474b9dbf1cbb1db88b6b: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
18:29:20.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:20.959954  4506 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
18:29:20.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.953791  4269 master_runner.cc:187] Error getting master registration for 127.4.40.189:36729: OK, instance_id { permanent_uuid: "fc3057f83b274f1b90772ae8607f285b" instance_seqno: 1783535360414418 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
18:29:20.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.962406  4269 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
18:29:20.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:20.965271  4513 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 765edd5c23c74b1ebc0ea9420c19e5ed: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
18:29:20.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:20.965572  4513 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
18:29:20.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.964408  4410 master_runner.cc:187] Error getting master registration for 127.4.40.189:36729: OK, instance_id { permanent_uuid: "fc3057f83b274f1b90772ae8607f285b" instance_seqno: 1783535360414418 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
18:29:20.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:20.971580  4410 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
18:29:21.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.083137  4489 raft_consensus.cc:493] T 00000000000000000000000000000000 P e9a0c1466df2474b9dbf1cbb1db88b6b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:29:21.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.083469  4489 raft_consensus.cc:515] T 00000000000000000000000000000000 P e9a0c1466df2474b9dbf1cbb1db88b6b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a0c1466df2474b9dbf1cbb1db88b6b" member_type: VOTER last_known_addr { host: "127.4.40.190" port: 39817 } } peers { permanent_uuid: "fc3057f83b274f1b90772ae8607f285b" member_type: VOTER last_known_addr { host: "127.4.40.189" port: 36729 } } peers { permanent_uuid: "765edd5c23c74b1ebc0ea9420c19e5ed" member_type: VOTER last_known_addr { host: "127.4.40.188" port: 40125 } }
18:29:21.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.085391  4489 leader_election.cc:290] T 00000000000000000000000000000000 P e9a0c1466df2474b9dbf1cbb1db88b6b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc3057f83b274f1b90772ae8607f285b (127.4.40.189:36729), 765edd5c23c74b1ebc0ea9420c19e5ed (127.4.40.188:40125)
18:29:21.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.086481  4454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e9a0c1466df2474b9dbf1cbb1db88b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765edd5c23c74b1ebc0ea9420c19e5ed" is_pre_election: true
18:29:21.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.087069  4454 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 765edd5c23c74b1ebc0ea9420c19e5ed [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9a0c1466df2474b9dbf1cbb1db88b6b in term 0.
18:29:21.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.087697  4284 leader_election.cc:304] T 00000000000000000000000000000000 P e9a0c1466df2474b9dbf1cbb1db88b6b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765edd5c23c74b1ebc0ea9420c19e5ed, e9a0c1466df2474b9dbf1cbb1db88b6b; no voters: 
18:29:21.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.088320  4489 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e9a0c1466df2474b9dbf1cbb1db88b6b [term 0 FOLLOWER]: Leader pre-election won for term 1
18:29:21.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.088482  4489 raft_consensus.cc:493] T 00000000000000000000000000000000 P e9a0c1466df2474b9dbf1cbb1db88b6b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
18:29:21.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.088615  4489 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e9a0c1466df2474b9dbf1cbb1db88b6b [term 0 FOLLOWER]: Advancing to term 1
18:29:21.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.092126  4489 raft_consensus.cc:515] T 00000000000000000000000000000000 P e9a0c1466df2474b9dbf1cbb1db88b6b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a0c1466df2474b9dbf1cbb1db88b6b" member_type: VOTER last_known_addr { host: "127.4.40.190" port: 39817 } } peers { permanent_uuid: "fc3057f83b274f1b90772ae8607f285b" member_type: VOTER last_known_addr { host: "127.4.40.189" port: 36729 } } peers { permanent_uuid: "765edd5c23c74b1ebc0ea9420c19e5ed" member_type: VOTER last_known_addr { host: "127.4.40.188" port: 40125 } }
18:29:21.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.094210  4489 leader_election.cc:290] T 00000000000000000000000000000000 P e9a0c1466df2474b9dbf1cbb1db88b6b [CANDIDATE]: Term 1 election: Requested vote from peers fc3057f83b274f1b90772ae8607f285b (127.4.40.189:36729), 765edd5c23c74b1ebc0ea9420c19e5ed (127.4.40.188:40125)
18:29:21.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.094678  4454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e9a0c1466df2474b9dbf1cbb1db88b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "765edd5c23c74b1ebc0ea9420c19e5ed"
18:29:21.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.094885  4454 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 765edd5c23c74b1ebc0ea9420c19e5ed [term 0 FOLLOWER]: Advancing to term 1
18:29:21.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.098367  4454 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 765edd5c23c74b1ebc0ea9420c19e5ed [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9a0c1466df2474b9dbf1cbb1db88b6b in term 1.
18:29:21.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.099052  4284 leader_election.cc:304] T 00000000000000000000000000000000 P e9a0c1466df2474b9dbf1cbb1db88b6b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765edd5c23c74b1ebc0ea9420c19e5ed, e9a0c1466df2474b9dbf1cbb1db88b6b; no voters: 
18:29:21.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.099440  4489 raft_consensus.cc:2804] T 00000000000000000000000000000000 P e9a0c1466df2474b9dbf1cbb1db88b6b [term 1 FOLLOWER]: Leader election won for term 1
18:29:21.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.107805  4489 raft_consensus.cc:697] T 00000000000000000000000000000000 P e9a0c1466df2474b9dbf1cbb1db88b6b [term 1 LEADER]: Becoming Leader. State: Replica: e9a0c1466df2474b9dbf1cbb1db88b6b, State: Running, Role: LEADER
18:29:21.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.108701  4489 consensus_queue.cc:237] T 00000000000000000000000000000000 P e9a0c1466df2474b9dbf1cbb1db88b6b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a0c1466df2474b9dbf1cbb1db88b6b" member_type: VOTER last_known_addr { host: "127.4.40.190" port: 39817 } } peers { permanent_uuid: "fc3057f83b274f1b90772ae8607f285b" member_type: VOTER last_known_addr { host: "127.4.40.189" port: 36729 } } peers { permanent_uuid: "765edd5c23c74b1ebc0ea9420c19e5ed" member_type: VOTER last_known_addr { host: "127.4.40.188" port: 40125 } }
18:29:21.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:21.111280  4433 tablet.cc:2406] T 00000000000000000000000000000000 P 765edd5c23c74b1ebc0ea9420c19e5ed: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:29:21.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.115774  4515 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9a0c1466df2474b9dbf1cbb1db88b6b [sys.catalog]: SysCatalogTable state changed. Reason: New leader e9a0c1466df2474b9dbf1cbb1db88b6b. Latest consensus state: current_term: 1 leader_uuid: "e9a0c1466df2474b9dbf1cbb1db88b6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a0c1466df2474b9dbf1cbb1db88b6b" member_type: VOTER last_known_addr { host: "127.4.40.190" port: 39817 } } peers { permanent_uuid: "fc3057f83b274f1b90772ae8607f285b" member_type: VOTER last_known_addr { host: "127.4.40.189" port: 36729 } } peers { permanent_uuid: "765edd5c23c74b1ebc0ea9420c19e5ed" member_type: VOTER last_known_addr { host: "127.4.40.188" port: 40125 } } }
18:29:21.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.116317  4515 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9a0c1466df2474b9dbf1cbb1db88b6b [sys.catalog]: This master's current role is: LEADER
18:29:21.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.121611  4408 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.40.188" port: 40125 } attempt: 5
18:29:21.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.123389  4517 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
18:29:21.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.126377  4517 catalog_manager.cc:1519] Initializing Kudu cluster ID...
18:29:21.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.139457  4408 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc3057f83b274f1b90772ae8607f285b: Bootstrap starting.
18:29:21.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.147323  4408 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P fc3057f83b274f1b90772ae8607f285b: Neither blocks nor log segments found. Creating new log.
18:29:21.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.149974  4408 log.cc:826] T 00000000000000000000000000000000 P fc3057f83b274f1b90772ae8607f285b: Log is configured to *not* fsync() on all Append() calls
18:29:21.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.166188  4408 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P fc3057f83b274f1b90772ae8607f285b: No bootstrap required, opened a new log
18:29:21.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.174065  4454 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 765edd5c23c74b1ebc0ea9420c19e5ed [term 1 FOLLOWER]: Refusing update from remote peer e9a0c1466df2474b9dbf1cbb1db88b6b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
18:29:21.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.175607  4515 consensus_queue.cc:1048] T 00000000000000000000000000000000 P e9a0c1466df2474b9dbf1cbb1db88b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "765edd5c23c74b1ebc0ea9420c19e5ed" member_type: VOTER last_known_addr { host: "127.4.40.188" port: 40125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:29:21.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.190474  4408 raft_consensus.cc:359] T 00000000000000000000000000000000 P fc3057f83b274f1b90772ae8607f285b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a0c1466df2474b9dbf1cbb1db88b6b" member_type: VOTER last_known_addr { host: "127.4.40.190" port: 39817 } } peers { permanent_uuid: "fc3057f83b274f1b90772ae8607f285b" member_type: VOTER last_known_addr { host: "127.4.40.189" port: 36729 } } peers { permanent_uuid: "765edd5c23c74b1ebc0ea9420c19e5ed" member_type: VOTER last_known_addr { host: "127.4.40.188" port: 40125 } }
18:29:21.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.190830  4408 raft_consensus.cc:385] T 00000000000000000000000000000000 P fc3057f83b274f1b90772ae8607f285b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:29:21.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.190945  4408 raft_consensus.cc:740] T 00000000000000000000000000000000 P fc3057f83b274f1b90772ae8607f285b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc3057f83b274f1b90772ae8607f285b, State: Initialized, Role: FOLLOWER
18:29:21.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.191680  4408 consensus_queue.cc:260] T 00000000000000000000000000000000 P fc3057f83b274f1b90772ae8607f285b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a0c1466df2474b9dbf1cbb1db88b6b" member_type: VOTER last_known_addr { host: "127.4.40.190" port: 39817 } } peers { permanent_uuid: "fc3057f83b274f1b90772ae8607f285b" member_type: VOTER last_known_addr { host: "127.4.40.189" port: 36729 } } peers { permanent_uuid: "765edd5c23c74b1ebc0ea9420c19e5ed" member_type: VOTER last_known_addr { host: "127.4.40.188" port: 40125 } }
18:29:21.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.194931  4494 sys_catalog.cc:455] T 00000000000000000000000000000000 P 765edd5c23c74b1ebc0ea9420c19e5ed [sys.catalog]: SysCatalogTable state changed. Reason: New leader e9a0c1466df2474b9dbf1cbb1db88b6b. Latest consensus state: current_term: 1 leader_uuid: "e9a0c1466df2474b9dbf1cbb1db88b6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a0c1466df2474b9dbf1cbb1db88b6b" member_type: VOTER last_known_addr { host: "127.4.40.190" port: 39817 } } peers { permanent_uuid: "fc3057f83b274f1b90772ae8607f285b" member_type: VOTER last_known_addr { host: "127.4.40.189" port: 36729 } } peers { permanent_uuid: "765edd5c23c74b1ebc0ea9420c19e5ed" member_type: VOTER last_known_addr { host: "127.4.40.188" port: 40125 } } }
18:29:21.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.195245  4494 sys_catalog.cc:458] T 00000000000000000000000000000000 P 765edd5c23c74b1ebc0ea9420c19e5ed [sys.catalog]: This master's current role is: FOLLOWER
18:29:21.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.196045  4518 mvcc.cc:204] Tried to move back new op lower bound from 7305360839348203520 to 7305360839106404352. Current Snapshot: MvccSnapshot[applied={T|T < 7305360839348203520}]
18:29:21.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.198817  4520 mvcc.cc:204] Tried to move back new op lower bound from 7305360839348203520 to 7305360839106404352. Current Snapshot: MvccSnapshot[applied={T|T < 7305360839348203520}]
18:29:21.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.203073  4489 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9a0c1466df2474b9dbf1cbb1db88b6b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e9a0c1466df2474b9dbf1cbb1db88b6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a0c1466df2474b9dbf1cbb1db88b6b" member_type: VOTER last_known_addr { host: "127.4.40.190" port: 39817 } } peers { permanent_uuid: "fc3057f83b274f1b90772ae8607f285b" member_type: VOTER last_known_addr { host: "127.4.40.189" port: 36729 } } peers { permanent_uuid: "765edd5c23c74b1ebc0ea9420c19e5ed" member_type: VOTER last_known_addr { host: "127.4.40.188" port: 40125 } } }
18:29:21.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.203397  4489 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9a0c1466df2474b9dbf1cbb1db88b6b [sys.catalog]: This master's current role is: LEADER
18:29:21.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.205098  4494 sys_catalog.cc:455] T 00000000000000000000000000000000 P 765edd5c23c74b1ebc0ea9420c19e5ed [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e9a0c1466df2474b9dbf1cbb1db88b6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a0c1466df2474b9dbf1cbb1db88b6b" member_type: VOTER last_known_addr { host: "127.4.40.190" port: 39817 } } peers { permanent_uuid: "fc3057f83b274f1b90772ae8607f285b" member_type: VOTER last_known_addr { host: "127.4.40.189" port: 36729 } } peers { permanent_uuid: "765edd5c23c74b1ebc0ea9420c19e5ed" member_type: VOTER last_known_addr { host: "127.4.40.188" port: 40125 } } }
18:29:21.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.205322  4494 sys_catalog.cc:458] T 00000000000000000000000000000000 P 765edd5c23c74b1ebc0ea9420c19e5ed [sys.catalog]: This master's current role is: FOLLOWER
18:29:21.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.205731  4517 catalog_manager.cc:1382] Generated new cluster ID: 1337635f0c3d47ffa9b68d952144b4fb
18:29:21.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.205855  4517 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
18:29:21.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.207247  4522 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc3057f83b274f1b90772ae8607f285b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a0c1466df2474b9dbf1cbb1db88b6b" member_type: VOTER last_known_addr { host: "127.4.40.190" port: 39817 } } peers { permanent_uuid: "fc3057f83b274f1b90772ae8607f285b" member_type: VOTER last_known_addr { host: "127.4.40.189" port: 36729 } } peers { permanent_uuid: "765edd5c23c74b1ebc0ea9420c19e5ed" member_type: VOTER last_known_addr { host: "127.4.40.188" port: 40125 } } }
18:29:21.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.207547  4522 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc3057f83b274f1b90772ae8607f285b [sys.catalog]: This master's current role is: FOLLOWER
18:29:21.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.209398  4408 sys_catalog.cc:565] T 00000000000000000000000000000000 P fc3057f83b274f1b90772ae8607f285b [sys.catalog]: configured and running, proceeding with master startup.
18:29:21.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.209828  4380 raft_consensus.cc:3060] T 00000000000000000000000000000000 P fc3057f83b274f1b90772ae8607f285b [term 0 FOLLOWER]: Advancing to term 1
18:29:21.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.212703  4382 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e9a0c1466df2474b9dbf1cbb1db88b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc3057f83b274f1b90772ae8607f285b" is_pre_election: true
18:29:21.215 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.214331  4381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e9a0c1466df2474b9dbf1cbb1db88b6b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc3057f83b274f1b90772ae8607f285b"
18:29:21.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.222075  4380 raft_consensus.cc:1275] T 00000000000000000000000000000000 P fc3057f83b274f1b90772ae8607f285b [term 1 FOLLOWER]: Refusing update from remote peer e9a0c1466df2474b9dbf1cbb1db88b6b: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
18:29:21.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.225522  4515 consensus_queue.cc:1048] T 00000000000000000000000000000000 P e9a0c1466df2474b9dbf1cbb1db88b6b [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc3057f83b274f1b90772ae8607f285b" member_type: VOTER last_known_addr { host: "127.4.40.189" port: 36729 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:29:21.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.262821  4522 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc3057f83b274f1b90772ae8607f285b [sys.catalog]: SysCatalogTable state changed. Reason: New leader e9a0c1466df2474b9dbf1cbb1db88b6b. Latest consensus state: current_term: 1 leader_uuid: "e9a0c1466df2474b9dbf1cbb1db88b6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a0c1466df2474b9dbf1cbb1db88b6b" member_type: VOTER last_known_addr { host: "127.4.40.190" port: 39817 } } peers { permanent_uuid: "fc3057f83b274f1b90772ae8607f285b" member_type: VOTER last_known_addr { host: "127.4.40.189" port: 36729 } } peers { permanent_uuid: "765edd5c23c74b1ebc0ea9420c19e5ed" member_type: VOTER last_known_addr { host: "127.4.40.188" port: 40125 } } }
18:29:21.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.263084  4522 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc3057f83b274f1b90772ae8607f285b [sys.catalog]: This master's current role is: FOLLOWER
18:29:21.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.263545  4528 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc3057f83b274f1b90772ae8607f285b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e9a0c1466df2474b9dbf1cbb1db88b6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a0c1466df2474b9dbf1cbb1db88b6b" member_type: VOTER last_known_addr { host: "127.4.40.190" port: 39817 } } peers { permanent_uuid: "fc3057f83b274f1b90772ae8607f285b" member_type: VOTER last_known_addr { host: "127.4.40.189" port: 36729 } } peers { permanent_uuid: "765edd5c23c74b1ebc0ea9420c19e5ed" member_type: VOTER last_known_addr { host: "127.4.40.188" port: 40125 } } }
18:29:21.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.264091  4528 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc3057f83b274f1b90772ae8607f285b [sys.catalog]: This master's current role is: FOLLOWER
18:29:21.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.286726  4515 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9a0c1466df2474b9dbf1cbb1db88b6b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e9a0c1466df2474b9dbf1cbb1db88b6b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a0c1466df2474b9dbf1cbb1db88b6b" member_type: VOTER last_known_addr { host: "127.4.40.190" port: 39817 } } peers { permanent_uuid: "fc3057f83b274f1b90772ae8607f285b" member_type: VOTER last_known_addr { host: "127.4.40.189" port: 36729 } } peers { permanent_uuid: "765edd5c23c74b1ebc0ea9420c19e5ed" member_type: VOTER last_known_addr { host: "127.4.40.188" port: 40125 } } }
18:29:21.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.286998  4515 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9a0c1466df2474b9dbf1cbb1db88b6b [sys.catalog]: This master's current role is: LEADER
18:29:21.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.303020  4517 catalog_manager.cc:1405] Generated new certificate authority record
18:29:21.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.305239  4517 catalog_manager.cc:1539] Loading token signing keys...
18:29:21.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.343504  4517 catalog_manager.cc:6069] T 00000000000000000000000000000000 P e9a0c1466df2474b9dbf1cbb1db88b6b: Generated new TSK 0
18:29:21.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.345185  4517 catalog_manager.cc:1549] Initializing in-progress tserver states...
18:29:21.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.364060  4539 catalog_manager.cc:1294] Loaded cluster ID: 1337635f0c3d47ffa9b68d952144b4fb
18:29:21.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.364555  4539 catalog_manager.cc:1587] T 00000000000000000000000000000000 P fc3057f83b274f1b90772ae8607f285b: loading cluster ID for follower catalog manager: success
18:29:21.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.375836  4539 catalog_manager.cc:1609] T 00000000000000000000000000000000 P fc3057f83b274f1b90772ae8607f285b: acquiring CA information for follower catalog manager: success
18:29:21.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.377579  4258 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskRlQDJI/build/asan/bin/kudu
18:29:21.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskRlQDJI/build/asan/bin/kudu
18:29:21.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/ts-0/wal
18:29:21.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/ts-0/data
18:29:21.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:29:21.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:29:21.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:29:21.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:29:21.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:29:21.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:29:21.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/ts-0/logs
18:29:21.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/ts-0/data/info.pb
18:29:21.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:29:21.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:29:21.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:29:21.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:29:21.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:29:21.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:29:21.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:29:21.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:29:21.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
18:29:21.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:29:21.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.40.129:0
18:29:21.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.4.40.129
18:29:21.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.40.129
18:29:21.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:29:21.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125
18:29:21.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.40.148:32775
18:29:21.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:29:21.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:29:21.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
18:29:21.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.379165  4539 catalog_manager.cc:1637] T 00000000000000000000000000000000 P fc3057f83b274f1b90772ae8607f285b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
18:29:21.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:21.787012  4541 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:29:21.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:21.787315  4541 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:29:21.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:21.787398  4541 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:29:21.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:21.795712  4541 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:29:21.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:21.795882  4541 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.40.129
18:29:21.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.806327  4541 tablet_server_runner.cc:78] Tablet server non-default flags:
18:29:21.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:29:21.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.40.148:32775
18:29:21.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:29:21.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:29:21.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/ts-0/data
18:29:21.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/ts-0/wal
18:29:21.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:29:21.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:29:21.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.40.129:0
18:29:21.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:29:21.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:29:21.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:29:21.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/ts-0/data/info.pb
18:29:21.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.40.129
18:29:21.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:29:21.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125
18:29:21.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:29:21.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:29:21.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:29:21.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:29:21.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:29:21.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.4.40.129
18:29:21.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/ts-0/logs
18:29:21.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:29:21.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:29:21.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:29:21.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
18:29:21.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:29:21.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:29:21.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:29:21.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:01:24 UTC on bdcb31816ec0
18:29:21.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16870
18:29:21.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
18:29:21.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.808259  4541 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:29:21.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.810635  4541 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:29:21.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:21.821101  4546 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:21.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:21.821661  4547 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:21.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:21.822400  4549 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:21.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.823060  4541 server_base.cc:1061] running on GCE node
18:29:21.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.823762  4541 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:29:21.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.825018  4541 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:29:21.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.826426  4541 hybrid_clock.cc:648] HybridClock initialized: now 1783535361826317 us; error 100 us; skew 500 ppm
18:29:21.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.826951  4541 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:29:21.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.829638  4541 webserver.cc:534] Webserver started at http://127.4.40.129:33145/ using document root <none> and password file <none>
18:29:21.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.830624  4541 fs_manager.cc:362] Metadata directory not provided
18:29:21.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.830750  4541 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:29:21.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.831146  4541 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:29:21.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.834410  4541 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/ts-0/data/instance:
18:29:21.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "4a46d44cd1bf40519816989ced7df794"
18:29:21.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:29:21 on dist-test-slave-0d16"
18:29:21.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.835403  4541 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/ts-0/wal/instance:
18:29:21.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "4a46d44cd1bf40519816989ced7df794"
18:29:21.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:29:21 on dist-test-slave-0d16"
18:29:21.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.842226  4541 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.004s	sys 0.004s
18:29:21.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.846689  4555 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:29:21.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.848296  4541 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
18:29:21.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.848453  4541 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/ts-0/data,/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/ts-0/wal
18:29:21.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "4a46d44cd1bf40519816989ced7df794"
18:29:21.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:29:21 on dist-test-slave-0d16"
18:29:21.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.848774  4541 fs_report.cc:389] FS layout report
18:29:21.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:29:21.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/ts-0/wal
18:29:21.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/ts-0/wal
18:29:21.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/ts-0/data/data
18:29:21.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:29:21.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:29:21.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:29:21.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:29:21.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:29:21.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:29:21.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:29:21.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:29:21.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:29:21.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:29:21.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:29:21.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.877239  4541 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:29:21.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.878196  4541 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:29:21.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.878537  4541 kserver.cc:163] Server-wide thread pool size limit: 3276
18:29:21.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.879750  4541 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
18:29:21.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.881925  4541 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
18:29:21.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.882036  4541 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
18:29:21.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.882131  4541 ts_tablet_manager.cc:616] Registered 0 tablets
18:29:21.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.882220  4541 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
18:29:21.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.918967  4541 rpc_server.cc:307] RPC server started. Bound to: 127.4.40.129:44141
18:29:21.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.919016  4668 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.40.129:44141 every 8 connection(s)
18:29:21.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.920480  4541 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/ts-0/data/info.pb
18:29:21.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.930287  4258 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskRlQDJI/build/asan/bin/kudu as pid 4541
18:29:21.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.930517  4258 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/ts-0/wal/instance
18:29:21.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.935621  4258 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskRlQDJI/build/asan/bin/kudu
18:29:21.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskRlQDJI/build/asan/bin/kudu
18:29:21.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/ts-1/wal
18:29:21.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/ts-1/data
18:29:21.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:29:21.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:29:21.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:29:21.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:29:21.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:29:21.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:29:21.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/ts-1/logs
18:29:21.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/ts-1/data/info.pb
18:29:21.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:29:21.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:29:21.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:29:21.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:29:21.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:29:21.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:29:21.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:29:21.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:29:21.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
18:29:21.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:29:21.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.40.130:0
18:29:21.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.4.40.130
18:29:21.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.40.130
18:29:21.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:29:21.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125
18:29:21.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.40.148:32775
18:29:21.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:29:21.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:29:21.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
18:29:21.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.937526  4670 heartbeater.cc:344] Connected to a master server at 127.4.40.188:40125
18:29:21.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.937552  4669 heartbeater.cc:344] Connected to a master server at 127.4.40.190:39817
18:29:21.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.938019  4670 heartbeater.cc:461] Registering TS with master...
18:29:21.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.938019  4669 heartbeater.cc:461] Registering TS with master...
18:29:21.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.939284  4670 heartbeater.cc:507] Master 127.4.40.188:40125 requested a full tablet report, sending...
18:29:21.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.940519  4671 heartbeater.cc:344] Connected to a master server at 127.4.40.189:36729
18:29:21.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.940685  4671 heartbeater.cc:461] Registering TS with master...
18:29:21.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.941089  4671 heartbeater.cc:507] Master 127.4.40.189:36729 requested a full tablet report, sending...
18:29:21.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.941390  4669 heartbeater.cc:507] Master 127.4.40.190:39817 requested a full tablet report, sending...
18:29:21.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.942338  4444 ts_manager.cc:194] Registered new tserver with Master: 4a46d44cd1bf40519816989ced7df794 (127.4.40.129:44141)
18:29:21.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.943797  4372 ts_manager.cc:194] Registered new tserver with Master: 4a46d44cd1bf40519816989ced7df794 (127.4.40.129:44141)
18:29:21.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.945250  4301 ts_manager.cc:194] Registered new tserver with Master: 4a46d44cd1bf40519816989ced7df794 (127.4.40.129:44141)
18:29:21.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.946816  4301 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.4.40.129:35323
18:29:21.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.967542  4513 catalog_manager.cc:1294] Loaded cluster ID: 1337635f0c3d47ffa9b68d952144b4fb
18:29:21.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.967643  4513 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 765edd5c23c74b1ebc0ea9420c19e5ed: loading cluster ID for follower catalog manager: success
18:29:21.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.970513  4513 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 765edd5c23c74b1ebc0ea9420c19e5ed: acquiring CA information for follower catalog manager: success
18:29:21.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:21.972424  4513 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 765edd5c23c74b1ebc0ea9420c19e5ed: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
18:29:22.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:22.300707  4679 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:29:22.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:22.301020  4679 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:29:22.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:22.301100  4679 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:29:22.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:22.309314  4679 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:29:22.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:22.309473  4679 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.40.130
18:29:22.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.319337  4679 tablet_server_runner.cc:78] Tablet server non-default flags:
18:29:22.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:29:22.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.40.148:32775
18:29:22.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:29:22.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:29:22.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/ts-1/data
18:29:22.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/ts-1/wal
18:29:22.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:29:22.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:29:22.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.40.130:0
18:29:22.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:29:22.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:29:22.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:29:22.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/ts-1/data/info.pb
18:29:22.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.40.130
18:29:22.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:29:22.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125
18:29:22.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:29:22.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:29:22.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:29:22.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:29:22.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:29:22.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.4.40.130
18:29:22.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/ts-1/logs
18:29:22.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:29:22.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:29:22.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:29:22.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
18:29:22.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:29:22.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:29:22.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:29:22.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:01:24 UTC on bdcb31816ec0
18:29:22.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16870
18:29:22.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
18:29:22.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.321316  4679 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:29:22.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.323742  4679 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:29:22.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:22.334743  4684 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:22.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:22.335563  4685 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:22.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:22.337198  4688 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:22.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.337219  4679 server_base.cc:1061] running on GCE node
18:29:22.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.337791  4679 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:29:22.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.338605  4679 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:29:22.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.339805  4679 hybrid_clock.cc:648] HybridClock initialized: now 1783535362339643 us; error 149 us; skew 500 ppm
18:29:22.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.340209  4679 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:29:22.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.342489  4679 webserver.cc:534] Webserver started at http://127.4.40.130:35197/ using document root <none> and password file <none>
18:29:22.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.343272  4679 fs_manager.cc:362] Metadata directory not provided
18:29:22.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.343401  4679 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:29:22.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.343786  4679 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:29:22.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.346369  4679 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/ts-1/data/instance:
18:29:22.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "a21237301eac491aa3bceb485bedd4d1"
18:29:22.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:29:22 on dist-test-slave-0d16"
18:29:22.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.347186  4679 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/ts-1/wal/instance:
18:29:22.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "a21237301eac491aa3bceb485bedd4d1"
18:29:22.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:29:22 on dist-test-slave-0d16"
18:29:22.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.352662  4679 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.005s
18:29:22.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.356007  4693 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:29:22.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.357432  4679 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
18:29:22.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.357618  4679 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/ts-1/data,/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/ts-1/wal
18:29:22.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "a21237301eac491aa3bceb485bedd4d1"
18:29:22.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:29:22 on dist-test-slave-0d16"
18:29:22.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.357856  4679 fs_report.cc:389] FS layout report
18:29:22.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:29:22.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/ts-1/wal
18:29:22.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/ts-1/wal
18:29:22.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/ts-1/data/data
18:29:22.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:29:22.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:29:22.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:29:22.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:29:22.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:29:22.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:29:22.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:29:22.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:29:22.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:29:22.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:29:22.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:29:22.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.380041  4679 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:29:22.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.381286  4679 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:29:22.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.381618  4679 kserver.cc:163] Server-wide thread pool size limit: 3276
18:29:22.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.382925  4679 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
18:29:22.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.385664  4679 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
18:29:22.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.385758  4679 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
18:29:22.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.385852  4679 ts_tablet_manager.cc:616] Registered 0 tablets
18:29:22.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.385900  4679 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
18:29:22.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.420631  4679 rpc_server.cc:307] RPC server started. Bound to: 127.4.40.130:37515
18:29:22.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.420668  4806 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.40.130:37515 every 8 connection(s)
18:29:22.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.422775  4679 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/ts-1/data/info.pb
18:29:22.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.430131  4258 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskRlQDJI/build/asan/bin/kudu as pid 4679
18:29:22.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.430384  4258 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/ts-1/wal/instance
18:29:22.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.439023  4258 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskRlQDJI/build/asan/bin/kudu
18:29:22.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskRlQDJI/build/asan/bin/kudu
18:29:22.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/ts-2/wal
18:29:22.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/ts-2/data
18:29:22.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:29:22.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:29:22.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:29:22.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:29:22.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:29:22.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:29:22.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/ts-2/logs
18:29:22.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/ts-2/data/info.pb
18:29:22.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:29:22.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:29:22.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:29:22.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:29:22.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:29:22.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:29:22.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:29:22.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:29:22.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
18:29:22.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:29:22.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.40.131:0
18:29:22.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.4.40.131
18:29:22.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.40.131
18:29:22.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:29:22.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125
18:29:22.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.40.148:32775
18:29:22.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:29:22.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:29:22.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
18:29:22.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.442764  4807 heartbeater.cc:344] Connected to a master server at 127.4.40.190:39817
18:29:22.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.443259  4807 heartbeater.cc:461] Registering TS with master...
18:29:22.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.444428  4807 heartbeater.cc:507] Master 127.4.40.190:39817 requested a full tablet report, sending...
18:29:22.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.445501  4808 heartbeater.cc:344] Connected to a master server at 127.4.40.188:40125
18:29:22.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.445690  4808 heartbeater.cc:461] Registering TS with master...
18:29:22.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.446856  4808 heartbeater.cc:507] Master 127.4.40.188:40125 requested a full tablet report, sending...
18:29:22.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.447844  4809 heartbeater.cc:344] Connected to a master server at 127.4.40.189:36729
18:29:22.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.447882  4301 ts_manager.cc:194] Registered new tserver with Master: a21237301eac491aa3bceb485bedd4d1 (127.4.40.130:37515)
18:29:22.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.447955  4809 heartbeater.cc:461] Registering TS with master...
18:29:22.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.448132  4444 ts_manager.cc:194] Registered new tserver with Master: a21237301eac491aa3bceb485bedd4d1 (127.4.40.130:37515)
18:29:22.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.448412  4809 heartbeater.cc:507] Master 127.4.40.189:36729 requested a full tablet report, sending...
18:29:22.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.449030  4301 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.4.40.130:49877
18:29:22.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.450083  4372 ts_manager.cc:194] Registered new tserver with Master: a21237301eac491aa3bceb485bedd4d1 (127.4.40.130:37515)
18:29:22.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:22.775955  4814 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:29:22.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:22.776266  4814 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:29:22.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:22.776345  4814 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:29:22.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:22.784559  4814 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:29:22.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:22.784732  4814 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.40.131
18:29:22.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.794821  4814 tablet_server_runner.cc:78] Tablet server non-default flags:
18:29:22.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:29:22.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.40.148:32775
18:29:22.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:29:22.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:29:22.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/ts-2/data
18:29:22.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/ts-2/wal
18:29:22.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:29:22.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:29:22.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.40.131:0
18:29:22.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:29:22.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:29:22.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:29:22.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/ts-2/data/info.pb
18:29:22.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.40.131
18:29:22.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
18:29:22.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125
18:29:22.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:29:22.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:29:22.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:29:22.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:29:22.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:29:22.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.4.40.131
18:29:22.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/ts-2/logs
18:29:22.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:29:22.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:29:22.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:29:22.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
18:29:22.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:29:22.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:29:22.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:29:22.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:01:24 UTC on bdcb31816ec0
18:29:22.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16870
18:29:22.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
18:29:22.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.796386  4814 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:29:22.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.798144  4814 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:29:22.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:22.807717  4820 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:22.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:22.807698  4819 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:22.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:22.808642  4822 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:22.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.809731  4814 server_base.cc:1061] running on GCE node
18:29:22.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.810295  4814 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:29:22.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.811291  4814 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:29:22.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.812479  4814 hybrid_clock.cc:648] HybridClock initialized: now 1783535362812428 us; error 48 us; skew 500 ppm
18:29:22.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.812808  4814 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:29:22.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.814837  4814 webserver.cc:534] Webserver started at http://127.4.40.131:42117/ using document root <none> and password file <none>
18:29:22.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.815541  4814 fs_manager.cc:362] Metadata directory not provided
18:29:22.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.815626  4814 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:29:22.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.815923  4814 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
18:29:22.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.818522  4814 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/ts-2/data/instance:
18:29:22.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f11dd9759d47486b82dadfb50f55da8c"
18:29:22.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:29:22 on dist-test-slave-0d16"
18:29:22.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.819226  4814 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/ts-2/wal/instance:
18:29:22.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f11dd9759d47486b82dadfb50f55da8c"
18:29:22.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:29:22 on dist-test-slave-0d16"
18:29:22.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.824622  4814 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.008s	sys 0.000s
18:29:22.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.827961  4828 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:29:22.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.829250  4814 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
18:29:22.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.829450  4814 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/ts-2/data,/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/ts-2/wal
18:29:22.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f11dd9759d47486b82dadfb50f55da8c"
18:29:22.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:29:22 on dist-test-slave-0d16"
18:29:22.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.829695  4814 fs_report.cc:389] FS layout report
18:29:22.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:29:22.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/ts-2/wal
18:29:22.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/ts-2/wal
18:29:22.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/ts-2/data/data
18:29:22.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:29:22.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:29:22.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:29:22.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:29:22.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:29:22.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:29:22.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:29:22.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:29:22.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:29:22.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:29:22.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:29:22.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.855093  4814 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:29:22.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.856032  4814 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:29:22.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.856376  4814 kserver.cc:163] Server-wide thread pool size limit: 3276
18:29:22.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.857457  4814 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
18:29:22.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.859215  4814 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
18:29:22.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.859336  4814 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
18:29:22.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.859444  4814 ts_tablet_manager.cc:616] Registered 0 tablets
18:29:22.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.859522  4814 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
18:29:22.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.894651  4814 rpc_server.cc:307] RPC server started. Bound to: 127.4.40.131:43953
18:29:22.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.894737  4940 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.40.131:43953 every 8 connection(s)
18:29:22.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.896162  4814 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/ts-2/data/info.pb
18:29:22.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.903944  4258 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskRlQDJI/build/asan/bin/kudu as pid 4814
18:29:22.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.904109  4258 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/ts-2/wal/instance
18:29:22.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.914070  4942 heartbeater.cc:344] Connected to a master server at 127.4.40.188:40125
18:29:22.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.914158  4943 heartbeater.cc:344] Connected to a master server at 127.4.40.189:36729
18:29:22.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.914542  4942 heartbeater.cc:461] Registering TS with master...
18:29:22.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.914543  4943 heartbeater.cc:461] Registering TS with master...
18:29:22.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.914844  4941 heartbeater.cc:344] Connected to a master server at 127.4.40.190:39817
18:29:22.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.914971  4941 heartbeater.cc:461] Registering TS with master...
18:29:22.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.915747  4943 heartbeater.cc:507] Master 127.4.40.189:36729 requested a full tablet report, sending...
18:29:22.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.915773  4941 heartbeater.cc:507] Master 127.4.40.190:39817 requested a full tablet report, sending...
18:29:22.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.915802  4942 heartbeater.cc:507] Master 127.4.40.188:40125 requested a full tablet report, sending...
18:29:22.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.917506  4372 ts_manager.cc:194] Registered new tserver with Master: f11dd9759d47486b82dadfb50f55da8c (127.4.40.131:43953)
18:29:22.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.917618  4444 ts_manager.cc:194] Registered new tserver with Master: f11dd9759d47486b82dadfb50f55da8c (127.4.40.131:43953)
18:29:22.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.917622  4301 ts_manager.cc:194] Registered new tserver with Master: f11dd9759d47486b82dadfb50f55da8c (127.4.40.131:43953)
18:29:22.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.918704  4301 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.4.40.131:54381
18:29:22.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.930228  4258 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
18:29:22.932 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
18:29:22.932 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

18:29:22.934 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.4.40.190"
      port: 39817
    }
    bound_http_address {
      host: "127.4.40.190"
      port: 37073
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.4.40.189"
      port: 36729
    }
    bound_http_address {
      host: "127.4.40.189"
      port: 37505
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.4.40.188"
      port: 40125
    }
    bound_http_address {
      host: "127.4.40.188"
      port: 38817
    }
  }
}

18:29:22.935 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

18:29:22.936 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.4.40.129"
      port: 44141
    }
    bound_http_address {
      host: "127.4.40.129"
      port: 33145
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.4.40.130"
      port: 37515
    }
    bound_http_address {
      host: "127.4.40.130"
      port: 35197
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.4.40.131"
      port: 43953
    }
    bound_http_address {
      host: "127.4.40.131"
      port: 42117
    }
  }
}

18:29:22.936 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
18:29:22.938 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
18:29:22.940 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.4.40.190:39817(127.4.40.190:39817)] connecting to peer
18:29:22.941 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.4.40.189:36729(127.4.40.189:36729)] connecting to peer
18:29:22.942 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.4.40.190:39817(127.4.40.190:39817)] Successfully connected to peer
18:29:22.945 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.40.190
18:29:22.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.949896  4669 heartbeater.cc:499] Master 127.4.40.190:39817 was elected leader, sending a full tablet report...
18:29:22.952 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.4.40.188:40125(127.4.40.188:40125)] connecting to peer
18:29:22.955 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.4.40.189:36729(127.4.40.189:36729)] Successfully connected to peer
18:29:22.958 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.40.189
18:29:22.964 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.4.40.188:40125(127.4.40.188:40125)] Successfully connected to peer
18:29:22.966 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xfc903114, L:/127.0.0.1:36620 - R:/127.4.40.190:39817] using SASL/PLAIN
18:29:22.967 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.40.188
18:29:22.969 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
18:29:22.969 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=30), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.190:39817, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.189:36729, [13ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.188:40125, [29ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.190:39817: OK, deferred=null) after lookup
18:29:22.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:22.971503  4301 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36620:
18:29:22.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "org.apache.kudu.client.TestClientFailoverSupport-RESTART"
18:29:22.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
18:29:22.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:29:22.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key"
18:29:22.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
18:29:22.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
18:29:22.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:29:22.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:29:22.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:29:22.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:29:22.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:29:22.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:29:22.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column1_i"
18:29:22.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
18:29:22.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
18:29:22.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:29:22.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:29:22.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:29:22.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:29:22.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:29:22.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:29:22.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column2_i"
18:29:22.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
18:29:22.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
18:29:22.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:29:22.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:29:22.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:29:22.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:29:22.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:29:22.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:29:22.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column3_s"
18:29:22.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
18:29:22.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
18:29:22.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: true
18:29:22.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: DICT_ENCODING
18:29:22.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: LZ4
18:29:22.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 4096
18:29:22.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:29:22.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:29:22.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:29:22.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
18:29:22.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column4_b"
18:29:22.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BOOL
18:29:22.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
18:29:22.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
18:29:22.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
18:29:22.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
18:29:22.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
18:29:22.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:29:22.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
18:29:22.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
18:29:22.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
18:29:22.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
18:29:22.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key"
18:29:22.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
18:29:22.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
18:29:22.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
18:29:22.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:22.973527  4301 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table org.apache.kudu.client.TestClientFailoverSupport-RESTART in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
18:29:23.001 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x09f26c0b, L:/127.0.0.1:59824 - R:/127.4.40.189:36729] using SASL/PLAIN
18:29:23.019 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x9cb3b824, L:/127.0.0.1:50066 - R:/127.4.40.188:40125] using SASL/PLAIN
18:29:23.030 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 3237ab7b611f4c27b316c87cfd64786d
18:29:23.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.054997  4603 tablet_service.cc:1511] Processing CreateTablet for tablet 8c227e7597694257901adcf3484c16af (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-RESTART [id=3237ab7b611f4c27b316c87cfd64786d]), partition=RANGE (key) PARTITION UNBOUNDED
18:29:23.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.056347  4603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c227e7597694257901adcf3484c16af. 1 dirs total, 0 dirs full, 0 dirs failed
18:29:23.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.066480  4876 tablet_service.cc:1511] Processing CreateTablet for tablet 8c227e7597694257901adcf3484c16af (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-RESTART [id=3237ab7b611f4c27b316c87cfd64786d]), partition=RANGE (key) PARTITION UNBOUNDED
18:29:23.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.068022  4876 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c227e7597694257901adcf3484c16af. 1 dirs total, 0 dirs full, 0 dirs failed
18:29:23.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.068465  4971 tablet_bootstrap.cc:492] T 8c227e7597694257901adcf3484c16af P 4a46d44cd1bf40519816989ced7df794: Bootstrap starting.
18:29:23.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.071445  4971 tablet_bootstrap.cc:654] T 8c227e7597694257901adcf3484c16af P 4a46d44cd1bf40519816989ced7df794: Neither blocks nor log segments found. Creating new log.
18:29:23.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.071478  4742 tablet_service.cc:1511] Processing CreateTablet for tablet 8c227e7597694257901adcf3484c16af (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-RESTART [id=3237ab7b611f4c27b316c87cfd64786d]), partition=RANGE (key) PARTITION UNBOUNDED
18:29:23.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.072402  4971 log.cc:826] T 8c227e7597694257901adcf3484c16af P 4a46d44cd1bf40519816989ced7df794: Log is configured to *not* fsync() on all Append() calls
18:29:23.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.072902  4742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c227e7597694257901adcf3484c16af. 1 dirs total, 0 dirs full, 0 dirs failed
18:29:23.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.075240  4971 tablet_bootstrap.cc:492] T 8c227e7597694257901adcf3484c16af P 4a46d44cd1bf40519816989ced7df794: No bootstrap required, opened a new log
18:29:23.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.075524  4971 ts_tablet_manager.cc:1403] T 8c227e7597694257901adcf3484c16af P 4a46d44cd1bf40519816989ced7df794: Time spent bootstrapping tablet: real 0.007s	user 0.002s	sys 0.003s
18:29:23.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.083062  4971 raft_consensus.cc:359] T 8c227e7597694257901adcf3484c16af P 4a46d44cd1bf40519816989ced7df794 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a46d44cd1bf40519816989ced7df794" member_type: VOTER last_known_addr { host: "127.4.40.129" port: 44141 } } peers { permanent_uuid: "f11dd9759d47486b82dadfb50f55da8c" member_type: VOTER last_known_addr { host: "127.4.40.131" port: 43953 } } peers { permanent_uuid: "a21237301eac491aa3bceb485bedd4d1" member_type: VOTER last_known_addr { host: "127.4.40.130" port: 37515 } }
18:29:23.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.083710  4971 raft_consensus.cc:385] T 8c227e7597694257901adcf3484c16af P 4a46d44cd1bf40519816989ced7df794 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:29:23.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.083966  4971 raft_consensus.cc:740] T 8c227e7597694257901adcf3484c16af P 4a46d44cd1bf40519816989ced7df794 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a46d44cd1bf40519816989ced7df794, State: Initialized, Role: FOLLOWER
18:29:23.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.084024  4973 tablet_bootstrap.cc:492] T 8c227e7597694257901adcf3484c16af P a21237301eac491aa3bceb485bedd4d1: Bootstrap starting.
18:29:23.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.085121  4971 consensus_queue.cc:260] T 8c227e7597694257901adcf3484c16af P 4a46d44cd1bf40519816989ced7df794 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a46d44cd1bf40519816989ced7df794" member_type: VOTER last_known_addr { host: "127.4.40.129" port: 44141 } } peers { permanent_uuid: "f11dd9759d47486b82dadfb50f55da8c" member_type: VOTER last_known_addr { host: "127.4.40.131" port: 43953 } } peers { permanent_uuid: "a21237301eac491aa3bceb485bedd4d1" member_type: VOTER last_known_addr { host: "127.4.40.130" port: 37515 } }
18:29:23.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.087154  4973 tablet_bootstrap.cc:654] T 8c227e7597694257901adcf3484c16af P a21237301eac491aa3bceb485bedd4d1: Neither blocks nor log segments found. Creating new log.
18:29:23.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.088119  4974 tablet_bootstrap.cc:492] T 8c227e7597694257901adcf3484c16af P f11dd9759d47486b82dadfb50f55da8c: Bootstrap starting.
18:29:23.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.088472  4973 log.cc:826] T 8c227e7597694257901adcf3484c16af P a21237301eac491aa3bceb485bedd4d1: Log is configured to *not* fsync() on all Append() calls
18:29:23.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.089923  4971 ts_tablet_manager.cc:1434] T 8c227e7597694257901adcf3484c16af P 4a46d44cd1bf40519816989ced7df794: Time spent starting tablet: real 0.014s	user 0.013s	sys 0.001s
18:29:23.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.091552  4973 tablet_bootstrap.cc:492] T 8c227e7597694257901adcf3484c16af P a21237301eac491aa3bceb485bedd4d1: No bootstrap required, opened a new log
18:29:23.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.091965  4973 ts_tablet_manager.cc:1403] T 8c227e7597694257901adcf3484c16af P a21237301eac491aa3bceb485bedd4d1: Time spent bootstrapping tablet: real 0.008s	user 0.004s	sys 0.004s
18:29:23.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.092303  4974 tablet_bootstrap.cc:654] T 8c227e7597694257901adcf3484c16af P f11dd9759d47486b82dadfb50f55da8c: Neither blocks nor log segments found. Creating new log.
18:29:23.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.093672  4974 log.cc:826] T 8c227e7597694257901adcf3484c16af P f11dd9759d47486b82dadfb50f55da8c: Log is configured to *not* fsync() on all Append() calls
18:29:23.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.098345  4974 tablet_bootstrap.cc:492] T 8c227e7597694257901adcf3484c16af P f11dd9759d47486b82dadfb50f55da8c: No bootstrap required, opened a new log
18:29:23.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.098628  4974 ts_tablet_manager.cc:1403] T 8c227e7597694257901adcf3484c16af P f11dd9759d47486b82dadfb50f55da8c: Time spent bootstrapping tablet: real 0.011s	user 0.004s	sys 0.004s
18:29:23.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.099839  4973 raft_consensus.cc:359] T 8c227e7597694257901adcf3484c16af P a21237301eac491aa3bceb485bedd4d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a46d44cd1bf40519816989ced7df794" member_type: VOTER last_known_addr { host: "127.4.40.129" port: 44141 } } peers { permanent_uuid: "f11dd9759d47486b82dadfb50f55da8c" member_type: VOTER last_known_addr { host: "127.4.40.131" port: 43953 } } peers { permanent_uuid: "a21237301eac491aa3bceb485bedd4d1" member_type: VOTER last_known_addr { host: "127.4.40.130" port: 37515 } }
18:29:23.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.100220  4973 raft_consensus.cc:385] T 8c227e7597694257901adcf3484c16af P a21237301eac491aa3bceb485bedd4d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:29:23.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.100327  4973 raft_consensus.cc:740] T 8c227e7597694257901adcf3484c16af P a21237301eac491aa3bceb485bedd4d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a21237301eac491aa3bceb485bedd4d1, State: Initialized, Role: FOLLOWER
18:29:23.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.101046  4973 consensus_queue.cc:260] T 8c227e7597694257901adcf3484c16af P a21237301eac491aa3bceb485bedd4d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a46d44cd1bf40519816989ced7df794" member_type: VOTER last_known_addr { host: "127.4.40.129" port: 44141 } } peers { permanent_uuid: "f11dd9759d47486b82dadfb50f55da8c" member_type: VOTER last_known_addr { host: "127.4.40.131" port: 43953 } } peers { permanent_uuid: "a21237301eac491aa3bceb485bedd4d1" member_type: VOTER last_known_addr { host: "127.4.40.130" port: 37515 } }
18:29:23.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.102689  4807 heartbeater.cc:499] Master 127.4.40.190:39817 was elected leader, sending a full tablet report...
18:29:23.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.104710  4973 ts_tablet_manager.cc:1434] T 8c227e7597694257901adcf3484c16af P a21237301eac491aa3bceb485bedd4d1: Time spent starting tablet: real 0.013s	user 0.011s	sys 0.000s
18:29:23.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.105631  4974 raft_consensus.cc:359] T 8c227e7597694257901adcf3484c16af P f11dd9759d47486b82dadfb50f55da8c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a46d44cd1bf40519816989ced7df794" member_type: VOTER last_known_addr { host: "127.4.40.129" port: 44141 } } peers { permanent_uuid: "f11dd9759d47486b82dadfb50f55da8c" member_type: VOTER last_known_addr { host: "127.4.40.131" port: 43953 } } peers { permanent_uuid: "a21237301eac491aa3bceb485bedd4d1" member_type: VOTER last_known_addr { host: "127.4.40.130" port: 37515 } }
18:29:23.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.106213  4974 raft_consensus.cc:385] T 8c227e7597694257901adcf3484c16af P f11dd9759d47486b82dadfb50f55da8c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
18:29:23.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.106473  4974 raft_consensus.cc:740] T 8c227e7597694257901adcf3484c16af P f11dd9759d47486b82dadfb50f55da8c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f11dd9759d47486b82dadfb50f55da8c, State: Initialized, Role: FOLLOWER
18:29:23.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.108315  4974 consensus_queue.cc:260] T 8c227e7597694257901adcf3484c16af P f11dd9759d47486b82dadfb50f55da8c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a46d44cd1bf40519816989ced7df794" member_type: VOTER last_known_addr { host: "127.4.40.129" port: 44141 } } peers { permanent_uuid: "f11dd9759d47486b82dadfb50f55da8c" member_type: VOTER last_known_addr { host: "127.4.40.131" port: 43953 } } peers { permanent_uuid: "a21237301eac491aa3bceb485bedd4d1" member_type: VOTER last_known_addr { host: "127.4.40.130" port: 37515 } }
18:29:23.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.109409  4941 heartbeater.cc:499] Master 127.4.40.190:39817 was elected leader, sending a full tablet report...
18:29:23.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.110219  4974 ts_tablet_manager.cc:1434] T 8c227e7597694257901adcf3484c16af P f11dd9759d47486b82dadfb50f55da8c: Time spent starting tablet: real 0.011s	user 0.012s	sys 0.000s
18:29:23.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.110602  4979 raft_consensus.cc:493] T 8c227e7597694257901adcf3484c16af P f11dd9759d47486b82dadfb50f55da8c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
18:29:23.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.111341  4979 raft_consensus.cc:515] T 8c227e7597694257901adcf3484c16af P f11dd9759d47486b82dadfb50f55da8c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a46d44cd1bf40519816989ced7df794" member_type: VOTER last_known_addr { host: "127.4.40.129" port: 44141 } } peers { permanent_uuid: "f11dd9759d47486b82dadfb50f55da8c" member_type: VOTER last_known_addr { host: "127.4.40.131" port: 43953 } } peers { permanent_uuid: "a21237301eac491aa3bceb485bedd4d1" member_type: VOTER last_known_addr { host: "127.4.40.130" port: 37515 } }
18:29:23.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.115002  4979 leader_election.cc:290] T 8c227e7597694257901adcf3484c16af P f11dd9759d47486b82dadfb50f55da8c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4a46d44cd1bf40519816989ced7df794 (127.4.40.129:44141), a21237301eac491aa3bceb485bedd4d1 (127.4.40.130:37515)
18:29:23.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.120628  4623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c227e7597694257901adcf3484c16af" candidate_uuid: "f11dd9759d47486b82dadfb50f55da8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a46d44cd1bf40519816989ced7df794" is_pre_election: true
18:29:23.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.120841  4762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c227e7597694257901adcf3484c16af" candidate_uuid: "f11dd9759d47486b82dadfb50f55da8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a21237301eac491aa3bceb485bedd4d1" is_pre_election: true
18:29:23.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.121197  4623 raft_consensus.cc:2468] T 8c227e7597694257901adcf3484c16af P 4a46d44cd1bf40519816989ced7df794 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f11dd9759d47486b82dadfb50f55da8c in term 0.
18:29:23.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.121337  4762 raft_consensus.cc:2468] T 8c227e7597694257901adcf3484c16af P a21237301eac491aa3bceb485bedd4d1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f11dd9759d47486b82dadfb50f55da8c in term 0.
18:29:23.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.122002  4830 leader_election.cc:304] T 8c227e7597694257901adcf3484c16af P f11dd9759d47486b82dadfb50f55da8c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a46d44cd1bf40519816989ced7df794, f11dd9759d47486b82dadfb50f55da8c; no voters: 
18:29:23.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.122433  4979 raft_consensus.cc:2804] T 8c227e7597694257901adcf3484c16af P f11dd9759d47486b82dadfb50f55da8c [term 0 FOLLOWER]: Leader pre-election won for term 1
18:29:23.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.122588  4979 raft_consensus.cc:493] T 8c227e7597694257901adcf3484c16af P f11dd9759d47486b82dadfb50f55da8c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
18:29:23.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.122725  4979 raft_consensus.cc:3060] T 8c227e7597694257901adcf3484c16af P f11dd9759d47486b82dadfb50f55da8c [term 0 FOLLOWER]: Advancing to term 1
18:29:23.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.125268  4979 raft_consensus.cc:515] T 8c227e7597694257901adcf3484c16af P f11dd9759d47486b82dadfb50f55da8c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a46d44cd1bf40519816989ced7df794" member_type: VOTER last_known_addr { host: "127.4.40.129" port: 44141 } } peers { permanent_uuid: "f11dd9759d47486b82dadfb50f55da8c" member_type: VOTER last_known_addr { host: "127.4.40.131" port: 43953 } } peers { permanent_uuid: "a21237301eac491aa3bceb485bedd4d1" member_type: VOTER last_known_addr { host: "127.4.40.130" port: 37515 } }
18:29:23.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.125993  4979 leader_election.cc:290] T 8c227e7597694257901adcf3484c16af P f11dd9759d47486b82dadfb50f55da8c [CANDIDATE]: Term 1 election: Requested vote from peers 4a46d44cd1bf40519816989ced7df794 (127.4.40.129:44141), a21237301eac491aa3bceb485bedd4d1 (127.4.40.130:37515)
18:29:23.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.126390  4623 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c227e7597694257901adcf3484c16af" candidate_uuid: "f11dd9759d47486b82dadfb50f55da8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a46d44cd1bf40519816989ced7df794"
18:29:23.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.126433  4762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c227e7597694257901adcf3484c16af" candidate_uuid: "f11dd9759d47486b82dadfb50f55da8c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a21237301eac491aa3bceb485bedd4d1"
18:29:23.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.126581  4762 raft_consensus.cc:3060] T 8c227e7597694257901adcf3484c16af P a21237301eac491aa3bceb485bedd4d1 [term 0 FOLLOWER]: Advancing to term 1
18:29:23.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.126605  4623 raft_consensus.cc:3060] T 8c227e7597694257901adcf3484c16af P 4a46d44cd1bf40519816989ced7df794 [term 0 FOLLOWER]: Advancing to term 1
18:29:23.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.128769  4762 raft_consensus.cc:2468] T 8c227e7597694257901adcf3484c16af P a21237301eac491aa3bceb485bedd4d1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f11dd9759d47486b82dadfb50f55da8c in term 1.
18:29:23.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.128826  4623 raft_consensus.cc:2468] T 8c227e7597694257901adcf3484c16af P 4a46d44cd1bf40519816989ced7df794 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f11dd9759d47486b82dadfb50f55da8c in term 1.
18:29:23.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.129212  4829 leader_election.cc:304] T 8c227e7597694257901adcf3484c16af P f11dd9759d47486b82dadfb50f55da8c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a21237301eac491aa3bceb485bedd4d1, f11dd9759d47486b82dadfb50f55da8c; no voters: 
18:29:23.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.129534  4979 raft_consensus.cc:2804] T 8c227e7597694257901adcf3484c16af P f11dd9759d47486b82dadfb50f55da8c [term 1 FOLLOWER]: Leader election won for term 1
18:29:23.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.129999  4979 raft_consensus.cc:697] T 8c227e7597694257901adcf3484c16af P f11dd9759d47486b82dadfb50f55da8c [term 1 LEADER]: Becoming Leader. State: Replica: f11dd9759d47486b82dadfb50f55da8c, State: Running, Role: LEADER
18:29:23.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.130539  4979 consensus_queue.cc:237] T 8c227e7597694257901adcf3484c16af P f11dd9759d47486b82dadfb50f55da8c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a46d44cd1bf40519816989ced7df794" member_type: VOTER last_known_addr { host: "127.4.40.129" port: 44141 } } peers { permanent_uuid: "f11dd9759d47486b82dadfb50f55da8c" member_type: VOTER last_known_addr { host: "127.4.40.131" port: 43953 } } peers { permanent_uuid: "a21237301eac491aa3bceb485bedd4d1" member_type: VOTER last_known_addr { host: "127.4.40.130" port: 37515 } }
18:29:23.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.135883  4300 catalog_manager.cc:5696] T 8c227e7597694257901adcf3484c16af P f11dd9759d47486b82dadfb50f55da8c reported cstate change: term changed from 0 to 1, leader changed from <none> to f11dd9759d47486b82dadfb50f55da8c (127.4.40.131). New cstate: current_term: 1 leader_uuid: "f11dd9759d47486b82dadfb50f55da8c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a46d44cd1bf40519816989ced7df794" member_type: VOTER last_known_addr { host: "127.4.40.129" port: 44141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f11dd9759d47486b82dadfb50f55da8c" member_type: VOTER last_known_addr { host: "127.4.40.131" port: 43953 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a21237301eac491aa3bceb485bedd4d1" member_type: VOTER last_known_addr { host: "127.4.40.130" port: 37515 } health_report { overall_health: UNKNOWN } } }
18:29:23.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:23.149353  4944 tablet.cc:2406] T 8c227e7597694257901adcf3484c16af P f11dd9759d47486b82dadfb50f55da8c: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:29:23.166 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 3237ab7b611f4c27b316c87cfd64786d
18:29:23.169 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 8c227e7597694257901adcf3484c16af for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
18:29:23.170 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=8c227e7597694257901adcf3484c16af@[4a46d44cd1bf40519816989ced7df794(127.4.40.129:44141),a21237301eac491aa3bceb485bedd4d1(127.4.40.130:37515),f11dd9759d47486b82dadfb50f55da8c(127.4.40.131:43953)[L]]}]
18:29:23.170 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=3), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.4.40.190:39817, [3ms] Sub RPC GetTableLocations: received response from server master-127.4.40.190:39817: OK, deferred=null) after lookup
18:29:23.170 [DEBUG - kudu-nio-0] (Connection.java:748) [peer f11dd9759d47486b82dadfb50f55da8c(127.4.40.131:43953)] connecting to peer
18:29:23.172 [DEBUG - kudu-nio-3] (Connection.java:757) [peer f11dd9759d47486b82dadfb50f55da8c(127.4.40.131:43953)] Successfully connected to peer
18:29:23.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:23.173777  4672 tablet.cc:2406] T 8c227e7597694257901adcf3484c16af P 4a46d44cd1bf40519816989ced7df794: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:29:23.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:23.176940  4810 tablet.cc:2406] T 8c227e7597694257901adcf3484c16af P a21237301eac491aa3bceb485bedd4d1: Can't schedule compaction. Clean time has not been advanced past its initial value.
18:29:23.192 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0xe10b17ef, L:/127.0.0.1:45312 - R:/127.4.40.131:43953] using TOKEN/null
18:29:23.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.201807  4623 raft_consensus.cc:1275] T 8c227e7597694257901adcf3484c16af P 4a46d44cd1bf40519816989ced7df794 [term 1 FOLLOWER]: Refusing update from remote peer f11dd9759d47486b82dadfb50f55da8c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
18:29:23.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.201807  4762 raft_consensus.cc:1275] T 8c227e7597694257901adcf3484c16af P a21237301eac491aa3bceb485bedd4d1 [term 1 FOLLOWER]: Refusing update from remote peer f11dd9759d47486b82dadfb50f55da8c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
18:29:23.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.202796  4980 consensus_queue.cc:1048] T 8c227e7597694257901adcf3484c16af P f11dd9759d47486b82dadfb50f55da8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a46d44cd1bf40519816989ced7df794" member_type: VOTER last_known_addr { host: "127.4.40.129" port: 44141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:29:23.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.203039  4979 consensus_queue.cc:1048] T 8c227e7597694257901adcf3484c16af P f11dd9759d47486b82dadfb50f55da8c [LEADER]: Connected to new peer: Peer: permanent_uuid: "a21237301eac491aa3bceb485bedd4d1" member_type: VOTER last_known_addr { host: "127.4.40.130" port: 37515 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
18:29:23.311 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 10 rows, more = false) for scanner KuduScanner(table=org.apache.kudu.client.TestClientFailoverSupport-RESTART, tablet=8c227e7597694257901adcf3484c16af, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:29:23.311 [INFO - Time-limited test] (MiniKuduCluster.java:399) Killing master server 127.4.40.190:39817
18:29:23.312 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: stop_daemon {
  id {
    type: MASTER
    index: 0
  }
}

18:29:23.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.312824  4258 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskRlQDJI/build/asan/bin/kudu pid 4269
18:29:23.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.314324  4331 generic_service.cc:196] Checking for leaks (request via RPC)
18:29:23.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.460644  4258 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskRlQDJI/build/asan/bin/kudu with pid 4269
18:29:23.487 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.4.40.190:39817(127.4.40.190:39817)] handling channelInactive
18:29:23.487 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.40.190:39817(127.4.40.190:39817)] cleaning up while in state READY due to: connection closed
18:29:23.487 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
18:29:23.488 [INFO - Time-limited test] (MiniKuduCluster.java:380) Starting master server 127.4.40.190:39817
18:29:23.491 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: start_daemon {
  id {
    type: MASTER
    index: 0
  }
}

18:29:23.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.492839  4258 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskRlQDJI/build/asan/bin/kudu
18:29:23.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskRlQDJI/build/asan/bin/kudu
18:29:23.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/master-0/wal
18:29:23.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/master-0/data
18:29:23.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
18:29:23.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
18:29:23.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
18:29:23.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:29:23.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:29:23.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:29:23.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/master-0/logs
18:29:23.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/master-0/data/info.pb
18:29:23.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:29:23.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
18:29:23.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
18:29:23.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
18:29:23.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
18:29:23.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:29:23.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:29:23.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:29:23.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
18:29:23.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
18:29:23.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:29:23.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:29:23.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.40.190:39817
18:29:23.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.40.190
18:29:23.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=37073
18:29:23.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.40.148:32775
18:29:23.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:29:23.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:29:23.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:29:23.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:29:23.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125
18:29:23.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:29:23.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33613/jwks.json with env {}
18:29:23.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:23.839047  4995 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
18:29:23.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:23.839335  4995 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
18:29:23.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:23.839416  4995 flags.cc:432] Enabled unsafe flag: --never_fsync=true
18:29:23.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:23.848292  4995 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
18:29:23.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:23.848390  4995 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
18:29:23.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:23.848446  4995 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
18:29:23.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:23.848531  4995 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
18:29:23.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:23.848608  4995 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
18:29:23.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:23.848644  4995 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:33613/jwks.json
18:29:23.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.858737  4995 master_runner.cc:387] Master server non-default flags:
18:29:23.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
18:29:23.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.40.148:32775
18:29:23.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
18:29:23.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
18:29:23.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/master-0/data
18:29:23.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/master-0/wal
18:29:23.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
18:29:23.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125
18:29:23.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
18:29:23.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
18:29:23.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
18:29:23.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.40.190:39817
18:29:23.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
18:29:23.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
18:29:23.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
18:29:23.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33613/jwks.json
18:29:23.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
18:29:23.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
18:29:23.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/master-0/data/info.pb
18:29:23.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.40.190
18:29:23.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=37073
18:29:23.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
18:29:23.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
18:29:23.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
18:29:23.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
18:29:23.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
18:29:23.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/master-0/logs
18:29:23.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
18:29:23.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
18:29:23.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
18:29:23.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
18:29:23.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
18:29:23.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 3ddc7d4404ac90c834b1cdd020973c286611e9b0
18:29:23.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
18:29:23.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 18:01:24 UTC on bdcb31816ec0
18:29:23.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16870
18:29:23.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) ASAN enabled
18:29:23.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.860430  4995 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
18:29:23.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.862142  4995 file_cache.cc:492] Constructed file cache file cache with capacity 419430
18:29:23.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:23.870671  5001 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:23.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:23.871003  5000 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:23.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:23.871431  5003 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
18:29:23.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.872149  4995 server_base.cc:1061] running on GCE node
18:29:23.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.872956  4995 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
18:29:23.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.874362  4995 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
18:29:23.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.875599  4995 hybrid_clock.cc:648] HybridClock initialized: now 1783535363875545 us; error 43 us; skew 500 ppm
18:29:23.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.875998  4995 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
18:29:23.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.878188  4995 webserver.cc:534] Webserver started at http://127.4.40.190:37073/ using document root <none> and password file <none>
18:29:23.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.878937  4995 fs_manager.cc:362] Metadata directory not provided
18:29:23.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.879086  4995 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
18:29:23.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.884593  4995 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.003s	sys 0.001s
18:29:23.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.887450  5009 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
18:29:23.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.888873  4995 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
18:29:23.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.889063  4995 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/master-0/data,/tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/master-0/wal
18:29:23.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e9a0c1466df2474b9dbf1cbb1db88b6b"
18:29:23.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 18:29:19 on dist-test-slave-0d16"
18:29:23.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.889835  4995 fs_report.cc:389] FS layout report
18:29:23.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
18:29:23.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/master-0/wal
18:29:23.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/master-0/wal
18:29:23.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/master-0/data/data
18:29:23.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
18:29:23.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
18:29:23.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
18:29:23.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
18:29:23.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
18:29:23.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
18:29:23.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
18:29:23.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
18:29:23.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
18:29:23.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
18:29:23.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
18:29:23.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.916890  4995 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
18:29:23.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.917800  4995 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
18:29:23.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.918049  4995 kserver.cc:163] Server-wide thread pool size limit: 3276
18:29:23.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.939538  4995 rpc_server.cc:307] RPC server started. Bound to: 127.4.40.190:39817
18:29:23.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.939574  5061 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.40.190:39817 every 8 connection(s)
18:29:23.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.941334  4995 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/master-0/data/info.pb
18:29:23.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.942102  4258 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskRlQDJI/build/asan/bin/kudu as pid 4995
18:29:23.943 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
18:29:23.943 [INFO - Time-limited test] (MiniKuduCluster.java:475) Killing tablet server 127.4.40.131:43953
18:29:23.943 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: stop_daemon {
  id {
    type: TSERVER
    index: 2
  }
}

18:29:23.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.943809  4258 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskRlQDJI/build/asan/bin/kudu pid 4814
18:29:23.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.949343  5062 sys_catalog.cc:263] Verifying existing consensus state
18:29:23.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.952878  5062 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e9a0c1466df2474b9dbf1cbb1db88b6b: Bootstrap starting.
18:29:23.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.956067  4936 generic_service.cc:196] Checking for leaks (request via RPC)
18:29:23.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.971210  5062 log.cc:826] T 00000000000000000000000000000000 P e9a0c1466df2474b9dbf1cbb1db88b6b: Log is configured to *not* fsync() on all Append() calls
18:29:23.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.982370  5062 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e9a0c1466df2474b9dbf1cbb1db88b6b: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=5 ignored=0} mutations{seen=2 ignored=0} orphaned_commits=0. Pending: 0 replicates
18:29:23.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.983023  5062 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e9a0c1466df2474b9dbf1cbb1db88b6b: Bootstrap complete.
18:29:23.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.990037  5062 raft_consensus.cc:359] T 00000000000000000000000000000000 P e9a0c1466df2474b9dbf1cbb1db88b6b [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a0c1466df2474b9dbf1cbb1db88b6b" member_type: VOTER last_known_addr { host: "127.4.40.190" port: 39817 } } peers { permanent_uuid: "fc3057f83b274f1b90772ae8607f285b" member_type: VOTER last_known_addr { host: "127.4.40.189" port: 36729 } } peers { permanent_uuid: "765edd5c23c74b1ebc0ea9420c19e5ed" member_type: VOTER last_known_addr { host: "127.4.40.188" port: 40125 } }
18:29:23.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.990810  5062 raft_consensus.cc:740] T 00000000000000000000000000000000 P e9a0c1466df2474b9dbf1cbb1db88b6b [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9a0c1466df2474b9dbf1cbb1db88b6b, State: Initialized, Role: FOLLOWER
18:29:23.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.991683  5062 consensus_queue.cc:260] T 00000000000000000000000000000000 P e9a0c1466df2474b9dbf1cbb1db88b6b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a0c1466df2474b9dbf1cbb1db88b6b" member_type: VOTER last_known_addr { host: "127.4.40.190" port: 39817 } } peers { permanent_uuid: "fc3057f83b274f1b90772ae8607f285b" member_type: VOTER last_known_addr { host: "127.4.40.189" port: 36729 } } peers { permanent_uuid: "765edd5c23c74b1ebc0ea9420c19e5ed" member_type: VOTER last_known_addr { host: "127.4.40.188" port: 40125 } }
18:29:23.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.992682  5068 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9a0c1466df2474b9dbf1cbb1db88b6b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a0c1466df2474b9dbf1cbb1db88b6b" member_type: VOTER last_known_addr { host: "127.4.40.190" port: 39817 } } peers { permanent_uuid: "fc3057f83b274f1b90772ae8607f285b" member_type: VOTER last_known_addr { host: "127.4.40.189" port: 36729 } } peers { permanent_uuid: "765edd5c23c74b1ebc0ea9420c19e5ed" member_type: VOTER last_known_addr { host: "127.4.40.188" port: 40125 } } }
18:29:23.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.993206  5068 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9a0c1466df2474b9dbf1cbb1db88b6b [sys.catalog]: This master's current role is: FOLLOWER
18:29:23.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:23.994097  5062 sys_catalog.cc:565] T 00000000000000000000000000000000 P e9a0c1466df2474b9dbf1cbb1db88b6b [sys.catalog]: configured and running, proceeding with master startup.
18:29:24.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:24.005328  5079 catalog_manager.cc:1294] Loaded cluster ID: 1337635f0c3d47ffa9b68d952144b4fb
18:29:24.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:24.005878  5079 catalog_manager.cc:1587] T 00000000000000000000000000000000 P e9a0c1466df2474b9dbf1cbb1db88b6b: loading cluster ID for follower catalog manager: success
18:29:24.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:24.011438  5079 catalog_manager.cc:1609] T 00000000000000000000000000000000 P e9a0c1466df2474b9dbf1cbb1db88b6b: acquiring CA information for follower catalog manager: success
18:29:24.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:24.015120  5079 catalog_manager.cc:1637] T 00000000000000000000000000000000 P e9a0c1466df2474b9dbf1cbb1db88b6b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
18:29:24.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:24.047776  4995 master_runner.cc:264] No leader master found from master e9a0c1466df2474b9dbf1cbb1db88b6b
18:29:24.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:24.047951  4995 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
18:29:24.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:24.112522  4258 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskRlQDJI/build/asan/bin/kudu with pid 4814
18:29:24.144 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
18:29:24.145 [DEBUG - kudu-nio-3] (Connection.java:239) [peer f11dd9759d47486b82dadfb50f55da8c(127.4.40.131:43953)] handling channelInactive
18:29:24.145 [DEBUG - kudu-nio-3] (Connection.java:709) [peer f11dd9759d47486b82dadfb50f55da8c(127.4.40.131:43953)] cleaning up while in state READY due to: connection closed
18:29:24.161 [DEBUG - pool-4-thread-1] (Connection.java:748) [peer f11dd9759d47486b82dadfb50f55da8c(127.4.40.131:43953)] connecting to peer
18:29:24.163 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer f11dd9759d47486b82dadfb50f55da8c(127.4.40.131:43953): Connection refused: /127.4.40.131:43953
18:29:24.163 [DEBUG - kudu-nio-4] (Connection.java:709) [peer f11dd9759d47486b82dadfb50f55da8c(127.4.40.131:43953)] cleaning up while in state CONNECTING due to: Failed to connect to peer f11dd9759d47486b82dadfb50f55da8c(127.4.40.131:43953): Connection refused: /127.4.40.131:43953
18:29:24.164 [INFO - kudu-nio-4] (AsyncKuduClient.java:2355) Invalidating location f11dd9759d47486b82dadfb50f55da8c(127.4.40.131:43953) for tablet 8c227e7597694257901adcf3484c16af: Failed to connect to peer f11dd9759d47486b82dadfb50f55da8c(127.4.40.131:43953): Connection refused: /127.4.40.131:43953
18:29:24.181 [DEBUG - pool-4-thread-1] (Connection.java:748) [peer master-127.4.40.190:39817(127.4.40.190:39817)] connecting to peer
18:29:24.183 [DEBUG - kudu-nio-5] (Connection.java:757) [peer master-127.4.40.190:39817(127.4.40.190:39817)] Successfully connected to peer
18:29:24.205 [DEBUG - kudu-nio-5] (Negotiator.java:919) Authenticated connection [id: 0x048fd776, L:/127.0.0.1:36644 - R:/127.4.40.190:39817] using TOKEN/null
18:29:24.208 [DEBUG - kudu-nio-5] (RemoteTablet.java:166) master-127.4.40.190:39817 was demoted as the leader for Kudu Master
18:29:24.224 [WARN - kudu-nio-2] (ConnectToCluster.java:302) None of the provided masters 127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125 is a leader; will retry
18:29:24.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:24.233664  5027 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "4a46d44cd1bf40519816989ced7df794" instance_seqno: 1783535361908479) as {username='slave'} at 127.4.40.129:40845; Asking this server to re-register.
18:29:24.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:24.234424  4669 heartbeater.cc:461] Registering TS with master...
18:29:24.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:24.236030  5027 ts_manager.cc:194] Registered new tserver with Master: 4a46d44cd1bf40519816989ced7df794 (127.4.40.129:44141)
18:29:24.245 [WARN - kudu-nio-1] (ConnectToCluster.java:302) None of the provided masters 127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125 is a leader; will retry
18:29:24.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:24.246699  5027 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "a21237301eac491aa3bceb485bedd4d1" instance_seqno: 1783535362412349) as {username='slave'} at 127.4.40.130:43571; Asking this server to re-register.
18:29:24.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:24.247584  4807 heartbeater.cc:461] Registering TS with master...
18:29:24.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:24.248955  5027 ts_manager.cc:194] Registered new tserver with Master: a21237301eac491aa3bceb485bedd4d1 (127.4.40.130:37515)
18:29:24.264 [WARN - kudu-nio-2] (ConnectToCluster.java:302) None of the provided masters 127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125 is a leader; will retry
18:29:24.284 [WARN - kudu-nio-5] (ConnectToCluster.java:302) None of the provided masters 127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125 is a leader; will retry
18:29:24.323 [WARN - kudu-nio-5] (ConnectToCluster.java:302) None of the provided masters 127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125 is a leader; will retry
18:29:24.343 [WARN - kudu-nio-1] (ConnectToCluster.java:302) None of the provided masters 127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125 is a leader; will retry
18:29:24.384 [WARN - kudu-nio-2] (ConnectToCluster.java:302) None of the provided masters 127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125 is a leader; will retry
18:29:24.424 [WARN - kudu-nio-2] (ConnectToCluster.java:302) None of the provided masters 127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125 is a leader; will retry
18:29:24.444 [WARN - kudu-nio-5] (ConnectToCluster.java:302) None of the provided masters 127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125 is a leader; will retry
18:29:24.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:24.642674  5089 raft_consensus.cc:493] T 00000000000000000000000000000000 P fc3057f83b274f1b90772ae8607f285b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e9a0c1466df2474b9dbf1cbb1db88b6b)
18:29:24.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:24.642987  5089 raft_consensus.cc:515] T 00000000000000000000000000000000 P fc3057f83b274f1b90772ae8607f285b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a0c1466df2474b9dbf1cbb1db88b6b" member_type: VOTER last_known_addr { host: "127.4.40.190" port: 39817 } } peers { permanent_uuid: "fc3057f83b274f1b90772ae8607f285b" member_type: VOTER last_known_addr { host: "127.4.40.189" port: 36729 } } peers { permanent_uuid: "765edd5c23c74b1ebc0ea9420c19e5ed" member_type: VOTER last_known_addr { host: "127.4.40.188" port: 40125 } }
18:29:24.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:24.643066  5090 raft_consensus.cc:493] T 00000000000000000000000000000000 P 765edd5c23c74b1ebc0ea9420c19e5ed [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e9a0c1466df2474b9dbf1cbb1db88b6b)
18:29:24.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:24.643261  5090 raft_consensus.cc:515] T 00000000000000000000000000000000 P 765edd5c23c74b1ebc0ea9420c19e5ed [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a0c1466df2474b9dbf1cbb1db88b6b" member_type: VOTER last_known_addr { host: "127.4.40.190" port: 39817 } } peers { permanent_uuid: "fc3057f83b274f1b90772ae8607f285b" member_type: VOTER last_known_addr { host: "127.4.40.189" port: 36729 } } peers { permanent_uuid: "765edd5c23c74b1ebc0ea9420c19e5ed" member_type: VOTER last_known_addr { host: "127.4.40.188" port: 40125 } }
18:29:24.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:24.644229  5089 leader_election.cc:290] T 00000000000000000000000000000000 P fc3057f83b274f1b90772ae8607f285b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e9a0c1466df2474b9dbf1cbb1db88b6b (127.4.40.190:39817), 765edd5c23c74b1ebc0ea9420c19e5ed (127.4.40.188:40125)
18:29:24.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:24.644639  5090 leader_election.cc:290] T 00000000000000000000000000000000 P 765edd5c23c74b1ebc0ea9420c19e5ed [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e9a0c1466df2474b9dbf1cbb1db88b6b (127.4.40.190:39817), fc3057f83b274f1b90772ae8607f285b (127.4.40.189:36729)
18:29:24.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:24.645215  4381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "765edd5c23c74b1ebc0ea9420c19e5ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "fc3057f83b274f1b90772ae8607f285b" is_pre_election: true
18:29:24.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:24.645221  4454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fc3057f83b274f1b90772ae8607f285b" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "765edd5c23c74b1ebc0ea9420c19e5ed" is_pre_election: true
18:29:24.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:24.645442  4454 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 765edd5c23c74b1ebc0ea9420c19e5ed [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc3057f83b274f1b90772ae8607f285b in term 1.
18:29:24.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:24.645462  4381 raft_consensus.cc:2468] T 00000000000000000000000000000000 P fc3057f83b274f1b90772ae8607f285b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 765edd5c23c74b1ebc0ea9420c19e5ed in term 1.
18:29:24.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:24.646041  4428 leader_election.cc:304] T 00000000000000000000000000000000 P 765edd5c23c74b1ebc0ea9420c19e5ed [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765edd5c23c74b1ebc0ea9420c19e5ed, fc3057f83b274f1b90772ae8607f285b; no voters: 
18:29:24.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:24.646503  5090 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 765edd5c23c74b1ebc0ea9420c19e5ed [term 1 FOLLOWER]: Leader pre-election won for term 2
18:29:24.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:24.646625  5090 raft_consensus.cc:493] T 00000000000000000000000000000000 P 765edd5c23c74b1ebc0ea9420c19e5ed [term 1 FOLLOWER]: Starting leader election (detected failure of leader e9a0c1466df2474b9dbf1cbb1db88b6b)
18:29:24.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:24.646605  4356 leader_election.cc:304] T 00000000000000000000000000000000 P fc3057f83b274f1b90772ae8607f285b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 765edd5c23c74b1ebc0ea9420c19e5ed, fc3057f83b274f1b90772ae8607f285b; no voters: 
18:29:24.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:24.646749  5090 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 765edd5c23c74b1ebc0ea9420c19e5ed [term 1 FOLLOWER]: Advancing to term 2
18:29:24.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:24.646975  5089 raft_consensus.cc:2804] T 00000000000000000000000000000000 P fc3057f83b274f1b90772ae8607f285b [term 1 FOLLOWER]: Leader pre-election won for term 2
18:29:24.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:24.647095  5089 raft_consensus.cc:493] T 00000000000000000000000000000000 P fc3057f83b274f1b90772ae8607f285b [term 1 FOLLOWER]: Starting leader election (detected failure of leader e9a0c1466df2474b9dbf1cbb1db88b6b)
18:29:24.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:24.647218  5089 raft_consensus.cc:3060] T 00000000000000000000000000000000 P fc3057f83b274f1b90772ae8607f285b [term 1 FOLLOWER]: Advancing to term 2
18:29:24.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:24.650329  5089 raft_consensus.cc:515] T 00000000000000000000000000000000 P fc3057f83b274f1b90772ae8607f285b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a0c1466df2474b9dbf1cbb1db88b6b" member_type: VOTER last_known_addr { host: "127.4.40.190" port: 39817 } } peers { permanent_uuid: "fc3057f83b274f1b90772ae8607f285b" member_type: VOTER last_known_addr { host: "127.4.40.189" port: 36729 } } peers { permanent_uuid: "765edd5c23c74b1ebc0ea9420c19e5ed" member_type: VOTER last_known_addr { host: "127.4.40.188" port: 40125 } }
18:29:24.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:24.650350  5090 raft_consensus.cc:515] T 00000000000000000000000000000000 P 765edd5c23c74b1ebc0ea9420c19e5ed [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a0c1466df2474b9dbf1cbb1db88b6b" member_type: VOTER last_known_addr { host: "127.4.40.190" port: 39817 } } peers { permanent_uuid: "fc3057f83b274f1b90772ae8607f285b" member_type: VOTER last_known_addr { host: "127.4.40.189" port: 36729 } } peers { permanent_uuid: "765edd5c23c74b1ebc0ea9420c19e5ed" member_type: VOTER last_known_addr { host: "127.4.40.188" port: 40125 } }
18:29:24.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:24.651623  4381 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "765edd5c23c74b1ebc0ea9420c19e5ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "fc3057f83b274f1b90772ae8607f285b"
18:29:24.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:24.651840  4454 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fc3057f83b274f1b90772ae8607f285b" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "765edd5c23c74b1ebc0ea9420c19e5ed"
18:29:24.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:24.651932  4381 raft_consensus.cc:2393] T 00000000000000000000000000000000 P fc3057f83b274f1b90772ae8607f285b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 765edd5c23c74b1ebc0ea9420c19e5ed in current term 2: Already voted for candidate fc3057f83b274f1b90772ae8607f285b in this term.
18:29:24.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:24.652098  4454 raft_consensus.cc:2393] T 00000000000000000000000000000000 P 765edd5c23c74b1ebc0ea9420c19e5ed [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate fc3057f83b274f1b90772ae8607f285b in current term 2: Already voted for candidate 765edd5c23c74b1ebc0ea9420c19e5ed in this term.
18:29:24.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:24.652706  5089 leader_election.cc:290] T 00000000000000000000000000000000 P fc3057f83b274f1b90772ae8607f285b [CANDIDATE]: Term 2 election: Requested vote from peers e9a0c1466df2474b9dbf1cbb1db88b6b (127.4.40.190:39817), 765edd5c23c74b1ebc0ea9420c19e5ed (127.4.40.188:40125)
18:29:24.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:24.652933  5090 leader_election.cc:290] T 00000000000000000000000000000000 P 765edd5c23c74b1ebc0ea9420c19e5ed [CANDIDATE]: Term 2 election: Requested vote from peers e9a0c1466df2474b9dbf1cbb1db88b6b (127.4.40.190:39817), fc3057f83b274f1b90772ae8607f285b (127.4.40.189:36729)
18:29:24.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:24.655638  5036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fc3057f83b274f1b90772ae8607f285b" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "e9a0c1466df2474b9dbf1cbb1db88b6b"
18:29:24.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:24.655615  5037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "fc3057f83b274f1b90772ae8607f285b" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "e9a0c1466df2474b9dbf1cbb1db88b6b" is_pre_election: true
18:29:24.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:24.656193  5036 raft_consensus.cc:3060] T 00000000000000000000000000000000 P e9a0c1466df2474b9dbf1cbb1db88b6b [term 1 FOLLOWER]: Advancing to term 2
18:29:24.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:24.660475  5036 raft_consensus.cc:2468] T 00000000000000000000000000000000 P e9a0c1466df2474b9dbf1cbb1db88b6b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc3057f83b274f1b90772ae8607f285b in term 2.
18:29:24.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:24.660725  5037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "765edd5c23c74b1ebc0ea9420c19e5ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "e9a0c1466df2474b9dbf1cbb1db88b6b" is_pre_election: true
18:29:24.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:24.661015  5037 raft_consensus.cc:2393] T 00000000000000000000000000000000 P e9a0c1466df2474b9dbf1cbb1db88b6b [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 765edd5c23c74b1ebc0ea9420c19e5ed in current term 2: Already voted for candidate fc3057f83b274f1b90772ae8607f285b in this term.
18:29:24.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:24.660943  5035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "765edd5c23c74b1ebc0ea9420c19e5ed" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "e9a0c1466df2474b9dbf1cbb1db88b6b"
18:29:24.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:24.661072  4358 leader_election.cc:304] T 00000000000000000000000000000000 P fc3057f83b274f1b90772ae8607f285b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: e9a0c1466df2474b9dbf1cbb1db88b6b, fc3057f83b274f1b90772ae8607f285b; no voters: 765edd5c23c74b1ebc0ea9420c19e5ed
18:29:24.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:24.661296  5035 raft_consensus.cc:2393] T 00000000000000000000000000000000 P e9a0c1466df2474b9dbf1cbb1db88b6b [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 765edd5c23c74b1ebc0ea9420c19e5ed in current term 2: Already voted for candidate fc3057f83b274f1b90772ae8607f285b in this term.
18:29:24.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:24.661418  5089 raft_consensus.cc:2804] T 00000000000000000000000000000000 P fc3057f83b274f1b90772ae8607f285b [term 2 FOLLOWER]: Leader election won for term 2
18:29:24.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:24.661891  5089 raft_consensus.cc:697] T 00000000000000000000000000000000 P fc3057f83b274f1b90772ae8607f285b [term 2 LEADER]: Becoming Leader. State: Replica: fc3057f83b274f1b90772ae8607f285b, State: Running, Role: LEADER
18:29:24.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:24.662073  4430 leader_election.cc:304] T 00000000000000000000000000000000 P 765edd5c23c74b1ebc0ea9420c19e5ed [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 765edd5c23c74b1ebc0ea9420c19e5ed; no voters: e9a0c1466df2474b9dbf1cbb1db88b6b, fc3057f83b274f1b90772ae8607f285b
18:29:24.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:24.662431  5090 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 765edd5c23c74b1ebc0ea9420c19e5ed [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
18:29:24.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:24.662384  5089 consensus_queue.cc:237] T 00000000000000000000000000000000 P fc3057f83b274f1b90772ae8607f285b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a0c1466df2474b9dbf1cbb1db88b6b" member_type: VOTER last_known_addr { host: "127.4.40.190" port: 39817 } } peers { permanent_uuid: "fc3057f83b274f1b90772ae8607f285b" member_type: VOTER last_known_addr { host: "127.4.40.189" port: 36729 } } peers { permanent_uuid: "765edd5c23c74b1ebc0ea9420c19e5ed" member_type: VOTER last_known_addr { host: "127.4.40.188" port: 40125 } }
18:29:24.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:24.664234  5094 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc3057f83b274f1b90772ae8607f285b [sys.catalog]: SysCatalogTable state changed. Reason: New leader fc3057f83b274f1b90772ae8607f285b. Latest consensus state: current_term: 2 leader_uuid: "fc3057f83b274f1b90772ae8607f285b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a0c1466df2474b9dbf1cbb1db88b6b" member_type: VOTER last_known_addr { host: "127.4.40.190" port: 39817 } } peers { permanent_uuid: "fc3057f83b274f1b90772ae8607f285b" member_type: VOTER last_known_addr { host: "127.4.40.189" port: 36729 } } peers { permanent_uuid: "765edd5c23c74b1ebc0ea9420c19e5ed" member_type: VOTER last_known_addr { host: "127.4.40.188" port: 40125 } } }
18:29:24.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:24.664531  5094 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc3057f83b274f1b90772ae8607f285b [sys.catalog]: This master's current role is: LEADER
18:29:24.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:24.665225  5096 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
18:29:24.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:24.667536  5096 catalog_manager.cc:679] Loaded metadata for table org.apache.kudu.client.TestClientFailoverSupport-RESTART [id=3237ab7b611f4c27b316c87cfd64786d]
18:29:24.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:24.669183  5096 tablet_loader.cc:96] loaded metadata for tablet 8c227e7597694257901adcf3484c16af (table org.apache.kudu.client.TestClientFailoverSupport-RESTART [id=3237ab7b611f4c27b316c87cfd64786d])
18:29:24.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:24.669519  5096 catalog_manager.cc:1519] Initializing Kudu cluster ID...
18:29:24.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:24.670532  5096 catalog_manager.cc:1294] Loaded cluster ID: 1337635f0c3d47ffa9b68d952144b4fb
18:29:24.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:24.670601  5096 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
18:29:24.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:24.671669  5096 catalog_manager.cc:1539] Loading token signing keys...
18:29:24.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:24.672665  5096 catalog_manager.cc:6080] T 00000000000000000000000000000000 P fc3057f83b274f1b90772ae8607f285b: Loaded TSK: 0
18:29:24.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:24.673511  5096 catalog_manager.cc:1549] Initializing in-progress tserver states...
18:29:25.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.109241  5036 raft_consensus.cc:1275] T 00000000000000000000000000000000 P e9a0c1466df2474b9dbf1cbb1db88b6b [term 2 FOLLOWER]: Refusing update from remote peer fc3057f83b274f1b90772ae8607f285b: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 2 index: 8. (index mismatch)
18:29:25.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.110136  5094 consensus_queue.cc:1048] T 00000000000000000000000000000000 P fc3057f83b274f1b90772ae8607f285b [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9a0c1466df2474b9dbf1cbb1db88b6b" member_type: VOTER last_known_addr { host: "127.4.40.190" port: 39817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
18:29:25.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.113929  5097 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9a0c1466df2474b9dbf1cbb1db88b6b [sys.catalog]: SysCatalogTable state changed. Reason: New leader fc3057f83b274f1b90772ae8607f285b. Latest consensus state: current_term: 2 leader_uuid: "fc3057f83b274f1b90772ae8607f285b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a0c1466df2474b9dbf1cbb1db88b6b" member_type: VOTER last_known_addr { host: "127.4.40.190" port: 39817 } } peers { permanent_uuid: "fc3057f83b274f1b90772ae8607f285b" member_type: VOTER last_known_addr { host: "127.4.40.189" port: 36729 } } peers { permanent_uuid: "765edd5c23c74b1ebc0ea9420c19e5ed" member_type: VOTER last_known_addr { host: "127.4.40.188" port: 40125 } } }
18:29:25.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.114249  5097 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9a0c1466df2474b9dbf1cbb1db88b6b [sys.catalog]: This master's current role is: FOLLOWER
18:29:25.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.115263  5094 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc3057f83b274f1b90772ae8607f285b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "fc3057f83b274f1b90772ae8607f285b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a0c1466df2474b9dbf1cbb1db88b6b" member_type: VOTER last_known_addr { host: "127.4.40.190" port: 39817 } } peers { permanent_uuid: "fc3057f83b274f1b90772ae8607f285b" member_type: VOTER last_known_addr { host: "127.4.40.189" port: 36729 } } peers { permanent_uuid: "765edd5c23c74b1ebc0ea9420c19e5ed" member_type: VOTER last_known_addr { host: "127.4.40.188" port: 40125 } } }
18:29:25.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.115542  5094 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc3057f83b274f1b90772ae8607f285b [sys.catalog]: This master's current role is: LEADER
18:29:25.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.116042  4454 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 765edd5c23c74b1ebc0ea9420c19e5ed [term 2 FOLLOWER]: Refusing update from remote peer fc3057f83b274f1b90772ae8607f285b: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 2 index: 8. (index mismatch)
18:29:25.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.116825  5100 consensus_queue.cc:1048] T 00000000000000000000000000000000 P fc3057f83b274f1b90772ae8607f285b [LEADER]: Connected to new peer: Peer: permanent_uuid: "765edd5c23c74b1ebc0ea9420c19e5ed" member_type: VOTER last_known_addr { host: "127.4.40.188" port: 40125 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
18:29:25.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.117233  5097 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9a0c1466df2474b9dbf1cbb1db88b6b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "fc3057f83b274f1b90772ae8607f285b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a0c1466df2474b9dbf1cbb1db88b6b" member_type: VOTER last_known_addr { host: "127.4.40.190" port: 39817 } } peers { permanent_uuid: "fc3057f83b274f1b90772ae8607f285b" member_type: VOTER last_known_addr { host: "127.4.40.189" port: 36729 } } peers { permanent_uuid: "765edd5c23c74b1ebc0ea9420c19e5ed" member_type: VOTER last_known_addr { host: "127.4.40.188" port: 40125 } } }
18:29:25.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.117425  5097 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9a0c1466df2474b9dbf1cbb1db88b6b [sys.catalog]: This master's current role is: FOLLOWER
18:29:25.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.119668  5090 sys_catalog.cc:455] T 00000000000000000000000000000000 P 765edd5c23c74b1ebc0ea9420c19e5ed [sys.catalog]: SysCatalogTable state changed. Reason: New leader fc3057f83b274f1b90772ae8607f285b. Latest consensus state: current_term: 2 leader_uuid: "fc3057f83b274f1b90772ae8607f285b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a0c1466df2474b9dbf1cbb1db88b6b" member_type: VOTER last_known_addr { host: "127.4.40.190" port: 39817 } } peers { permanent_uuid: "fc3057f83b274f1b90772ae8607f285b" member_type: VOTER last_known_addr { host: "127.4.40.189" port: 36729 } } peers { permanent_uuid: "765edd5c23c74b1ebc0ea9420c19e5ed" member_type: VOTER last_known_addr { host: "127.4.40.188" port: 40125 } } }
18:29:25.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.119460  5104 sys_catalog.cc:455] T 00000000000000000000000000000000 P 765edd5c23c74b1ebc0ea9420c19e5ed [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "fc3057f83b274f1b90772ae8607f285b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a0c1466df2474b9dbf1cbb1db88b6b" member_type: VOTER last_known_addr { host: "127.4.40.190" port: 39817 } } peers { permanent_uuid: "fc3057f83b274f1b90772ae8607f285b" member_type: VOTER last_known_addr { host: "127.4.40.189" port: 36729 } } peers { permanent_uuid: "765edd5c23c74b1ebc0ea9420c19e5ed" member_type: VOTER last_known_addr { host: "127.4.40.188" port: 40125 } } }
18:29:25.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.119906  5090 sys_catalog.cc:458] T 00000000000000000000000000000000 P 765edd5c23c74b1ebc0ea9420c19e5ed [sys.catalog]: This master's current role is: FOLLOWER
18:29:25.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.119928  5104 sys_catalog.cc:458] T 00000000000000000000000000000000 P 765edd5c23c74b1ebc0ea9420c19e5ed [sys.catalog]: This master's current role is: FOLLOWER
18:29:25.167 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
18:29:25.167 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableLocations, tablet=Kudu Master, attempt=11, TimeoutTracker(timeout=29965, elapsed=986), Traces: [0ms] sending RPC to server master-127.4.40.190:39817, [28ms] delaying RPC due to: Illegal state: Not the leader. Local UUID: e9a0c1466df2474b9dbf1cbb1db88b6b, Raft Consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a0c1466df2474b9dbf1cbb1db88b6b" member_type: VOTER last_known_addr { host: "127.4.40.190" port: 39817 } } peers { permanent_uuid: "fc3057f83b274f1b90772ae8607f285b" member_type: VOTER last_known_addr { host: "127.4.40.189" port: 36729 } } peers { permanent_uuid: "765edd5c23c74b1ebc0ea9420c19e5ed" member_type: VOTER last_known_addr { host: "127.4.40.188" port: 40125 } } } (error 0), [28ms] received response from server master-127.4.40.190:39817: Illegal state: Not the leader. Local UUID: e9a0c1466df2474b9dbf1cbb1db88b6b, Raft Consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a0c1466df2474b9dbf1cbb1db88b6b" member_type: VOTER last_known_addr { host: "127.4.40.190" port: 39817 } } peers { permanent_uuid: "fc3057f83b274f1b90772ae8607f285b" member_type: VOTER last_known_addr { host: "127.4.40.189" port: 36729 } } peers { permanent_uuid: "765edd5c23c74b1ebc0ea9420c19e5ed" member_type: VOTER last_known_addr { host: "127.4.40.188" port: 40125 } } } (error 0), [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.190:39817, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.189:36729, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.188:40125, [43ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.190:39817: OK, [43ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.189:36729: OK, [44ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.188:40125: OK, [44ms] delaying RPC due to: Service unavailable: Master config (127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125) has no leader., [60ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.190:39817, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.189:36729, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.188:40125, [62ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.190:39817: OK, [64ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.188:40125: OK, [65ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.189:36729: OK, [65ms] delaying RPC due to: Service unavailable: Master config (127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125) has no leader., [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.190:39817, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.189:36729, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.188:40125, [84ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.189:36729: OK, [84ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.190:39817: OK, [84ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.188:40125: OK, [85ms] delaying RPC due to: Service unavailable: Master config (127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125) has no leader., [100ms] refreshing cache from master, [100ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.190:39817, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.189:36729, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.188:40125, [103ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.189:36729: OK, [104ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.188:40125: OK, [104ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.190:39817: OK, [104ms] delaying RPC due to: Service unavailable: Master config (127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125) has no leader., [140ms] refreshing cache from master, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.190:39817, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.189:36729, [140ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.188:40125, [143ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.188:40125: OK, [143ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.189:36729: OK, [143ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.190:39817: OK, [143ms] delaying RPC due to: Service unavailable: Master config (127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125) has no leader., [160ms] refreshing cache from master, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.190:39817, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.189:36729, [160ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.188:40125, [163ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.190:39817: OK, [163ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.188:40125: OK, [163ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.189:36729: OK, [163ms] delaying RPC due to: Service unavailable: Master config (127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125) has no leader., [200ms] refreshing cache from master, [200ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.190:39817, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.189:36729, [201ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.188:40125, [203ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.190:39817: OK, [203ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.189:36729: OK, [203ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.188:40125: OK, [204ms] delaying RPC due to: Service unavailable: Master config (127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125) has no leader., [239ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.190:39817, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.189:36729, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.188:40125, [242ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.189:36729: OK, [243ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.190:39817: OK, [244ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.188:40125: OK, [244ms] delaying RPC due to: Service unavailable: Master config (127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125) has no leader., [259ms] refreshing cache from master, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.190:39817, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.189:36729, [260ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.188:40125, [263ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.188:40125: OK, [263ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.189:36729: OK, [263ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.190:39817: OK, [264ms] delaying RPC due to: Service unavailable: Master config (127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125) has no leader., [980ms] refreshing cache from master, [980ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.190:39817, [980ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.189:36729, [981ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.188:40125, [982ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.190:39817: OK, [983ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.188:40125: OK, [986ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.189:36729: OK, deferred=Deferred@452568265(state=PENDING, result=null, callback=get tablet locations from the master for table org.apache.kudu.client.TestClientFailoverSupport-RESTART -> release master lookup permit -> retry RPC -> (continuation of Deferred@1432629246 after retry RPC after error@724154526) -> (continuation of Deferred@761163016 after retry RPC after error@2060868486) -> (continuation of Deferred@238653693 after retry RPC after error@1756505324) -> (continuation of Deferred@911876831 after retry RPC after error@2123908601) -> (continuation of Deferred@1013226671 after retry RPC after error@1166563979) -> (continuation of Deferred@572773439 after retry RPC after error@514386447) -> (continuation of Deferred@112299153 after retry RPC after error@23773902) -> (continuation of Deferred@1037331696 after retry RPC after error@1685389783) -> (continuation of Deferred@1856691404 after retry RPC after error@964763493), errback=passthrough -> release master lookup permit -> retry RPC after error -> (continuation of Deferred@1432629246 after retry RPC after error@724154526) -> (continuation of Deferred@761163016 after retry RPC after error@2060868486) -> (continuation of Deferred@238653693 after retry RPC after error@1756505324) -> (continuation of Deferred@911876831 after retry RPC after error@2123908601) -> (continuation of Deferred@1013226671 after retry RPC after error@1166563979) -> (continuation of Deferred@572773439 after retry RPC after error@514386447) -> (continuation of Deferred@112299153 after retry RPC after error@23773902) -> (continuation of Deferred@1037331696 after retry RPC after error@1685389783) -> (continuation of Deferred@1856691404 after retry RPC after error@964763493))) after lookup
18:29:25.171 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 8c227e7597694257901adcf3484c16af for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
18:29:25.171 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=8c227e7597694257901adcf3484c16af@[4a46d44cd1bf40519816989ced7df794(127.4.40.129:44141),a21237301eac491aa3bceb485bedd4d1(127.4.40.130:37515),f11dd9759d47486b82dadfb50f55da8c(127.4.40.131:43953)[L]]}]
18:29:25.172 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=8c227e7597694257901adcf3484c16af, attempt=3, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=1027), Traces: [0ms] sending RPC to server f11dd9759d47486b82dadfb50f55da8c, [1ms] delaying RPC due to: Illegal state: connection is terminated, [16ms] sending RPC to server f11dd9759d47486b82dadfb50f55da8c, [19ms] received response from server f11dd9759d47486b82dadfb50f55da8c: Network error: Failed to connect to peer f11dd9759d47486b82dadfb50f55da8c(127.4.40.131:43953): Connection refused: /127.4.40.131:43953, [20ms] delaying RPC due to: Network error: Failed to connect to peer f11dd9759d47486b82dadfb50f55da8c(127.4.40.131:43953): Connection refused: /127.4.40.131:43953, [36ms] refreshing cache from master, [36ms] Sub RPC GetTableLocations: sending RPC to server master-127.4.40.190:39817, [64ms] Sub RPC GetTableLocations: delaying RPC due to: Illegal state: Not the leader. Local UUID: e9a0c1466df2474b9dbf1cbb1db88b6b, Raft Consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a0c1466df2474b9dbf1cbb1db88b6b" member_type: VOTER last_known_addr { host: "127.4.40.190" port: 39817 } } peers { permanent_uuid: "fc3057f83b274f1b90772ae8607f285b" member_type: VOTER last_known_addr { host: "127.4.40.189" port: 36729 } } peers { permanent_uuid: "765edd5c23c74b1ebc0ea9420c19e5ed" member_type: VOTER last_known_addr { host: "127.4.40.188" port: 40125 } } } (error 0), [64ms] Sub RPC GetTableLocations: received response from server master-127.4.40.190:39817: Illegal state: Not the leader. Local UUID: e9a0c1466df2474b9dbf1cbb1db88b6b, Raft Consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a0c1466df2474b9dbf1cbb1db88b6b" member_type: VOTER last_known_addr { host: "127.4.40.190" port: 39817 } } peers { permanent_uuid: "fc3057f83b274f1b90772ae8607f285b" member_type: VOTER last_known_addr { host: "127.4.40.189" port: 36729 } } peers { permanent_uuid: "765edd5c23c74b1ebc0ea9420c19e5ed" member_type: VOTER last_known_addr { host: "127.4.40.188" port: 40125 } } } (error 0), [76ms] Sub RPC GetTableLocations: refreshing cache from master, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.190:39817, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.189:36729, [77ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.188:40125, [79ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.190:39817: OK, [79ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.189:36729: OK, [80ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.188:40125: OK, [80ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125) has no leader., [96ms] Sub RPC GetTableLocations: refreshing cache from master, [96ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.190:39817, [96ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.189:36729, [97ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.188:40125, [98ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.190:39817: OK, [100ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.188:40125: OK, [101ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.189:36729: OK, [101ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125) has no leader., [116ms] Sub RPC GetTableLocations: refreshing cache from master, [116ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.190:39817, [117ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.189:36729, [117ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.188:40125, [120ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.189:36729: OK, [120ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.190:39817: OK, [120ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.188:40125: OK, [121ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125) has no leader., [136ms] Sub RPC GetTableLocations: refreshing cache from master, [136ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.190:39817, [137ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.189:36729, [137ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.188:40125, [139ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.189:36729: OK, [140ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.188:40125: OK, [140ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.190:39817: OK, [140ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125) has no leader., [176ms] Sub RPC GetTableLocations: refreshing cache from master, [176ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.190:39817, [176ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.189:36729, [176ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.188:40125, [179ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.188:40125: OK, [179ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.189:36729: OK, [179ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.190:39817: OK, [179ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125) has no leader., [196ms] Sub RPC GetTableLocations: refreshing cache from master, [196ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.190:39817, [196ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.189:36729, [196ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.188:40125, [199ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.190:39817: OK, [199ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.188:40125: OK, [199ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.189:36729: OK, [199ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125) has no leader., [236ms] Sub RPC GetTableLocations: refreshing cache from master, [236ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.190:39817, [237ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.189:36729, [237ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.188:40125, [239ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.190:39817: OK, [239ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.189:36729: OK, [239ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.188:40125: OK, [240ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125) has no leader., [275ms] Sub RPC GetTableLocations: refreshing cache from master, [276ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.190:39817, [276ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.189:36729, [276ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.188:40125, [278ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.189:36729: OK, [279ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.190:39817: OK, [280ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.188:40125: OK, [280ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125) has no leader., [295ms] Sub RPC GetTableLocations: refreshing cache from master, [296ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.190:39817, [296ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.189:36729, [296ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.188:40125, [299ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.188:40125: OK, [299ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.189:36729: OK, [299ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.190:39817: OK, [300ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125) has no leader., [1016ms] Sub RPC GetTableLocations: refreshing cache from master, [1016ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.190:39817, [1016ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.189:36729, [1017ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.188:40125, [1018ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.190:39817: OK, [1019ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.188:40125: OK, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.189:36729: OK, [1024ms] Sub RPC GetTableLocations: sending RPC to server master-127.4.40.189:36729, [1027ms] Sub RPC GetTableLocations: received response from server master-127.4.40.189:36729: OK, deferred=Deferred@1796968914(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$238/0x00007fe8483357f8@536f6cc1 -> passthrough -> wakeup thread Time-limited test, errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@62242bfe -> wakeup thread Time-limited test)) after lookup
18:29:25.173 [DEBUG - kudu-nio-1] (Connection.java:748) [peer f11dd9759d47486b82dadfb50f55da8c(127.4.40.131:43953)] connecting to peer
18:29:25.174 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer f11dd9759d47486b82dadfb50f55da8c(127.4.40.131:43953): Connection refused: /127.4.40.131:43953
18:29:25.175 [DEBUG - kudu-nio-6] (Connection.java:709) [peer f11dd9759d47486b82dadfb50f55da8c(127.4.40.131:43953)] cleaning up while in state CONNECTING due to: Failed to connect to peer f11dd9759d47486b82dadfb50f55da8c(127.4.40.131:43953): Connection refused: /127.4.40.131:43953
18:29:25.175 [INFO - kudu-nio-6] (AsyncKuduClient.java:2355) Invalidating location f11dd9759d47486b82dadfb50f55da8c(127.4.40.131:43953) for tablet 8c227e7597694257901adcf3484c16af: Failed to connect to peer f11dd9759d47486b82dadfb50f55da8c(127.4.40.131:43953): Connection refused: /127.4.40.131:43953
18:29:25.203 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 8c227e7597694257901adcf3484c16af for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
18:29:25.203 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=8c227e7597694257901adcf3484c16af@[4a46d44cd1bf40519816989ced7df794(127.4.40.129:44141),a21237301eac491aa3bceb485bedd4d1(127.4.40.130:37515),f11dd9759d47486b82dadfb50f55da8c(127.4.40.131:43953)[L]]}]
18:29:25.204 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=8c227e7597694257901adcf3484c16af, attempt=5, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=1059), Traces: [0ms] sending RPC to server f11dd9759d47486b82dadfb50f55da8c, [1ms] delaying RPC due to: Illegal state: connection is terminated, [16ms] sending RPC to server f11dd9759d47486b82dadfb50f55da8c, [19ms] received response from server f11dd9759d47486b82dadfb50f55da8c: Network error: Failed to connect to peer f11dd9759d47486b82dadfb50f55da8c(127.4.40.131:43953): Connection refused: /127.4.40.131:43953, [20ms] delaying RPC due to: Network error: Failed to connect to peer f11dd9759d47486b82dadfb50f55da8c(127.4.40.131:43953): Connection refused: /127.4.40.131:43953, [36ms] refreshing cache from master, [36ms] Sub RPC GetTableLocations: sending RPC to server master-127.4.40.190:39817, [64ms] Sub RPC GetTableLocations: delaying RPC due to: Illegal state: Not the leader. Local UUID: e9a0c1466df2474b9dbf1cbb1db88b6b, Raft Consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a0c1466df2474b9dbf1cbb1db88b6b" member_type: VOTER last_known_addr { host: "127.4.40.190" port: 39817 } } peers { permanent_uuid: "fc3057f83b274f1b90772ae8607f285b" member_type: VOTER last_known_addr { host: "127.4.40.189" port: 36729 } } peers { permanent_uuid: "765edd5c23c74b1ebc0ea9420c19e5ed" member_type: VOTER last_known_addr { host: "127.4.40.188" port: 40125 } } } (error 0), [64ms] Sub RPC GetTableLocations: received response from server master-127.4.40.190:39817: Illegal state: Not the leader. Local UUID: e9a0c1466df2474b9dbf1cbb1db88b6b, Raft Consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a0c1466df2474b9dbf1cbb1db88b6b" member_type: VOTER last_known_addr { host: "127.4.40.190" port: 39817 } } peers { permanent_uuid: "fc3057f83b274f1b90772ae8607f285b" member_type: VOTER last_known_addr { host: "127.4.40.189" port: 36729 } } peers { permanent_uuid: "765edd5c23c74b1ebc0ea9420c19e5ed" member_type: VOTER last_known_addr { host: "127.4.40.188" port: 40125 } } } (error 0), [76ms] Sub RPC GetTableLocations: refreshing cache from master, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.190:39817, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.189:36729, [77ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.188:40125, [79ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.190:39817: OK, [79ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.189:36729: OK, [80ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.188:40125: OK, [80ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125) has no leader., [96ms] Sub RPC GetTableLocations: refreshing cache from master, [96ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.190:39817, [96ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.189:36729, [97ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.188:40125, [98ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.190:39817: OK, [100ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.188:40125: OK, [101ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.189:36729: OK, [101ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125) has no leader., [116ms] Sub RPC GetTableLocations: refreshing cache from master, [116ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.190:39817, [117ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.189:36729, [117ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.188:40125, [120ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.189:36729: OK, [120ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.190:39817: OK, [120ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.188:40125: OK, [121ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125) has no leader., [136ms] Sub RPC GetTableLocations: refreshing cache from master, [136ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.190:39817, [137ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.189:36729, [137ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.188:40125, [139ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.189:36729: OK, [140ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.188:40125: OK, [140ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.190:39817: OK, [140ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125) has no leader., [176ms] Sub RPC GetTableLocations: refreshing cache from master, [176ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.190:39817, [176ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.189:36729, [176ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.188:40125, [179ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.188:40125: OK, [179ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.189:36729: OK, [179ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.190:39817: OK, [179ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125) has no leader., [196ms] Sub RPC GetTableLocations: refreshing cache from master, [196ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.190:39817, [196ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.189:36729, [196ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.188:40125, [199ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.190:39817: OK, [199ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.188:40125: OK, [199ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.189:36729: OK, [199ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125) has no leader., [236ms] Sub RPC GetTableLocations: refreshing cache from master, [236ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.190:39817, [237ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.189:36729, [237ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.188:40125, [239ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.190:39817: OK, [239ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.189:36729: OK, [239ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.188:40125: OK, [240ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125) has no leader., [275ms] Sub RPC GetTableLocations: refreshing cache from master, [276ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.190:39817, [276ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.189:36729, [276ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.188:40125, [278ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.189:36729: OK, [279ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.190:39817: OK, [280ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.188:40125: OK, [280ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125) has no leader., [295ms] Sub RPC GetTableLocations: refreshing cache from master, [296ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.190:39817, [296ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.189:36729, [296ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.188:40125, [299ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.188:40125: OK, [299ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.189:36729: OK, [299ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.190:39817: OK, [300ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125) has no leader., [1016ms] Sub RPC GetTableLocations: refreshing cache from master, [1016ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.190:39817, [1016ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.189:36729, [1017ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.188:40125, [1018ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.190:39817: OK, [1019ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.188:40125: OK, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.189:36729: OK, [1024ms] Sub RPC GetTableLocations: sending RPC to server master-127.4.40.189:36729, [1027ms] Sub RPC GetTableLocations: received response from server master-127.4.40.189:36729: OK, [1028ms] sending RPC to server f11dd9759d47486b82dadfb50f55da8c, [1031ms] received response from server f11dd9759d47486b82dadfb50f55da8c: Network error: Failed to connect to peer f11dd9759d47486b82dadfb50f55da8c(127.4.40.131:43953): Connection refused: /127.4.40.131:43953, [1031ms] delaying RPC due to: Network error: Failed to connect to peer f11dd9759d47486b82dadfb50f55da8c(127.4.40.131:43953): Connection refused: /127.4.40.131:43953, [1056ms] refreshing cache from master, [1056ms] Sub RPC GetTableLocations: sending RPC to server master-127.4.40.189:36729, [1058ms] Sub RPC GetTableLocations: received response from server master-127.4.40.189:36729: OK, deferred=Deferred@1796968914(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$238/0x00007fe8483357f8@536f6cc1 -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@452568265 after retry RPC@2068641349), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@62242bfe -> wakeup thread Time-limited test -> (continuation of Deferred@452568265 after retry RPC@2068641349))) after lookup
18:29:25.205 [DEBUG - kudu-nio-1] (Connection.java:748) [peer f11dd9759d47486b82dadfb50f55da8c(127.4.40.131:43953)] connecting to peer
18:29:25.207 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer f11dd9759d47486b82dadfb50f55da8c(127.4.40.131:43953): Connection refused: /127.4.40.131:43953
18:29:25.207 [DEBUG - kudu-nio-7] (Connection.java:709) [peer f11dd9759d47486b82dadfb50f55da8c(127.4.40.131:43953)] cleaning up while in state CONNECTING due to: Failed to connect to peer f11dd9759d47486b82dadfb50f55da8c(127.4.40.131:43953): Connection refused: /127.4.40.131:43953
18:29:25.207 [INFO - kudu-nio-7] (AsyncKuduClient.java:2355) Invalidating location f11dd9759d47486b82dadfb50f55da8c(127.4.40.131:43953) for tablet 8c227e7597694257901adcf3484c16af: Failed to connect to peer f11dd9759d47486b82dadfb50f55da8c(127.4.40.131:43953): Connection refused: /127.4.40.131:43953
18:29:25.283 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 8c227e7597694257901adcf3484c16af for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
18:29:25.284 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=8c227e7597694257901adcf3484c16af@[4a46d44cd1bf40519816989ced7df794(127.4.40.129:44141),a21237301eac491aa3bceb485bedd4d1(127.4.40.130:37515),f11dd9759d47486b82dadfb50f55da8c(127.4.40.131:43953)[L]]}]
18:29:25.285 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=8c227e7597694257901adcf3484c16af, attempt=7, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=1139), Traces: [0ms] sending RPC to server f11dd9759d47486b82dadfb50f55da8c, [1ms] delaying RPC due to: Illegal state: connection is terminated, [16ms] sending RPC to server f11dd9759d47486b82dadfb50f55da8c, [19ms] received response from server f11dd9759d47486b82dadfb50f55da8c: Network error: Failed to connect to peer f11dd9759d47486b82dadfb50f55da8c(127.4.40.131:43953): Connection refused: /127.4.40.131:43953, [20ms] delaying RPC due to: Network error: Failed to connect to peer f11dd9759d47486b82dadfb50f55da8c(127.4.40.131:43953): Connection refused: /127.4.40.131:43953, [36ms] refreshing cache from master, [36ms] Sub RPC GetTableLocations: sending RPC to server master-127.4.40.190:39817, [64ms] Sub RPC GetTableLocations: delaying RPC due to: Illegal state: Not the leader. Local UUID: e9a0c1466df2474b9dbf1cbb1db88b6b, Raft Consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a0c1466df2474b9dbf1cbb1db88b6b" member_type: VOTER last_known_addr { host: "127.4.40.190" port: 39817 } } peers { permanent_uuid: "fc3057f83b274f1b90772ae8607f285b" member_type: VOTER last_known_addr { host: "127.4.40.189" port: 36729 } } peers { permanent_uuid: "765edd5c23c74b1ebc0ea9420c19e5ed" member_type: VOTER last_known_addr { host: "127.4.40.188" port: 40125 } } } (error 0), [64ms] Sub RPC GetTableLocations: received response from server master-127.4.40.190:39817: Illegal state: Not the leader. Local UUID: e9a0c1466df2474b9dbf1cbb1db88b6b, Raft Consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a0c1466df2474b9dbf1cbb1db88b6b" member_type: VOTER last_known_addr { host: "127.4.40.190" port: 39817 } } peers { permanent_uuid: "fc3057f83b274f1b90772ae8607f285b" member_type: VOTER last_known_addr { host: "127.4.40.189" port: 36729 } } peers { permanent_uuid: "765edd5c23c74b1ebc0ea9420c19e5ed" member_type: VOTER last_known_addr { host: "127.4.40.188" port: 40125 } } } (error 0), [76ms] Sub RPC GetTableLocations: refreshing cache from master, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.190:39817, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.189:36729, [77ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.188:40125, [79ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.190:39817: OK, [79ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.189:36729: OK, [80ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.188:40125: OK, [80ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125) has no leader., [96ms] Sub RPC GetTableLocations: refreshing cache from master, [96ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.190:39817, [96ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.189:36729, [97ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.188:40125, [98ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.190:39817: OK, [100ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.188:40125: OK, [101ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.189:36729: OK, [101ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125) has no leader., [116ms] Sub RPC GetTableLocations: refreshing cache from master, [116ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.190:39817, [117ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.189:36729, [117ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.188:40125, [120ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.189:36729: OK, [120ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.190:39817: OK, [120ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.188:40125: OK, [121ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125) has no leader., [136ms] Sub RPC GetTableLocations: refreshing cache from master, [136ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.190:39817, [137ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.189:36729, [137ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.188:40125, [139ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.189:36729: OK, [140ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.188:40125: OK, [140ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.190:39817: OK, [140ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125) has no leader., [176ms] Sub RPC GetTableLocations: refreshing cache from master, [176ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.190:39817, [176ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.189:36729, [176ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.188:40125, [179ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.188:40125: OK, [179ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.189:36729: OK, [179ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.190:39817: OK, [179ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125) has no leader., [196ms] Sub RPC GetTableLocations: refreshing cache from master, [196ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.190:39817, [196ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.189:36729, [196ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.188:40125, [199ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.190:39817: OK, [199ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.188:40125: OK, [199ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.189:36729: OK, [199ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125) has no leader., [236ms] Sub RPC GetTableLocations: refreshing cache from master, [236ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.190:39817, [237ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.189:36729, [237ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.188:40125, [239ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.190:39817: OK, [239ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.189:36729: OK, [239ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.188:40125: OK, [240ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125) has no leader., [275ms] Sub RPC GetTableLocations: refreshing cache from master, [276ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.190:39817, [276ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.189:36729, [276ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.188:40125, [278ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.189:36729: OK, [279ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.190:39817: OK, [280ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.188:40125: OK, [280ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125) has no leader., [295ms] Sub RPC GetTableLocations: refreshing cache from master, [296ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.190:39817, [296ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.189:36729, [296ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.188:40125, [299ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.188:40125: OK, [299ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.189:36729: OK, [299ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.190:39817: OK, [300ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125) has no leader., [1016ms] Sub RPC GetTableLocations: refreshing cache from master, [1016ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.190:39817, [1016ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.189:36729, [1017ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.188:40125, [1018ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.190:39817: OK, [1019ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.188:40125: OK, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.189:36729: OK, [1024ms] Sub RPC GetTableLocations: sending RPC to server master-127.4.40.189:36729, [1027ms] Sub RPC GetTableLocations: received response from server master-127.4.40.189:36729: OK, [1028ms] sending RPC to server f11dd9759d47486b82dadfb50f55da8c, [1031ms] received response from server f11dd9759d47486b82dadfb50f55da8c: Network error: Failed to connect to peer f11dd9759d47486b82dadfb50f55da8c(127.4.40.131:43953): Connection refused: /127.4.40.131:43953, [1031ms] delaying RPC due to: Network error: Failed to connect to peer f11dd9759d47486b82dadfb50f55da8c(127.4.40.131:43953): Connection refused: /127.4.40.131:43953, [1056ms] refreshing cache from master, [1056ms] Sub RPC GetTableLocations: sending RPC to server master-127.4.40.189:36729, [1058ms] Sub RPC GetTableLocations: received response from server master-127.4.40.189:36729: OK, [1061ms] sending RPC to server f11dd9759d47486b82dadfb50f55da8c, [1063ms] received response from server f11dd9759d47486b82dadfb50f55da8c: Network error: Failed to connect to peer f11dd9759d47486b82dadfb50f55da8c(127.4.40.131:43953): Connection refused: /127.4.40.131:43953, [1063ms] delaying RPC due to: Network error: Failed to connect to peer f11dd9759d47486b82dadfb50f55da8c(127.4.40.131:43953): Connection refused: /127.4.40.131:43953, [1136ms] refreshing cache from master, [1136ms] too many traces: truncated at 100 traces, deferred=Deferred@1796968914(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$238/0x00007fe8483357f8@536f6cc1 -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@452568265 after retry RPC@2068641349) -> (continuation of Deferred@1581994971 after retry RPC@242345419), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@62242bfe -> wakeup thread Time-limited test -> (continuation of Deferred@452568265 after retry RPC@2068641349) -> (continuation of Deferred@1581994971 after retry RPC@242345419))) after lookup
18:29:25.286 [DEBUG - kudu-nio-1] (Connection.java:748) [peer f11dd9759d47486b82dadfb50f55da8c(127.4.40.131:43953)] connecting to peer
18:29:25.287 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer f11dd9759d47486b82dadfb50f55da8c(127.4.40.131:43953): Connection refused: /127.4.40.131:43953
18:29:25.287 [DEBUG - kudu-nio-0] (Connection.java:709) [peer f11dd9759d47486b82dadfb50f55da8c(127.4.40.131:43953)] cleaning up while in state CONNECTING due to: Failed to connect to peer f11dd9759d47486b82dadfb50f55da8c(127.4.40.131:43953): Connection refused: /127.4.40.131:43953
18:29:25.287 [INFO - kudu-nio-0] (AsyncKuduClient.java:2355) Invalidating location f11dd9759d47486b82dadfb50f55da8c(127.4.40.131:43953) for tablet 8c227e7597694257901adcf3484c16af: Failed to connect to peer f11dd9759d47486b82dadfb50f55da8c(127.4.40.131:43953): Connection refused: /127.4.40.131:43953
18:29:25.323 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 8c227e7597694257901adcf3484c16af for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
18:29:25.323 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=8c227e7597694257901adcf3484c16af@[4a46d44cd1bf40519816989ced7df794(127.4.40.129:44141),a21237301eac491aa3bceb485bedd4d1(127.4.40.130:37515),f11dd9759d47486b82dadfb50f55da8c(127.4.40.131:43953)[L]]}]
18:29:25.324 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=8c227e7597694257901adcf3484c16af, attempt=9, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=1179), Traces: [0ms] sending RPC to server f11dd9759d47486b82dadfb50f55da8c, [1ms] delaying RPC due to: Illegal state: connection is terminated, [16ms] sending RPC to server f11dd9759d47486b82dadfb50f55da8c, [19ms] received response from server f11dd9759d47486b82dadfb50f55da8c: Network error: Failed to connect to peer f11dd9759d47486b82dadfb50f55da8c(127.4.40.131:43953): Connection refused: /127.4.40.131:43953, [20ms] delaying RPC due to: Network error: Failed to connect to peer f11dd9759d47486b82dadfb50f55da8c(127.4.40.131:43953): Connection refused: /127.4.40.131:43953, [36ms] refreshing cache from master, [36ms] Sub RPC GetTableLocations: sending RPC to server master-127.4.40.190:39817, [64ms] Sub RPC GetTableLocations: delaying RPC due to: Illegal state: Not the leader. Local UUID: e9a0c1466df2474b9dbf1cbb1db88b6b, Raft Consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a0c1466df2474b9dbf1cbb1db88b6b" member_type: VOTER last_known_addr { host: "127.4.40.190" port: 39817 } } peers { permanent_uuid: "fc3057f83b274f1b90772ae8607f285b" member_type: VOTER last_known_addr { host: "127.4.40.189" port: 36729 } } peers { permanent_uuid: "765edd5c23c74b1ebc0ea9420c19e5ed" member_type: VOTER last_known_addr { host: "127.4.40.188" port: 40125 } } } (error 0), [64ms] Sub RPC GetTableLocations: received response from server master-127.4.40.190:39817: Illegal state: Not the leader. Local UUID: e9a0c1466df2474b9dbf1cbb1db88b6b, Raft Consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a0c1466df2474b9dbf1cbb1db88b6b" member_type: VOTER last_known_addr { host: "127.4.40.190" port: 39817 } } peers { permanent_uuid: "fc3057f83b274f1b90772ae8607f285b" member_type: VOTER last_known_addr { host: "127.4.40.189" port: 36729 } } peers { permanent_uuid: "765edd5c23c74b1ebc0ea9420c19e5ed" member_type: VOTER last_known_addr { host: "127.4.40.188" port: 40125 } } } (error 0), [76ms] Sub RPC GetTableLocations: refreshing cache from master, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.190:39817, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.189:36729, [77ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.188:40125, [79ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.190:39817: OK, [79ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.189:36729: OK, [80ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.188:40125: OK, [80ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125) has no leader., [96ms] Sub RPC GetTableLocations: refreshing cache from master, [96ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.190:39817, [96ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.189:36729, [97ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.188:40125, [98ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.190:39817: OK, [100ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.188:40125: OK, [101ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.189:36729: OK, [101ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125) has no leader., [116ms] Sub RPC GetTableLocations: refreshing cache from master, [116ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.190:39817, [117ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.189:36729, [117ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.188:40125, [120ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.189:36729: OK, [120ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.190:39817: OK, [120ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.188:40125: OK, [121ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125) has no leader., [136ms] Sub RPC GetTableLocations: refreshing cache from master, [136ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.190:39817, [137ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.189:36729, [137ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.188:40125, [139ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.189:36729: OK, [140ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.188:40125: OK, [140ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.190:39817: OK, [140ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125) has no leader., [176ms] Sub RPC GetTableLocations: refreshing cache from master, [176ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.190:39817, [176ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.189:36729, [176ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.188:40125, [179ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.188:40125: OK, [179ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.189:36729: OK, [179ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.190:39817: OK, [179ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125) has no leader., [196ms] Sub RPC GetTableLocations: refreshing cache from master, [196ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.190:39817, [196ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.189:36729, [196ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.188:40125, [199ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.190:39817: OK, [199ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.188:40125: OK, [199ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.189:36729: OK, [199ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125) has no leader., [236ms] Sub RPC GetTableLocations: refreshing cache from master, [236ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.190:39817, [237ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.189:36729, [237ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.188:40125, [239ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.190:39817: OK, [239ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.189:36729: OK, [239ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.188:40125: OK, [240ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125) has no leader., [275ms] Sub RPC GetTableLocations: refreshing cache from master, [276ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.190:39817, [276ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.189:36729, [276ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.188:40125, [278ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.189:36729: OK, [279ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.190:39817: OK, [280ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.188:40125: OK, [280ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125) has no leader., [295ms] Sub RPC GetTableLocations: refreshing cache from master, [296ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.190:39817, [296ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.189:36729, [296ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.188:40125, [299ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.188:40125: OK, [299ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.189:36729: OK, [299ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.190:39817: OK, [300ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125) has no leader., [1016ms] Sub RPC GetTableLocations: refreshing cache from master, [1016ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.190:39817, [1016ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.189:36729, [1017ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.188:40125, [1018ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.190:39817: OK, [1019ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.188:40125: OK, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.189:36729: OK, [1024ms] Sub RPC GetTableLocations: sending RPC to server master-127.4.40.189:36729, [1027ms] Sub RPC GetTableLocations: received response from server master-127.4.40.189:36729: OK, [1028ms] sending RPC to server f11dd9759d47486b82dadfb50f55da8c, [1031ms] received response from server f11dd9759d47486b82dadfb50f55da8c: Network error: Failed to connect to peer f11dd9759d47486b82dadfb50f55da8c(127.4.40.131:43953): Connection refused: /127.4.40.131:43953, [1031ms] delaying RPC due to: Network error: Failed to connect to peer f11dd9759d47486b82dadfb50f55da8c(127.4.40.131:43953): Connection refused: /127.4.40.131:43953, [1056ms] refreshing cache from master, [1056ms] Sub RPC GetTableLocations: sending RPC to server master-127.4.40.189:36729, [1058ms] Sub RPC GetTableLocations: received response from server master-127.4.40.189:36729: OK, [1061ms] sending RPC to server f11dd9759d47486b82dadfb50f55da8c, [1063ms] received response from server f11dd9759d47486b82dadfb50f55da8c: Network error: Failed to connect to peer f11dd9759d47486b82dadfb50f55da8c(127.4.40.131:43953): Connection refused: /127.4.40.131:43953, [1063ms] delaying RPC due to: Network error: Failed to connect to peer f11dd9759d47486b82dadfb50f55da8c(127.4.40.131:43953): Connection refused: /127.4.40.131:43953, [1136ms] refreshing cache from master, [1136ms] too many traces: truncated at 100 traces, deferred=Deferred@1796968914(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$238/0x00007fe8483357f8@536f6cc1 -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@452568265 after retry RPC@2068641349) -> (continuation of Deferred@1581994971 after retry RPC@242345419) -> (continuation of Deferred@1046188377 after retry RPC@1057322212), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@62242bfe -> wakeup thread Time-limited test -> (continuation of Deferred@452568265 after retry RPC@2068641349) -> (continuation of Deferred@1581994971 after retry RPC@242345419) -> (continuation of Deferred@1046188377 after retry RPC@1057322212))) after lookup
18:29:25.325 [DEBUG - kudu-nio-1] (Connection.java:748) [peer f11dd9759d47486b82dadfb50f55da8c(127.4.40.131:43953)] connecting to peer
18:29:25.326 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer f11dd9759d47486b82dadfb50f55da8c(127.4.40.131:43953): Connection refused: /127.4.40.131:43953
18:29:25.326 [DEBUG - kudu-nio-1] (Connection.java:709) [peer f11dd9759d47486b82dadfb50f55da8c(127.4.40.131:43953)] cleaning up while in state CONNECTING due to: Failed to connect to peer f11dd9759d47486b82dadfb50f55da8c(127.4.40.131:43953): Connection refused: /127.4.40.131:43953
18:29:25.326 [INFO - kudu-nio-1] (AsyncKuduClient.java:2355) Invalidating location f11dd9759d47486b82dadfb50f55da8c(127.4.40.131:43953) for tablet 8c227e7597694257901adcf3484c16af: Failed to connect to peer f11dd9759d47486b82dadfb50f55da8c(127.4.40.131:43953): Connection refused: /127.4.40.131:43953
18:29:25.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.400403  5107 raft_consensus.cc:493] T 8c227e7597694257901adcf3484c16af P a21237301eac491aa3bceb485bedd4d1 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f11dd9759d47486b82dadfb50f55da8c)
18:29:25.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.401026  5107 raft_consensus.cc:515] T 8c227e7597694257901adcf3484c16af P a21237301eac491aa3bceb485bedd4d1 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a46d44cd1bf40519816989ced7df794" member_type: VOTER last_known_addr { host: "127.4.40.129" port: 44141 } } peers { permanent_uuid: "f11dd9759d47486b82dadfb50f55da8c" member_type: VOTER last_known_addr { host: "127.4.40.131" port: 43953 } } peers { permanent_uuid: "a21237301eac491aa3bceb485bedd4d1" member_type: VOTER last_known_addr { host: "127.4.40.130" port: 37515 } }
18:29:25.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.402499  5107 leader_election.cc:290] T 8c227e7597694257901adcf3484c16af P a21237301eac491aa3bceb485bedd4d1 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4a46d44cd1bf40519816989ced7df794 (127.4.40.129:44141), f11dd9759d47486b82dadfb50f55da8c (127.4.40.131:43953)
18:29:25.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.420315  5111 raft_consensus.cc:493] T 8c227e7597694257901adcf3484c16af P 4a46d44cd1bf40519816989ced7df794 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f11dd9759d47486b82dadfb50f55da8c)
18:29:25.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:25.420958  4694 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.40.131:43953: connect: Connection refused (error 111)
18:29:25.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.420950  5111 raft_consensus.cc:515] T 8c227e7597694257901adcf3484c16af P 4a46d44cd1bf40519816989ced7df794 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a46d44cd1bf40519816989ced7df794" member_type: VOTER last_known_addr { host: "127.4.40.129" port: 44141 } } peers { permanent_uuid: "f11dd9759d47486b82dadfb50f55da8c" member_type: VOTER last_known_addr { host: "127.4.40.131" port: 43953 } } peers { permanent_uuid: "a21237301eac491aa3bceb485bedd4d1" member_type: VOTER last_known_addr { host: "127.4.40.130" port: 37515 } }
18:29:25.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.426719  4622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c227e7597694257901adcf3484c16af" candidate_uuid: "a21237301eac491aa3bceb485bedd4d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "4a46d44cd1bf40519816989ced7df794" is_pre_election: true
18:29:25.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.426993  4622 raft_consensus.cc:2468] T 8c227e7597694257901adcf3484c16af P 4a46d44cd1bf40519816989ced7df794 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a21237301eac491aa3bceb485bedd4d1 in term 1.
18:29:25.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.427600  4695 leader_election.cc:304] T 8c227e7597694257901adcf3484c16af P a21237301eac491aa3bceb485bedd4d1 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a46d44cd1bf40519816989ced7df794, a21237301eac491aa3bceb485bedd4d1; no voters: 
18:29:25.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:25.427946  4694 leader_election.cc:336] T 8c227e7597694257901adcf3484c16af P a21237301eac491aa3bceb485bedd4d1 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f11dd9759d47486b82dadfb50f55da8c (127.4.40.131:43953): Network error: Client connection negotiation failed: client connection to 127.4.40.131:43953: connect: Connection refused (error 111)
18:29:25.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.428028  5107 raft_consensus.cc:2804] T 8c227e7597694257901adcf3484c16af P a21237301eac491aa3bceb485bedd4d1 [term 1 FOLLOWER]: Leader pre-election won for term 2
18:29:25.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.428646  5107 raft_consensus.cc:493] T 8c227e7597694257901adcf3484c16af P a21237301eac491aa3bceb485bedd4d1 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f11dd9759d47486b82dadfb50f55da8c)
18:29:25.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.428791  5107 raft_consensus.cc:3060] T 8c227e7597694257901adcf3484c16af P a21237301eac491aa3bceb485bedd4d1 [term 1 FOLLOWER]: Advancing to term 2
18:29:25.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.431020  5111 leader_election.cc:290] T 8c227e7597694257901adcf3484c16af P 4a46d44cd1bf40519816989ced7df794 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f11dd9759d47486b82dadfb50f55da8c (127.4.40.131:43953), a21237301eac491aa3bceb485bedd4d1 (127.4.40.130:37515)
18:29:25.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:25.432350  4556 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.40.131:43953: connect: Connection refused (error 111)
18:29:25.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.432529  5107 raft_consensus.cc:515] T 8c227e7597694257901adcf3484c16af P a21237301eac491aa3bceb485bedd4d1 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a46d44cd1bf40519816989ced7df794" member_type: VOTER last_known_addr { host: "127.4.40.129" port: 44141 } } peers { permanent_uuid: "f11dd9759d47486b82dadfb50f55da8c" member_type: VOTER last_known_addr { host: "127.4.40.131" port: 43953 } } peers { permanent_uuid: "a21237301eac491aa3bceb485bedd4d1" member_type: VOTER last_known_addr { host: "127.4.40.130" port: 37515 } }
18:29:25.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.433832  4622 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c227e7597694257901adcf3484c16af" candidate_uuid: "a21237301eac491aa3bceb485bedd4d1" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "4a46d44cd1bf40519816989ced7df794"
18:29:25.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.434082  4622 raft_consensus.cc:3060] T 8c227e7597694257901adcf3484c16af P 4a46d44cd1bf40519816989ced7df794 [term 1 FOLLOWER]: Advancing to term 2
18:29:25.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.438216  4622 raft_consensus.cc:2468] T 8c227e7597694257901adcf3484c16af P 4a46d44cd1bf40519816989ced7df794 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a21237301eac491aa3bceb485bedd4d1 in term 2.
18:29:25.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.438885  4695 leader_election.cc:304] T 8c227e7597694257901adcf3484c16af P a21237301eac491aa3bceb485bedd4d1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a46d44cd1bf40519816989ced7df794, a21237301eac491aa3bceb485bedd4d1; no voters: 
18:29:25.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.439674  5116 raft_consensus.cc:2804] T 8c227e7597694257901adcf3484c16af P a21237301eac491aa3bceb485bedd4d1 [term 2 FOLLOWER]: Leader election won for term 2
18:29:25.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.443424  5116 raft_consensus.cc:697] T 8c227e7597694257901adcf3484c16af P a21237301eac491aa3bceb485bedd4d1 [term 2 LEADER]: Becoming Leader. State: Replica: a21237301eac491aa3bceb485bedd4d1, State: Running, Role: LEADER
18:29:25.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.444020  5107 leader_election.cc:290] T 8c227e7597694257901adcf3484c16af P a21237301eac491aa3bceb485bedd4d1 [CANDIDATE]: Term 2 election: Requested vote from peers 4a46d44cd1bf40519816989ced7df794 (127.4.40.129:44141), f11dd9759d47486b82dadfb50f55da8c (127.4.40.131:43953)
18:29:25.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.445851  4809 heartbeater.cc:499] Master 127.4.40.189:36729 was elected leader, sending a full tablet report...
18:29:25.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.446633  5116 consensus_queue.cc:237] T 8c227e7597694257901adcf3484c16af P a21237301eac491aa3bceb485bedd4d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 1.11, Last appended by leader: 11, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a46d44cd1bf40519816989ced7df794" member_type: VOTER last_known_addr { host: "127.4.40.129" port: 44141 } } peers { permanent_uuid: "f11dd9759d47486b82dadfb50f55da8c" member_type: VOTER last_known_addr { host: "127.4.40.131" port: 43953 } } peers { permanent_uuid: "a21237301eac491aa3bceb485bedd4d1" member_type: VOTER last_known_addr { host: "127.4.40.130" port: 37515 } }
18:29:25.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:25.450807  4556 leader_election.cc:336] T 8c227e7597694257901adcf3484c16af P 4a46d44cd1bf40519816989ced7df794 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f11dd9759d47486b82dadfb50f55da8c (127.4.40.131:43953): Network error: Client connection negotiation failed: client connection to 127.4.40.131:43953: connect: Connection refused (error 111)
18:29:25.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.456072  4372 catalog_manager.cc:5696] T 8c227e7597694257901adcf3484c16af P a21237301eac491aa3bceb485bedd4d1 reported cstate change: term changed from 1 to 2, leader changed from f11dd9759d47486b82dadfb50f55da8c (127.4.40.131) to a21237301eac491aa3bceb485bedd4d1 (127.4.40.130). New cstate: current_term: 2 leader_uuid: "a21237301eac491aa3bceb485bedd4d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4a46d44cd1bf40519816989ced7df794" member_type: VOTER last_known_addr { host: "127.4.40.129" port: 44141 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f11dd9759d47486b82dadfb50f55da8c" member_type: VOTER last_known_addr { host: "127.4.40.131" port: 43953 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a21237301eac491aa3bceb485bedd4d1" member_type: VOTER last_known_addr { host: "127.4.40.130" port: 37515 } health_report { overall_health: HEALTHY } } }
18:29:25.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:25.460161  4694 leader_election.cc:336] T 8c227e7597694257901adcf3484c16af P a21237301eac491aa3bceb485bedd4d1 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f11dd9759d47486b82dadfb50f55da8c (127.4.40.131:43953): Network error: Client connection negotiation failed: client connection to 127.4.40.131:43953: connect: Connection refused (error 111)
18:29:25.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.461474  4762 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c227e7597694257901adcf3484c16af" candidate_uuid: "4a46d44cd1bf40519816989ced7df794" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "a21237301eac491aa3bceb485bedd4d1" is_pre_election: true
18:29:25.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.462337  4556 leader_election.cc:304] T 8c227e7597694257901adcf3484c16af P 4a46d44cd1bf40519816989ced7df794 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4a46d44cd1bf40519816989ced7df794; no voters: a21237301eac491aa3bceb485bedd4d1, f11dd9759d47486b82dadfb50f55da8c
18:29:25.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.462734  5111 raft_consensus.cc:2749] T 8c227e7597694257901adcf3484c16af P 4a46d44cd1bf40519816989ced7df794 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
18:29:25.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.465144  5100 sys_catalog.cc:455] T 00000000000000000000000000000000 P fc3057f83b274f1b90772ae8607f285b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "fc3057f83b274f1b90772ae8607f285b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a0c1466df2474b9dbf1cbb1db88b6b" member_type: VOTER last_known_addr { host: "127.4.40.190" port: 39817 } } peers { permanent_uuid: "fc3057f83b274f1b90772ae8607f285b" member_type: VOTER last_known_addr { host: "127.4.40.189" port: 36729 } } peers { permanent_uuid: "765edd5c23c74b1ebc0ea9420c19e5ed" member_type: VOTER last_known_addr { host: "127.4.40.188" port: 40125 } } }
18:29:25.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.465399  5100 sys_catalog.cc:458] T 00000000000000000000000000000000 P fc3057f83b274f1b90772ae8607f285b [sys.catalog]: This master's current role is: LEADER
18:29:25.483 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 8c227e7597694257901adcf3484c16af for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
18:29:25.484 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=8c227e7597694257901adcf3484c16af@[4a46d44cd1bf40519816989ced7df794(127.4.40.129:44141),a21237301eac491aa3bceb485bedd4d1(127.4.40.130:37515)[L],f11dd9759d47486b82dadfb50f55da8c(127.4.40.131:43953)]}]
18:29:25.485 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=8c227e7597694257901adcf3484c16af, attempt=11, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=1339), Traces: [0ms] sending RPC to server f11dd9759d47486b82dadfb50f55da8c, [1ms] delaying RPC due to: Illegal state: connection is terminated, [16ms] sending RPC to server f11dd9759d47486b82dadfb50f55da8c, [19ms] received response from server f11dd9759d47486b82dadfb50f55da8c: Network error: Failed to connect to peer f11dd9759d47486b82dadfb50f55da8c(127.4.40.131:43953): Connection refused: /127.4.40.131:43953, [20ms] delaying RPC due to: Network error: Failed to connect to peer f11dd9759d47486b82dadfb50f55da8c(127.4.40.131:43953): Connection refused: /127.4.40.131:43953, [36ms] refreshing cache from master, [36ms] Sub RPC GetTableLocations: sending RPC to server master-127.4.40.190:39817, [64ms] Sub RPC GetTableLocations: delaying RPC due to: Illegal state: Not the leader. Local UUID: e9a0c1466df2474b9dbf1cbb1db88b6b, Raft Consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a0c1466df2474b9dbf1cbb1db88b6b" member_type: VOTER last_known_addr { host: "127.4.40.190" port: 39817 } } peers { permanent_uuid: "fc3057f83b274f1b90772ae8607f285b" member_type: VOTER last_known_addr { host: "127.4.40.189" port: 36729 } } peers { permanent_uuid: "765edd5c23c74b1ebc0ea9420c19e5ed" member_type: VOTER last_known_addr { host: "127.4.40.188" port: 40125 } } } (error 0), [64ms] Sub RPC GetTableLocations: received response from server master-127.4.40.190:39817: Illegal state: Not the leader. Local UUID: e9a0c1466df2474b9dbf1cbb1db88b6b, Raft Consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9a0c1466df2474b9dbf1cbb1db88b6b" member_type: VOTER last_known_addr { host: "127.4.40.190" port: 39817 } } peers { permanent_uuid: "fc3057f83b274f1b90772ae8607f285b" member_type: VOTER last_known_addr { host: "127.4.40.189" port: 36729 } } peers { permanent_uuid: "765edd5c23c74b1ebc0ea9420c19e5ed" member_type: VOTER last_known_addr { host: "127.4.40.188" port: 40125 } } } (error 0), [76ms] Sub RPC GetTableLocations: refreshing cache from master, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.190:39817, [76ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.189:36729, [77ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.188:40125, [79ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.190:39817: OK, [79ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.189:36729: OK, [80ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.188:40125: OK, [80ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125) has no leader., [96ms] Sub RPC GetTableLocations: refreshing cache from master, [96ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.190:39817, [96ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.189:36729, [97ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.188:40125, [98ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.190:39817: OK, [100ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.188:40125: OK, [101ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.189:36729: OK, [101ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125) has no leader., [116ms] Sub RPC GetTableLocations: refreshing cache from master, [116ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.190:39817, [117ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.189:36729, [117ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.188:40125, [120ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.189:36729: OK, [120ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.190:39817: OK, [120ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.188:40125: OK, [121ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125) has no leader., [136ms] Sub RPC GetTableLocations: refreshing cache from master, [136ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.190:39817, [137ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.189:36729, [137ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.188:40125, [139ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.189:36729: OK, [140ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.188:40125: OK, [140ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.190:39817: OK, [140ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125) has no leader., [176ms] Sub RPC GetTableLocations: refreshing cache from master, [176ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.190:39817, [176ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.189:36729, [176ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.188:40125, [179ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.188:40125: OK, [179ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.189:36729: OK, [179ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.190:39817: OK, [179ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125) has no leader., [196ms] Sub RPC GetTableLocations: refreshing cache from master, [196ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.190:39817, [196ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.189:36729, [196ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.188:40125, [199ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.190:39817: OK, [199ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.188:40125: OK, [199ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.189:36729: OK, [199ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125) has no leader., [236ms] Sub RPC GetTableLocations: refreshing cache from master, [236ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.190:39817, [237ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.189:36729, [237ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.188:40125, [239ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.190:39817: OK, [239ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.189:36729: OK, [239ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.188:40125: OK, [240ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125) has no leader., [275ms] Sub RPC GetTableLocations: refreshing cache from master, [276ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.190:39817, [276ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.189:36729, [276ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.188:40125, [278ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.189:36729: OK, [279ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.190:39817: OK, [280ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.188:40125: OK, [280ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125) has no leader., [295ms] Sub RPC GetTableLocations: refreshing cache from master, [296ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.190:39817, [296ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.189:36729, [296ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.188:40125, [299ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.188:40125: OK, [299ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.189:36729: OK, [299ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.190:39817: OK, [300ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.4.40.190:39817,127.4.40.189:36729,127.4.40.188:40125) has no leader., [1016ms] Sub RPC GetTableLocations: refreshing cache from master, [1016ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.190:39817, [1016ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.189:36729, [1017ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.40.188:40125, [1018ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.190:39817: OK, [1019ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.188:40125: OK, [1022ms] Sub RPC ConnectToMaster: received response from server master-127.4.40.189:36729: OK, [1024ms] Sub RPC GetTableLocations: sending RPC to server master-127.4.40.189:36729, [1027ms] Sub RPC GetTableLocations: received response from server master-127.4.40.189:36729: OK, [1028ms] sending RPC to server f11dd9759d47486b82dadfb50f55da8c, [1031ms] received response from server f11dd9759d47486b82dadfb50f55da8c: Network error: Failed to connect to peer f11dd9759d47486b82dadfb50f55da8c(127.4.40.131:43953): Connection refused: /127.4.40.131:43953, [1031ms] delaying RPC due to: Network error: Failed to connect to peer f11dd9759d47486b82dadfb50f55da8c(127.4.40.131:43953): Connection refused: /127.4.40.131:43953, [1056ms] refreshing cache from master, [1056ms] Sub RPC GetTableLocations: sending RPC to server master-127.4.40.189:36729, [1058ms] Sub RPC GetTableLocations: received response from server master-127.4.40.189:36729: OK, [1061ms] sending RPC to server f11dd9759d47486b82dadfb50f55da8c, [1063ms] received response from server f11dd9759d47486b82dadfb50f55da8c: Network error: Failed to connect to peer f11dd9759d47486b82dadfb50f55da8c(127.4.40.131:43953): Connection refused: /127.4.40.131:43953, [1063ms] delaying RPC due to: Network error: Failed to connect to peer f11dd9759d47486b82dadfb50f55da8c(127.4.40.131:43953): Connection refused: /127.4.40.131:43953, [1136ms] refreshing cache from master, [1136ms] too many traces: truncated at 100 traces, deferred=Deferred@1796968914(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$238/0x00007fe8483357f8@536f6cc1 -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@452568265 after retry RPC@2068641349) -> (continuation of Deferred@1581994971 after retry RPC@242345419) -> (continuation of Deferred@1046188377 after retry RPC@1057322212) -> (continuation of Deferred@510563624 after retry RPC@1331847794), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@62242bfe -> wakeup thread Time-limited test -> (continuation of Deferred@452568265 after retry RPC@2068641349) -> (continuation of Deferred@1581994971 after retry RPC@242345419) -> (continuation of Deferred@1046188377 after retry RPC@1057322212) -> (continuation of Deferred@510563624 after retry RPC@1331847794))) after lookup
18:29:25.486 [DEBUG - kudu-nio-1] (Connection.java:748) [peer a21237301eac491aa3bceb485bedd4d1(127.4.40.130:37515)] connecting to peer
18:29:25.487 [DEBUG - kudu-nio-2] (Connection.java:757) [peer a21237301eac491aa3bceb485bedd4d1(127.4.40.130:37515)] Successfully connected to peer
18:29:25.506 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0xa1a5bf88, L:/127.0.0.1:44632 - R:/127.4.40.130:37515] using TOKEN/null
18:29:25.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.511189  4622 raft_consensus.cc:1275] T 8c227e7597694257901adcf3484c16af P 4a46d44cd1bf40519816989ced7df794 [term 2 FOLLOWER]: Refusing update from remote peer a21237301eac491aa3bceb485bedd4d1: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 2 index: 13. (index mismatch)
18:29:25.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:25.511677  4694 consensus_peers.cc:597] T 8c227e7597694257901adcf3484c16af P a21237301eac491aa3bceb485bedd4d1 -> Peer f11dd9759d47486b82dadfb50f55da8c (127.4.40.131:43953): Couldn't send request to peer f11dd9759d47486b82dadfb50f55da8c. Status: Network error: Client connection negotiation failed: client connection to 127.4.40.131:43953: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
18:29:25.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.512010  5116 consensus_queue.cc:1048] T 8c227e7597694257901adcf3484c16af P a21237301eac491aa3bceb485bedd4d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a46d44cd1bf40519816989ced7df794" member_type: VOTER last_known_addr { host: "127.4.40.129" port: 44141 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
18:29:25.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.514007  4671 heartbeater.cc:499] Master 127.4.40.189:36729 was elected leader, sending a full tablet report...
18:29:25.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.517225  5123 mvcc.cc:204] Tried to move back new op lower bound from 7305360857125412864 to 7305360856879718400. Current Snapshot: MvccSnapshot[applied={T|T < 7305360857125412864}]
18:29:25.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.520133  5124 mvcc.cc:204] Tried to move back new op lower bound from 7305360857125412864 to 7305360856879718400. Current Snapshot: MvccSnapshot[applied={T|T < 7305360857125412864}]
18:29:25.597 [DEBUG - kudu-nio-2] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 20 rows, more = false) for scanner KuduScanner(table=org.apache.kudu.client.TestClientFailoverSupport-RESTART, tablet=8c227e7597694257901adcf3484c16af, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
18:29:25.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.599880  4372 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:59824:
18:29:25.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "org.apache.kudu.client.TestClientFailoverSupport-RESTART" }
18:29:25.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.600138  4372 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:59824:
18:29:25.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "org.apache.kudu.client.TestClientFailoverSupport-RESTART" }
18:29:25.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.609915  4372 catalog_manager.cc:5983] T 00000000000000000000000000000000 P fc3057f83b274f1b90772ae8607f285b: Sending DeleteTablet for 3 replicas of tablet 8c227e7597694257901adcf3484c16af
18:29:25.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.632334  4603 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c227e7597694257901adcf3484c16af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-07-08 18:29:25 UTC) from {username='slave'} at 127.0.0.1:44614
18:29:25.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:25.643801  4356 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.40.131:43953: connect: Connection refused (error 111) [suppressed 4 similar messages]
18:29:25.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.647034  5132 tablet_replica.cc:333] T 8c227e7597694257901adcf3484c16af P 4a46d44cd1bf40519816989ced7df794: stopping tablet replica
18:29:25.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.648070  5132 raft_consensus.cc:2243] T 8c227e7597694257901adcf3484c16af P 4a46d44cd1bf40519816989ced7df794 [term 2 FOLLOWER]: Raft consensus shutting down.
18:29:25.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.649209  5132 raft_consensus.cc:2272] T 8c227e7597694257901adcf3484c16af P 4a46d44cd1bf40519816989ced7df794 [term 2 FOLLOWER]: Raft consensus is shut down!
18:29:25.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.651955  5132 ts_tablet_manager.cc:1916] T 8c227e7597694257901adcf3484c16af P 4a46d44cd1bf40519816989ced7df794: Deleting tablet data with delete state TABLET_DATA_DELETED
18:29:25.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.662065  5132 ts_tablet_manager.cc:1929] T 8c227e7597694257901adcf3484c16af P 4a46d44cd1bf40519816989ced7df794: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.22
18:29:25.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.662987  5132 log.cc:1199] T 8c227e7597694257901adcf3484c16af P 4a46d44cd1bf40519816989ced7df794: Deleting WAL directory at /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/ts-0/wal/wals/8c227e7597694257901adcf3484c16af
18:29:25.664 [DEBUG - main] (Connection.java:575) [peer f11dd9759d47486b82dadfb50f55da8c(127.4.40.131:43953)] disconnecting while in state TERMINATED
18:29:25.664 [DEBUG - main] (Connection.java:575) [peer master-127.4.40.189:36729(127.4.40.189:36729)] disconnecting while in state READY
18:29:25.664 [DEBUG - main] (Connection.java:575) [peer master-127.4.40.190:39817(127.4.40.190:39817)] disconnecting while in state READY
18:29:25.665 [DEBUG - main] (Connection.java:575) [peer a21237301eac491aa3bceb485bedd4d1(127.4.40.130:37515)] disconnecting while in state READY
18:29:25.665 [DEBUG - main] (Connection.java:575) [peer master-127.4.40.188:40125(127.4.40.188:40125)] disconnecting while in state READY
18:29:25.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.664845  4742 tablet_service.cc:1558] Processing DeleteTablet for tablet 8c227e7597694257901adcf3484c16af with delete_type TABLET_DATA_DELETED (Table deleted at 2026-07-08 18:29:25 UTC) from {username='slave'} at 127.0.0.1:44648
18:29:25.666 [DEBUG - kudu-nio-5] (Connection.java:239) [peer master-127.4.40.190:39817(127.4.40.190:39817)] handling channelInactive
18:29:25.666 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.40.190:39817(127.4.40.190:39817)] cleaning up while in state READY due to: connection closed
18:29:25.666 [DEBUG - kudu-nio-2] (Connection.java:239) [peer a21237301eac491aa3bceb485bedd4d1(127.4.40.130:37515)] handling channelInactive
18:29:25.666 [DEBUG - kudu-nio-2] (Connection.java:709) [peer a21237301eac491aa3bceb485bedd4d1(127.4.40.130:37515)] cleaning up while in state READY due to: connection closed
18:29:25.666 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.4.40.188:40125(127.4.40.188:40125)] handling channelInactive
18:29:25.667 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.40.188:40125(127.4.40.188:40125)] cleaning up while in state READY due to: connection closed
18:29:25.668 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
18:29:25.668 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.4.40.189:36729(127.4.40.189:36729)] handling channelInactive
18:29:25.668 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.40.189:36729(127.4.40.189:36729)] cleaning up while in state READY due to: connection closed
18:29:25.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.671193  5132 ts_tablet_manager.cc:1950] T 8c227e7597694257901adcf3484c16af P 4a46d44cd1bf40519816989ced7df794: Deleting consensus metadata
18:29:25.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.671634  4258 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskRlQDJI/build/asan/bin/kudu pid 4541
18:29:25.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.673478  4357 catalog_manager.cc:5027] TS 4a46d44cd1bf40519816989ced7df794 (127.4.40.129:44141): tablet 8c227e7597694257901adcf3484c16af (table org.apache.kudu.client.TestClientFailoverSupport-RESTART [id=3237ab7b611f4c27b316c87cfd64786d]) successfully deleted
18:29:25.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.674837  5134 tablet_replica.cc:333] T 8c227e7597694257901adcf3484c16af P a21237301eac491aa3bceb485bedd4d1: stopping tablet replica
18:29:25.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.675431  5134 raft_consensus.cc:2243] T 8c227e7597694257901adcf3484c16af P a21237301eac491aa3bceb485bedd4d1 [term 2 LEADER]: Raft consensus shutting down.
18:29:25.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.677102  5134 raft_consensus.cc:2272] T 8c227e7597694257901adcf3484c16af P a21237301eac491aa3bceb485bedd4d1 [term 2 FOLLOWER]: Raft consensus is shut down!
18:29:25.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.679415  5134 ts_tablet_manager.cc:1916] T 8c227e7597694257901adcf3484c16af P a21237301eac491aa3bceb485bedd4d1: Deleting tablet data with delete state TABLET_DATA_DELETED
18:29:25.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:25.682863  4356 catalog_manager.cc:4754] TS f11dd9759d47486b82dadfb50f55da8c (127.4.40.131:43953): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8c227e7597694257901adcf3484c16af: Network error: Client connection negotiation failed: client connection to 127.4.40.131:43953: connect: Connection refused (error 111)
18:29:25.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.689014  5134 ts_tablet_manager.cc:1929] T 8c227e7597694257901adcf3484c16af P a21237301eac491aa3bceb485bedd4d1: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.22
18:29:25.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.689476  5134 log.cc:1199] T 8c227e7597694257901adcf3484c16af P a21237301eac491aa3bceb485bedd4d1: Deleting WAL directory at /tmp/dist-test-taskRlQDJI/test-tmp/mini-kudu-cluster10245134338740646263/ts-1/wal/wals/8c227e7597694257901adcf3484c16af
18:29:25.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.690308  5134 ts_tablet_manager.cc:1950] T 8c227e7597694257901adcf3484c16af P a21237301eac491aa3bceb485bedd4d1: Deleting consensus metadata
18:29:25.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.692449  4356 catalog_manager.cc:5027] TS a21237301eac491aa3bceb485bedd4d1 (127.4.40.130:37515): tablet 8c227e7597694257901adcf3484c16af (table org.apache.kudu.client.TestClientFailoverSupport-RESTART [id=3237ab7b611f4c27b316c87cfd64786d]) successfully deleted
18:29:25.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.694541  4664 generic_service.cc:196] Checking for leaks (request via RPC)
18:29:25.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.796079  4258 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskRlQDJI/build/asan/bin/kudu with pid 4541
18:29:25.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.815181  4258 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskRlQDJI/build/asan/bin/kudu pid 4679
18:29:25.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.822546  4802 generic_service.cc:196] Checking for leaks (request via RPC)
18:29:25.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.945534  4258 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskRlQDJI/build/asan/bin/kudu with pid 4679
18:29:25.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.965628  4258 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskRlQDJI/build/asan/bin/kudu pid 4995
18:29:25.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:25.973018  5057 generic_service.cc:196] Checking for leaks (request via RPC)
18:29:26.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:26.080240  4258 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskRlQDJI/build/asan/bin/kudu with pid 4995
18:29:26.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:26.102444  4258 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskRlQDJI/build/asan/bin/kudu pid 4338
18:29:26.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:26.103615  4403 generic_service.cc:196] Checking for leaks (request via RPC)
18:29:26.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:26.218431  4258 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskRlQDJI/build/asan/bin/kudu with pid 4338
18:29:26.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 18:29:26.240360  4431 connection.cc:573] server connection from 127.0.0.1:50056 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
18:29:26.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:26.240685  4258 external_mini_cluster.cc:1705] Attempting to check leaks for /tmp/dist-test-taskRlQDJI/build/asan/bin/kudu pid 4410
18:29:26.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:26.241734  4474 generic_service.cc:196] Checking for leaks (request via RPC)
18:29:26.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 18:29:26.348783  4258 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskRlQDJI/build/asan/bin/kudu with pid 4410
18:29:26.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T18:29:26Z chronyd exiting

Time: 16.18

OK (2 tests)

