JUnit version 4.13.2
.02:03:45.410 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1779069825401
02:03:45.462 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
02:03:45.521 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
02:03:45.530 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskvuyF4C/test-tmp
02:03:45.535 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
02:03:45.538 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskvuyF4C/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
02:03:45.735 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

02:03:45.914 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
02:03:45.915 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

02:03:45.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:45.919574  3928 mini_oidc.cc:150] Starting JWKS server
02:03:45.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:45.923044  3928 webserver.cc:533] Webserver started at http://127.0.0.1:42027/ using document root <none> and password file <none>
02:03:45.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:45.923601  3928 mini_oidc.cc:186] Starting OIDC Discovery server
02:03:45.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:45.925560  3928 webserver.cc:533] Webserver started at http://127.0.0.1:38953/ using document root <none> and password file <none>
02:03:45.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T02:03:45Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
02:03:45.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T02:03:45Z Disabled control of system clock
02:03:45.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:45.982648  3928 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskvuyF4C/build/tsan/bin/kudu
02:03:45.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskvuyF4C/build/tsan/bin/kudu
02:03:45.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/master-0/wal
02:03:45.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/master-0/data
02:03:45.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:03:45.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:03:45.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:03:45.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:03:45.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:03:45.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:03:45.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/master-0/logs
02:03:45.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/master-0/data/info.pb
02:03:45.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:03:45.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:03:45.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:03:45.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:03:45.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:03:45.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:03:45.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:03:45.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:03:45.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
02:03:45.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:03:45.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:03:45.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:03:45.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.214.62:33483
02:03:45.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.214.62
02:03:45.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:03:45.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.214.20:43891
02:03:45.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:03:45.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:03:45.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:03:45.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:03:45.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.3.214.62:33483,127.3.214.61:37531,127.3.214.60:35211
02:03:45.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:03:45.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:42027/jwks.json with env {}
02:03:46.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:46.277047  3940 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:03:46.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:46.277611  3940 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:03:46.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:46.278337  3940 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:03:46.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:46.311861  3940 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
02:03:46.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:46.312180  3940 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:03:46.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:46.312373  3940 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
02:03:46.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:46.312553  3940 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
02:03:46.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:46.312739  3940 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
02:03:46.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:46.312944  3940 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:42027/jwks.json
02:03:46.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:46.351110  3940 master_runner.cc:387] Master server non-default flags:
02:03:46.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:03:46.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.214.20:43891
02:03:46.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:03:46.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:03:46.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/master-0/data
02:03:46.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/master-0/wal
02:03:46.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:03:46.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.3.214.62:33483,127.3.214.61:37531,127.3.214.60:35211
02:03:46.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:03:46.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:03:46.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:03:46.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.214.62:33483
02:03:46.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:03:46.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:03:46.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:03:46.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:42027/jwks.json
02:03:46.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:03:46.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:03:46.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/master-0/data/info.pb
02:03:46.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.214.62
02:03:46.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:03:46.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:03:46.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:03:46.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:03:46.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:03:46.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:03:46.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/master-0/logs
02:03:46.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:03:46.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:03:46.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:03:46.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
02:03:46.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:03:46.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
02:03:46.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:03:46.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 01:43:23 UTC on e7f111948823
02:03:46.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11951
02:03:46.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:03:46.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:46.352526  3940 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:03:46.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:46.354698  3940 file_cache.cc:492] Constructed file cache file cache with capacity 419430
02:03:46.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:46.368525  3946 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:03:47.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:47.770372  3945 debug-util.cc:398] Leaking SignalData structure 0x7b08000271e0 after lost signal to thread 3940
02:03:47.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:47.927029  3940 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.558s	user 0.631s	sys 0.927s
02:03:47.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:47.928928  3940 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.560s	user 0.631s	sys 0.927s
02:03:47.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:46.370138  3947 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:03:47.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:47.929788  3948 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1560 milliseconds
02:03:47.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:47.929901  3949 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:03:47.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:47.930264  3940 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
02:03:47.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:47.934134  3940 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:03:47.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:47.936492  3940 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:03:47.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:47.937829  3940 hybrid_clock.cc:648] HybridClock initialized: now 1779069827937786 us; error 57 us; skew 500 ppm
02:03:47.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:47.938789  3940 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:03:47.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:47.945050  3940 webserver.cc:533] Webserver started at http://127.3.214.62:37833/ using document root <none> and password file <none>
02:03:47.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:47.946192  3940 fs_manager.cc:362] Metadata directory not provided
02:03:47.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:47.946422  3940 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:03:47.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:47.947006  3940 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:03:47.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:47.951614  3940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/master-0/data/instance:
02:03:47.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d4c56e542e4e4647be8f87b8ee56969b"
02:03:47.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:03:47 on dist-test-slave-m4h6"
02:03:47.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:47.953116  3940 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/master-0/wal/instance:
02:03:47.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d4c56e542e4e4647be8f87b8ee56969b"
02:03:47.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:03:47 on dist-test-slave-m4h6"
02:03:47.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:47.961614  3940 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.006s	sys 0.002s
02:03:47.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:47.967787  3956 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:03:47.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:47.969173  3940 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.002s
02:03:47.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:47.969492  3940 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/master-0/data,/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/master-0/wal
02:03:47.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d4c56e542e4e4647be8f87b8ee56969b"
02:03:47.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:03:47 on dist-test-slave-m4h6"
02:03:47.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:47.969816  3940 fs_report.cc:389] FS layout report
02:03:47.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:03:47.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/master-0/wal
02:03:47.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/master-0/wal
02:03:47.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/master-0/data/data
02:03:47.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:03:47.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:03:47.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:03:47.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:03:47.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:03:47.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:03:47.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:03:47.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:03:47.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:03:47.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:03:47.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:03:48.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:48.025662  3940 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:03:48.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:48.027151  3940 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:03:48.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:48.027580  3940 kserver.cc:163] Server-wide thread pool size limit: 3276
02:03:48.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:48.096518  3940 rpc_server.cc:307] RPC server started. Bound to: 127.3.214.62:33483
02:03:48.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:48.096619  4007 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.214.62:33483 every 8 connection(s)
02:03:48.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:48.099558  3940 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/master-0/data/info.pb
02:03:48.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:48.102442  3928 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskvuyF4C/build/tsan/bin/kudu as pid 3940
02:03:48.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:48.102968  3928 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/master-0/wal/instance
02:03:48.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:48.107491  4008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
02:03:48.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:48.108242  3928 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskvuyF4C/build/tsan/bin/kudu
02:03:48.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskvuyF4C/build/tsan/bin/kudu
02:03:48.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/master-1/wal
02:03:48.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/master-1/data
02:03:48.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:03:48.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:03:48.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:03:48.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:03:48.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:03:48.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:03:48.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/master-1/logs
02:03:48.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/master-1/data/info.pb
02:03:48.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:03:48.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:03:48.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:03:48.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:03:48.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:03:48.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:03:48.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:03:48.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:03:48.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
02:03:48.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:03:48.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:03:48.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:03:48.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.214.61:37531
02:03:48.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.214.61
02:03:48.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:03:48.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.214.20:43891
02:03:48.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:03:48.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:03:48.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:03:48.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:03:48.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.3.214.62:33483,127.3.214.61:37531,127.3.214.60:35211
02:03:48.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:03:48.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:42027/jwks.json with env {}
02:03:48.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:48.122416  4008 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.214.62" port: 33483 } has no permanent_uuid. Determining permanent_uuid...
02:03:48.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:48.148743  4008 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.214.61" port: 37531 } has no permanent_uuid. Determining permanent_uuid...
02:03:48.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:48.151336  3958 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.214.61:37531: connect: Connection refused (error 111)
02:03:48.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:48.156062  4008 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.214.61:37531: Network error: Client connection negotiation failed: client connection to 127.3.214.61:37531: connect: Connection refused (error 111)
02:03:48.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:48.205657  4008 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.214.61" port: 37531 } attempt: 1
02:03:48.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:48.209515  4008 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.214.61:37531: Network error: Client connection negotiation failed: client connection to 127.3.214.61:37531: connect: Connection refused (error 111)
02:03:48.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:48.277891  4008 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.214.61" port: 37531 } attempt: 2
02:03:48.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:48.282083  4008 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.214.61:37531: Network error: Client connection negotiation failed: client connection to 127.3.214.61:37531: connect: Connection refused (error 111)
02:03:48.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:48.373466  4008 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.214.61" port: 37531 } attempt: 3
02:03:48.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:48.377351  4008 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.214.61:37531: Network error: Client connection negotiation failed: client connection to 127.3.214.61:37531: connect: Connection refused (error 111)
02:03:48.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:48.420148  4010 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:03:48.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:48.420713  4010 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:03:48.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:48.421165  4010 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:03:48.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:48.454638  4010 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
02:03:48.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:48.454984  4010 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:03:48.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:48.455209  4010 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
02:03:48.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:48.455399  4010 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
02:03:48.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:48.455628  4010 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
02:03:48.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:48.455770  4010 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:42027/jwks.json
02:03:48.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:48.496233  4010 master_runner.cc:387] Master server non-default flags:
02:03:48.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:03:48.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.214.20:43891
02:03:48.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:03:48.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:03:48.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/master-1/data
02:03:48.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/master-1/wal
02:03:48.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:03:48.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.3.214.62:33483,127.3.214.61:37531,127.3.214.60:35211
02:03:48.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:03:48.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:03:48.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:03:48.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.214.61:37531
02:03:48.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:03:48.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:03:48.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:03:48.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:42027/jwks.json
02:03:48.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:03:48.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:03:48.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/master-1/data/info.pb
02:03:48.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.214.61
02:03:48.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:03:48.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:03:48.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:03:48.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:03:48.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:03:48.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:03:48.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/master-1/logs
02:03:48.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:03:48.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:03:48.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:03:48.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
02:03:48.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:03:48.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
02:03:48.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:03:48.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 01:43:23 UTC on e7f111948823
02:03:48.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11951
02:03:48.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:03:48.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:48.497748  4010 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:03:48.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:48.499651  4010 file_cache.cc:492] Constructed file cache file cache with capacity 419430
02:03:48.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:48.512310  4019 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:03:48.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:48.520732  4008 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.214.61" port: 37531 } attempt: 4
02:03:48.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:48.527626  4008 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.214.61:37531: Network error: Client connection negotiation failed: client connection to 127.3.214.61:37531: connect: Connection refused (error 111)
02:03:48.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:48.827126  4008 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.214.61" port: 37531 } attempt: 5
02:03:48.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:48.833223  4008 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.214.61:37531: Network error: Client connection negotiation failed: client connection to 127.3.214.61:37531: connect: Connection refused (error 111)
02:03:49.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:49.380714  4008 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.214.61" port: 37531 } attempt: 6
02:03:49.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:49.415406  4008 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.214.61:37531: Network error: Client connection negotiation failed: client connection to 127.3.214.61:37531: connect: Connection refused (error 111)
02:03:49.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:48.512663  4020 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:03:49.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:49.781430  4022 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:03:49.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:49.784088  4010 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.272s	user 0.384s	sys 0.871s
02:03:49.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:49.785104  4010 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.273s	user 0.384s	sys 0.872s
02:03:49.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:49.786089  4021 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1265 milliseconds
02:03:49.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:49.786109  4010 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
02:03:49.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:49.787779  4010 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:03:49.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:49.790429  4010 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:03:49.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:49.791795  4010 hybrid_clock.cc:648] HybridClock initialized: now 1779069829791758 us; error 52 us; skew 500 ppm
02:03:49.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:49.792712  4010 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:03:49.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:49.799855  4010 webserver.cc:533] Webserver started at http://127.3.214.61:37445/ using document root <none> and password file <none>
02:03:49.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:49.800944  4010 fs_manager.cc:362] Metadata directory not provided
02:03:49.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:49.801172  4010 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:03:49.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:49.801748  4010 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:03:49.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:49.806301  4010 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/master-1/data/instance:
02:03:49.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f64b888c0b984212ac259d020ce9a646"
02:03:49.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:03:49 on dist-test-slave-m4h6"
02:03:49.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:49.807612  4010 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/master-1/wal/instance:
02:03:49.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f64b888c0b984212ac259d020ce9a646"
02:03:49.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:03:49 on dist-test-slave-m4h6"
02:03:49.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:49.815575  4010 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.001s
02:03:49.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:49.822000  4031 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:03:49.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:49.823288  4010 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
02:03:49.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:49.823693  4010 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/master-1/data,/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/master-1/wal
02:03:49.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f64b888c0b984212ac259d020ce9a646"
02:03:49.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:03:49 on dist-test-slave-m4h6"
02:03:49.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:49.824133  4010 fs_report.cc:389] FS layout report
02:03:49.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:03:49.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/master-1/wal
02:03:49.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/master-1/wal
02:03:49.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/master-1/data/data
02:03:49.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:03:49.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:03:49.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:03:49.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:03:49.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:03:49.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:03:49.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:03:49.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:03:49.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:03:49.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:03:49.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:03:49.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:49.892560  4010 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:03:49.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:49.894157  4010 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:03:49.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:49.894635  4010 kserver.cc:163] Server-wide thread pool size limit: 3276
02:03:49.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:49.961905  4010 rpc_server.cc:307] RPC server started. Bound to: 127.3.214.61:37531
02:03:49.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:49.961980  4082 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.214.61:37531 every 8 connection(s)
02:03:49.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:49.964906  4010 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/master-1/data/info.pb
02:03:49.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:49.970113  3928 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskvuyF4C/build/tsan/bin/kudu as pid 4010
02:03:49.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:49.970451  3928 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/master-1/wal/instance
02:03:49.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:49.971176  4083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
02:03:49.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:49.972453  3928 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskvuyF4C/build/tsan/bin/kudu
02:03:49.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskvuyF4C/build/tsan/bin/kudu
02:03:49.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/master-2/wal
02:03:49.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/master-2/data
02:03:49.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:03:49.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:03:49.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:03:49.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:03:49.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:03:49.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:03:49.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/master-2/logs
02:03:49.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/master-2/data/info.pb
02:03:49.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:03:49.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:03:49.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:03:49.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:03:49.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:03:49.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:03:49.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:03:49.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:03:49.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
02:03:49.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:03:49.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:03:49.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:03:49.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.214.60:35211
02:03:49.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.214.60
02:03:49.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:03:49.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.214.20:43891
02:03:49.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:03:49.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:03:49.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:03:49.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:03:49.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.3.214.62:33483,127.3.214.61:37531,127.3.214.60:35211
02:03:49.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:03:49.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:42027/jwks.json with env {}
02:03:49.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:49.984320  4083 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.214.62" port: 33483 } has no permanent_uuid. Determining permanent_uuid...
02:03:50.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:50.004956  4083 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.214.61" port: 37531 } has no permanent_uuid. Determining permanent_uuid...
02:03:50.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:50.018491  4083 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.214.60" port: 35211 } has no permanent_uuid. Determining permanent_uuid...
02:03:50.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:50.020763  4035 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.214.60:35211: connect: Connection refused (error 111)
02:03:50.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:50.024667  4083 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.214.60:35211: Network error: Client connection negotiation failed: client connection to 127.3.214.60:35211: connect: Connection refused (error 111)
02:03:50.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:50.074208  4083 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.214.60" port: 35211 } attempt: 1
02:03:50.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:50.078503  4083 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.214.60:35211: Network error: Client connection negotiation failed: client connection to 127.3.214.60:35211: connect: Connection refused (error 111)
02:03:50.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:50.146963  4083 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.214.60" port: 35211 } attempt: 2
02:03:50.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:50.151201  4083 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.214.60:35211: Network error: Client connection negotiation failed: client connection to 127.3.214.60:35211: connect: Connection refused (error 111)
02:03:50.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:50.242619  4083 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.214.60" port: 35211 } attempt: 3
02:03:50.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:50.246886  4083 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.214.60:35211: Network error: Client connection negotiation failed: client connection to 127.3.214.60:35211: connect: Connection refused (error 111)
02:03:50.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:50.278699  4085 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:03:50.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:50.279240  4085 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:03:50.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:50.279678  4085 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:03:50.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:50.312232  4085 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
02:03:50.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:50.312510  4085 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:03:50.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:50.312713  4085 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
02:03:50.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:50.312894  4085 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
02:03:50.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:50.313071  4085 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
02:03:50.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:50.313216  4085 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:42027/jwks.json
02:03:50.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:50.351644  4085 master_runner.cc:387] Master server non-default flags:
02:03:50.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:03:50.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.214.20:43891
02:03:50.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:03:50.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:03:50.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/master-2/data
02:03:50.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/master-2/wal
02:03:50.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:03:50.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.3.214.62:33483,127.3.214.61:37531,127.3.214.60:35211
02:03:50.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:03:50.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:03:50.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:03:50.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.214.60:35211
02:03:50.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:03:50.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:03:50.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:03:50.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:42027/jwks.json
02:03:50.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:03:50.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:03:50.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/master-2/data/info.pb
02:03:50.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.214.60
02:03:50.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:03:50.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:03:50.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:03:50.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:03:50.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:03:50.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:03:50.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/master-2/logs
02:03:50.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:03:50.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:03:50.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:03:50.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
02:03:50.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:03:50.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
02:03:50.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:03:50.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 01:43:23 UTC on e7f111948823
02:03:50.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11951
02:03:50.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:03:50.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:50.353058  4085 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:03:50.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:50.354782  4085 file_cache.cc:492] Constructed file cache file cache with capacity 419430
02:03:50.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:50.365592  4095 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:03:50.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:50.390277  4083 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.214.60" port: 35211 } attempt: 4
02:03:50.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:50.397332  4083 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.214.60:35211: Network error: Client connection negotiation failed: client connection to 127.3.214.60:35211: connect: Connection refused (error 111)
02:03:50.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:50.475948  4008 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.214.61" port: 37531 } attempt: 7
02:03:50.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:50.504740  4008 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.214.60" port: 35211 } has no permanent_uuid. Determining permanent_uuid...
02:03:50.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:50.534744  4008 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.214.60:35211: Network error: Client connection negotiation failed: client connection to 127.3.214.60:35211: connect: Connection refused (error 111)
02:03:50.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:50.593257  4008 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.214.60" port: 35211 } attempt: 1
02:03:50.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:50.598968  4008 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.214.60:35211: Network error: Client connection negotiation failed: client connection to 127.3.214.60:35211: connect: Connection refused (error 111)
02:03:50.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:50.680461  4008 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.214.60" port: 35211 } attempt: 2
02:03:50.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:50.686451  4008 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.214.60:35211: Network error: Client connection negotiation failed: client connection to 127.3.214.60:35211: connect: Connection refused (error 111)
02:03:50.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:50.696799  4083 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.214.60" port: 35211 } attempt: 5
02:03:50.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:50.707651  4083 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.214.60:35211: Network error: Client connection negotiation failed: client connection to 127.3.214.60:35211: connect: Connection refused (error 111)
02:03:50.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:50.771992  4008 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.214.60" port: 35211 } attempt: 3
02:03:50.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:50.779297  4008 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.214.60:35211: Network error: Client connection negotiation failed: client connection to 127.3.214.60:35211: connect: Connection refused (error 111)
02:03:50.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:50.919835  4008 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.214.60" port: 35211 } attempt: 4
02:03:50.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:50.926865  4008 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.214.60:35211: Network error: Client connection negotiation failed: client connection to 127.3.214.60:35211: connect: Connection refused (error 111)
02:03:51.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:51.210389  4008 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.214.60" port: 35211 } attempt: 5
02:03:51.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:51.217388  4008 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.214.60:35211: Network error: Client connection negotiation failed: client connection to 127.3.214.60:35211: connect: Connection refused (error 111)
02:03:51.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:51.255704  4083 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.214.60" port: 35211 } attempt: 6
02:03:51.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:51.280218  4083 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.214.60:35211: Network error: Client connection negotiation failed: client connection to 127.3.214.60:35211: connect: Connection refused (error 111)
02:03:51.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:50.366097  4096 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:03:51.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:51.698742  4097 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1330 milliseconds
02:03:51.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:51.699595  4098 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:03:51.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:51.702004  4085 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.336s	user 0.496s	sys 0.839s
02:03:51.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:51.702726  4085 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.337s	user 0.497s	sys 0.840s
02:03:51.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:51.703028  4085 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
02:03:51.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:51.704530  4085 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:03:51.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:51.707628  4085 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:03:51.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:51.709415  4085 hybrid_clock.cc:648] HybridClock initialized: now 1779069831709355 us; error 56 us; skew 500 ppm
02:03:51.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:51.710507  4085 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:03:51.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:51.719475  4085 webserver.cc:533] Webserver started at http://127.3.214.60:41583/ using document root <none> and password file <none>
02:03:51.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:51.720829  4085 fs_manager.cc:362] Metadata directory not provided
02:03:51.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:51.721127  4085 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:03:51.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:51.721666  4085 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:03:51.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:51.728303  4085 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/master-2/data/instance:
02:03:51.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "16601d0bcd514a8ba8ac0bc9afa2d561"
02:03:51.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:03:51 on dist-test-slave-m4h6"
02:03:51.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:51.729818  4085 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/master-2/wal/instance:
02:03:51.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "16601d0bcd514a8ba8ac0bc9afa2d561"
02:03:51.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:03:51 on dist-test-slave-m4h6"
02:03:51.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:51.739540  4085 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.007s	sys 0.003s
02:03:51.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:51.747182  4110 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:03:51.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:51.748684  4085 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.001s	sys 0.001s
02:03:51.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:51.749125  4085 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/master-2/data,/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/master-2/wal
02:03:51.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "16601d0bcd514a8ba8ac0bc9afa2d561"
02:03:51.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:03:51 on dist-test-slave-m4h6"
02:03:51.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:51.749589  4085 fs_report.cc:389] FS layout report
02:03:51.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:03:51.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/master-2/wal
02:03:51.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/master-2/wal
02:03:51.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/master-2/data/data
02:03:51.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:03:51.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:03:51.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:03:51.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:03:51.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:03:51.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:03:51.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:03:51.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:03:51.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:03:51.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:03:51.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:03:51.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:51.769884  4008 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.214.60" port: 35211 } attempt: 6
02:03:51.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:51.776675  4008 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.3.214.60:35211: Network error: Client connection negotiation failed: client connection to 127.3.214.60:35211: connect: Connection refused (error 111)
02:03:51.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:51.840477  4085 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:03:51.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:51.841974  4085 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:03:51.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:51.842387  4085 kserver.cc:163] Server-wide thread pool size limit: 3276
02:03:51.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:51.911305  4085 rpc_server.cc:307] RPC server started. Bound to: 127.3.214.60:35211
02:03:51.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:51.911391  4163 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.214.60:35211 every 8 connection(s)
02:03:51.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:51.913983  4085 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/master-2/data/info.pb
02:03:51.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:51.919781  4164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
02:03:51.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:51.922672  3928 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskvuyF4C/build/tsan/bin/kudu as pid 4085
02:03:51.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:51.923035  3928 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/master-2/wal/instance
02:03:51.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:51.932557  4164 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.214.62" port: 33483 } has no permanent_uuid. Determining permanent_uuid...
02:03:51.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:51.966231  4164 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.214.61" port: 37531 } has no permanent_uuid. Determining permanent_uuid...
02:03:51.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:51.978127  4164 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.3.214.60" port: 35211 } has no permanent_uuid. Determining permanent_uuid...
02:03:52.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.000022  4164 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 16601d0bcd514a8ba8ac0bc9afa2d561: Bootstrap starting.
02:03:52.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.006012  4164 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 16601d0bcd514a8ba8ac0bc9afa2d561: Neither blocks nor log segments found. Creating new log.
02:03:52.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.008955  4164 log.cc:826] T 00000000000000000000000000000000 P 16601d0bcd514a8ba8ac0bc9afa2d561: Log is configured to *not* fsync() on all Append() calls
02:03:52.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.014320  4164 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 16601d0bcd514a8ba8ac0bc9afa2d561: No bootstrap required, opened a new log
02:03:52.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.036448  4164 raft_consensus.cc:359] T 00000000000000000000000000000000 P 16601d0bcd514a8ba8ac0bc9afa2d561 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4c56e542e4e4647be8f87b8ee56969b" member_type: VOTER last_known_addr { host: "127.3.214.62" port: 33483 } } peers { permanent_uuid: "f64b888c0b984212ac259d020ce9a646" member_type: VOTER last_known_addr { host: "127.3.214.61" port: 37531 } } peers { permanent_uuid: "16601d0bcd514a8ba8ac0bc9afa2d561" member_type: VOTER last_known_addr { host: "127.3.214.60" port: 35211 } }
02:03:52.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.037084  4164 raft_consensus.cc:385] T 00000000000000000000000000000000 P 16601d0bcd514a8ba8ac0bc9afa2d561 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:03:52.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.037281  4164 raft_consensus.cc:740] T 00000000000000000000000000000000 P 16601d0bcd514a8ba8ac0bc9afa2d561 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 16601d0bcd514a8ba8ac0bc9afa2d561, State: Initialized, Role: FOLLOWER
02:03:52.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.037997  4164 consensus_queue.cc:260] T 00000000000000000000000000000000 P 16601d0bcd514a8ba8ac0bc9afa2d561 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4c56e542e4e4647be8f87b8ee56969b" member_type: VOTER last_known_addr { host: "127.3.214.62" port: 33483 } } peers { permanent_uuid: "f64b888c0b984212ac259d020ce9a646" member_type: VOTER last_known_addr { host: "127.3.214.61" port: 37531 } } peers { permanent_uuid: "16601d0bcd514a8ba8ac0bc9afa2d561" member_type: VOTER last_known_addr { host: "127.3.214.60" port: 35211 } }
02:03:52.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.041721  4173 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16601d0bcd514a8ba8ac0bc9afa2d561 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4c56e542e4e4647be8f87b8ee56969b" member_type: VOTER last_known_addr { host: "127.3.214.62" port: 33483 } } peers { permanent_uuid: "f64b888c0b984212ac259d020ce9a646" member_type: VOTER last_known_addr { host: "127.3.214.61" port: 37531 } } peers { permanent_uuid: "16601d0bcd514a8ba8ac0bc9afa2d561" member_type: VOTER last_known_addr { host: "127.3.214.60" port: 35211 } } }
02:03:52.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.042373  4173 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16601d0bcd514a8ba8ac0bc9afa2d561 [sys.catalog]: This master's current role is: FOLLOWER
02:03:52.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.043514  4164 sys_catalog.cc:565] T 00000000000000000000000000000000 P 16601d0bcd514a8ba8ac0bc9afa2d561 [sys.catalog]: configured and running, proceeding with master startup.
02:03:52.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:52.068507  4184 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 16601d0bcd514a8ba8ac0bc9afa2d561: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
02:03:52.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:52.068873  4184 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
02:03:52.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.064141  4085 master_runner.cc:187] Error getting master registration for 127.3.214.62:33483: OK, instance_id { permanent_uuid: "d4c56e542e4e4647be8f87b8ee56969b" instance_seqno: 1779069828078279 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
02:03:52.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.087497  4085 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
02:03:52.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:52.097393  4118 tablet.cc:2404] T 00000000000000000000000000000000 P 16601d0bcd514a8ba8ac0bc9afa2d561: Can't schedule compaction. Clean time has not been advanced past its initial value.
02:03:52.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.340737  4083 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.214.60" port: 35211 } attempt: 7
02:03:52.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.362159  4083 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f64b888c0b984212ac259d020ce9a646: Bootstrap starting.
02:03:52.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.368008  4083 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f64b888c0b984212ac259d020ce9a646: Neither blocks nor log segments found. Creating new log.
02:03:52.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.370515  4083 log.cc:826] T 00000000000000000000000000000000 P f64b888c0b984212ac259d020ce9a646: Log is configured to *not* fsync() on all Append() calls
02:03:52.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.374905  4083 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f64b888c0b984212ac259d020ce9a646: No bootstrap required, opened a new log
02:03:52.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.393915  4083 raft_consensus.cc:359] T 00000000000000000000000000000000 P f64b888c0b984212ac259d020ce9a646 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4c56e542e4e4647be8f87b8ee56969b" member_type: VOTER last_known_addr { host: "127.3.214.62" port: 33483 } } peers { permanent_uuid: "f64b888c0b984212ac259d020ce9a646" member_type: VOTER last_known_addr { host: "127.3.214.61" port: 37531 } } peers { permanent_uuid: "16601d0bcd514a8ba8ac0bc9afa2d561" member_type: VOTER last_known_addr { host: "127.3.214.60" port: 35211 } }
02:03:52.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.394537  4083 raft_consensus.cc:385] T 00000000000000000000000000000000 P f64b888c0b984212ac259d020ce9a646 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:03:52.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.394742  4083 raft_consensus.cc:740] T 00000000000000000000000000000000 P f64b888c0b984212ac259d020ce9a646 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f64b888c0b984212ac259d020ce9a646, State: Initialized, Role: FOLLOWER
02:03:52.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.395403  4083 consensus_queue.cc:260] T 00000000000000000000000000000000 P f64b888c0b984212ac259d020ce9a646 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4c56e542e4e4647be8f87b8ee56969b" member_type: VOTER last_known_addr { host: "127.3.214.62" port: 33483 } } peers { permanent_uuid: "f64b888c0b984212ac259d020ce9a646" member_type: VOTER last_known_addr { host: "127.3.214.61" port: 37531 } } peers { permanent_uuid: "16601d0bcd514a8ba8ac0bc9afa2d561" member_type: VOTER last_known_addr { host: "127.3.214.60" port: 35211 } }
02:03:52.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.397827  4188 sys_catalog.cc:455] T 00000000000000000000000000000000 P f64b888c0b984212ac259d020ce9a646 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4c56e542e4e4647be8f87b8ee56969b" member_type: VOTER last_known_addr { host: "127.3.214.62" port: 33483 } } peers { permanent_uuid: "f64b888c0b984212ac259d020ce9a646" member_type: VOTER last_known_addr { host: "127.3.214.61" port: 37531 } } peers { permanent_uuid: "16601d0bcd514a8ba8ac0bc9afa2d561" member_type: VOTER last_known_addr { host: "127.3.214.60" port: 35211 } } }
02:03:52.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.398629  4188 sys_catalog.cc:458] T 00000000000000000000000000000000 P f64b888c0b984212ac259d020ce9a646 [sys.catalog]: This master's current role is: FOLLOWER
02:03:52.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.399571  4083 sys_catalog.cc:565] T 00000000000000000000000000000000 P f64b888c0b984212ac259d020ce9a646 [sys.catalog]: configured and running, proceeding with master startup.
02:03:52.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:52.402645  4037 tablet.cc:2404] T 00000000000000000000000000000000 P f64b888c0b984212ac259d020ce9a646: Can't schedule compaction. Clean time has not been advanced past its initial value.
02:03:52.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:52.429823  4199 catalog_manager.cc:1593] T 00000000000000000000000000000000 P f64b888c0b984212ac259d020ce9a646: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
02:03:52.430 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:52.430657  4199 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
02:03:52.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.423872  4010 master_runner.cc:187] Error getting master registration for 127.3.214.62:33483: OK, instance_id { permanent_uuid: "d4c56e542e4e4647be8f87b8ee56969b" instance_seqno: 1779069828078279 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
02:03:52.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.446245  4010 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
02:03:52.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.462725  4173 raft_consensus.cc:493] T 00000000000000000000000000000000 P 16601d0bcd514a8ba8ac0bc9afa2d561 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
02:03:52.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.463315  4173 raft_consensus.cc:515] T 00000000000000000000000000000000 P 16601d0bcd514a8ba8ac0bc9afa2d561 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4c56e542e4e4647be8f87b8ee56969b" member_type: VOTER last_known_addr { host: "127.3.214.62" port: 33483 } } peers { permanent_uuid: "f64b888c0b984212ac259d020ce9a646" member_type: VOTER last_known_addr { host: "127.3.214.61" port: 37531 } } peers { permanent_uuid: "16601d0bcd514a8ba8ac0bc9afa2d561" member_type: VOTER last_known_addr { host: "127.3.214.60" port: 35211 } }
02:03:52.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.467129  4173 leader_election.cc:290] T 00000000000000000000000000000000 P 16601d0bcd514a8ba8ac0bc9afa2d561 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d4c56e542e4e4647be8f87b8ee56969b (127.3.214.62:33483), f64b888c0b984212ac259d020ce9a646 (127.3.214.61:37531)
02:03:52.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.467353  4058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "16601d0bcd514a8ba8ac0bc9afa2d561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f64b888c0b984212ac259d020ce9a646" is_pre_election: true
02:03:52.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.468299  4058 raft_consensus.cc:2468] T 00000000000000000000000000000000 P f64b888c0b984212ac259d020ce9a646 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 16601d0bcd514a8ba8ac0bc9afa2d561 in term 0.
02:03:52.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.469810  4114 leader_election.cc:304] T 00000000000000000000000000000000 P 16601d0bcd514a8ba8ac0bc9afa2d561 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16601d0bcd514a8ba8ac0bc9afa2d561, f64b888c0b984212ac259d020ce9a646; no voters: 
02:03:52.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.471203  4173 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 16601d0bcd514a8ba8ac0bc9afa2d561 [term 0 FOLLOWER]: Leader pre-election won for term 1
02:03:52.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.471552  4173 raft_consensus.cc:493] T 00000000000000000000000000000000 P 16601d0bcd514a8ba8ac0bc9afa2d561 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
02:03:52.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.471868  4173 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 16601d0bcd514a8ba8ac0bc9afa2d561 [term 0 FOLLOWER]: Advancing to term 1
02:03:52.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.480788  4173 raft_consensus.cc:515] T 00000000000000000000000000000000 P 16601d0bcd514a8ba8ac0bc9afa2d561 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4c56e542e4e4647be8f87b8ee56969b" member_type: VOTER last_known_addr { host: "127.3.214.62" port: 33483 } } peers { permanent_uuid: "f64b888c0b984212ac259d020ce9a646" member_type: VOTER last_known_addr { host: "127.3.214.61" port: 37531 } } peers { permanent_uuid: "16601d0bcd514a8ba8ac0bc9afa2d561" member_type: VOTER last_known_addr { host: "127.3.214.60" port: 35211 } }
02:03:52.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.484262  4058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "16601d0bcd514a8ba8ac0bc9afa2d561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f64b888c0b984212ac259d020ce9a646"
02:03:52.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.484875  4058 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f64b888c0b984212ac259d020ce9a646 [term 0 FOLLOWER]: Advancing to term 1
02:03:52.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.496558  4058 raft_consensus.cc:2468] T 00000000000000000000000000000000 P f64b888c0b984212ac259d020ce9a646 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16601d0bcd514a8ba8ac0bc9afa2d561 in term 1.
02:03:52.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.502951  4114 leader_election.cc:304] T 00000000000000000000000000000000 P 16601d0bcd514a8ba8ac0bc9afa2d561 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 16601d0bcd514a8ba8ac0bc9afa2d561, f64b888c0b984212ac259d020ce9a646; no voters: 
02:03:52.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.508666  4173 leader_election.cc:290] T 00000000000000000000000000000000 P 16601d0bcd514a8ba8ac0bc9afa2d561 [CANDIDATE]: Term 1 election: Requested vote from peers d4c56e542e4e4647be8f87b8ee56969b (127.3.214.62:33483), f64b888c0b984212ac259d020ce9a646 (127.3.214.61:37531)
02:03:52.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.509249  4173 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 16601d0bcd514a8ba8ac0bc9afa2d561 [term 1 FOLLOWER]: Leader election won for term 1
02:03:52.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.510668  4173 raft_consensus.cc:697] T 00000000000000000000000000000000 P 16601d0bcd514a8ba8ac0bc9afa2d561 [term 1 LEADER]: Becoming Leader. State: Replica: 16601d0bcd514a8ba8ac0bc9afa2d561, State: Running, Role: LEADER
02:03:52.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.511582  4173 consensus_queue.cc:237] T 00000000000000000000000000000000 P 16601d0bcd514a8ba8ac0bc9afa2d561 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4c56e542e4e4647be8f87b8ee56969b" member_type: VOTER last_known_addr { host: "127.3.214.62" port: 33483 } } peers { permanent_uuid: "f64b888c0b984212ac259d020ce9a646" member_type: VOTER last_known_addr { host: "127.3.214.61" port: 37531 } } peers { permanent_uuid: "16601d0bcd514a8ba8ac0bc9afa2d561" member_type: VOTER last_known_addr { host: "127.3.214.60" port: 35211 } }
02:03:52.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.539258  4201 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16601d0bcd514a8ba8ac0bc9afa2d561 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 16601d0bcd514a8ba8ac0bc9afa2d561. Latest consensus state: current_term: 1 leader_uuid: "16601d0bcd514a8ba8ac0bc9afa2d561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4c56e542e4e4647be8f87b8ee56969b" member_type: VOTER last_known_addr { host: "127.3.214.62" port: 33483 } } peers { permanent_uuid: "f64b888c0b984212ac259d020ce9a646" member_type: VOTER last_known_addr { host: "127.3.214.61" port: 37531 } } peers { permanent_uuid: "16601d0bcd514a8ba8ac0bc9afa2d561" member_type: VOTER last_known_addr { host: "127.3.214.60" port: 35211 } } }
02:03:52.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.540040  4201 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16601d0bcd514a8ba8ac0bc9afa2d561 [sys.catalog]: This master's current role is: LEADER
02:03:52.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.544589  4203 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
02:03:52.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.558810  4203 catalog_manager.cc:1519] Initializing Kudu cluster ID...
02:03:52.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.588886  4058 raft_consensus.cc:1275] T 00000000000000000000000000000000 P f64b888c0b984212ac259d020ce9a646 [term 1 FOLLOWER]: Refusing update from remote peer 16601d0bcd514a8ba8ac0bc9afa2d561: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
02:03:52.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.590512  4173 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 16601d0bcd514a8ba8ac0bc9afa2d561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f64b888c0b984212ac259d020ce9a646" member_type: VOTER last_known_addr { host: "127.3.214.61" port: 37531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
02:03:52.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.622840  4188 sys_catalog.cc:455] T 00000000000000000000000000000000 P f64b888c0b984212ac259d020ce9a646 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 16601d0bcd514a8ba8ac0bc9afa2d561. Latest consensus state: current_term: 1 leader_uuid: "16601d0bcd514a8ba8ac0bc9afa2d561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4c56e542e4e4647be8f87b8ee56969b" member_type: VOTER last_known_addr { host: "127.3.214.62" port: 33483 } } peers { permanent_uuid: "f64b888c0b984212ac259d020ce9a646" member_type: VOTER last_known_addr { host: "127.3.214.61" port: 37531 } } peers { permanent_uuid: "16601d0bcd514a8ba8ac0bc9afa2d561" member_type: VOTER last_known_addr { host: "127.3.214.60" port: 35211 } } }
02:03:52.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.623611  4188 sys_catalog.cc:458] T 00000000000000000000000000000000 P f64b888c0b984212ac259d020ce9a646 [sys.catalog]: This master's current role is: FOLLOWER
02:03:52.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.639323  4201 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16601d0bcd514a8ba8ac0bc9afa2d561 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "16601d0bcd514a8ba8ac0bc9afa2d561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4c56e542e4e4647be8f87b8ee56969b" member_type: VOTER last_known_addr { host: "127.3.214.62" port: 33483 } } peers { permanent_uuid: "f64b888c0b984212ac259d020ce9a646" member_type: VOTER last_known_addr { host: "127.3.214.61" port: 37531 } } peers { permanent_uuid: "16601d0bcd514a8ba8ac0bc9afa2d561" member_type: VOTER last_known_addr { host: "127.3.214.60" port: 35211 } } }
02:03:52.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.640106  4201 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16601d0bcd514a8ba8ac0bc9afa2d561 [sys.catalog]: This master's current role is: LEADER
02:03:52.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.642362  4203 catalog_manager.cc:1382] Generated new cluster ID: af524257e553494496e573387f1db125
02:03:52.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.642688  4203 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
02:03:52.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.646762  4188 sys_catalog.cc:455] T 00000000000000000000000000000000 P f64b888c0b984212ac259d020ce9a646 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "16601d0bcd514a8ba8ac0bc9afa2d561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4c56e542e4e4647be8f87b8ee56969b" member_type: VOTER last_known_addr { host: "127.3.214.62" port: 33483 } } peers { permanent_uuid: "f64b888c0b984212ac259d020ce9a646" member_type: VOTER last_known_addr { host: "127.3.214.61" port: 37531 } } peers { permanent_uuid: "16601d0bcd514a8ba8ac0bc9afa2d561" member_type: VOTER last_known_addr { host: "127.3.214.60" port: 35211 } } }
02:03:52.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.648059  4188 sys_catalog.cc:458] T 00000000000000000000000000000000 P f64b888c0b984212ac259d020ce9a646 [sys.catalog]: This master's current role is: FOLLOWER
02:03:52.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.701484  4203 catalog_manager.cc:1405] Generated new certificate authority record
02:03:52.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.706589  4203 catalog_manager.cc:1539] Loading token signing keys...
02:03:52.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.767877  4203 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 16601d0bcd514a8ba8ac0bc9afa2d561: Generated new TSK 0
02:03:52.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.770884  4203 catalog_manager.cc:1549] Initializing in-progress tserver states...
02:03:52.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.792320  3928 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskvuyF4C/build/tsan/bin/kudu
02:03:52.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskvuyF4C/build/tsan/bin/kudu
02:03:52.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/ts-0/wal
02:03:52.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/ts-0/data
02:03:52.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:03:52.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:03:52.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:03:52.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:03:52.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:03:52.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:03:52.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/ts-0/logs
02:03:52.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/ts-0/data/info.pb
02:03:52.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:03:52.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:03:52.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:03:52.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:03:52.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:03:52.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:03:52.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:03:52.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:03:52.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
02:03:52.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:03:52.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.214.1:0
02:03:52.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.3.214.1
02:03:52.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.214.1
02:03:52.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:03:52.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.3.214.62:33483,127.3.214.61:37531,127.3.214.60:35211
02:03:52.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.214.20:43891
02:03:52.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:03:52.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:03:52.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
02:03:52.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.810025  4008 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.3.214.60" port: 35211 } attempt: 7
02:03:52.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.875661  4008 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d4c56e542e4e4647be8f87b8ee56969b: Bootstrap starting.
02:03:52.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.919610  4008 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d4c56e542e4e4647be8f87b8ee56969b: Neither blocks nor log segments found. Creating new log.
02:03:52.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.933261  4008 log.cc:826] T 00000000000000000000000000000000 P d4c56e542e4e4647be8f87b8ee56969b: Log is configured to *not* fsync() on all Append() calls
02:03:52.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.964265  4008 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d4c56e542e4e4647be8f87b8ee56969b: No bootstrap required, opened a new log
02:03:53.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:53.015455  4008 raft_consensus.cc:359] T 00000000000000000000000000000000 P d4c56e542e4e4647be8f87b8ee56969b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4c56e542e4e4647be8f87b8ee56969b" member_type: VOTER last_known_addr { host: "127.3.214.62" port: 33483 } } peers { permanent_uuid: "f64b888c0b984212ac259d020ce9a646" member_type: VOTER last_known_addr { host: "127.3.214.61" port: 37531 } } peers { permanent_uuid: "16601d0bcd514a8ba8ac0bc9afa2d561" member_type: VOTER last_known_addr { host: "127.3.214.60" port: 35211 } }
02:03:53.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:53.016520  4008 raft_consensus.cc:385] T 00000000000000000000000000000000 P d4c56e542e4e4647be8f87b8ee56969b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:03:53.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:53.016839  4008 raft_consensus.cc:740] T 00000000000000000000000000000000 P d4c56e542e4e4647be8f87b8ee56969b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d4c56e542e4e4647be8f87b8ee56969b, State: Initialized, Role: FOLLOWER
02:03:53.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:53.017741  4008 consensus_queue.cc:260] T 00000000000000000000000000000000 P d4c56e542e4e4647be8f87b8ee56969b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4c56e542e4e4647be8f87b8ee56969b" member_type: VOTER last_known_addr { host: "127.3.214.62" port: 33483 } } peers { permanent_uuid: "f64b888c0b984212ac259d020ce9a646" member_type: VOTER last_known_addr { host: "127.3.214.61" port: 37531 } } peers { permanent_uuid: "16601d0bcd514a8ba8ac0bc9afa2d561" member_type: VOTER last_known_addr { host: "127.3.214.60" port: 35211 } }
02:03:53.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:53.021077  4212 sys_catalog.cc:455] T 00000000000000000000000000000000 P d4c56e542e4e4647be8f87b8ee56969b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4c56e542e4e4647be8f87b8ee56969b" member_type: VOTER last_known_addr { host: "127.3.214.62" port: 33483 } } peers { permanent_uuid: "f64b888c0b984212ac259d020ce9a646" member_type: VOTER last_known_addr { host: "127.3.214.61" port: 37531 } } peers { permanent_uuid: "16601d0bcd514a8ba8ac0bc9afa2d561" member_type: VOTER last_known_addr { host: "127.3.214.60" port: 35211 } } }
02:03:53.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:53.023424  4212 sys_catalog.cc:458] T 00000000000000000000000000000000 P d4c56e542e4e4647be8f87b8ee56969b [sys.catalog]: This master's current role is: FOLLOWER
02:03:53.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:53.030640  4008 sys_catalog.cc:565] T 00000000000000000000000000000000 P d4c56e542e4e4647be8f87b8ee56969b [sys.catalog]: configured and running, proceeding with master startup.
02:03:53.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:53.031163  3981 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d4c56e542e4e4647be8f87b8ee56969b [term 0 FOLLOWER]: Advancing to term 1
02:03:53.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:53.047219  3981 raft_consensus.cc:1275] T 00000000000000000000000000000000 P d4c56e542e4e4647be8f87b8ee56969b [term 1 FOLLOWER]: Refusing update from remote peer 16601d0bcd514a8ba8ac0bc9afa2d561: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
02:03:53.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:53.031649  3982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "16601d0bcd514a8ba8ac0bc9afa2d561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4c56e542e4e4647be8f87b8ee56969b"
02:03:53.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:53.032332  3983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "16601d0bcd514a8ba8ac0bc9afa2d561" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d4c56e542e4e4647be8f87b8ee56969b" is_pre_election: true
02:03:53.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:53.038411  3962 tablet.cc:2404] T 00000000000000000000000000000000 P d4c56e542e4e4647be8f87b8ee56969b: Can't schedule compaction. Clean time has not been advanced past its initial value.
02:03:53.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:53.058988  3982 raft_consensus.cc:2468] T 00000000000000000000000000000000 P d4c56e542e4e4647be8f87b8ee56969b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 16601d0bcd514a8ba8ac0bc9afa2d561 in term 1.
02:03:53.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:53.062188  4201 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 16601d0bcd514a8ba8ac0bc9afa2d561 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d4c56e542e4e4647be8f87b8ee56969b" member_type: VOTER last_known_addr { host: "127.3.214.62" port: 33483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
02:03:53.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:53.159044  4212 sys_catalog.cc:455] T 00000000000000000000000000000000 P d4c56e542e4e4647be8f87b8ee56969b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 16601d0bcd514a8ba8ac0bc9afa2d561. Latest consensus state: current_term: 1 leader_uuid: "16601d0bcd514a8ba8ac0bc9afa2d561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4c56e542e4e4647be8f87b8ee56969b" member_type: VOTER last_known_addr { host: "127.3.214.62" port: 33483 } } peers { permanent_uuid: "f64b888c0b984212ac259d020ce9a646" member_type: VOTER last_known_addr { host: "127.3.214.61" port: 37531 } } peers { permanent_uuid: "16601d0bcd514a8ba8ac0bc9afa2d561" member_type: VOTER last_known_addr { host: "127.3.214.60" port: 35211 } } }
02:03:53.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:53.159788  4212 sys_catalog.cc:458] T 00000000000000000000000000000000 P d4c56e542e4e4647be8f87b8ee56969b [sys.catalog]: This master's current role is: FOLLOWER
02:03:53.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:53.161043  4224 sys_catalog.cc:455] T 00000000000000000000000000000000 P d4c56e542e4e4647be8f87b8ee56969b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "16601d0bcd514a8ba8ac0bc9afa2d561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4c56e542e4e4647be8f87b8ee56969b" member_type: VOTER last_known_addr { host: "127.3.214.62" port: 33483 } } peers { permanent_uuid: "f64b888c0b984212ac259d020ce9a646" member_type: VOTER last_known_addr { host: "127.3.214.61" port: 37531 } } peers { permanent_uuid: "16601d0bcd514a8ba8ac0bc9afa2d561" member_type: VOTER last_known_addr { host: "127.3.214.60" port: 35211 } } }
02:03:53.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:53.161943  4224 sys_catalog.cc:458] T 00000000000000000000000000000000 P d4c56e542e4e4647be8f87b8ee56969b [sys.catalog]: This master's current role is: FOLLOWER
02:03:53.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:53.167868  4229 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
02:03:53.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:53.391263  4209 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:03:53.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:53.391825  4209 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:03:53.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:53.392490  4209 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:03:53.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:53.427212  4209 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:03:53.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:53.428241  4209 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.214.1
02:03:53.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:53.437048  4199 catalog_manager.cc:1294] Loaded cluster ID: af524257e553494496e573387f1db125
02:03:53.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:53.437772  4199 catalog_manager.cc:1587] T 00000000000000000000000000000000 P f64b888c0b984212ac259d020ce9a646: loading cluster ID for follower catalog manager: success
02:03:53.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:53.446738  4199 catalog_manager.cc:1609] T 00000000000000000000000000000000 P f64b888c0b984212ac259d020ce9a646: acquiring CA information for follower catalog manager: success
02:03:53.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:53.452230  4201 sys_catalog.cc:455] T 00000000000000000000000000000000 P 16601d0bcd514a8ba8ac0bc9afa2d561 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "16601d0bcd514a8ba8ac0bc9afa2d561" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4c56e542e4e4647be8f87b8ee56969b" member_type: VOTER last_known_addr { host: "127.3.214.62" port: 33483 } } peers { permanent_uuid: "f64b888c0b984212ac259d020ce9a646" member_type: VOTER last_known_addr { host: "127.3.214.61" port: 37531 } } peers { permanent_uuid: "16601d0bcd514a8ba8ac0bc9afa2d561" member_type: VOTER last_known_addr { host: "127.3.214.60" port: 35211 } } }
02:03:53.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:53.453955  4201 sys_catalog.cc:458] T 00000000000000000000000000000000 P 16601d0bcd514a8ba8ac0bc9afa2d561 [sys.catalog]: This master's current role is: LEADER
02:03:53.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:53.458732  4199 catalog_manager.cc:1637] T 00000000000000000000000000000000 P f64b888c0b984212ac259d020ce9a646: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
02:03:53.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:53.486862  4209 tablet_server_runner.cc:78] Tablet server non-default flags:
02:03:53.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:03:53.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.214.20:43891
02:03:53.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:03:53.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:03:53.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/ts-0/data
02:03:53.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/ts-0/wal
02:03:53.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:03:53.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:03:53.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.214.1:0
02:03:53.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:03:53.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:03:53.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:03:53.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/ts-0/data/info.pb
02:03:53.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.214.1
02:03:53.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:03:53.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.3.214.62:33483,127.3.214.61:37531,127.3.214.60:35211
02:03:53.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:03:53.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:03:53.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:03:53.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:03:53.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:03:53.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.3.214.1
02:03:53.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/ts-0/logs
02:03:53.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:03:53.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:03:53.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:03:53.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
02:03:53.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:03:53.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
02:03:53.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:03:53.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 01:43:23 UTC on e7f111948823
02:03:53.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11951
02:03:53.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:03:53.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:53.488631  4209 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:03:53.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:53.491168  4209 file_cache.cc:492] Constructed file cache file cache with capacity 419430
02:03:53.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:53.506932  4238 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:03:54.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:54.195842  4229 catalog_manager.cc:1294] Loaded cluster ID: af524257e553494496e573387f1db125
02:03:54.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:54.200253  4229 catalog_manager.cc:1587] T 00000000000000000000000000000000 P d4c56e542e4e4647be8f87b8ee56969b: loading cluster ID for follower catalog manager: success
02:03:54.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:54.231067  4229 catalog_manager.cc:1609] T 00000000000000000000000000000000 P d4c56e542e4e4647be8f87b8ee56969b: acquiring CA information for follower catalog manager: success
02:03:54.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:54.254596  4229 catalog_manager.cc:1637] T 00000000000000000000000000000000 P d4c56e542e4e4647be8f87b8ee56969b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
02:03:55.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:54.908672  4237 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 4209
02:03:55.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:55.114611  4209 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 1.606s	user 0.466s	sys 0.588s
02:03:55.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:55.122164  4209 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 1.613s	user 0.467s	sys 0.588s
02:03:55.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:53.511081  4239 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:03:55.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:55.134670  4209 server_base.cc:1061] running on GCE node
02:03:55.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:55.136130  4248 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:03:55.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:55.137605  4209 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:03:55.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:55.142189  4209 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:03:55.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:55.143774  4209 hybrid_clock.cc:648] HybridClock initialized: now 1779069835143573 us; error 213 us; skew 500 ppm
02:03:55.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:55.144892  4209 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:03:55.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:55.152232  4209 webserver.cc:533] Webserver started at http://127.3.214.1:39793/ using document root <none> and password file <none>
02:03:55.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:55.153484  4209 fs_manager.cc:362] Metadata directory not provided
02:03:55.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:55.153755  4209 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:03:55.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:55.154309  4209 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:03:55.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:55.159391  4209 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/ts-0/data/instance:
02:03:55.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "018adfb8613f431ebd81a16dd1ef7cc9"
02:03:55.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:03:55 on dist-test-slave-m4h6"
02:03:55.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:55.160816  4209 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/ts-0/wal/instance:
02:03:55.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "018adfb8613f431ebd81a16dd1ef7cc9"
02:03:55.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:03:55 on dist-test-slave-m4h6"
02:03:55.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:55.170094  4209 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.005s	sys 0.004s
02:03:55.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:55.176793  4253 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:03:55.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:55.178093  4209 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.002s
02:03:55.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:55.178471  4209 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/ts-0/data,/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/ts-0/wal
02:03:55.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "018adfb8613f431ebd81a16dd1ef7cc9"
02:03:55.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:03:55 on dist-test-slave-m4h6"
02:03:55.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:55.178884  4209 fs_report.cc:389] FS layout report
02:03:55.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:03:55.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/ts-0/wal
02:03:55.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/ts-0/wal
02:03:55.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/ts-0/data/data
02:03:55.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:03:55.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:03:55.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:03:55.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:03:55.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:03:55.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:03:55.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:03:55.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:03:55.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:03:55.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:03:55.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:03:55.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:55.233641  4209 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:03:55.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:55.235199  4209 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:03:55.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:55.235754  4209 kserver.cc:163] Server-wide thread pool size limit: 3276
02:03:55.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:55.238898  4209 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
02:03:55.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:55.243785  4209 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
02:03:55.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:55.244019  4209 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
02:03:55.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:55.244306  4209 ts_tablet_manager.cc:616] Registered 0 tablets
02:03:55.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:55.244539  4209 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
02:03:55.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:55.450606  4209 rpc_server.cc:307] RPC server started. Bound to: 127.3.214.1:34805
02:03:55.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:55.450722  4365 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.214.1:34805 every 8 connection(s)
02:03:55.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:55.454408  4209 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/ts-0/data/info.pb
02:03:55.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:55.457089  3928 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskvuyF4C/build/tsan/bin/kudu as pid 4209
02:03:55.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:55.457582  3928 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/ts-0/wal/instance
02:03:55.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:55.470770  3928 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskvuyF4C/build/tsan/bin/kudu
02:03:55.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskvuyF4C/build/tsan/bin/kudu
02:03:55.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/ts-1/wal
02:03:55.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/ts-1/data
02:03:55.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:03:55.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:03:55.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:03:55.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:03:55.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:03:55.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:03:55.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/ts-1/logs
02:03:55.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/ts-1/data/info.pb
02:03:55.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:03:55.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:03:55.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:03:55.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:03:55.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:03:55.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:03:55.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:03:55.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:03:55.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
02:03:55.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:03:55.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.214.2:0
02:03:55.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.3.214.2
02:03:55.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.214.2
02:03:55.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:03:55.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.3.214.62:33483,127.3.214.61:37531,127.3.214.60:35211
02:03:55.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.214.20:43891
02:03:55.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:03:55.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:03:55.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
02:03:55.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:55.531239  4366 heartbeater.cc:344] Connected to a master server at 127.3.214.60:35211
02:03:55.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:55.536470  4366 heartbeater.cc:461] Registering TS with master...
02:03:55.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:55.535526  4369 heartbeater.cc:344] Connected to a master server at 127.3.214.61:37531
02:03:55.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:55.537035  4369 heartbeater.cc:461] Registering TS with master...
02:03:55.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:55.537894  4366 heartbeater.cc:507] Master 127.3.214.60:35211 requested a full tablet report, sending...
02:03:55.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:55.538175  4369 heartbeater.cc:507] Master 127.3.214.61:37531 requested a full tablet report, sending...
02:03:55.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:55.541682  4371 heartbeater.cc:344] Connected to a master server at 127.3.214.62:33483
02:03:55.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:55.542050  4371 heartbeater.cc:461] Registering TS with master...
02:03:55.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:55.542936  4371 heartbeater.cc:507] Master 127.3.214.62:33483 requested a full tablet report, sending...
02:03:55.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:55.543025  4129 ts_manager.cc:194] Registered new tserver with Master: 018adfb8613f431ebd81a16dd1ef7cc9 (127.3.214.1:34805)
02:03:55.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:55.545722  4129 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.3.214.1:38249
02:03:55.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:55.545926  3973 ts_manager.cc:194] Registered new tserver with Master: 018adfb8613f431ebd81a16dd1ef7cc9 (127.3.214.1:34805)
02:03:55.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:55.550431  4048 ts_manager.cc:194] Registered new tserver with Master: 018adfb8613f431ebd81a16dd1ef7cc9 (127.3.214.1:34805)
02:03:55.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:55.833444  4370 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:03:55.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:55.833936  4370 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:03:55.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:55.834345  4370 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:03:55.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:55.868263  4370 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:03:55.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:55.869171  4370 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.214.2
02:03:55.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:55.907094  4370 tablet_server_runner.cc:78] Tablet server non-default flags:
02:03:55.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:03:55.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.214.20:43891
02:03:55.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:03:55.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:03:55.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/ts-1/data
02:03:55.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/ts-1/wal
02:03:55.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:03:55.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:03:55.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.214.2:0
02:03:55.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:03:55.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:03:55.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:03:55.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/ts-1/data/info.pb
02:03:55.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.214.2
02:03:55.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:03:55.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.3.214.62:33483,127.3.214.61:37531,127.3.214.60:35211
02:03:55.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:03:55.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:03:55.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:03:55.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:03:55.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:03:55.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.3.214.2
02:03:55.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/ts-1/logs
02:03:55.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:03:55.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:03:55.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:03:55.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
02:03:55.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:03:55.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
02:03:55.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:03:55.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 01:43:23 UTC on e7f111948823
02:03:55.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11951
02:03:55.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:03:55.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:55.908682  4370 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:03:55.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:55.910753  4370 file_cache.cc:492] Constructed file cache file cache with capacity 419430
02:03:55.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:55.930733  4383 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:03:56.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:56.550028  4366 heartbeater.cc:499] Master 127.3.214.60:35211 was elected leader, sending a full tablet report...
02:03:57.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:55.931448  4384 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:03:57.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:57.158908  4370 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 1.229s	user 0.480s	sys 0.724s
02:03:57.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:57.160873  4370 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 1.231s	user 0.483s	sys 0.724s
02:03:57.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:57.169855  4370 server_base.cc:1061] running on GCE node
02:03:57.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:57.171727  4389 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:03:57.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:57.173197  4370 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:03:57.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:57.176046  4370 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:03:57.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:57.177771  4370 hybrid_clock.cc:648] HybridClock initialized: now 1779069837177729 us; error 52 us; skew 500 ppm
02:03:57.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:57.178856  4370 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:03:57.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:57.188922  4370 webserver.cc:533] Webserver started at http://127.3.214.2:36511/ using document root <none> and password file <none>
02:03:57.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:57.190344  4370 fs_manager.cc:362] Metadata directory not provided
02:03:57.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:57.190693  4370 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:03:57.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:57.191324  4370 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:03:57.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:57.197871  4370 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/ts-1/data/instance:
02:03:57.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6c64d5c77cf54b82a75cb06a30e74340"
02:03:57.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:03:57 on dist-test-slave-m4h6"
02:03:57.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:57.199361  4370 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/ts-1/wal/instance:
02:03:57.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6c64d5c77cf54b82a75cb06a30e74340"
02:03:57.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:03:57 on dist-test-slave-m4h6"
02:03:57.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:57.209627  4370 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.006s	sys 0.002s
02:03:57.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:57.217298  4394 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:03:57.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:57.218969  4370 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.004s	sys 0.001s
02:03:57.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:57.219404  4370 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/ts-1/data,/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/ts-1/wal
02:03:57.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "6c64d5c77cf54b82a75cb06a30e74340"
02:03:57.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:03:57 on dist-test-slave-m4h6"
02:03:57.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:57.219852  4370 fs_report.cc:389] FS layout report
02:03:57.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:03:57.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/ts-1/wal
02:03:57.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/ts-1/wal
02:03:57.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/ts-1/data/data
02:03:57.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:03:57.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:03:57.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:03:57.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:03:57.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:03:57.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:03:57.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:03:57.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:03:57.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:03:57.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:03:57.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:03:57.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:57.297677  4370 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:03:57.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:57.299633  4370 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:03:57.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:57.300213  4370 kserver.cc:163] Server-wide thread pool size limit: 3276
02:03:57.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:57.303498  4370 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
02:03:57.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:57.309150  4370 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
02:03:57.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:57.309441  4370 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
02:03:57.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:57.309732  4370 ts_tablet_manager.cc:616] Registered 0 tablets
02:03:57.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:57.309937  4370 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
02:03:57.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:57.452764  4370 rpc_server.cc:307] RPC server started. Bound to: 127.3.214.2:42201
02:03:57.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:57.452868  4506 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.214.2:42201 every 8 connection(s)
02:03:57.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:57.456535  4370 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/ts-1/data/info.pb
02:03:57.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:57.463387  3928 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskvuyF4C/build/tsan/bin/kudu as pid 4370
02:03:57.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:57.464072  3928 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/ts-1/wal/instance
02:03:57.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:57.487529  3928 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskvuyF4C/build/tsan/bin/kudu
02:03:57.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskvuyF4C/build/tsan/bin/kudu
02:03:57.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/ts-2/wal
02:03:57.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/ts-2/data
02:03:57.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:03:57.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:03:57.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:03:57.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:03:57.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:03:57.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:03:57.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/ts-2/logs
02:03:57.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/ts-2/data/info.pb
02:03:57.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:03:57.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:03:57.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:03:57.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:03:57.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:03:57.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:03:57.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:03:57.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:03:57.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
02:03:57.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:03:57.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.214.3:0
02:03:57.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.3.214.3
02:03:57.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.214.3
02:03:57.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:03:57.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.3.214.62:33483,127.3.214.61:37531,127.3.214.60:35211
02:03:57.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.214.20:43891
02:03:57.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:03:57.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:03:57.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
02:03:57.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:57.521045  4507 heartbeater.cc:344] Connected to a master server at 127.3.214.60:35211
02:03:57.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:57.522013  4507 heartbeater.cc:461] Registering TS with master...
02:03:57.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:57.522653  4509 heartbeater.cc:344] Connected to a master server at 127.3.214.62:33483
02:03:57.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:57.522992  4509 heartbeater.cc:461] Registering TS with master...
02:03:57.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:57.523415  4508 heartbeater.cc:344] Connected to a master server at 127.3.214.61:37531
02:03:57.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:57.523653  4507 heartbeater.cc:507] Master 127.3.214.60:35211 requested a full tablet report, sending...
02:03:57.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:57.523730  4508 heartbeater.cc:461] Registering TS with master...
02:03:57.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:57.524147  4509 heartbeater.cc:507] Master 127.3.214.62:33483 requested a full tablet report, sending...
02:03:57.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:57.524674  4508 heartbeater.cc:507] Master 127.3.214.61:37531 requested a full tablet report, sending...
02:03:57.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:57.527169  4048 ts_manager.cc:194] Registered new tserver with Master: 6c64d5c77cf54b82a75cb06a30e74340 (127.3.214.2:42201)
02:03:57.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:57.527271  3973 ts_manager.cc:194] Registered new tserver with Master: 6c64d5c77cf54b82a75cb06a30e74340 (127.3.214.2:42201)
02:03:57.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:57.527706  4129 ts_manager.cc:194] Registered new tserver with Master: 6c64d5c77cf54b82a75cb06a30e74340 (127.3.214.2:42201)
02:03:57.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:57.529420  4129 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.3.214.2:38383
02:03:57.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:57.803712  4517 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:03:57.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:57.804186  4517 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:03:57.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:57.804605  4517 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:03:57.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:57.838593  4517 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:03:57.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:57.839416  4517 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.3.214.3
02:03:57.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:57.880348  4517 tablet_server_runner.cc:78] Tablet server non-default flags:
02:03:57.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:03:57.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.3.214.20:43891
02:03:57.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:03:57.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:03:57.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/ts-2/data
02:03:57.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/ts-2/wal
02:03:57.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:03:57.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:03:57.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.3.214.3:0
02:03:57.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:03:57.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:03:57.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:03:57.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/ts-2/data/info.pb
02:03:57.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.3.214.3
02:03:57.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:03:57.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.3.214.62:33483,127.3.214.61:37531,127.3.214.60:35211
02:03:57.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:03:57.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:03:57.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:03:57.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:03:57.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:03:57.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.3.214.3
02:03:57.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/ts-2/logs
02:03:57.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:03:57.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:03:57.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:03:57.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
02:03:57.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:03:57.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
02:03:57.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:03:57.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 01:43:23 UTC on e7f111948823
02:03:57.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11951
02:03:57.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:03:57.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:57.881613  4517 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:03:57.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:57.883193  4517 file_cache.cc:492] Constructed file cache file cache with capacity 419430
02:03:57.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:57.895363  4523 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:03:58.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.532912  4507 heartbeater.cc:499] Master 127.3.214.60:35211 was elected leader, sending a full tablet report...
02:03:59.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:57.896492  4524 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:03:59.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:59.097995  4525 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1200 milliseconds
02:03:59.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:59.099086  4526 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:03:59.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:59.101150  4517 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.205s	user 0.380s	sys 0.811s
02:03:59.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:59.101491  4517 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.206s	user 0.380s	sys 0.811s
02:03:59.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:59.101766  4517 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
02:03:59.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:59.104957  4517 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:03:59.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:59.108227  4517 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:03:59.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:59.109956  4517 hybrid_clock.cc:648] HybridClock initialized: now 1779069839109824 us; error 139 us; skew 500 ppm
02:03:59.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:59.111318  4517 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:03:59.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:59.120770  4517 webserver.cc:533] Webserver started at http://127.3.214.3:41951/ using document root <none> and password file <none>
02:03:59.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:59.122458  4517 fs_manager.cc:362] Metadata directory not provided
02:03:59.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:59.123093  4517 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:03:59.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:59.123890  4517 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:03:59.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:59.130636  4517 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/ts-2/data/instance:
02:03:59.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "bb42b1e029044183a7826531d8a6c5d4"
02:03:59.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:03:59 on dist-test-slave-m4h6"
02:03:59.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:59.132221  4517 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/ts-2/wal/instance:
02:03:59.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "bb42b1e029044183a7826531d8a6c5d4"
02:03:59.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:03:59 on dist-test-slave-m4h6"
02:03:59.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:59.141997  4517 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.006s	sys 0.002s
02:03:59.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:59.149438  4534 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:03:59.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:59.150774  4517 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.003s
02:03:59.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:59.151185  4517 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/ts-2/data,/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/ts-2/wal
02:03:59.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "bb42b1e029044183a7826531d8a6c5d4"
02:03:59.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:03:59 on dist-test-slave-m4h6"
02:03:59.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:59.151630  4517 fs_report.cc:389] FS layout report
02:03:59.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:03:59.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/ts-2/wal
02:03:59.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/ts-2/wal
02:03:59.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/ts-2/data/data
02:03:59.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:03:59.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:03:59.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:03:59.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:03:59.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:03:59.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:03:59.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:03:59.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:03:59.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:03:59.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:03:59.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:03:59.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:59.237524  4517 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:03:59.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:59.239027  4517 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:03:59.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:59.239445  4517 kserver.cc:163] Server-wide thread pool size limit: 3276
02:03:59.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:59.242122  4517 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
02:03:59.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:59.246490  4517 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
02:03:59.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:59.246704  4517 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
02:03:59.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:59.246930  4517 ts_tablet_manager.cc:616] Registered 0 tablets
02:03:59.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:59.247076  4517 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
02:03:59.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:59.377041  4517 rpc_server.cc:307] RPC server started. Bound to: 127.3.214.3:35411
02:03:59.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:59.377151  4646 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.3.214.3:35411 every 8 connection(s)
02:03:59.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:59.379828  4517 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/ts-2/data/info.pb
02:03:59.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:59.383684  3928 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskvuyF4C/build/tsan/bin/kudu as pid 4517
02:03:59.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:59.384076  3928 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/ts-2/wal/instance
02:03:59.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:59.453215  4649 heartbeater.cc:344] Connected to a master server at 127.3.214.62:33483
02:03:59.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:59.453728  4649 heartbeater.cc:461] Registering TS with master...
02:03:59.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:59.454777  4647 heartbeater.cc:344] Connected to a master server at 127.3.214.60:35211
02:03:59.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:59.455111  4649 heartbeater.cc:507] Master 127.3.214.62:33483 requested a full tablet report, sending...
02:03:59.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:59.455138  4647 heartbeater.cc:461] Registering TS with master...
02:03:59.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:59.457327  4647 heartbeater.cc:507] Master 127.3.214.60:35211 requested a full tablet report, sending...
02:03:59.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:59.459787  3973 ts_manager.cc:194] Registered new tserver with Master: bb42b1e029044183a7826531d8a6c5d4 (127.3.214.3:35411)
02:03:59.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:59.461858  4129 ts_manager.cc:194] Registered new tserver with Master: bb42b1e029044183a7826531d8a6c5d4 (127.3.214.3:35411)
02:03:59.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:59.463536  4129 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.3.214.3:56263
02:03:59.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:59.466454  4648 heartbeater.cc:344] Connected to a master server at 127.3.214.61:37531
02:03:59.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:59.466804  4648 heartbeater.cc:461] Registering TS with master...
02:03:59.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:59.467686  4648 heartbeater.cc:507] Master 127.3.214.61:37531 requested a full tablet report, sending...
02:03:59.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:59.470358  4048 ts_manager.cc:194] Registered new tserver with Master: bb42b1e029044183a7826531d8a6c5d4 (127.3.214.3:35411)
02:03:59.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:59.480753  3928 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
02:03:59.492 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
02:03:59.493 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

02:03:59.502 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.3.214.62"
      port: 33483
    }
    bound_http_address {
      host: "127.3.214.62"
      port: 37833
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.3.214.61"
      port: 37531
    }
    bound_http_address {
      host: "127.3.214.61"
      port: 37445
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.3.214.60"
      port: 35211
    }
    bound_http_address {
      host: "127.3.214.60"
      port: 41583
    }
  }
}

02:03:59.505 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

02:03:59.507 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.3.214.1"
      port: 34805
    }
    bound_http_address {
      host: "127.3.214.1"
      port: 39793
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.3.214.2"
      port: 42201
    }
    bound_http_address {
      host: "127.3.214.2"
      port: 36511
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.3.214.3"
      port: 35411
    }
    bound_http_address {
      host: "127.3.214.3"
      port: 41951
    }
  }
}

02:03:59.507 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
02:03:59.690 [DEBUG - main] (CompositeStrategy.java:59) Unable to load modern Subject methods, relying only on legacy methods
java.lang.NoSuchMethodException: javax.security.auth.Subject.current()
	at java.base/java.lang.Class.getDeclaredMethod(Class.java:2677)
	at org.apache.kudu.client.internals.ModernStrategy.<init>(ModernStrategy.java:51)
	at org.apache.kudu.client.internals.CompositeStrategy.<init>(CompositeStrategy.java:52)
	at org.apache.kudu.client.internals.CompositeStrategy.<clinit>(CompositeStrategy.java:41)
	at org.apache.kudu.client.internals.SecurityManagerCompatibility.get(SecurityManagerCompatibility.java:43)
	at org.apache.kudu.client.SecurityContext.setupSubject(SecurityContext.java:155)
	at org.apache.kudu.client.SecurityContext.<init>(SecurityContext.java:138)
	at org.apache.kudu.client.AsyncKuduClient.<init>(AsyncKuduClient.java:431)
	at org.apache.kudu.client.AsyncKuduClient$AsyncKuduClientBuilder.build(AsyncKuduClient.java:3109)
	at org.apache.kudu.test.KuduTestHarness.before(KuduTestHarness.java:161)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:50)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.doOneAttemptAndReport(RetryRule.java:184)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.evaluate(RetryRule.java:244)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runners.Suite.runChild(Suite.java:128)
	at org.junit.runners.Suite.runChild(Suite.java:27)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
	at org.junit.runner.JUnitCore.runMain(JUnitCore.java:77)
	at org.junit.runner.JUnitCore.main(JUnitCore.java:36)
02:03:59.755 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
02:03:59.936 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.3.214.62:33483(127.3.214.62:33483)] connecting to peer
02:04:00.006 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.3.214.61:37531(127.3.214.61:37531)] connecting to peer
02:04:00.014 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.3.214.60:35211(127.3.214.60:35211)] connecting to peer
02:04:00.029 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.3.214.61:37531(127.3.214.61:37531)] Successfully connected to peer
02:04:00.031 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.3.214.62:33483(127.3.214.62:33483)] Successfully connected to peer
02:04:00.031 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.3.214.60:35211(127.3.214.60:35211)] Successfully connected to peer
02:04:00.131 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.3.214.62
02:04:00.141 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.3.214.61
02:04:00.141 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.3.214.60
02:04:00.369 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x2935b597, L:/127.0.0.1:50736 - R:/127.3.214.60:35211] using SASL/PLAIN
02:04:00.369 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x92b66d56, L:/127.0.0.1:53272 - R:/127.3.214.61:37531] using SASL/PLAIN
02:04:00.369 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x079576c5, L:/127.0.0.1:40832 - R:/127.3.214.62:33483] using SASL/PLAIN
02:04:00.410 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
02:04:00.411 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=522), Traces: [0ms] refreshing cache from master, [29ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.214.62:33483, [112ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.214.61:37531, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.214.60:35211, [493ms] Sub RPC ConnectToMaster: received response from server master-127.3.214.61:37531: OK, [493ms] Sub RPC ConnectToMaster: received response from server master-127.3.214.62:33483: OK, [493ms] Sub RPC ConnectToMaster: received response from server master-127.3.214.60:35211: OK, deferred=null) after lookup
02:04:00.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:00.467644  4647 heartbeater.cc:499] Master 127.3.214.60:35211 was elected leader, sending a full tablet report...
02:04:00.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:00.476639  4129 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:50736:
02:04:00.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "org.apache.kudu.client.TestClientFailoverSupport-KILL"
02:04:00.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
02:04:00.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
02:04:00.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key"
02:04:00.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
02:04:00.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
02:04:00.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
02:04:00.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
02:04:00.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
02:04:00.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
02:04:00.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:04:00.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
02:04:00.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column1_i"
02:04:00.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
02:04:00.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
02:04:00.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
02:04:00.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
02:04:00.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
02:04:00.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
02:04:00.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:04:00.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
02:04:00.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column2_i"
02:04:00.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
02:04:00.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
02:04:00.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
02:04:00.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
02:04:00.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
02:04:00.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
02:04:00.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:04:00.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
02:04:00.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column3_s"
02:04:00.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
02:04:00.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
02:04:00.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: true
02:04:00.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: DICT_ENCODING
02:04:00.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: LZ4
02:04:00.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 4096
02:04:00.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
02:04:00.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
02:04:00.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:04:00.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
02:04:00.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column4_b"
02:04:00.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BOOL
02:04:00.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
02:04:00.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
02:04:00.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
02:04:00.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
02:04:00.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
02:04:00.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:04:00.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
02:04:00.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
02:04:00.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
02:04:00.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
02:04:00.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key"
02:04:00.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
02:04:00.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:04:00.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
02:04:00.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:00.480001  4129 catalog_manager.cc:7058] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table org.apache.kudu.client.TestClientFailoverSupport-KILL in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
02:04:00.539 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 780b79c815774700a0b4281546d325f0
02:04:00.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:00.575932  4301 tablet_service.cc:1511] Processing CreateTablet for tablet dc1a9ebc52a94ebbb02cbbb24ba736ff (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-KILL [id=780b79c815774700a0b4281546d325f0]), partition=RANGE (key) PARTITION UNBOUNDED
02:04:00.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:00.578006  4301 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc1a9ebc52a94ebbb02cbbb24ba736ff. 1 dirs total, 0 dirs full, 0 dirs failed
02:04:00.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:00.583360  4582 tablet_service.cc:1511] Processing CreateTablet for tablet dc1a9ebc52a94ebbb02cbbb24ba736ff (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-KILL [id=780b79c815774700a0b4281546d325f0]), partition=RANGE (key) PARTITION UNBOUNDED
02:04:00.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:00.584928  4582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc1a9ebc52a94ebbb02cbbb24ba736ff. 1 dirs total, 0 dirs full, 0 dirs failed
02:04:00.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:00.585479  4442 tablet_service.cc:1511] Processing CreateTablet for tablet dc1a9ebc52a94ebbb02cbbb24ba736ff (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-KILL [id=780b79c815774700a0b4281546d325f0]), partition=RANGE (key) PARTITION UNBOUNDED
02:04:00.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:00.587302  4442 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc1a9ebc52a94ebbb02cbbb24ba736ff. 1 dirs total, 0 dirs full, 0 dirs failed
02:04:00.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:00.608767  4684 tablet_bootstrap.cc:492] T dc1a9ebc52a94ebbb02cbbb24ba736ff P bb42b1e029044183a7826531d8a6c5d4: Bootstrap starting.
02:04:00.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:00.617918  4684 tablet_bootstrap.cc:654] T dc1a9ebc52a94ebbb02cbbb24ba736ff P bb42b1e029044183a7826531d8a6c5d4: Neither blocks nor log segments found. Creating new log.
02:04:00.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:00.620263  4684 log.cc:826] T dc1a9ebc52a94ebbb02cbbb24ba736ff P bb42b1e029044183a7826531d8a6c5d4: Log is configured to *not* fsync() on all Append() calls
02:04:00.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:00.621202  4685 tablet_bootstrap.cc:492] T dc1a9ebc52a94ebbb02cbbb24ba736ff P 018adfb8613f431ebd81a16dd1ef7cc9: Bootstrap starting.
02:04:00.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:00.621317  4686 tablet_bootstrap.cc:492] T dc1a9ebc52a94ebbb02cbbb24ba736ff P 6c64d5c77cf54b82a75cb06a30e74340: Bootstrap starting.
02:04:00.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:00.625690  4684 tablet_bootstrap.cc:492] T dc1a9ebc52a94ebbb02cbbb24ba736ff P bb42b1e029044183a7826531d8a6c5d4: No bootstrap required, opened a new log
02:04:00.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:00.626170  4684 ts_tablet_manager.cc:1403] T dc1a9ebc52a94ebbb02cbbb24ba736ff P bb42b1e029044183a7826531d8a6c5d4: Time spent bootstrapping tablet: real 0.019s	user 0.007s	sys 0.005s
02:04:00.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:00.628548  4686 tablet_bootstrap.cc:654] T dc1a9ebc52a94ebbb02cbbb24ba736ff P 6c64d5c77cf54b82a75cb06a30e74340: Neither blocks nor log segments found. Creating new log.
02:04:00.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:00.628970  4685 tablet_bootstrap.cc:654] T dc1a9ebc52a94ebbb02cbbb24ba736ff P 018adfb8613f431ebd81a16dd1ef7cc9: Neither blocks nor log segments found. Creating new log.
02:04:00.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:00.630846  4686 log.cc:826] T dc1a9ebc52a94ebbb02cbbb24ba736ff P 6c64d5c77cf54b82a75cb06a30e74340: Log is configured to *not* fsync() on all Append() calls
02:04:00.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:00.631139  4685 log.cc:826] T dc1a9ebc52a94ebbb02cbbb24ba736ff P 018adfb8613f431ebd81a16dd1ef7cc9: Log is configured to *not* fsync() on all Append() calls
02:04:00.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:00.637902  4685 tablet_bootstrap.cc:492] T dc1a9ebc52a94ebbb02cbbb24ba736ff P 018adfb8613f431ebd81a16dd1ef7cc9: No bootstrap required, opened a new log
02:04:00.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:00.638398  4685 ts_tablet_manager.cc:1403] T dc1a9ebc52a94ebbb02cbbb24ba736ff P 018adfb8613f431ebd81a16dd1ef7cc9: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.000s
02:04:00.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:00.638698  4686 tablet_bootstrap.cc:492] T dc1a9ebc52a94ebbb02cbbb24ba736ff P 6c64d5c77cf54b82a75cb06a30e74340: No bootstrap required, opened a new log
02:04:00.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:00.639214  4686 ts_tablet_manager.cc:1403] T dc1a9ebc52a94ebbb02cbbb24ba736ff P 6c64d5c77cf54b82a75cb06a30e74340: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
02:04:00.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:00.656387  4684 raft_consensus.cc:359] T dc1a9ebc52a94ebbb02cbbb24ba736ff P bb42b1e029044183a7826531d8a6c5d4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c64d5c77cf54b82a75cb06a30e74340" member_type: VOTER last_known_addr { host: "127.3.214.2" port: 42201 } } peers { permanent_uuid: "018adfb8613f431ebd81a16dd1ef7cc9" member_type: VOTER last_known_addr { host: "127.3.214.1" port: 34805 } } peers { permanent_uuid: "bb42b1e029044183a7826531d8a6c5d4" member_type: VOTER last_known_addr { host: "127.3.214.3" port: 35411 } }
02:04:00.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:00.657289  4684 raft_consensus.cc:385] T dc1a9ebc52a94ebbb02cbbb24ba736ff P bb42b1e029044183a7826531d8a6c5d4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:04:00.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:00.657608  4684 raft_consensus.cc:740] T dc1a9ebc52a94ebbb02cbbb24ba736ff P bb42b1e029044183a7826531d8a6c5d4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb42b1e029044183a7826531d8a6c5d4, State: Initialized, Role: FOLLOWER
02:04:00.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:00.658603  4684 consensus_queue.cc:260] T dc1a9ebc52a94ebbb02cbbb24ba736ff P bb42b1e029044183a7826531d8a6c5d4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c64d5c77cf54b82a75cb06a30e74340" member_type: VOTER last_known_addr { host: "127.3.214.2" port: 42201 } } peers { permanent_uuid: "018adfb8613f431ebd81a16dd1ef7cc9" member_type: VOTER last_known_addr { host: "127.3.214.1" port: 34805 } } peers { permanent_uuid: "bb42b1e029044183a7826531d8a6c5d4" member_type: VOTER last_known_addr { host: "127.3.214.3" port: 35411 } }
02:04:00.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:00.660966  4685 raft_consensus.cc:359] T dc1a9ebc52a94ebbb02cbbb24ba736ff P 018adfb8613f431ebd81a16dd1ef7cc9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c64d5c77cf54b82a75cb06a30e74340" member_type: VOTER last_known_addr { host: "127.3.214.2" port: 42201 } } peers { permanent_uuid: "018adfb8613f431ebd81a16dd1ef7cc9" member_type: VOTER last_known_addr { host: "127.3.214.1" port: 34805 } } peers { permanent_uuid: "bb42b1e029044183a7826531d8a6c5d4" member_type: VOTER last_known_addr { host: "127.3.214.3" port: 35411 } }
02:04:00.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:00.661841  4685 raft_consensus.cc:385] T dc1a9ebc52a94ebbb02cbbb24ba736ff P 018adfb8613f431ebd81a16dd1ef7cc9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:04:00.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:00.662133  4685 raft_consensus.cc:740] T dc1a9ebc52a94ebbb02cbbb24ba736ff P 018adfb8613f431ebd81a16dd1ef7cc9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 018adfb8613f431ebd81a16dd1ef7cc9, State: Initialized, Role: FOLLOWER
02:04:00.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:00.663450  4685 consensus_queue.cc:260] T dc1a9ebc52a94ebbb02cbbb24ba736ff P 018adfb8613f431ebd81a16dd1ef7cc9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c64d5c77cf54b82a75cb06a30e74340" member_type: VOTER last_known_addr { host: "127.3.214.2" port: 42201 } } peers { permanent_uuid: "018adfb8613f431ebd81a16dd1ef7cc9" member_type: VOTER last_known_addr { host: "127.3.214.1" port: 34805 } } peers { permanent_uuid: "bb42b1e029044183a7826531d8a6c5d4" member_type: VOTER last_known_addr { host: "127.3.214.3" port: 35411 } }
02:04:00.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:00.668540  4686 raft_consensus.cc:359] T dc1a9ebc52a94ebbb02cbbb24ba736ff P 6c64d5c77cf54b82a75cb06a30e74340 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c64d5c77cf54b82a75cb06a30e74340" member_type: VOTER last_known_addr { host: "127.3.214.2" port: 42201 } } peers { permanent_uuid: "018adfb8613f431ebd81a16dd1ef7cc9" member_type: VOTER last_known_addr { host: "127.3.214.1" port: 34805 } } peers { permanent_uuid: "bb42b1e029044183a7826531d8a6c5d4" member_type: VOTER last_known_addr { host: "127.3.214.3" port: 35411 } }
02:04:00.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:00.670853  4686 raft_consensus.cc:385] T dc1a9ebc52a94ebbb02cbbb24ba736ff P 6c64d5c77cf54b82a75cb06a30e74340 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:04:00.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:00.673931  4685 ts_tablet_manager.cc:1434] T dc1a9ebc52a94ebbb02cbbb24ba736ff P 018adfb8613f431ebd81a16dd1ef7cc9: Time spent starting tablet: real 0.035s	user 0.017s	sys 0.018s
02:04:00.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:00.678925  4686 raft_consensus.cc:740] T dc1a9ebc52a94ebbb02cbbb24ba736ff P 6c64d5c77cf54b82a75cb06a30e74340 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6c64d5c77cf54b82a75cb06a30e74340, State: Initialized, Role: FOLLOWER
02:04:00.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:00.682571  4686 consensus_queue.cc:260] T dc1a9ebc52a94ebbb02cbbb24ba736ff P 6c64d5c77cf54b82a75cb06a30e74340 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c64d5c77cf54b82a75cb06a30e74340" member_type: VOTER last_known_addr { host: "127.3.214.2" port: 42201 } } peers { permanent_uuid: "018adfb8613f431ebd81a16dd1ef7cc9" member_type: VOTER last_known_addr { host: "127.3.214.1" port: 34805 } } peers { permanent_uuid: "bb42b1e029044183a7826531d8a6c5d4" member_type: VOTER last_known_addr { host: "127.3.214.3" port: 35411 } }
02:04:00.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:00.671803  4684 ts_tablet_manager.cc:1434] T dc1a9ebc52a94ebbb02cbbb24ba736ff P bb42b1e029044183a7826531d8a6c5d4: Time spent starting tablet: real 0.045s	user 0.025s	sys 0.017s
02:04:00.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:00.690702  4652 tablet.cc:2404] T dc1a9ebc52a94ebbb02cbbb24ba736ff P bb42b1e029044183a7826531d8a6c5d4: Can't schedule compaction. Clean time has not been advanced past its initial value.
02:04:00.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:00.695075  4686 ts_tablet_manager.cc:1434] T dc1a9ebc52a94ebbb02cbbb24ba736ff P 6c64d5c77cf54b82a75cb06a30e74340: Time spent starting tablet: real 0.056s	user 0.034s	sys 0.009s
02:04:00.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:00.743428  4514 tablet.cc:2404] T dc1a9ebc52a94ebbb02cbbb24ba736ff P 6c64d5c77cf54b82a75cb06a30e74340: Can't schedule compaction. Clean time has not been advanced past its initial value.
02:04:00.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:00.784754  4374 tablet.cc:2404] T dc1a9ebc52a94ebbb02cbbb24ba736ff P 018adfb8613f431ebd81a16dd1ef7cc9: Can't schedule compaction. Clean time has not been advanced past its initial value.
02:04:00.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:00.938304  4691 raft_consensus.cc:493] T dc1a9ebc52a94ebbb02cbbb24ba736ff P 018adfb8613f431ebd81a16dd1ef7cc9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
02:04:00.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:00.938809  4691 raft_consensus.cc:515] T dc1a9ebc52a94ebbb02cbbb24ba736ff P 018adfb8613f431ebd81a16dd1ef7cc9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c64d5c77cf54b82a75cb06a30e74340" member_type: VOTER last_known_addr { host: "127.3.214.2" port: 42201 } } peers { permanent_uuid: "018adfb8613f431ebd81a16dd1ef7cc9" member_type: VOTER last_known_addr { host: "127.3.214.1" port: 34805 } } peers { permanent_uuid: "bb42b1e029044183a7826531d8a6c5d4" member_type: VOTER last_known_addr { host: "127.3.214.3" port: 35411 } }
02:04:00.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:00.941417  4691 leader_election.cc:290] T dc1a9ebc52a94ebbb02cbbb24ba736ff P 018adfb8613f431ebd81a16dd1ef7cc9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6c64d5c77cf54b82a75cb06a30e74340 (127.3.214.2:42201), bb42b1e029044183a7826531d8a6c5d4 (127.3.214.3:35411)
02:04:00.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:00.956246  4462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1a9ebc52a94ebbb02cbbb24ba736ff" candidate_uuid: "018adfb8613f431ebd81a16dd1ef7cc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c64d5c77cf54b82a75cb06a30e74340" is_pre_election: true
02:04:00.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:00.957080  4462 raft_consensus.cc:2468] T dc1a9ebc52a94ebbb02cbbb24ba736ff P 6c64d5c77cf54b82a75cb06a30e74340 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018adfb8613f431ebd81a16dd1ef7cc9 in term 0.
02:04:00.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:00.958181  4602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1a9ebc52a94ebbb02cbbb24ba736ff" candidate_uuid: "018adfb8613f431ebd81a16dd1ef7cc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb42b1e029044183a7826531d8a6c5d4" is_pre_election: true
02:04:00.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:00.958492  4254 leader_election.cc:304] T dc1a9ebc52a94ebbb02cbbb24ba736ff P 018adfb8613f431ebd81a16dd1ef7cc9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018adfb8613f431ebd81a16dd1ef7cc9, 6c64d5c77cf54b82a75cb06a30e74340; no voters: 
02:04:00.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:00.959074  4602 raft_consensus.cc:2468] T dc1a9ebc52a94ebbb02cbbb24ba736ff P bb42b1e029044183a7826531d8a6c5d4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 018adfb8613f431ebd81a16dd1ef7cc9 in term 0.
02:04:00.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:00.959398  4691 raft_consensus.cc:2804] T dc1a9ebc52a94ebbb02cbbb24ba736ff P 018adfb8613f431ebd81a16dd1ef7cc9 [term 0 FOLLOWER]: Leader pre-election won for term 1
02:04:00.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:00.959760  4691 raft_consensus.cc:493] T dc1a9ebc52a94ebbb02cbbb24ba736ff P 018adfb8613f431ebd81a16dd1ef7cc9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
02:04:00.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:00.960103  4691 raft_consensus.cc:3060] T dc1a9ebc52a94ebbb02cbbb24ba736ff P 018adfb8613f431ebd81a16dd1ef7cc9 [term 0 FOLLOWER]: Advancing to term 1
02:04:00.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:00.966713  4691 raft_consensus.cc:515] T dc1a9ebc52a94ebbb02cbbb24ba736ff P 018adfb8613f431ebd81a16dd1ef7cc9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c64d5c77cf54b82a75cb06a30e74340" member_type: VOTER last_known_addr { host: "127.3.214.2" port: 42201 } } peers { permanent_uuid: "018adfb8613f431ebd81a16dd1ef7cc9" member_type: VOTER last_known_addr { host: "127.3.214.1" port: 34805 } } peers { permanent_uuid: "bb42b1e029044183a7826531d8a6c5d4" member_type: VOTER last_known_addr { host: "127.3.214.3" port: 35411 } }
02:04:00.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:00.968658  4691 leader_election.cc:290] T dc1a9ebc52a94ebbb02cbbb24ba736ff P 018adfb8613f431ebd81a16dd1ef7cc9 [CANDIDATE]: Term 1 election: Requested vote from peers 6c64d5c77cf54b82a75cb06a30e74340 (127.3.214.2:42201), bb42b1e029044183a7826531d8a6c5d4 (127.3.214.3:35411)
02:04:00.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:00.969559  4462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1a9ebc52a94ebbb02cbbb24ba736ff" candidate_uuid: "018adfb8613f431ebd81a16dd1ef7cc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6c64d5c77cf54b82a75cb06a30e74340"
02:04:00.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:00.970063  4462 raft_consensus.cc:3060] T dc1a9ebc52a94ebbb02cbbb24ba736ff P 6c64d5c77cf54b82a75cb06a30e74340 [term 0 FOLLOWER]: Advancing to term 1
02:04:00.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:00.970836  4602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1a9ebc52a94ebbb02cbbb24ba736ff" candidate_uuid: "018adfb8613f431ebd81a16dd1ef7cc9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb42b1e029044183a7826531d8a6c5d4"
02:04:00.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:00.971381  4602 raft_consensus.cc:3060] T dc1a9ebc52a94ebbb02cbbb24ba736ff P bb42b1e029044183a7826531d8a6c5d4 [term 0 FOLLOWER]: Advancing to term 1
02:04:00.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:00.977061  4462 raft_consensus.cc:2468] T dc1a9ebc52a94ebbb02cbbb24ba736ff P 6c64d5c77cf54b82a75cb06a30e74340 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018adfb8613f431ebd81a16dd1ef7cc9 in term 1.
02:04:00.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:00.977698  4602 raft_consensus.cc:2468] T dc1a9ebc52a94ebbb02cbbb24ba736ff P bb42b1e029044183a7826531d8a6c5d4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 018adfb8613f431ebd81a16dd1ef7cc9 in term 1.
02:04:00.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:00.978732  4254 leader_election.cc:304] T dc1a9ebc52a94ebbb02cbbb24ba736ff P 018adfb8613f431ebd81a16dd1ef7cc9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 018adfb8613f431ebd81a16dd1ef7cc9, 6c64d5c77cf54b82a75cb06a30e74340; no voters: 
02:04:00.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:00.980249  4691 raft_consensus.cc:2804] T dc1a9ebc52a94ebbb02cbbb24ba736ff P 018adfb8613f431ebd81a16dd1ef7cc9 [term 1 FOLLOWER]: Leader election won for term 1
02:04:00.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:00.982410  4691 raft_consensus.cc:697] T dc1a9ebc52a94ebbb02cbbb24ba736ff P 018adfb8613f431ebd81a16dd1ef7cc9 [term 1 LEADER]: Becoming Leader. State: Replica: 018adfb8613f431ebd81a16dd1ef7cc9, State: Running, Role: LEADER
02:04:00.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:00.983377  4691 consensus_queue.cc:237] T dc1a9ebc52a94ebbb02cbbb24ba736ff P 018adfb8613f431ebd81a16dd1ef7cc9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c64d5c77cf54b82a75cb06a30e74340" member_type: VOTER last_known_addr { host: "127.3.214.2" port: 42201 } } peers { permanent_uuid: "018adfb8613f431ebd81a16dd1ef7cc9" member_type: VOTER last_known_addr { host: "127.3.214.1" port: 34805 } } peers { permanent_uuid: "bb42b1e029044183a7826531d8a6c5d4" member_type: VOTER last_known_addr { host: "127.3.214.3" port: 35411 } }
02:04:00.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:00.994741  4128 catalog_manager.cc:5696] T dc1a9ebc52a94ebbb02cbbb24ba736ff P 018adfb8613f431ebd81a16dd1ef7cc9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 018adfb8613f431ebd81a16dd1ef7cc9 (127.3.214.1). New cstate: current_term: 1 leader_uuid: "018adfb8613f431ebd81a16dd1ef7cc9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c64d5c77cf54b82a75cb06a30e74340" member_type: VOTER last_known_addr { host: "127.3.214.2" port: 42201 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "018adfb8613f431ebd81a16dd1ef7cc9" member_type: VOTER last_known_addr { host: "127.3.214.1" port: 34805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb42b1e029044183a7826531d8a6c5d4" member_type: VOTER last_known_addr { host: "127.3.214.3" port: 35411 } health_report { overall_health: UNKNOWN } } }
02:04:01.102 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 780b79c815774700a0b4281546d325f0
02:04:01.128 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet dc1a9ebc52a94ebbb02cbbb24ba736ff for table 'org.apache.kudu.client.TestClientFailoverSupport-KILL' with partition [<start>, <end>)
02:04:01.136 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299992, tablet=dc1a9ebc52a94ebbb02cbbb24ba736ff@[018adfb8613f431ebd81a16dd1ef7cc9(127.3.214.1:34805)[L],6c64d5c77cf54b82a75cb06a30e74340(127.3.214.2:42201),bb42b1e029044183a7826531d8a6c5d4(127.3.214.3:35411)]}]
02:04:01.138 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=23), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.214.60:35211, [11ms] Sub RPC GetTableLocations: received response from server master-127.3.214.60:35211: OK, deferred=null) after lookup
02:04:01.151 [DEBUG - kudu-nio-2] (Connection.java:748) [peer 018adfb8613f431ebd81a16dd1ef7cc9(127.3.214.1:34805)] connecting to peer
02:04:01.164 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 018adfb8613f431ebd81a16dd1ef7cc9(127.3.214.1:34805)] Successfully connected to peer
02:04:01.226 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x4d752211, L:/127.0.0.1:51608 - R:/127.3.214.1:34805] using TOKEN/null
02:04:01.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:01.241559  4462 raft_consensus.cc:1275] T dc1a9ebc52a94ebbb02cbbb24ba736ff P 6c64d5c77cf54b82a75cb06a30e74340 [term 1 FOLLOWER]: Refusing update from remote peer 018adfb8613f431ebd81a16dd1ef7cc9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
02:04:01.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:01.241600  4602 raft_consensus.cc:1275] T dc1a9ebc52a94ebbb02cbbb24ba736ff P bb42b1e029044183a7826531d8a6c5d4 [term 1 FOLLOWER]: Refusing update from remote peer 018adfb8613f431ebd81a16dd1ef7cc9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
02:04:01.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:01.243237  4691 consensus_queue.cc:1048] T dc1a9ebc52a94ebbb02cbbb24ba736ff P 018adfb8613f431ebd81a16dd1ef7cc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb42b1e029044183a7826531d8a6c5d4" member_type: VOTER last_known_addr { host: "127.3.214.3" port: 35411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
02:04:01.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:01.244455  4695 consensus_queue.cc:1048] T dc1a9ebc52a94ebbb02cbbb24ba736ff P 018adfb8613f431ebd81a16dd1ef7cc9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6c64d5c77cf54b82a75cb06a30e74340" member_type: VOTER last_known_addr { host: "127.3.214.2" port: 42201 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
02:04:01.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:01.272294  4701 mvcc.cc:204] Tried to move back new op lower bound from 7287070069708263424 to 7287070068677492736. Current Snapshot: MvccSnapshot[applied={T|T < 7287070069708263424}]
02:04:01.618 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 10 rows, more = false) for scanner KuduScanner(table=org.apache.kudu.client.TestClientFailoverSupport-KILL, tablet=dc1a9ebc52a94ebbb02cbbb24ba736ff, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
02:04:01.620 [INFO - Time-limited test] (MiniKuduCluster.java:399) Killing master server 127.3.214.60:35211
02:04:01.621 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: stop_daemon {
  id {
    type: MASTER
    index: 2
  }
}

02:04:01.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:01.622046  3928 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskvuyF4C/build/tsan/bin/kudu with pid 4085
02:04:01.648 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.3.214.60:35211(127.3.214.60:35211)] handling channelInactive
02:04:01.649 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.214.60:35211(127.3.214.60:35211)] cleaning up while in state READY due to: connection closed
02:04:01.650 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
02:04:01.651 [INFO - Time-limited test] (MiniKuduCluster.java:475) Killing tablet server 127.3.214.1:34805
02:04:01.651 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: stop_daemon {
  id {
    type: TSERVER
    index: 0
  }
}

02:04:01.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:01.652199  3928 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskvuyF4C/build/tsan/bin/kudu with pid 4209
02:04:01.688 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
02:04:01.689 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 018adfb8613f431ebd81a16dd1ef7cc9(127.3.214.1:34805)] handling channelInactive
02:04:01.689 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 018adfb8613f431ebd81a16dd1ef7cc9(127.3.214.1:34805)] cleaning up while in state READY due to: connection closed
02:04:01.689 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location 018adfb8613f431ebd81a16dd1ef7cc9(127.3.214.1:34805) for tablet dc1a9ebc52a94ebbb02cbbb24ba736ff: connection closed
02:04:01.711 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.3.214.60:35211(127.3.214.60:35211)] connecting to peer
02:04:01.714 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211
02:04:01.714 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.214.60:35211(127.3.214.60:35211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211
02:04:01.714 [INFO - kudu-nio-4] (AsyncKuduClient.java:2355) Invalidating location master-127.3.214.60:35211(127.3.214.60:35211) for tablet Kudu Master: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211
02:04:01.731 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.3.214.60:35211(127.3.214.60:35211)] connecting to peer
02:04:01.737 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211
02:04:01.738 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.214.60:35211(127.3.214.60:35211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211
02:04:01.738 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.3.214.60:35211: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211
02:04:01.741 [WARN - kudu-nio-5] (ConnectToCluster.java:305) Unable to find the leader master 127.3.214.62:33483,127.3.214.61:37531,127.3.214.60:35211; will retry
02:04:01.752 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.3.214.60:35211(127.3.214.60:35211)] connecting to peer
02:04:01.755 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211
02:04:01.756 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.214.60:35211(127.3.214.60:35211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211
02:04:01.756 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.214.60:35211: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211
02:04:01.757 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.3.214.62:33483,127.3.214.61:37531,127.3.214.60:35211; will retry
02:04:01.772 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.3.214.60:35211(127.3.214.60:35211)] connecting to peer
02:04:01.774 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211
02:04:01.775 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.214.60:35211(127.3.214.60:35211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211
02:04:01.775 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.214.60:35211: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211
02:04:01.775 [WARN - kudu-nio-7] (ConnectToCluster.java:305) Unable to find the leader master 127.3.214.62:33483,127.3.214.61:37531,127.3.214.60:35211; will retry
02:04:01.791 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.3.214.60:35211(127.3.214.60:35211)] connecting to peer
02:04:01.793 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211
02:04:01.793 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.214.60:35211(127.3.214.60:35211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211
02:04:01.793 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.3.214.60:35211: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211
02:04:01.795 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.214.62:33483,127.3.214.61:37531,127.3.214.60:35211; will retry
02:04:01.832 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.3.214.60:35211(127.3.214.60:35211)] connecting to peer
02:04:01.834 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211
02:04:01.834 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.214.60:35211(127.3.214.60:35211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211
02:04:01.834 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.214.60:35211: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211
02:04:01.835 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.214.62:33483,127.3.214.61:37531,127.3.214.60:35211; will retry
02:04:01.871 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.3.214.60:35211(127.3.214.60:35211)] connecting to peer
02:04:01.873 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211
02:04:01.873 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.3.214.60:35211(127.3.214.60:35211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211
02:04:01.874 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.3.214.60:35211: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211
02:04:01.875 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.3.214.62:33483,127.3.214.61:37531,127.3.214.60:35211; will retry
02:04:01.952 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.3.214.60:35211(127.3.214.60:35211)] connecting to peer
02:04:01.954 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211
02:04:01.954 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.3.214.60:35211(127.3.214.60:35211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211
02:04:01.955 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.3.214.60:35211: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211
02:04:01.955 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.214.62:33483,127.3.214.61:37531,127.3.214.60:35211; will retry
02:04:01.992 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.3.214.60:35211(127.3.214.60:35211)] connecting to peer
02:04:01.997 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211
02:04:01.997 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.3.214.60:35211(127.3.214.60:35211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211
02:04:01.997 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.3.214.60:35211: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211
02:04:01.997 [WARN - kudu-nio-4] (ConnectToCluster.java:305) Unable to find the leader master 127.3.214.62:33483,127.3.214.61:37531,127.3.214.60:35211; will retry
02:04:02.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:02.299180  4647 heartbeater.cc:646] Failed to heartbeat to 127.3.214.60:35211 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.3.214.60:35211: connect: Connection refused (error 111)
02:04:02.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:02.362027  4507 heartbeater.cc:646] Failed to heartbeat to 127.3.214.60:35211 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.3.214.60:35211: connect: Connection refused (error 111)
02:04:02.451 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.3.214.60:35211(127.3.214.60:35211)] connecting to peer
02:04:02.453 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211
02:04:02.454 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.3.214.60:35211(127.3.214.60:35211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211
02:04:02.454 [INFO - pool-2-thread-1] (ConnectToCluster.java:385) Unable to connect to master 127.3.214.60:35211: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211
02:04:02.457 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.3.214.62:33483,127.3.214.61:37531,127.3.214.60:35211; will retry
02:04:02.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:02.896942  4720 raft_consensus.cc:493] T 00000000000000000000000000000000 P f64b888c0b984212ac259d020ce9a646 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 16601d0bcd514a8ba8ac0bc9afa2d561)
02:04:02.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:02.897419  4720 raft_consensus.cc:515] T 00000000000000000000000000000000 P f64b888c0b984212ac259d020ce9a646 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4c56e542e4e4647be8f87b8ee56969b" member_type: VOTER last_known_addr { host: "127.3.214.62" port: 33483 } } peers { permanent_uuid: "f64b888c0b984212ac259d020ce9a646" member_type: VOTER last_known_addr { host: "127.3.214.61" port: 37531 } } peers { permanent_uuid: "16601d0bcd514a8ba8ac0bc9afa2d561" member_type: VOTER last_known_addr { host: "127.3.214.60" port: 35211 } }
02:04:02.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:02.899178  4720 leader_election.cc:290] T 00000000000000000000000000000000 P f64b888c0b984212ac259d020ce9a646 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d4c56e542e4e4647be8f87b8ee56969b (127.3.214.62:33483), 16601d0bcd514a8ba8ac0bc9afa2d561 (127.3.214.60:35211)
02:04:02.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:02.900236  3982 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f64b888c0b984212ac259d020ce9a646" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "d4c56e542e4e4647be8f87b8ee56969b" is_pre_election: true
02:04:02.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:02.901384  4035 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.214.60:35211: connect: Connection refused (error 111) [suppressed 6 similar messages]
02:04:02.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:02.904443  4035 leader_election.cc:336] T 00000000000000000000000000000000 P f64b888c0b984212ac259d020ce9a646 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 16601d0bcd514a8ba8ac0bc9afa2d561 (127.3.214.60:35211): Network error: Client connection negotiation failed: client connection to 127.3.214.60:35211: connect: Connection refused (error 111)
02:04:02.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:02.904793  4035 leader_election.cc:304] T 00000000000000000000000000000000 P f64b888c0b984212ac259d020ce9a646 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f64b888c0b984212ac259d020ce9a646; no voters: 16601d0bcd514a8ba8ac0bc9afa2d561, d4c56e542e4e4647be8f87b8ee56969b
02:04:02.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:02.905517  4720 raft_consensus.cc:2749] T 00000000000000000000000000000000 P f64b888c0b984212ac259d020ce9a646 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
02:04:03.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.052317  4723 raft_consensus.cc:493] T dc1a9ebc52a94ebbb02cbbb24ba736ff P 6c64d5c77cf54b82a75cb06a30e74340 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 018adfb8613f431ebd81a16dd1ef7cc9)
02:04:03.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.052829  4723 raft_consensus.cc:515] T dc1a9ebc52a94ebbb02cbbb24ba736ff P 6c64d5c77cf54b82a75cb06a30e74340 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c64d5c77cf54b82a75cb06a30e74340" member_type: VOTER last_known_addr { host: "127.3.214.2" port: 42201 } } peers { permanent_uuid: "018adfb8613f431ebd81a16dd1ef7cc9" member_type: VOTER last_known_addr { host: "127.3.214.1" port: 34805 } } peers { permanent_uuid: "bb42b1e029044183a7826531d8a6c5d4" member_type: VOTER last_known_addr { host: "127.3.214.3" port: 35411 } }
02:04:03.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.054605  4724 raft_consensus.cc:493] T dc1a9ebc52a94ebbb02cbbb24ba736ff P bb42b1e029044183a7826531d8a6c5d4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 018adfb8613f431ebd81a16dd1ef7cc9)
02:04:03.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.055001  4724 raft_consensus.cc:515] T dc1a9ebc52a94ebbb02cbbb24ba736ff P bb42b1e029044183a7826531d8a6c5d4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c64d5c77cf54b82a75cb06a30e74340" member_type: VOTER last_known_addr { host: "127.3.214.2" port: 42201 } } peers { permanent_uuid: "018adfb8613f431ebd81a16dd1ef7cc9" member_type: VOTER last_known_addr { host: "127.3.214.1" port: 34805 } } peers { permanent_uuid: "bb42b1e029044183a7826531d8a6c5d4" member_type: VOTER last_known_addr { host: "127.3.214.3" port: 35411 } }
02:04:03.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.055466  4723 leader_election.cc:290] T dc1a9ebc52a94ebbb02cbbb24ba736ff P 6c64d5c77cf54b82a75cb06a30e74340 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 018adfb8613f431ebd81a16dd1ef7cc9 (127.3.214.1:34805), bb42b1e029044183a7826531d8a6c5d4 (127.3.214.3:35411)
02:04:03.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.058151  4724 leader_election.cc:290] T dc1a9ebc52a94ebbb02cbbb24ba736ff P bb42b1e029044183a7826531d8a6c5d4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6c64d5c77cf54b82a75cb06a30e74340 (127.3.214.2:42201), 018adfb8613f431ebd81a16dd1ef7cc9 (127.3.214.1:34805)
02:04:03.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:03.059073  4395 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.214.1:34805: connect: Connection refused (error 111)
02:04:03.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.071020  4602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1a9ebc52a94ebbb02cbbb24ba736ff" candidate_uuid: "6c64d5c77cf54b82a75cb06a30e74340" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "bb42b1e029044183a7826531d8a6c5d4" is_pre_election: true
02:04:03.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.071692  4602 raft_consensus.cc:2468] T dc1a9ebc52a94ebbb02cbbb24ba736ff P bb42b1e029044183a7826531d8a6c5d4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6c64d5c77cf54b82a75cb06a30e74340 in term 1.
02:04:03.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:03.072480  4535 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.214.1:34805: connect: Connection refused (error 111)
02:04:03.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.073807  4397 leader_election.cc:304] T dc1a9ebc52a94ebbb02cbbb24ba736ff P 6c64d5c77cf54b82a75cb06a30e74340 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6c64d5c77cf54b82a75cb06a30e74340, bb42b1e029044183a7826531d8a6c5d4; no voters: 
02:04:03.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.074684  4723 raft_consensus.cc:2804] T dc1a9ebc52a94ebbb02cbbb24ba736ff P 6c64d5c77cf54b82a75cb06a30e74340 [term 1 FOLLOWER]: Leader pre-election won for term 2
02:04:03.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.075039  4723 raft_consensus.cc:493] T dc1a9ebc52a94ebbb02cbbb24ba736ff P 6c64d5c77cf54b82a75cb06a30e74340 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 018adfb8613f431ebd81a16dd1ef7cc9)
02:04:03.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.075389  4723 raft_consensus.cc:3060] T dc1a9ebc52a94ebbb02cbbb24ba736ff P 6c64d5c77cf54b82a75cb06a30e74340 [term 1 FOLLOWER]: Advancing to term 2
02:04:03.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:03.075156  4395 leader_election.cc:336] T dc1a9ebc52a94ebbb02cbbb24ba736ff P 6c64d5c77cf54b82a75cb06a30e74340 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 018adfb8613f431ebd81a16dd1ef7cc9 (127.3.214.1:34805): Network error: Client connection negotiation failed: client connection to 127.3.214.1:34805: connect: Connection refused (error 111)
02:04:03.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:03.078115  4535 leader_election.cc:336] T dc1a9ebc52a94ebbb02cbbb24ba736ff P bb42b1e029044183a7826531d8a6c5d4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 018adfb8613f431ebd81a16dd1ef7cc9 (127.3.214.1:34805): Network error: Client connection negotiation failed: client connection to 127.3.214.1:34805: connect: Connection refused (error 111)
02:04:03.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.081557  4462 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1a9ebc52a94ebbb02cbbb24ba736ff" candidate_uuid: "bb42b1e029044183a7826531d8a6c5d4" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "6c64d5c77cf54b82a75cb06a30e74340" is_pre_election: true
02:04:03.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.081465  4723 raft_consensus.cc:515] T dc1a9ebc52a94ebbb02cbbb24ba736ff P 6c64d5c77cf54b82a75cb06a30e74340 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c64d5c77cf54b82a75cb06a30e74340" member_type: VOTER last_known_addr { host: "127.3.214.2" port: 42201 } } peers { permanent_uuid: "018adfb8613f431ebd81a16dd1ef7cc9" member_type: VOTER last_known_addr { host: "127.3.214.1" port: 34805 } } peers { permanent_uuid: "bb42b1e029044183a7826531d8a6c5d4" member_type: VOTER last_known_addr { host: "127.3.214.3" port: 35411 } }
02:04:03.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.082432  4462 raft_consensus.cc:2393] T dc1a9ebc52a94ebbb02cbbb24ba736ff P 6c64d5c77cf54b82a75cb06a30e74340 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate bb42b1e029044183a7826531d8a6c5d4 in current term 2: Already voted for candidate 6c64d5c77cf54b82a75cb06a30e74340 in this term.
02:04:03.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.083074  4723 leader_election.cc:290] T dc1a9ebc52a94ebbb02cbbb24ba736ff P 6c64d5c77cf54b82a75cb06a30e74340 [CANDIDATE]: Term 2 election: Requested vote from peers 018adfb8613f431ebd81a16dd1ef7cc9 (127.3.214.1:34805), bb42b1e029044183a7826531d8a6c5d4 (127.3.214.3:35411)
02:04:03.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.083704  4535 leader_election.cc:304] T dc1a9ebc52a94ebbb02cbbb24ba736ff P bb42b1e029044183a7826531d8a6c5d4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: bb42b1e029044183a7826531d8a6c5d4; no voters: 018adfb8613f431ebd81a16dd1ef7cc9, 6c64d5c77cf54b82a75cb06a30e74340
02:04:03.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.084182  4602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc1a9ebc52a94ebbb02cbbb24ba736ff" candidate_uuid: "6c64d5c77cf54b82a75cb06a30e74340" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "bb42b1e029044183a7826531d8a6c5d4"
02:04:03.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.084728  4724 raft_consensus.cc:3060] T dc1a9ebc52a94ebbb02cbbb24ba736ff P bb42b1e029044183a7826531d8a6c5d4 [term 1 FOLLOWER]: Advancing to term 2
02:04:03.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:03.088096  4395 leader_election.cc:336] T dc1a9ebc52a94ebbb02cbbb24ba736ff P 6c64d5c77cf54b82a75cb06a30e74340 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 018adfb8613f431ebd81a16dd1ef7cc9 (127.3.214.1:34805): Network error: Client connection negotiation failed: client connection to 127.3.214.1:34805: connect: Connection refused (error 111)
02:04:03.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.090871  4724 raft_consensus.cc:2749] T dc1a9ebc52a94ebbb02cbbb24ba736ff P bb42b1e029044183a7826531d8a6c5d4 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
02:04:03.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.095196  4733 raft_consensus.cc:493] T 00000000000000000000000000000000 P d4c56e542e4e4647be8f87b8ee56969b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 16601d0bcd514a8ba8ac0bc9afa2d561)
02:04:03.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.095795  4733 raft_consensus.cc:515] T 00000000000000000000000000000000 P d4c56e542e4e4647be8f87b8ee56969b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4c56e542e4e4647be8f87b8ee56969b" member_type: VOTER last_known_addr { host: "127.3.214.62" port: 33483 } } peers { permanent_uuid: "f64b888c0b984212ac259d020ce9a646" member_type: VOTER last_known_addr { host: "127.3.214.61" port: 37531 } } peers { permanent_uuid: "16601d0bcd514a8ba8ac0bc9afa2d561" member_type: VOTER last_known_addr { host: "127.3.214.60" port: 35211 } }
02:04:03.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.097638  4602 raft_consensus.cc:2468] T dc1a9ebc52a94ebbb02cbbb24ba736ff P bb42b1e029044183a7826531d8a6c5d4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6c64d5c77cf54b82a75cb06a30e74340 in term 2.
02:04:03.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.099380  4057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d4c56e542e4e4647be8f87b8ee56969b" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "f64b888c0b984212ac259d020ce9a646" is_pre_election: true
02:04:03.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.099782  4733 leader_election.cc:290] T 00000000000000000000000000000000 P d4c56e542e4e4647be8f87b8ee56969b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f64b888c0b984212ac259d020ce9a646 (127.3.214.61:37531), 16601d0bcd514a8ba8ac0bc9afa2d561 (127.3.214.60:35211)
02:04:03.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.100112  4057 raft_consensus.cc:2468] T 00000000000000000000000000000000 P f64b888c0b984212ac259d020ce9a646 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d4c56e542e4e4647be8f87b8ee56969b in term 1.
02:04:03.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.101277  4397 leader_election.cc:304] T dc1a9ebc52a94ebbb02cbbb24ba736ff P 6c64d5c77cf54b82a75cb06a30e74340 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6c64d5c77cf54b82a75cb06a30e74340, bb42b1e029044183a7826531d8a6c5d4; no voters: 018adfb8613f431ebd81a16dd1ef7cc9
02:04:03.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.101397  3958 leader_election.cc:304] T 00000000000000000000000000000000 P d4c56e542e4e4647be8f87b8ee56969b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d4c56e542e4e4647be8f87b8ee56969b, f64b888c0b984212ac259d020ce9a646; no voters: 
02:04:03.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:03.102473  3960 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.3.214.60:35211: connect: Connection refused (error 111) [suppressed 13 similar messages]
02:04:03.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.104043  4733 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d4c56e542e4e4647be8f87b8ee56969b [term 1 FOLLOWER]: Leader pre-election won for term 2
02:04:03.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.104462  4733 raft_consensus.cc:493] T 00000000000000000000000000000000 P d4c56e542e4e4647be8f87b8ee56969b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 16601d0bcd514a8ba8ac0bc9afa2d561)
02:04:03.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.105661  4733 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d4c56e542e4e4647be8f87b8ee56969b [term 1 FOLLOWER]: Advancing to term 2
02:04:03.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:03.106359  3960 leader_election.cc:336] T 00000000000000000000000000000000 P d4c56e542e4e4647be8f87b8ee56969b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 16601d0bcd514a8ba8ac0bc9afa2d561 (127.3.214.60:35211): Network error: Client connection negotiation failed: client connection to 127.3.214.60:35211: connect: Connection refused (error 111)
02:04:03.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.114473  4733 raft_consensus.cc:515] T 00000000000000000000000000000000 P d4c56e542e4e4647be8f87b8ee56969b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4c56e542e4e4647be8f87b8ee56969b" member_type: VOTER last_known_addr { host: "127.3.214.62" port: 33483 } } peers { permanent_uuid: "f64b888c0b984212ac259d020ce9a646" member_type: VOTER last_known_addr { host: "127.3.214.61" port: 37531 } } peers { permanent_uuid: "16601d0bcd514a8ba8ac0bc9afa2d561" member_type: VOTER last_known_addr { host: "127.3.214.60" port: 35211 } }
02:04:03.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.115742  4723 raft_consensus.cc:2804] T dc1a9ebc52a94ebbb02cbbb24ba736ff P 6c64d5c77cf54b82a75cb06a30e74340 [term 2 FOLLOWER]: Leader election won for term 2
02:04:03.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.117144  4057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d4c56e542e4e4647be8f87b8ee56969b" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "f64b888c0b984212ac259d020ce9a646"
02:04:03.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.117708  4057 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f64b888c0b984212ac259d020ce9a646 [term 1 FOLLOWER]: Advancing to term 2
02:04:03.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:03.121269  3960 leader_election.cc:336] T 00000000000000000000000000000000 P d4c56e542e4e4647be8f87b8ee56969b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 16601d0bcd514a8ba8ac0bc9afa2d561 (127.3.214.60:35211): Network error: Client connection negotiation failed: client connection to 127.3.214.60:35211: connect: Connection refused (error 111)
02:04:03.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.121951  4733 leader_election.cc:290] T 00000000000000000000000000000000 P d4c56e542e4e4647be8f87b8ee56969b [CANDIDATE]: Term 2 election: Requested vote from peers f64b888c0b984212ac259d020ce9a646 (127.3.214.61:37531), 16601d0bcd514a8ba8ac0bc9afa2d561 (127.3.214.60:35211)
02:04:03.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.126863  4057 raft_consensus.cc:2468] T 00000000000000000000000000000000 P f64b888c0b984212ac259d020ce9a646 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d4c56e542e4e4647be8f87b8ee56969b in term 2.
02:04:03.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.128805  3958 leader_election.cc:304] T 00000000000000000000000000000000 P d4c56e542e4e4647be8f87b8ee56969b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: d4c56e542e4e4647be8f87b8ee56969b, f64b888c0b984212ac259d020ce9a646; no voters: 16601d0bcd514a8ba8ac0bc9afa2d561
02:04:03.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.130445  4733 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d4c56e542e4e4647be8f87b8ee56969b [term 2 FOLLOWER]: Leader election won for term 2
02:04:03.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.130288  4723 raft_consensus.cc:697] T dc1a9ebc52a94ebbb02cbbb24ba736ff P 6c64d5c77cf54b82a75cb06a30e74340 [term 2 LEADER]: Becoming Leader. State: Replica: 6c64d5c77cf54b82a75cb06a30e74340, State: Running, Role: LEADER
02:04:03.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.132110  4733 raft_consensus.cc:697] T 00000000000000000000000000000000 P d4c56e542e4e4647be8f87b8ee56969b [term 2 LEADER]: Becoming Leader. State: Replica: d4c56e542e4e4647be8f87b8ee56969b, State: Running, Role: LEADER
02:04:03.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.131920  4723 consensus_queue.cc:237] T dc1a9ebc52a94ebbb02cbbb24ba736ff P 6c64d5c77cf54b82a75cb06a30e74340 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 1.11, Last appended by leader: 11, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c64d5c77cf54b82a75cb06a30e74340" member_type: VOTER last_known_addr { host: "127.3.214.2" port: 42201 } } peers { permanent_uuid: "018adfb8613f431ebd81a16dd1ef7cc9" member_type: VOTER last_known_addr { host: "127.3.214.1" port: 34805 } } peers { permanent_uuid: "bb42b1e029044183a7826531d8a6c5d4" member_type: VOTER last_known_addr { host: "127.3.214.3" port: 35411 } }
02:04:03.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.133095  4733 consensus_queue.cc:237] T 00000000000000000000000000000000 P d4c56e542e4e4647be8f87b8ee56969b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4c56e542e4e4647be8f87b8ee56969b" member_type: VOTER last_known_addr { host: "127.3.214.62" port: 33483 } } peers { permanent_uuid: "f64b888c0b984212ac259d020ce9a646" member_type: VOTER last_known_addr { host: "127.3.214.61" port: 37531 } } peers { permanent_uuid: "16601d0bcd514a8ba8ac0bc9afa2d561" member_type: VOTER last_known_addr { host: "127.3.214.60" port: 35211 } }
02:04:03.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.141124  4737 sys_catalog.cc:455] T 00000000000000000000000000000000 P d4c56e542e4e4647be8f87b8ee56969b [sys.catalog]: SysCatalogTable state changed. Reason: New leader d4c56e542e4e4647be8f87b8ee56969b. Latest consensus state: current_term: 2 leader_uuid: "d4c56e542e4e4647be8f87b8ee56969b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4c56e542e4e4647be8f87b8ee56969b" member_type: VOTER last_known_addr { host: "127.3.214.62" port: 33483 } } peers { permanent_uuid: "f64b888c0b984212ac259d020ce9a646" member_type: VOTER last_known_addr { host: "127.3.214.61" port: 37531 } } peers { permanent_uuid: "16601d0bcd514a8ba8ac0bc9afa2d561" member_type: VOTER last_known_addr { host: "127.3.214.60" port: 35211 } } }
02:04:03.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.141932  4737 sys_catalog.cc:458] T 00000000000000000000000000000000 P d4c56e542e4e4647be8f87b8ee56969b [sys.catalog]: This master's current role is: LEADER
02:04:03.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.145447  4740 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
02:04:03.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.153678  4740 catalog_manager.cc:679] Loaded metadata for table org.apache.kudu.client.TestClientFailoverSupport-KILL [id=780b79c815774700a0b4281546d325f0]
02:04:03.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.158381  4740 tablet_loader.cc:96] loaded metadata for tablet dc1a9ebc52a94ebbb02cbbb24ba736ff (table org.apache.kudu.client.TestClientFailoverSupport-KILL [id=780b79c815774700a0b4281546d325f0])
02:04:03.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.159520  4740 catalog_manager.cc:1519] Initializing Kudu cluster ID...
02:04:03.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.162338  4740 catalog_manager.cc:1294] Loaded cluster ID: af524257e553494496e573387f1db125
02:04:03.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.162547  4740 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
02:04:03.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.165781  4740 catalog_manager.cc:1539] Loading token signing keys...
02:04:03.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.168553  4740 catalog_manager.cc:6080] T 00000000000000000000000000000000 P d4c56e542e4e4647be8f87b8ee56969b: Loaded TSK: 0
02:04:03.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.169615  4740 catalog_manager.cc:1549] Initializing in-progress tserver states...
02:04:03.171 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.3.214.60:35211(127.3.214.60:35211)] connecting to peer
02:04:03.173 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211
02:04:03.174 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.3.214.60:35211(127.3.214.60:35211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211
02:04:03.174 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.3.214.60:35211: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211
02:04:03.177 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.3.214.62:33483,127.3.214.61:37531,127.3.214.60:35211; will retry
02:04:03.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:03.555807  4395 consensus_peers.cc:597] T dc1a9ebc52a94ebbb02cbbb24ba736ff P 6c64d5c77cf54b82a75cb06a30e74340 -> Peer 018adfb8613f431ebd81a16dd1ef7cc9 (127.3.214.1:34805): Couldn't send request to peer 018adfb8613f431ebd81a16dd1ef7cc9. Status: Network error: Client connection negotiation failed: client connection to 127.3.214.1:34805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
02:04:03.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.566293  4057 raft_consensus.cc:1275] T 00000000000000000000000000000000 P f64b888c0b984212ac259d020ce9a646 [term 2 FOLLOWER]: Refusing update from remote peer d4c56e542e4e4647be8f87b8ee56969b: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 2 index: 8. (index mismatch)
02:04:03.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.567798  4733 consensus_queue.cc:1048] T 00000000000000000000000000000000 P d4c56e542e4e4647be8f87b8ee56969b [LEADER]: Connected to new peer: Peer: permanent_uuid: "f64b888c0b984212ac259d020ce9a646" member_type: VOTER last_known_addr { host: "127.3.214.61" port: 37531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
02:04:03.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.571807  4741 sys_catalog.cc:455] T 00000000000000000000000000000000 P f64b888c0b984212ac259d020ce9a646 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d4c56e542e4e4647be8f87b8ee56969b. Latest consensus state: current_term: 2 leader_uuid: "d4c56e542e4e4647be8f87b8ee56969b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4c56e542e4e4647be8f87b8ee56969b" member_type: VOTER last_known_addr { host: "127.3.214.62" port: 33483 } } peers { permanent_uuid: "f64b888c0b984212ac259d020ce9a646" member_type: VOTER last_known_addr { host: "127.3.214.61" port: 37531 } } peers { permanent_uuid: "16601d0bcd514a8ba8ac0bc9afa2d561" member_type: VOTER last_known_addr { host: "127.3.214.60" port: 35211 } } }
02:04:03.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.572655  4741 sys_catalog.cc:458] T 00000000000000000000000000000000 P f64b888c0b984212ac259d020ce9a646 [sys.catalog]: This master's current role is: FOLLOWER
02:04:03.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.576113  4737 sys_catalog.cc:455] T 00000000000000000000000000000000 P d4c56e542e4e4647be8f87b8ee56969b [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "d4c56e542e4e4647be8f87b8ee56969b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4c56e542e4e4647be8f87b8ee56969b" member_type: VOTER last_known_addr { host: "127.3.214.62" port: 33483 } } peers { permanent_uuid: "f64b888c0b984212ac259d020ce9a646" member_type: VOTER last_known_addr { host: "127.3.214.61" port: 37531 } } peers { permanent_uuid: "16601d0bcd514a8ba8ac0bc9afa2d561" member_type: VOTER last_known_addr { host: "127.3.214.60" port: 35211 } } }
02:04:03.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.576879  4737 sys_catalog.cc:458] T 00000000000000000000000000000000 P d4c56e542e4e4647be8f87b8ee56969b [sys.catalog]: This master's current role is: LEADER
02:04:03.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.578387  4741 sys_catalog.cc:455] T 00000000000000000000000000000000 P f64b888c0b984212ac259d020ce9a646 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "d4c56e542e4e4647be8f87b8ee56969b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d4c56e542e4e4647be8f87b8ee56969b" member_type: VOTER last_known_addr { host: "127.3.214.62" port: 33483 } } peers { permanent_uuid: "f64b888c0b984212ac259d020ce9a646" member_type: VOTER last_known_addr { host: "127.3.214.61" port: 37531 } } peers { permanent_uuid: "16601d0bcd514a8ba8ac0bc9afa2d561" member_type: VOTER last_known_addr { host: "127.3.214.60" port: 35211 } } }
02:04:03.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.579226  4741 sys_catalog.cc:458] T 00000000000000000000000000000000 P f64b888c0b984212ac259d020ce9a646 [sys.catalog]: This master's current role is: FOLLOWER
02:04:03.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:03.580528  3960 consensus_peers.cc:597] T 00000000000000000000000000000000 P d4c56e542e4e4647be8f87b8ee56969b -> Peer 16601d0bcd514a8ba8ac0bc9afa2d561 (127.3.214.60:35211): Couldn't send request to peer 16601d0bcd514a8ba8ac0bc9afa2d561. Status: Network error: Client connection negotiation failed: client connection to 127.3.214.60:35211: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
02:04:03.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.594440  4602 raft_consensus.cc:1275] T dc1a9ebc52a94ebbb02cbbb24ba736ff P bb42b1e029044183a7826531d8a6c5d4 [term 2 FOLLOWER]: Refusing update from remote peer 6c64d5c77cf54b82a75cb06a30e74340: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 2 index: 12. (index mismatch)
02:04:03.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.595780  4723 consensus_queue.cc:1048] T dc1a9ebc52a94ebbb02cbbb24ba736ff P 6c64d5c77cf54b82a75cb06a30e74340 [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb42b1e029044183a7826531d8a6c5d4" member_type: VOTER last_known_addr { host: "127.3.214.3" port: 35411 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
02:04:03.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.599108  4649 heartbeater.cc:499] Master 127.3.214.62:33483 was elected leader, sending a full tablet report...
02:04:03.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.606163  3973 catalog_manager.cc:5696] T dc1a9ebc52a94ebbb02cbbb24ba736ff P bb42b1e029044183a7826531d8a6c5d4 reported cstate change: term changed from 1 to 2, leader changed from 018adfb8613f431ebd81a16dd1ef7cc9 (127.3.214.1) to 6c64d5c77cf54b82a75cb06a30e74340 (127.3.214.2). New cstate: current_term: 2 leader_uuid: "6c64d5c77cf54b82a75cb06a30e74340" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6c64d5c77cf54b82a75cb06a30e74340" member_type: VOTER last_known_addr { host: "127.3.214.2" port: 42201 } } peers { permanent_uuid: "018adfb8613f431ebd81a16dd1ef7cc9" member_type: VOTER last_known_addr { host: "127.3.214.1" port: 34805 } } peers { permanent_uuid: "bb42b1e029044183a7826531d8a6c5d4" member_type: VOTER last_known_addr { host: "127.3.214.3" port: 35411 } } }
02:04:04.591 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.3.214.60:35211(127.3.214.60:35211)] connecting to peer
02:04:04.593 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211
02:04:04.593 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.3.214.60:35211(127.3.214.60:35211)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211
02:04:04.594 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.3.214.60:35211: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211
02:04:04.596 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
02:04:04.598 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableLocations, tablet=Kudu Master, attempt=12, TimeoutTracker(timeout=29979, elapsed=2886), Traces: [0ms] sending RPC to server master-127.3.214.60:35211, [4ms] received response from server master-127.3.214.60:35211: Network error: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211, [4ms] delaying RPC due to: Network error: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211, [20ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.214.62:33483, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.214.61:37531, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.214.60:35211, [25ms] Sub RPC ConnectToMaster: received response from server master-127.3.214.61:37531: OK, [25ms] Sub RPC ConnectToMaster: received response from server master-127.3.214.62:33483: OK, [28ms] Sub RPC ConnectToMaster: received response from server master-127.3.214.60:35211: Network error: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211, [31ms] delaying RPC due to: Service unavailable: Master config (127.3.214.62:33483,127.3.214.61:37531,127.3.214.60:35211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211, [40ms] refreshing cache from master, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.214.62:33483, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.214.61:37531, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.214.60:35211, [46ms] Sub RPC ConnectToMaster: received response from server master-127.3.214.62:33483: OK, [46ms] Sub RPC ConnectToMaster: received response from server master-127.3.214.61:37531: OK, [46ms] Sub RPC ConnectToMaster: received response from server master-127.3.214.60:35211: Network error: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211, [47ms] delaying RPC due to: Service unavailable: Master config (127.3.214.62:33483,127.3.214.61:37531,127.3.214.60:35211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211, [60ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.214.62:33483, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.214.61:37531, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.214.60:35211, [64ms] Sub RPC ConnectToMaster: received response from server master-127.3.214.62:33483: OK, [64ms] Sub RPC ConnectToMaster: received response from server master-127.3.214.61:37531: OK, [65ms] Sub RPC ConnectToMaster: received response from server master-127.3.214.60:35211: Network error: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211, [65ms] delaying RPC due to: Service unavailable: Master config (127.3.214.62:33483,127.3.214.61:37531,127.3.214.60:35211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.214.62:33483, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.214.61:37531, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.214.60:35211, [83ms] Sub RPC ConnectToMaster: received response from server master-127.3.214.60:35211: Network error: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211, [84ms] Sub RPC ConnectToMaster: received response from server master-127.3.214.62:33483: OK, [85ms] Sub RPC ConnectToMaster: received response from server master-127.3.214.61:37531: OK, [85ms] delaying RPC due to: Service unavailable: Master config (127.3.214.62:33483,127.3.214.61:37531,127.3.214.60:35211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211, [120ms] refreshing cache from master, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.214.62:33483, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.214.61:37531, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.214.60:35211, [124ms] Sub RPC ConnectToMaster: received response from server master-127.3.214.60:35211: Network error: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211, [125ms] Sub RPC ConnectToMaster: received response from server master-127.3.214.62:33483: OK, [125ms] Sub RPC ConnectToMaster: received response from server master-127.3.214.61:37531: OK, [125ms] delaying RPC due to: Service unavailable: Master config (127.3.214.62:33483,127.3.214.61:37531,127.3.214.60:35211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211, [160ms] refreshing cache from master, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.214.62:33483, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.214.61:37531, [161ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.214.60:35211, [163ms] Sub RPC ConnectToMaster: received response from server master-127.3.214.60:35211: Network error: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211, [165ms] Sub RPC ConnectToMaster: received response from server master-127.3.214.61:37531: OK, [165ms] Sub RPC ConnectToMaster: received response from server master-127.3.214.62:33483: OK, [165ms] delaying RPC due to: Service unavailable: Master config (127.3.214.62:33483,127.3.214.61:37531,127.3.214.60:35211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211, [241ms] refreshing cache from master, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.214.62:33483, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.214.61:37531, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.214.60:35211, [244ms] Sub RPC ConnectToMaster: received response from server master-127.3.214.60:35211: Network error: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211, [245ms] Sub RPC ConnectToMaster: received response from server master-127.3.214.62:33483: OK, [245ms] Sub RPC ConnectToMaster: received response from server master-127.3.214.61:37531: OK, [245ms] delaying RPC due to: Service unavailable: Master config (127.3.214.62:33483,127.3.214.61:37531,127.3.214.60:35211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211, [281ms] refreshing cache from master, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.214.62:33483, [281ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.214.61:37531, [282ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.214.60:35211, [285ms] Sub RPC ConnectToMaster: received response from server master-127.3.214.61:37531: OK, [286ms] Sub RPC ConnectToMaster: received response from server master-127.3.214.62:33483: OK, [287ms] Sub RPC ConnectToMaster: received response from server master-127.3.214.60:35211: Network error: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211, [287ms] delaying RPC due to: Service unavailable: Master config (127.3.214.62:33483,127.3.214.61:37531,127.3.214.60:35211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211, [740ms] refreshing cache from master, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.214.62:33483, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.214.61:37531, [741ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.214.60:35211, [744ms] Sub RPC ConnectToMaster: received response from server master-127.3.214.60:35211: Network error: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211, [745ms] Sub RPC ConnectToMaster: received response from server master-127.3.214.61:37531: OK, [747ms] Sub RPC ConnectToMaster: received response from server master-127.3.214.62:33483: OK, [747ms] delaying RPC due to: Service unavailable: Master config (127.3.214.62:33483,127.3.214.61:37531,127.3.214.60:35211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211, [1460ms] refreshing cache from master, [1460ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.214.62:33483, [1461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.214.61:37531, [1461ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.214.60:35211, [1464ms] Sub RPC ConnectToMaster: received response from server master-127.3.214.60:35211: Network error: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211, [1465ms] Sub RPC ConnectToMaster: received response from server master-127.3.214.62:33483: OK, [1467ms] Sub RPC ConnectToMaster: received response from server master-127.3.214.61:37531: OK, [1468ms] delaying RPC due to: Service unavailable: Master config (127.3.214.62:33483,127.3.214.61:37531,127.3.214.60:35211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211, [2880ms] refreshing cache from master, [2880ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.214.62:33483, [2881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.214.61:37531, [2881ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.214.60:35211, [2883ms] Sub RPC ConnectToMaster: received response from server master-127.3.214.60:35211: Network error: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211, [2885ms] Sub RPC ConnectToMaster: received response from server master-127.3.214.61:37531: OK, [2886ms] Sub RPC ConnectToMaster: received response from server master-127.3.214.62:33483: OK, deferred=Deferred@1485822158(state=PENDING, result=null, callback=get tablet locations from the master for table org.apache.kudu.client.TestClientFailoverSupport-KILL -> release master lookup permit -> retry RPC -> (continuation of Deferred@254345845 after retry RPC after error@1258866046) -> (continuation of Deferred@533456412 after retry RPC after error@967050371) -> (continuation of Deferred@2128188264 after retry RPC after error@1945602808) -> (continuation of Deferred@860649884 after retry RPC after error@718660458) -> (continuation of Deferred@405108619 after retry RPC after error@1464503869) -> (continuation of Deferred@127573457 after retry RPC after error@47309051) -> (continuation of Deferred@838551045 after retry RPC after error@851647841) -> (continuation of Deferred@1633975037 after retry RPC after error@1824491538) -> (continuation of Deferred@127873262 after retry RPC after error@765267305) -> (continuation of Deferred@1877748149 after retry RPC after error@2130957122), errback=passthrough -> release master lookup permit -> retry RPC after error -> (continuation of Deferred@254345845 after retry RPC after error@1258866046) -> (continuation of Deferred@533456412 after retry RPC after error@967050371) -> (continuation of Deferred@2128188264 after retry RPC after error@1945602808) -> (continuation of Deferred@860649884 after retry RPC after error@718660458) -> (continuation of Deferred@405108619 after retry RPC after error@1464503869) -> (continuation of Deferred@127573457 after retry RPC after error@47309051) -> (continuation of Deferred@838551045 after retry RPC after error@851647841) -> (continuation of Deferred@1633975037 after retry RPC after error@1824491538) -> (continuation of Deferred@127873262 after retry RPC after error@765267305) -> (continuation of Deferred@1877748149 after retry RPC after error@2130957122))) after lookup
02:04:04.604 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet dc1a9ebc52a94ebbb02cbbb24ba736ff for table 'org.apache.kudu.client.TestClientFailoverSupport-KILL' with partition [<start>, <end>)
02:04:04.604 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=dc1a9ebc52a94ebbb02cbbb24ba736ff@[018adfb8613f431ebd81a16dd1ef7cc9(127.3.214.1:34805),6c64d5c77cf54b82a75cb06a30e74340(127.3.214.2:42201)[L],bb42b1e029044183a7826531d8a6c5d4(127.3.214.3:35411)]}]
02:04:04.606 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=dc1a9ebc52a94ebbb02cbbb24ba736ff, attempt=2, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=2916), Traces: [0ms] sending RPC to server 018adfb8613f431ebd81a16dd1ef7cc9, [0ms] received response from server 018adfb8613f431ebd81a16dd1ef7cc9: Network error: connection closed, [0ms] delaying RPC due to: Network error: connection closed, [21ms] refreshing cache from master, [21ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.214.60:35211, [25ms] Sub RPC GetTableLocations: received response from server master-127.3.214.60:35211: Network error: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211, [25ms] Sub RPC GetTableLocations: delaying RPC due to: Network error: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211, [41ms] Sub RPC GetTableLocations: refreshing cache from master, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.214.62:33483, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.214.61:37531, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.214.60:35211, [46ms] Sub RPC ConnectToMaster: received response from server master-127.3.214.61:37531: OK, [46ms] Sub RPC ConnectToMaster: received response from server master-127.3.214.62:33483: OK, [49ms] Sub RPC ConnectToMaster: received response from server master-127.3.214.60:35211: Network error: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211, [52ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.214.62:33483,127.3.214.61:37531,127.3.214.60:35211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211, [61ms] Sub RPC GetTableLocations: refreshing cache from master, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.214.62:33483, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.214.61:37531, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.214.60:35211, [67ms] Sub RPC ConnectToMaster: received response from server master-127.3.214.62:33483: OK, [67ms] Sub RPC ConnectToMaster: received response from server master-127.3.214.61:37531: OK, [67ms] Sub RPC ConnectToMaster: received response from server master-127.3.214.60:35211: Network error: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211, [68ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.214.62:33483,127.3.214.61:37531,127.3.214.60:35211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211, [81ms] Sub RPC GetTableLocations: refreshing cache from master, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.214.62:33483, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.214.61:37531, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.214.60:35211, [85ms] Sub RPC ConnectToMaster: received response from server master-127.3.214.62:33483: OK, [85ms] Sub RPC ConnectToMaster: received response from server master-127.3.214.61:37531: OK, [86ms] Sub RPC ConnectToMaster: received response from server master-127.3.214.60:35211: Network error: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211, [86ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.214.62:33483,127.3.214.61:37531,127.3.214.60:35211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211, [101ms] Sub RPC GetTableLocations: refreshing cache from master, [101ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.214.62:33483, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.214.61:37531, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.214.60:35211, [104ms] Sub RPC ConnectToMaster: received response from server master-127.3.214.60:35211: Network error: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211, [105ms] Sub RPC ConnectToMaster: received response from server master-127.3.214.62:33483: OK, [106ms] Sub RPC ConnectToMaster: received response from server master-127.3.214.61:37531: OK, [106ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.214.62:33483,127.3.214.61:37531,127.3.214.60:35211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211, [141ms] Sub RPC GetTableLocations: refreshing cache from master, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.214.62:33483, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.214.61:37531, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.214.60:35211, [145ms] Sub RPC ConnectToMaster: received response from server master-127.3.214.60:35211: Network error: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211, [146ms] Sub RPC ConnectToMaster: received response from server master-127.3.214.62:33483: OK, [146ms] Sub RPC ConnectToMaster: received response from server master-127.3.214.61:37531: OK, [146ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.214.62:33483,127.3.214.61:37531,127.3.214.60:35211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211, [181ms] Sub RPC GetTableLocations: refreshing cache from master, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.214.62:33483, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.214.61:37531, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.214.60:35211, [184ms] Sub RPC ConnectToMaster: received response from server master-127.3.214.60:35211: Network error: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211, [186ms] Sub RPC ConnectToMaster: received response from server master-127.3.214.61:37531: OK, [186ms] Sub RPC ConnectToMaster: received response from server master-127.3.214.62:33483: OK, [186ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.214.62:33483,127.3.214.61:37531,127.3.214.60:35211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211, [262ms] Sub RPC GetTableLocations: refreshing cache from master, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.214.62:33483, [262ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.214.61:37531, [263ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.214.60:35211, [265ms] Sub RPC ConnectToMaster: received response from server master-127.3.214.60:35211: Network error: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211, [266ms] Sub RPC ConnectToMaster: received response from server master-127.3.214.62:33483: OK, [266ms] Sub RPC ConnectToMaster: received response from server master-127.3.214.61:37531: OK, [266ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.214.62:33483,127.3.214.61:37531,127.3.214.60:35211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211, [302ms] Sub RPC GetTableLocations: refreshing cache from master, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.214.62:33483, [302ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.214.61:37531, [303ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.214.60:35211, [306ms] Sub RPC ConnectToMaster: received response from server master-127.3.214.61:37531: OK, [307ms] Sub RPC ConnectToMaster: received response from server master-127.3.214.62:33483: OK, [308ms] Sub RPC ConnectToMaster: received response from server master-127.3.214.60:35211: Network error: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211, [308ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.214.62:33483,127.3.214.61:37531,127.3.214.60:35211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211, [761ms] Sub RPC GetTableLocations: refreshing cache from master, [762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.214.62:33483, [762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.214.61:37531, [762ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.214.60:35211, [765ms] Sub RPC ConnectToMaster: received response from server master-127.3.214.60:35211: Network error: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211, [766ms] Sub RPC ConnectToMaster: received response from server master-127.3.214.61:37531: OK, [768ms] Sub RPC ConnectToMaster: received response from server master-127.3.214.62:33483: OK, [768ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.214.62:33483,127.3.214.61:37531,127.3.214.60:35211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211, [1481ms] Sub RPC GetTableLocations: refreshing cache from master, [1481ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.214.62:33483, [1482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.214.61:37531, [1482ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.214.60:35211, [1485ms] Sub RPC ConnectToMaster: received response from server master-127.3.214.60:35211: Network error: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211, [1486ms] Sub RPC ConnectToMaster: received response from server master-127.3.214.62:33483: OK, [1488ms] Sub RPC ConnectToMaster: received response from server master-127.3.214.61:37531: OK, [1489ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.3.214.62:33483,127.3.214.61:37531,127.3.214.60:35211) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211, [2901ms] Sub RPC GetTableLocations: refreshing cache from master, [2901ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.214.62:33483, [2902ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.214.61:37531, [2902ms] Sub RPC ConnectToMaster: sending RPC to server master-127.3.214.60:35211, [2904ms] Sub RPC ConnectToMaster: received response from server master-127.3.214.60:35211: Network error: Failed to connect to peer master-127.3.214.60:35211(127.3.214.60:35211): Connection refused: /127.3.214.60:35211, [2906ms] Sub RPC ConnectToMaster: received response from server master-127.3.214.61:37531: OK, [2907ms] Sub RPC ConnectToMaster: received response from server master-127.3.214.62:33483: OK, [2910ms] Sub RPC GetTableLocations: sending RPC to server master-127.3.214.62:33483, [2915ms] Sub RPC GetTableLocations: received response from server master-127.3.214.62:33483: OK, deferred=Deferred@1154885404(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$238/0x00007fa390336f90@4af91fb2 -> passthrough -> wakeup thread Time-limited test, errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@2b814c6c -> wakeup thread Time-limited test)) after lookup
02:04:04.608 [DEBUG - kudu-nio-0] (Connection.java:748) [peer 6c64d5c77cf54b82a75cb06a30e74340(127.3.214.2:42201)] connecting to peer
02:04:04.610 [DEBUG - kudu-nio-0] (Connection.java:757) [peer 6c64d5c77cf54b82a75cb06a30e74340(127.3.214.2:42201)] Successfully connected to peer
02:04:04.637 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xbf985b92, L:/127.0.0.1:36708 - R:/127.3.214.2:42201] using TOKEN/null
02:04:04.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:04.644739  4509 heartbeater.cc:499] Master 127.3.214.62:33483 was elected leader, sending a full tablet report...
02:04:04.808 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 20 rows, more = false) for scanner KuduScanner(table=org.apache.kudu.client.TestClientFailoverSupport-KILL, tablet=dc1a9ebc52a94ebbb02cbbb24ba736ff, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
02:04:04.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:04.814189  3973 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:40832:
02:04:04.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "org.apache.kudu.client.TestClientFailoverSupport-KILL" }
02:04:04.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:04.814883  3973 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:40832:
02:04:04.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "org.apache.kudu.client.TestClientFailoverSupport-KILL" }
02:04:04.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:04.835214  3973 catalog_manager.cc:5983] T 00000000000000000000000000000000 P d4c56e542e4e4647be8f87b8ee56969b: Sending DeleteTablet for 3 replicas of tablet dc1a9ebc52a94ebbb02cbbb24ba736ff
02:04:04.871 [DEBUG - main] (Connection.java:575) [peer 018adfb8613f431ebd81a16dd1ef7cc9(127.3.214.1:34805)] disconnecting while in state TERMINATED
02:04:04.873 [DEBUG - main] (Connection.java:575) [peer master-127.3.214.60:35211(127.3.214.60:35211)] disconnecting while in state TERMINATED
02:04:04.873 [DEBUG - main] (Connection.java:575) [peer master-127.3.214.61:37531(127.3.214.61:37531)] disconnecting while in state READY
02:04:04.874 [DEBUG - main] (Connection.java:575) [peer master-127.3.214.62:33483(127.3.214.62:33483)] disconnecting while in state READY
02:04:04.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:04.872414  4582 tablet_service.cc:1558] Processing DeleteTablet for tablet dc1a9ebc52a94ebbb02cbbb24ba736ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-18 02:04:04 UTC) from {username='slave'} at 127.0.0.1:36936
02:04:04.874 [DEBUG - main] (Connection.java:575) [peer 6c64d5c77cf54b82a75cb06a30e74340(127.3.214.2:42201)] disconnecting while in state READY
02:04:04.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:04.877488  4442 tablet_service.cc:1558] Processing DeleteTablet for tablet dc1a9ebc52a94ebbb02cbbb24ba736ff with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-18 02:04:04 UTC) from {username='slave'} at 127.0.0.1:36722
02:04:04.878 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.3.214.61:37531(127.3.214.61:37531)] handling channelInactive
02:04:04.878 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.3.214.61:37531(127.3.214.61:37531)] cleaning up while in state READY due to: connection closed
02:04:04.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:04.878770  3957 catalog_manager.cc:4754] TS 018adfb8613f431ebd81a16dd1ef7cc9 (127.3.214.1:34805): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet dc1a9ebc52a94ebbb02cbbb24ba736ff: Network error: Client connection negotiation failed: client connection to 127.3.214.1:34805: connect: Connection refused (error 111)
02:04:04.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:04.882906  4777 tablet_replica.cc:333] T dc1a9ebc52a94ebbb02cbbb24ba736ff P bb42b1e029044183a7826531d8a6c5d4: stopping tablet replica
02:04:04.884 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
02:04:04.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:04.884701  4778 tablet_replica.cc:333] T dc1a9ebc52a94ebbb02cbbb24ba736ff P 6c64d5c77cf54b82a75cb06a30e74340: stopping tablet replica
02:04:04.887 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.3.214.62:33483(127.3.214.62:33483)] handling channelInactive
02:04:04.888 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.3.214.62:33483(127.3.214.62:33483)] cleaning up while in state READY due to: connection closed
02:04:04.888 [DEBUG - kudu-nio-0] (Connection.java:239) [peer 6c64d5c77cf54b82a75cb06a30e74340(127.3.214.2:42201)] handling channelInactive
02:04:04.888 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 6c64d5c77cf54b82a75cb06a30e74340(127.3.214.2:42201)] cleaning up while in state READY due to: connection closed
02:04:04.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:04.886409  3928 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskvuyF4C/build/tsan/bin/kudu with pid 4370
02:04:04.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:04.888955  4777 raft_consensus.cc:2243] T dc1a9ebc52a94ebbb02cbbb24ba736ff P bb42b1e029044183a7826531d8a6c5d4 [term 2 FOLLOWER]: Raft consensus shutting down.
02:04:04.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:04.889899  4777 raft_consensus.cc:2272] T dc1a9ebc52a94ebbb02cbbb24ba736ff P bb42b1e029044183a7826531d8a6c5d4 [term 2 FOLLOWER]: Raft consensus is shut down!
02:04:04.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:04.892668  4777 ts_tablet_manager.cc:1916] T dc1a9ebc52a94ebbb02cbbb24ba736ff P bb42b1e029044183a7826531d8a6c5d4: Deleting tablet data with delete state TABLET_DATA_DELETED
02:04:04.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:04.902254  4777 ts_tablet_manager.cc:1929] T dc1a9ebc52a94ebbb02cbbb24ba736ff P bb42b1e029044183a7826531d8a6c5d4: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.22
02:04:04.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:04.902592  4777 log.cc:1199] T dc1a9ebc52a94ebbb02cbbb24ba736ff P bb42b1e029044183a7826531d8a6c5d4: Deleting WAL directory at /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster5034290451605006192/ts-2/wal/wals/dc1a9ebc52a94ebbb02cbbb24ba736ff
02:04:04.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:04.903365  4777 ts_tablet_manager.cc:1950] T dc1a9ebc52a94ebbb02cbbb24ba736ff P bb42b1e029044183a7826531d8a6c5d4: Deleting consensus metadata
02:04:04.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:04.905987  3959 catalog_manager.cc:5027] TS bb42b1e029044183a7826531d8a6c5d4 (127.3.214.3:35411): tablet dc1a9ebc52a94ebbb02cbbb24ba736ff (table org.apache.kudu.client.TestClientFailoverSupport-KILL [id=780b79c815774700a0b4281546d325f0]) successfully deleted
02:04:04.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:04.916211  3928 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskvuyF4C/build/tsan/bin/kudu with pid 4517
02:04:04.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:04.941493  3928 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskvuyF4C/build/tsan/bin/kudu with pid 3940
02:04:04.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:04.967159  3928 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskvuyF4C/build/tsan/bin/kudu with pid 4010
02:04:06.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T02:04:06Z chronyd exiting
.02:04:07.327 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1779069847327
02:04:07.330 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
02:04:07.331 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
02:04:07.331 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskvuyF4C/test-tmp
02:04:07.331 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
02:04:07.332 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskvuyF4C/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
02:04:07.335 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

02:04:07.653 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
02:04:07.653 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

02:04:07.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:07.657063  4784 mini_oidc.cc:150] Starting JWKS server
02:04:07.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:07.660194  4784 webserver.cc:533] Webserver started at http://127.0.0.1:34017/ using document root <none> and password file <none>
02:04:07.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:07.660632  4784 mini_oidc.cc:186] Starting OIDC Discovery server
02:04:07.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:07.662304  4784 webserver.cc:533] Webserver started at http://127.0.0.1:41393/ using document root <none> and password file <none>
02:04:07.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T02:04:07Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
02:04:07.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T02:04:07Z Disabled control of system clock
02:04:07.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:07.720357  4784 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskvuyF4C/build/tsan/bin/kudu
02:04:07.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskvuyF4C/build/tsan/bin/kudu
02:04:07.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/master-0/wal
02:04:07.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/master-0/data
02:04:07.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:04:07.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:04:07.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:04:07.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:04:07.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:04:07.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:04:07.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/master-0/logs
02:04:07.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/master-0/data/info.pb
02:04:07.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:04:07.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:04:07.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:04:07.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:04:07.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:04:07.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:04:07.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:04:07.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:04:07.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
02:04:07.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:04:07.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:04:07.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:04:07.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.172.62:36045
02:04:07.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.172.62
02:04:07.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:04:07.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.172.20:42163
02:04:07.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:04:07.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:04:07.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:04:07.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:04:07.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.4.172.62:36045,127.4.172.61:37983,127.4.172.60:40569
02:04:07.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:04:07.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34017/jwks.json with env {}
02:04:08.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:08.020001  4796 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:04:08.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:08.020553  4796 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:04:08.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:08.020992  4796 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:04:08.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:08.054030  4796 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
02:04:08.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:08.054333  4796 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:04:08.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:08.054527  4796 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
02:04:08.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:08.054715  4796 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
02:04:08.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:08.054917  4796 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
02:04:08.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:08.055053  4796 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:34017/jwks.json
02:04:08.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:08.092473  4796 master_runner.cc:387] Master server non-default flags:
02:04:08.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:04:08.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.172.20:42163
02:04:08.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:04:08.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:04:08.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/master-0/data
02:04:08.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/master-0/wal
02:04:08.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:04:08.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.4.172.62:36045,127.4.172.61:37983,127.4.172.60:40569
02:04:08.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:04:08.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:04:08.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:04:08.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.172.62:36045
02:04:08.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:04:08.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:04:08.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:04:08.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34017/jwks.json
02:04:08.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:04:08.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:04:08.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/master-0/data/info.pb
02:04:08.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.172.62
02:04:08.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:04:08.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:04:08.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:04:08.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:04:08.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:04:08.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:04:08.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/master-0/logs
02:04:08.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:04:08.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:04:08.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:04:08.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
02:04:08.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:04:08.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
02:04:08.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:04:08.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 01:43:23 UTC on e7f111948823
02:04:08.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11951
02:04:08.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:04:08.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:08.093804  4796 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:04:08.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:08.096091  4796 file_cache.cc:492] Constructed file cache file cache with capacity 419430
02:04:08.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:08.110162  4802 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:09.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:09.513013  4801 debug-util.cc:398] Leaking SignalData structure 0x7b08000271e0 after lost signal to thread 4796
02:04:09.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:09.661787  4796 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.552s	user 0.707s	sys 0.844s
02:04:09.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:09.662871  4796 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.552s	user 0.708s	sys 0.844s
02:04:09.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:08.110574  4803 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:09.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:09.664400  4804 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1552 milliseconds
02:04:09.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:09.665182  4805 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:09.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:09.665138  4796 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
02:04:09.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:09.668358  4796 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:04:09.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:09.670714  4796 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:04:09.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:09.672086  4796 hybrid_clock.cc:648] HybridClock initialized: now 1779069849672043 us; error 45 us; skew 500 ppm
02:04:09.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:09.672912  4796 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:04:09.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:09.678943  4796 webserver.cc:533] Webserver started at http://127.4.172.62:40609/ using document root <none> and password file <none>
02:04:09.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:09.679924  4796 fs_manager.cc:362] Metadata directory not provided
02:04:09.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:09.680190  4796 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:04:09.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:09.680711  4796 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:04:09.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:09.685140  4796 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/master-0/data/instance:
02:04:09.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ed926c19a2c045aa8dde57409b7638fc"
02:04:09.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:04:09 on dist-test-slave-m4h6"
02:04:09.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:09.686338  4796 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/master-0/wal/instance:
02:04:09.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ed926c19a2c045aa8dde57409b7638fc"
02:04:09.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:04:09 on dist-test-slave-m4h6"
02:04:09.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:09.693672  4796 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.000s	sys 0.008s
02:04:09.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:09.699393  4812 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:04:09.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:09.700490  4796 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.001s	sys 0.002s
02:04:09.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:09.700829  4796 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/master-0/data,/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/master-0/wal
02:04:09.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ed926c19a2c045aa8dde57409b7638fc"
02:04:09.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:04:09 on dist-test-slave-m4h6"
02:04:09.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:09.701185  4796 fs_report.cc:389] FS layout report
02:04:09.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:04:09.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/master-0/wal
02:04:09.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/master-0/wal
02:04:09.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/master-0/data/data
02:04:09.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:04:09.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:04:09.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:04:09.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:04:09.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:04:09.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:04:09.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:04:09.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:04:09.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:04:09.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:04:09.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:04:09.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:09.774821  4796 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:04:09.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:09.776465  4796 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:04:09.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:09.776995  4796 kserver.cc:163] Server-wide thread pool size limit: 3276
02:04:09.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:09.845754  4796 rpc_server.cc:307] RPC server started. Bound to: 127.4.172.62:36045
02:04:09.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:09.845850  4863 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.172.62:36045 every 8 connection(s)
02:04:09.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:09.848579  4796 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/master-0/data/info.pb
02:04:09.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:09.854362  4864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
02:04:09.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:09.858392  4784 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskvuyF4C/build/tsan/bin/kudu as pid 4796
02:04:09.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:09.858901  4784 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/master-0/wal/instance
02:04:09.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:09.864244  4784 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskvuyF4C/build/tsan/bin/kudu
02:04:09.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskvuyF4C/build/tsan/bin/kudu
02:04:09.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/master-1/wal
02:04:09.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/master-1/data
02:04:09.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:04:09.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:04:09.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:04:09.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:04:09.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:04:09.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:04:09.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/master-1/logs
02:04:09.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/master-1/data/info.pb
02:04:09.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:04:09.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:04:09.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:04:09.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:04:09.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:04:09.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:04:09.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:04:09.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:04:09.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
02:04:09.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:04:09.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:04:09.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:04:09.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.172.61:37983
02:04:09.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.172.61
02:04:09.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:04:09.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.172.20:42163
02:04:09.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:04:09.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:04:09.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:04:09.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:04:09.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.4.172.62:36045,127.4.172.61:37983,127.4.172.60:40569
02:04:09.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:04:09.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34017/jwks.json with env {}
02:04:09.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:09.869117  4864 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.172.62" port: 36045 } has no permanent_uuid. Determining permanent_uuid...
02:04:09.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:09.897801  4864 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.172.61" port: 37983 } has no permanent_uuid. Determining permanent_uuid...
02:04:09.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:09.900185  4814 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.172.61:37983: connect: Connection refused (error 111)
02:04:09.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:09.904160  4864 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.172.61:37983: Network error: Client connection negotiation failed: client connection to 127.4.172.61:37983: connect: Connection refused (error 111)
02:04:09.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:09.953675  4864 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.172.61" port: 37983 } attempt: 1
02:04:09.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:09.957908  4864 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.172.61:37983: Network error: Client connection negotiation failed: client connection to 127.4.172.61:37983: connect: Connection refused (error 111)
02:04:10.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:10.026314  4864 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.172.61" port: 37983 } attempt: 2
02:04:10.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:10.030889  4864 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.172.61:37983: Network error: Client connection negotiation failed: client connection to 127.4.172.61:37983: connect: Connection refused (error 111)
02:04:10.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:10.122327  4864 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.172.61" port: 37983 } attempt: 3
02:04:10.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:10.126225  4864 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.172.61:37983: Network error: Client connection negotiation failed: client connection to 127.4.172.61:37983: connect: Connection refused (error 111)
02:04:10.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:10.173024  4866 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:04:10.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:10.173576  4866 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:04:10.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:10.174018  4866 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:04:10.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:10.208738  4866 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
02:04:10.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:10.209029  4866 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:04:10.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:10.209232  4866 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
02:04:10.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:10.209427  4866 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
02:04:10.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:10.209625  4866 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
02:04:10.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:10.209770  4866 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:34017/jwks.json
02:04:10.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:10.247907  4866 master_runner.cc:387] Master server non-default flags:
02:04:10.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:04:10.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.172.20:42163
02:04:10.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:04:10.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:04:10.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/master-1/data
02:04:10.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/master-1/wal
02:04:10.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:04:10.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.4.172.62:36045,127.4.172.61:37983,127.4.172.60:40569
02:04:10.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:04:10.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:04:10.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:04:10.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.172.61:37983
02:04:10.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:04:10.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:04:10.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:04:10.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34017/jwks.json
02:04:10.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:04:10.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:04:10.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/master-1/data/info.pb
02:04:10.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.172.61
02:04:10.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:04:10.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:04:10.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:04:10.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:04:10.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:04:10.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:04:10.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/master-1/logs
02:04:10.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:04:10.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:04:10.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:04:10.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
02:04:10.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:04:10.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
02:04:10.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:04:10.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 01:43:23 UTC on e7f111948823
02:04:10.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11951
02:04:10.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:04:10.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:10.249325  4866 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:04:10.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:10.251016  4866 file_cache.cc:492] Constructed file cache file cache with capacity 419430
02:04:10.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:10.262099  4875 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:10.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:10.269675  4864 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.172.61" port: 37983 } attempt: 4
02:04:10.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:10.274343  4864 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.172.61:37983: Network error: Client connection negotiation failed: client connection to 127.4.172.61:37983: connect: Connection refused (error 111)
02:04:10.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:10.573884  4864 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.172.61" port: 37983 } attempt: 5
02:04:10.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:10.580147  4864 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.172.61:37983: Network error: Client connection negotiation failed: client connection to 127.4.172.61:37983: connect: Connection refused (error 111)
02:04:11.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:11.127671  4864 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.172.61" port: 37983 } attempt: 6
02:04:11.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:11.139254  4864 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.172.61:37983: Network error: Client connection negotiation failed: client connection to 127.4.172.61:37983: connect: Connection refused (error 111)
02:04:11.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:10.262660  4876 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:11.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:10.266418  4878 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:11.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:11.386546  4877 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1119 milliseconds
02:04:11.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:11.386682  4866 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
02:04:11.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:11.387815  4866 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:04:11.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:11.390719  4866 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:04:11.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:11.392109  4866 hybrid_clock.cc:648] HybridClock initialized: now 1779069851392065 us; error 56 us; skew 500 ppm
02:04:11.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:11.392901  4866 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:04:11.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:11.399489  4866 webserver.cc:533] Webserver started at http://127.4.172.61:39085/ using document root <none> and password file <none>
02:04:11.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:11.400478  4866 fs_manager.cc:362] Metadata directory not provided
02:04:11.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:11.400681  4866 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:04:11.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:11.401057  4866 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:04:11.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:11.405476  4866 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/master-1/data/instance:
02:04:11.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b8523780db2546d582e8872c0a74aac4"
02:04:11.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:04:11 on dist-test-slave-m4h6"
02:04:11.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:11.406543  4866 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/master-1/wal/instance:
02:04:11.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b8523780db2546d582e8872c0a74aac4"
02:04:11.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:04:11 on dist-test-slave-m4h6"
02:04:11.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:11.413692  4866 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.008s	sys 0.000s
02:04:11.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:11.419581  4887 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:04:11.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:11.420778  4866 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.001s
02:04:11.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:11.421120  4866 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/master-1/data,/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/master-1/wal
02:04:11.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b8523780db2546d582e8872c0a74aac4"
02:04:11.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:04:11 on dist-test-slave-m4h6"
02:04:11.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:11.421432  4866 fs_report.cc:389] FS layout report
02:04:11.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:04:11.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/master-1/wal
02:04:11.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/master-1/wal
02:04:11.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/master-1/data/data
02:04:11.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:04:11.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:04:11.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:04:11.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:04:11.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:04:11.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:04:11.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:04:11.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:04:11.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:04:11.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:04:11.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:04:11.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:11.488819  4866 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:04:11.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:11.490368  4866 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:04:11.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:11.490787  4866 kserver.cc:163] Server-wide thread pool size limit: 3276
02:04:11.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:11.560534  4866 rpc_server.cc:307] RPC server started. Bound to: 127.4.172.61:37983
02:04:11.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:11.560640  4938 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.172.61:37983 every 8 connection(s)
02:04:11.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:11.563428  4866 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/master-1/data/info.pb
02:04:11.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:11.569492  4939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
02:04:11.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:11.572111  4784 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskvuyF4C/build/tsan/bin/kudu as pid 4866
02:04:11.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:11.572465  4784 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/master-1/wal/instance
02:04:11.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:11.574404  4784 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskvuyF4C/build/tsan/bin/kudu
02:04:11.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskvuyF4C/build/tsan/bin/kudu
02:04:11.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/master-2/wal
02:04:11.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/master-2/data
02:04:11.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:04:11.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:04:11.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:04:11.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:04:11.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:04:11.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:04:11.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/master-2/logs
02:04:11.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/master-2/data/info.pb
02:04:11.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:04:11.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:04:11.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:04:11.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:04:11.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:04:11.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:04:11.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:04:11.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:04:11.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
02:04:11.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:04:11.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:04:11.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:04:11.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.172.60:40569
02:04:11.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.172.60
02:04:11.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:04:11.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.172.20:42163
02:04:11.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:04:11.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:04:11.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:04:11.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:04:11.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.4.172.62:36045,127.4.172.61:37983,127.4.172.60:40569
02:04:11.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:04:11.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34017/jwks.json with env {}
02:04:11.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:11.581574  4939 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.172.62" port: 36045 } has no permanent_uuid. Determining permanent_uuid...
02:04:11.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:11.604534  4939 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.172.61" port: 37983 } has no permanent_uuid. Determining permanent_uuid...
02:04:11.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:11.618839  4939 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.172.60" port: 40569 } has no permanent_uuid. Determining permanent_uuid...
02:04:11.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:11.621217  4890 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.172.60:40569: connect: Connection refused (error 111)
02:04:11.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:11.625345  4939 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.172.60:40569: Network error: Client connection negotiation failed: client connection to 127.4.172.60:40569: connect: Connection refused (error 111)
02:04:11.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:11.674949  4939 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.172.60" port: 40569 } attempt: 1
02:04:11.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:11.679107  4939 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.172.60:40569: Network error: Client connection negotiation failed: client connection to 127.4.172.60:40569: connect: Connection refused (error 111)
02:04:11.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:11.747639  4939 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.172.60" port: 40569 } attempt: 2
02:04:11.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:11.752204  4939 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.172.60:40569: Network error: Client connection negotiation failed: client connection to 127.4.172.60:40569: connect: Connection refused (error 111)
02:04:11.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:11.843663  4939 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.172.60" port: 40569 } attempt: 3
02:04:11.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:11.848852  4939 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.172.60:40569: Network error: Client connection negotiation failed: client connection to 127.4.172.60:40569: connect: Connection refused (error 111)
02:04:11.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:11.883028  4941 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:04:11.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:11.883567  4941 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:04:11.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:11.884063  4941 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:04:11.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:11.917392  4941 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
02:04:11.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:11.917789  4941 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:04:11.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:11.918083  4941 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
02:04:11.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:11.918303  4941 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
02:04:11.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:11.918495  4941 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
02:04:11.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:11.918646  4941 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:34017/jwks.json
02:04:11.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:11.955824  4941 master_runner.cc:387] Master server non-default flags:
02:04:11.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:04:11.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.172.20:42163
02:04:11.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:04:11.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:04:11.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/master-2/data
02:04:11.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/master-2/wal
02:04:11.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:04:11.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.4.172.62:36045,127.4.172.61:37983,127.4.172.60:40569
02:04:11.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:04:11.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:04:11.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:04:11.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.172.60:40569
02:04:11.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:04:11.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:04:11.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:04:11.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34017/jwks.json
02:04:11.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:04:11.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:04:11.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/master-2/data/info.pb
02:04:11.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.172.60
02:04:11.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:04:11.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:04:11.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:04:11.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:04:11.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:04:11.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:04:11.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/master-2/logs
02:04:11.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:04:11.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:04:11.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:04:11.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
02:04:11.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:04:11.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
02:04:11.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:04:11.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 01:43:23 UTC on e7f111948823
02:04:11.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11951
02:04:11.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:04:11.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:11.957122  4941 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:04:11.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:11.959043  4941 file_cache.cc:492] Constructed file cache file cache with capacity 419430
02:04:11.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:11.969938  4951 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:11.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:11.992329  4939 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.172.60" port: 40569 } attempt: 4
02:04:11.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:11.996399  4939 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.172.60:40569: Network error: Client connection negotiation failed: client connection to 127.4.172.60:40569: connect: Connection refused (error 111)
02:04:12.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:12.199801  4864 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.172.61" port: 37983 } attempt: 7
02:04:12.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:12.227504  4864 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.172.60" port: 40569 } has no permanent_uuid. Determining permanent_uuid...
02:04:12.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:12.234901  4864 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.172.60:40569: Network error: Client connection negotiation failed: client connection to 127.4.172.60:40569: connect: Connection refused (error 111)
02:04:12.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:12.293426  4864 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.172.60" port: 40569 } attempt: 1
02:04:12.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:12.295807  4939 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.172.60" port: 40569 } attempt: 5
02:04:12.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:12.299540  4864 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.172.60:40569: Network error: Client connection negotiation failed: client connection to 127.4.172.60:40569: connect: Connection refused (error 111)
02:04:12.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:12.301517  4939 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.172.60:40569: Network error: Client connection negotiation failed: client connection to 127.4.172.60:40569: connect: Connection refused (error 111)
02:04:12.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:12.381050  4864 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.172.60" port: 40569 } attempt: 2
02:04:12.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:12.386634  4864 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.172.60:40569: Network error: Client connection negotiation failed: client connection to 127.4.172.60:40569: connect: Connection refused (error 111)
02:04:12.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:12.472188  4864 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.172.60" port: 40569 } attempt: 3
02:04:12.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:12.478106  4864 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.172.60:40569: Network error: Client connection negotiation failed: client connection to 127.4.172.60:40569: connect: Connection refused (error 111)
02:04:12.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:12.618645  4864 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.172.60" port: 40569 } attempt: 4
02:04:12.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:12.624117  4864 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.172.60:40569: Network error: Client connection negotiation failed: client connection to 127.4.172.60:40569: connect: Connection refused (error 111)
02:04:12.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:12.849009  4939 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.172.60" port: 40569 } attempt: 6
02:04:12.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:12.863063  4939 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.172.60:40569: Network error: Client connection negotiation failed: client connection to 127.4.172.60:40569: connect: Connection refused (error 111)
02:04:12.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:12.907750  4864 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.172.60" port: 40569 } attempt: 5
02:04:12.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:12.913084  4864 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.4.172.60:40569: Network error: Client connection negotiation failed: client connection to 127.4.172.60:40569: connect: Connection refused (error 111)
02:04:13.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:11.970397  4952 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:13.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:13.148550  4954 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:13.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:13.151158  4953 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1175 milliseconds
02:04:13.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.151289  4941 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
02:04:13.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.152689  4941 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:04:13.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.156473  4941 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:04:13.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.157881  4941 hybrid_clock.cc:648] HybridClock initialized: now 1779069853157834 us; error 50 us; skew 500 ppm
02:04:13.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.158766  4941 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:04:13.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.165467  4941 webserver.cc:533] Webserver started at http://127.4.172.60:46099/ using document root <none> and password file <none>
02:04:13.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.166462  4941 fs_manager.cc:362] Metadata directory not provided
02:04:13.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.166697  4941 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:04:13.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.167207  4941 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:04:13.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.171684  4941 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/master-2/data/instance:
02:04:13.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c6f2b89ee5244beeaaa2db11be25f552"
02:04:13.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:04:13 on dist-test-slave-m4h6"
02:04:13.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.172942  4941 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/master-2/wal/instance:
02:04:13.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c6f2b89ee5244beeaaa2db11be25f552"
02:04:13.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:04:13 on dist-test-slave-m4h6"
02:04:13.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.180225  4941 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.007s	sys 0.000s
02:04:13.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.185966  4966 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:04:13.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.187232  4941 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
02:04:13.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.187594  4941 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/master-2/data,/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/master-2/wal
02:04:13.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c6f2b89ee5244beeaaa2db11be25f552"
02:04:13.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:04:13 on dist-test-slave-m4h6"
02:04:13.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.187909  4941 fs_report.cc:389] FS layout report
02:04:13.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:04:13.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/master-2/wal
02:04:13.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/master-2/wal
02:04:13.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/master-2/data/data
02:04:13.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:04:13.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:04:13.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:04:13.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:04:13.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:04:13.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:04:13.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:04:13.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:04:13.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:04:13.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:04:13.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:04:13.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.237891  4941 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:04:13.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.239388  4941 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:04:13.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.239813  4941 kserver.cc:163] Server-wide thread pool size limit: 3276
02:04:13.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.308300  4941 rpc_server.cc:307] RPC server started. Bound to: 127.4.172.60:40569
02:04:13.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.308382  5017 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.172.60:40569 every 8 connection(s)
02:04:13.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.310859  4941 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/master-2/data/info.pb
02:04:13.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.313004  4784 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskvuyF4C/build/tsan/bin/kudu as pid 4941
02:04:13.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.313452  4784 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/master-2/wal/instance
02:04:13.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.318665  5018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
02:04:13.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.335558  5018 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.172.62" port: 36045 } has no permanent_uuid. Determining permanent_uuid...
02:04:13.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.359231  5018 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.172.61" port: 37983 } has no permanent_uuid. Determining permanent_uuid...
02:04:13.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.369529  5018 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.4.172.60" port: 40569 } has no permanent_uuid. Determining permanent_uuid...
02:04:13.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.384574  5018 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c6f2b89ee5244beeaaa2db11be25f552: Bootstrap starting.
02:04:13.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.391008  5018 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c6f2b89ee5244beeaaa2db11be25f552: Neither blocks nor log segments found. Creating new log.
02:04:13.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.392776  5018 log.cc:826] T 00000000000000000000000000000000 P c6f2b89ee5244beeaaa2db11be25f552: Log is configured to *not* fsync() on all Append() calls
02:04:13.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.396940  5018 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c6f2b89ee5244beeaaa2db11be25f552: No bootstrap required, opened a new log
02:04:13.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.416311  5018 raft_consensus.cc:359] T 00000000000000000000000000000000 P c6f2b89ee5244beeaaa2db11be25f552 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed926c19a2c045aa8dde57409b7638fc" member_type: VOTER last_known_addr { host: "127.4.172.62" port: 36045 } } peers { permanent_uuid: "b8523780db2546d582e8872c0a74aac4" member_type: VOTER last_known_addr { host: "127.4.172.61" port: 37983 } } peers { permanent_uuid: "c6f2b89ee5244beeaaa2db11be25f552" member_type: VOTER last_known_addr { host: "127.4.172.60" port: 40569 } }
02:04:13.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.416951  5018 raft_consensus.cc:385] T 00000000000000000000000000000000 P c6f2b89ee5244beeaaa2db11be25f552 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:04:13.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.417141  5018 raft_consensus.cc:740] T 00000000000000000000000000000000 P c6f2b89ee5244beeaaa2db11be25f552 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6f2b89ee5244beeaaa2db11be25f552, State: Initialized, Role: FOLLOWER
02:04:13.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.417871  5018 consensus_queue.cc:260] T 00000000000000000000000000000000 P c6f2b89ee5244beeaaa2db11be25f552 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed926c19a2c045aa8dde57409b7638fc" member_type: VOTER last_known_addr { host: "127.4.172.62" port: 36045 } } peers { permanent_uuid: "b8523780db2546d582e8872c0a74aac4" member_type: VOTER last_known_addr { host: "127.4.172.61" port: 37983 } } peers { permanent_uuid: "c6f2b89ee5244beeaaa2db11be25f552" member_type: VOTER last_known_addr { host: "127.4.172.60" port: 40569 } }
02:04:13.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.420552  5027 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6f2b89ee5244beeaaa2db11be25f552 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed926c19a2c045aa8dde57409b7638fc" member_type: VOTER last_known_addr { host: "127.4.172.62" port: 36045 } } peers { permanent_uuid: "b8523780db2546d582e8872c0a74aac4" member_type: VOTER last_known_addr { host: "127.4.172.61" port: 37983 } } peers { permanent_uuid: "c6f2b89ee5244beeaaa2db11be25f552" member_type: VOTER last_known_addr { host: "127.4.172.60" port: 40569 } } }
02:04:13.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.421828  5027 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6f2b89ee5244beeaaa2db11be25f552 [sys.catalog]: This master's current role is: FOLLOWER
02:04:13.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.422248  5018 sys_catalog.cc:565] T 00000000000000000000000000000000 P c6f2b89ee5244beeaaa2db11be25f552 [sys.catalog]: configured and running, proceeding with master startup.
02:04:13.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:13.446292  5038 catalog_manager.cc:1593] T 00000000000000000000000000000000 P c6f2b89ee5244beeaaa2db11be25f552: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
02:04:13.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:13.446686  5038 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
02:04:13.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.442070  4941 master_runner.cc:187] Error getting master registration for 127.4.172.62:36045: OK, instance_id { permanent_uuid: "ed926c19a2c045aa8dde57409b7638fc" instance_seqno: 1779069849827045 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
02:04:13.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.464601  4941 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
02:04:13.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.465610  4864 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.172.60" port: 40569 } attempt: 6
02:04:13.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.486656  4864 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed926c19a2c045aa8dde57409b7638fc: Bootstrap starting.
02:04:13.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.493467  4864 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ed926c19a2c045aa8dde57409b7638fc: Neither blocks nor log segments found. Creating new log.
02:04:13.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:13.494858  4972 tablet.cc:2404] T 00000000000000000000000000000000 P c6f2b89ee5244beeaaa2db11be25f552: Can't schedule compaction. Clean time has not been advanced past its initial value.
02:04:13.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.495448  4864 log.cc:826] T 00000000000000000000000000000000 P ed926c19a2c045aa8dde57409b7638fc: Log is configured to *not* fsync() on all Append() calls
02:04:13.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.499823  4864 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ed926c19a2c045aa8dde57409b7638fc: No bootstrap required, opened a new log
02:04:13.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.519006  4864 raft_consensus.cc:359] T 00000000000000000000000000000000 P ed926c19a2c045aa8dde57409b7638fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed926c19a2c045aa8dde57409b7638fc" member_type: VOTER last_known_addr { host: "127.4.172.62" port: 36045 } } peers { permanent_uuid: "b8523780db2546d582e8872c0a74aac4" member_type: VOTER last_known_addr { host: "127.4.172.61" port: 37983 } } peers { permanent_uuid: "c6f2b89ee5244beeaaa2db11be25f552" member_type: VOTER last_known_addr { host: "127.4.172.60" port: 40569 } }
02:04:13.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.519666  4864 raft_consensus.cc:385] T 00000000000000000000000000000000 P ed926c19a2c045aa8dde57409b7638fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:04:13.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.519867  4864 raft_consensus.cc:740] T 00000000000000000000000000000000 P ed926c19a2c045aa8dde57409b7638fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed926c19a2c045aa8dde57409b7638fc, State: Initialized, Role: FOLLOWER
02:04:13.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.520666  4864 consensus_queue.cc:260] T 00000000000000000000000000000000 P ed926c19a2c045aa8dde57409b7638fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed926c19a2c045aa8dde57409b7638fc" member_type: VOTER last_known_addr { host: "127.4.172.62" port: 36045 } } peers { permanent_uuid: "b8523780db2546d582e8872c0a74aac4" member_type: VOTER last_known_addr { host: "127.4.172.61" port: 37983 } } peers { permanent_uuid: "c6f2b89ee5244beeaaa2db11be25f552" member_type: VOTER last_known_addr { host: "127.4.172.60" port: 40569 } }
02:04:13.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.523428  5042 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed926c19a2c045aa8dde57409b7638fc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed926c19a2c045aa8dde57409b7638fc" member_type: VOTER last_known_addr { host: "127.4.172.62" port: 36045 } } peers { permanent_uuid: "b8523780db2546d582e8872c0a74aac4" member_type: VOTER last_known_addr { host: "127.4.172.61" port: 37983 } } peers { permanent_uuid: "c6f2b89ee5244beeaaa2db11be25f552" member_type: VOTER last_known_addr { host: "127.4.172.60" port: 40569 } } }
02:04:13.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.524693  5042 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed926c19a2c045aa8dde57409b7638fc [sys.catalog]: This master's current role is: FOLLOWER
02:04:13.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.525355  4864 sys_catalog.cc:565] T 00000000000000000000000000000000 P ed926c19a2c045aa8dde57409b7638fc [sys.catalog]: configured and running, proceeding with master startup.
02:04:13.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:13.536330  4818 tablet.cc:2404] T 00000000000000000000000000000000 P ed926c19a2c045aa8dde57409b7638fc: Can't schedule compaction. Clean time has not been advanced past its initial value.
02:04:13.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:13.567507  5053 catalog_manager.cc:1593] T 00000000000000000000000000000000 P ed926c19a2c045aa8dde57409b7638fc: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
02:04:13.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:13.568267  5053 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
02:04:13.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.553103  4796 master_runner.cc:187] Error getting master registration for 127.4.172.61:37983: OK, instance_id { permanent_uuid: "b8523780db2546d582e8872c0a74aac4" instance_seqno: 1779069851541753 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
02:04:13.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.584666  4796 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
02:04:13.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.779448  5027 raft_consensus.cc:493] T 00000000000000000000000000000000 P c6f2b89ee5244beeaaa2db11be25f552 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
02:04:13.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.780141  5027 raft_consensus.cc:515] T 00000000000000000000000000000000 P c6f2b89ee5244beeaaa2db11be25f552 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed926c19a2c045aa8dde57409b7638fc" member_type: VOTER last_known_addr { host: "127.4.172.62" port: 36045 } } peers { permanent_uuid: "b8523780db2546d582e8872c0a74aac4" member_type: VOTER last_known_addr { host: "127.4.172.61" port: 37983 } } peers { permanent_uuid: "c6f2b89ee5244beeaaa2db11be25f552" member_type: VOTER last_known_addr { host: "127.4.172.60" port: 40569 } }
02:04:13.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.784133  4839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c6f2b89ee5244beeaaa2db11be25f552" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed926c19a2c045aa8dde57409b7638fc" is_pre_election: true
02:04:13.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.784418  5027 leader_election.cc:290] T 00000000000000000000000000000000 P c6f2b89ee5244beeaaa2db11be25f552 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed926c19a2c045aa8dde57409b7638fc (127.4.172.62:36045), b8523780db2546d582e8872c0a74aac4 (127.4.172.61:37983)
02:04:13.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.785153  4839 raft_consensus.cc:2468] T 00000000000000000000000000000000 P ed926c19a2c045aa8dde57409b7638fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6f2b89ee5244beeaaa2db11be25f552 in term 0.
02:04:13.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.786628  4967 leader_election.cc:304] T 00000000000000000000000000000000 P c6f2b89ee5244beeaaa2db11be25f552 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6f2b89ee5244beeaaa2db11be25f552, ed926c19a2c045aa8dde57409b7638fc; no voters: 
02:04:13.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.787669  5027 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c6f2b89ee5244beeaaa2db11be25f552 [term 0 FOLLOWER]: Leader pre-election won for term 1
02:04:13.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.788650  5027 raft_consensus.cc:493] T 00000000000000000000000000000000 P c6f2b89ee5244beeaaa2db11be25f552 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
02:04:13.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.789521  5027 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c6f2b89ee5244beeaaa2db11be25f552 [term 0 FOLLOWER]: Advancing to term 1
02:04:13.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.802487  5027 raft_consensus.cc:515] T 00000000000000000000000000000000 P c6f2b89ee5244beeaaa2db11be25f552 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed926c19a2c045aa8dde57409b7638fc" member_type: VOTER last_known_addr { host: "127.4.172.62" port: 36045 } } peers { permanent_uuid: "b8523780db2546d582e8872c0a74aac4" member_type: VOTER last_known_addr { host: "127.4.172.61" port: 37983 } } peers { permanent_uuid: "c6f2b89ee5244beeaaa2db11be25f552" member_type: VOTER last_known_addr { host: "127.4.172.60" port: 40569 } }
02:04:13.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.807623  5027 leader_election.cc:290] T 00000000000000000000000000000000 P c6f2b89ee5244beeaaa2db11be25f552 [CANDIDATE]: Term 1 election: Requested vote from peers ed926c19a2c045aa8dde57409b7638fc (127.4.172.62:36045), b8523780db2546d582e8872c0a74aac4 (127.4.172.61:37983)
02:04:13.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.809676  4839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c6f2b89ee5244beeaaa2db11be25f552" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed926c19a2c045aa8dde57409b7638fc"
02:04:13.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.810317  4839 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ed926c19a2c045aa8dde57409b7638fc [term 0 FOLLOWER]: Advancing to term 1
02:04:13.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.818778  4839 raft_consensus.cc:2468] T 00000000000000000000000000000000 P ed926c19a2c045aa8dde57409b7638fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6f2b89ee5244beeaaa2db11be25f552 in term 1.
02:04:13.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.821184  4967 leader_election.cc:304] T 00000000000000000000000000000000 P c6f2b89ee5244beeaaa2db11be25f552 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6f2b89ee5244beeaaa2db11be25f552, ed926c19a2c045aa8dde57409b7638fc; no voters: 
02:04:13.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.822136  5027 raft_consensus.cc:2804] T 00000000000000000000000000000000 P c6f2b89ee5244beeaaa2db11be25f552 [term 1 FOLLOWER]: Leader election won for term 1
02:04:13.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.825088  5027 raft_consensus.cc:697] T 00000000000000000000000000000000 P c6f2b89ee5244beeaaa2db11be25f552 [term 1 LEADER]: Becoming Leader. State: Replica: c6f2b89ee5244beeaaa2db11be25f552, State: Running, Role: LEADER
02:04:13.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.826926  5027 consensus_queue.cc:237] T 00000000000000000000000000000000 P c6f2b89ee5244beeaaa2db11be25f552 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed926c19a2c045aa8dde57409b7638fc" member_type: VOTER last_known_addr { host: "127.4.172.62" port: 36045 } } peers { permanent_uuid: "b8523780db2546d582e8872c0a74aac4" member_type: VOTER last_known_addr { host: "127.4.172.61" port: 37983 } } peers { permanent_uuid: "c6f2b89ee5244beeaaa2db11be25f552" member_type: VOTER last_known_addr { host: "127.4.172.60" port: 40569 } }
02:04:13.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.839444  5055 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6f2b89ee5244beeaaa2db11be25f552 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c6f2b89ee5244beeaaa2db11be25f552. Latest consensus state: current_term: 1 leader_uuid: "c6f2b89ee5244beeaaa2db11be25f552" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed926c19a2c045aa8dde57409b7638fc" member_type: VOTER last_known_addr { host: "127.4.172.62" port: 36045 } } peers { permanent_uuid: "b8523780db2546d582e8872c0a74aac4" member_type: VOTER last_known_addr { host: "127.4.172.61" port: 37983 } } peers { permanent_uuid: "c6f2b89ee5244beeaaa2db11be25f552" member_type: VOTER last_known_addr { host: "127.4.172.60" port: 40569 } } }
02:04:13.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.840783  5055 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6f2b89ee5244beeaaa2db11be25f552 [sys.catalog]: This master's current role is: LEADER
02:04:13.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.865576  5057 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
02:04:13.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.885041  5057 catalog_manager.cc:1519] Initializing Kudu cluster ID...
02:04:13.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.910784  4839 raft_consensus.cc:1275] T 00000000000000000000000000000000 P ed926c19a2c045aa8dde57409b7638fc [term 1 FOLLOWER]: Refusing update from remote peer c6f2b89ee5244beeaaa2db11be25f552: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
02:04:13.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.912957  5055 consensus_queue.cc:1048] T 00000000000000000000000000000000 P c6f2b89ee5244beeaaa2db11be25f552 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed926c19a2c045aa8dde57409b7638fc" member_type: VOTER last_known_addr { host: "127.4.172.62" port: 36045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
02:04:13.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.923648  4939 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.4.172.60" port: 40569 } attempt: 7
02:04:13.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.975375  4939 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8523780db2546d582e8872c0a74aac4: Bootstrap starting.
02:04:13.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.987193  5042 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed926c19a2c045aa8dde57409b7638fc [sys.catalog]: SysCatalogTable state changed. Reason: New leader c6f2b89ee5244beeaaa2db11be25f552. Latest consensus state: current_term: 1 leader_uuid: "c6f2b89ee5244beeaaa2db11be25f552" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed926c19a2c045aa8dde57409b7638fc" member_type: VOTER last_known_addr { host: "127.4.172.62" port: 36045 } } peers { permanent_uuid: "b8523780db2546d582e8872c0a74aac4" member_type: VOTER last_known_addr { host: "127.4.172.61" port: 37983 } } peers { permanent_uuid: "c6f2b89ee5244beeaaa2db11be25f552" member_type: VOTER last_known_addr { host: "127.4.172.60" port: 40569 } } }
02:04:13.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.992162  5058 mvcc.cc:204] Tried to move back new op lower bound from 7287070121588736000 to 7287070121295224832. Current Snapshot: MvccSnapshot[applied={T|T < 7287070121588736000}]
02:04:13.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.994323  5042 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed926c19a2c045aa8dde57409b7638fc [sys.catalog]: This master's current role is: FOLLOWER
02:04:14.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.999229  5027 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6f2b89ee5244beeaaa2db11be25f552 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c6f2b89ee5244beeaaa2db11be25f552" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed926c19a2c045aa8dde57409b7638fc" member_type: VOTER last_known_addr { host: "127.4.172.62" port: 36045 } } peers { permanent_uuid: "b8523780db2546d582e8872c0a74aac4" member_type: VOTER last_known_addr { host: "127.4.172.61" port: 37983 } } peers { permanent_uuid: "c6f2b89ee5244beeaaa2db11be25f552" member_type: VOTER last_known_addr { host: "127.4.172.60" port: 40569 } } }
02:04:14.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.999924  5027 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6f2b89ee5244beeaaa2db11be25f552 [sys.catalog]: This master's current role is: LEADER
02:04:14.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:14.001714  4939 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b8523780db2546d582e8872c0a74aac4: Neither blocks nor log segments found. Creating new log.
02:04:14.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:14.006580  5057 catalog_manager.cc:1382] Generated new cluster ID: ce43e541935c409f9ce78ec60053a02d
02:04:14.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:14.006875  5057 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
02:04:14.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:14.007519  4939 log.cc:826] T 00000000000000000000000000000000 P b8523780db2546d582e8872c0a74aac4: Log is configured to *not* fsync() on all Append() calls
02:04:14.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:14.013952  4939 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b8523780db2546d582e8872c0a74aac4: No bootstrap required, opened a new log
02:04:14.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:14.030990  5042 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed926c19a2c045aa8dde57409b7638fc [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c6f2b89ee5244beeaaa2db11be25f552" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed926c19a2c045aa8dde57409b7638fc" member_type: VOTER last_known_addr { host: "127.4.172.62" port: 36045 } } peers { permanent_uuid: "b8523780db2546d582e8872c0a74aac4" member_type: VOTER last_known_addr { host: "127.4.172.61" port: 37983 } } peers { permanent_uuid: "c6f2b89ee5244beeaaa2db11be25f552" member_type: VOTER last_known_addr { host: "127.4.172.60" port: 40569 } } }
02:04:14.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:14.031728  5042 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed926c19a2c045aa8dde57409b7638fc [sys.catalog]: This master's current role is: FOLLOWER
02:04:14.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:14.058099  4939 raft_consensus.cc:359] T 00000000000000000000000000000000 P b8523780db2546d582e8872c0a74aac4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed926c19a2c045aa8dde57409b7638fc" member_type: VOTER last_known_addr { host: "127.4.172.62" port: 36045 } } peers { permanent_uuid: "b8523780db2546d582e8872c0a74aac4" member_type: VOTER last_known_addr { host: "127.4.172.61" port: 37983 } } peers { permanent_uuid: "c6f2b89ee5244beeaaa2db11be25f552" member_type: VOTER last_known_addr { host: "127.4.172.60" port: 40569 } }
02:04:14.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:14.059301  4939 raft_consensus.cc:385] T 00000000000000000000000000000000 P b8523780db2546d582e8872c0a74aac4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:04:14.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:14.059847  4939 raft_consensus.cc:740] T 00000000000000000000000000000000 P b8523780db2546d582e8872c0a74aac4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b8523780db2546d582e8872c0a74aac4, State: Initialized, Role: FOLLOWER
02:04:14.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:14.061092  4939 consensus_queue.cc:260] T 00000000000000000000000000000000 P b8523780db2546d582e8872c0a74aac4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed926c19a2c045aa8dde57409b7638fc" member_type: VOTER last_known_addr { host: "127.4.172.62" port: 36045 } } peers { permanent_uuid: "b8523780db2546d582e8872c0a74aac4" member_type: VOTER last_known_addr { host: "127.4.172.61" port: 37983 } } peers { permanent_uuid: "c6f2b89ee5244beeaaa2db11be25f552" member_type: VOTER last_known_addr { host: "127.4.172.60" port: 40569 } }
02:04:14.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:14.084071  4939 sys_catalog.cc:565] T 00000000000000000000000000000000 P b8523780db2546d582e8872c0a74aac4 [sys.catalog]: configured and running, proceeding with master startup.
02:04:14.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:14.084743  4912 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b8523780db2546d582e8872c0a74aac4 [term 0 FOLLOWER]: Advancing to term 1
02:04:14.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:14.078084  5065 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8523780db2546d582e8872c0a74aac4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed926c19a2c045aa8dde57409b7638fc" member_type: VOTER last_known_addr { host: "127.4.172.62" port: 36045 } } peers { permanent_uuid: "b8523780db2546d582e8872c0a74aac4" member_type: VOTER last_known_addr { host: "127.4.172.61" port: 37983 } } peers { permanent_uuid: "c6f2b89ee5244beeaaa2db11be25f552" member_type: VOTER last_known_addr { host: "127.4.172.60" port: 40569 } } }
02:04:14.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:14.088387  4914 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c6f2b89ee5244beeaaa2db11be25f552" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8523780db2546d582e8872c0a74aac4" is_pre_election: true
02:04:14.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:14.088765  5065 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8523780db2546d582e8872c0a74aac4 [sys.catalog]: This master's current role is: FOLLOWER
02:04:14.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:14.091053  4913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c6f2b89ee5244beeaaa2db11be25f552" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b8523780db2546d582e8872c0a74aac4"
02:04:14.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:14.098213  4912 raft_consensus.cc:1275] T 00000000000000000000000000000000 P b8523780db2546d582e8872c0a74aac4 [term 1 FOLLOWER]: Refusing update from remote peer c6f2b89ee5244beeaaa2db11be25f552: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
02:04:14.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:14.100404  5027 consensus_queue.cc:1048] T 00000000000000000000000000000000 P c6f2b89ee5244beeaaa2db11be25f552 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b8523780db2546d582e8872c0a74aac4" member_type: VOTER last_known_addr { host: "127.4.172.61" port: 37983 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
02:04:14.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:14.125959  5057 catalog_manager.cc:1405] Generated new certificate authority record
02:04:14.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:14.131279  5057 catalog_manager.cc:1539] Loading token signing keys...
02:04:14.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:14.169142  5057 catalog_manager.cc:6069] T 00000000000000000000000000000000 P c6f2b89ee5244beeaaa2db11be25f552: Generated new TSK 0
02:04:14.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:14.170676  5057 catalog_manager.cc:1549] Initializing in-progress tserver states...
02:04:14.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:14.195758  5071 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8523780db2546d582e8872c0a74aac4 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "c6f2b89ee5244beeaaa2db11be25f552" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed926c19a2c045aa8dde57409b7638fc" member_type: VOTER last_known_addr { host: "127.4.172.62" port: 36045 } } peers { permanent_uuid: "b8523780db2546d582e8872c0a74aac4" member_type: VOTER last_known_addr { host: "127.4.172.61" port: 37983 } } peers { permanent_uuid: "c6f2b89ee5244beeaaa2db11be25f552" member_type: VOTER last_known_addr { host: "127.4.172.60" port: 40569 } } }
02:04:14.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:14.198154  5071 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8523780db2546d582e8872c0a74aac4 [sys.catalog]: This master's current role is: FOLLOWER
02:04:14.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:14.197435  5065 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8523780db2546d582e8872c0a74aac4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader c6f2b89ee5244beeaaa2db11be25f552. Latest consensus state: current_term: 1 leader_uuid: "c6f2b89ee5244beeaaa2db11be25f552" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed926c19a2c045aa8dde57409b7638fc" member_type: VOTER last_known_addr { host: "127.4.172.62" port: 36045 } } peers { permanent_uuid: "b8523780db2546d582e8872c0a74aac4" member_type: VOTER last_known_addr { host: "127.4.172.61" port: 37983 } } peers { permanent_uuid: "c6f2b89ee5244beeaaa2db11be25f552" member_type: VOTER last_known_addr { host: "127.4.172.60" port: 40569 } } }
02:04:14.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:14.199095  5065 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8523780db2546d582e8872c0a74aac4 [sys.catalog]: This master's current role is: FOLLOWER
02:04:14.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:14.202256  5055 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6f2b89ee5244beeaaa2db11be25f552 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "c6f2b89ee5244beeaaa2db11be25f552" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed926c19a2c045aa8dde57409b7638fc" member_type: VOTER last_known_addr { host: "127.4.172.62" port: 36045 } } peers { permanent_uuid: "b8523780db2546d582e8872c0a74aac4" member_type: VOTER last_known_addr { host: "127.4.172.61" port: 37983 } } peers { permanent_uuid: "c6f2b89ee5244beeaaa2db11be25f552" member_type: VOTER last_known_addr { host: "127.4.172.60" port: 40569 } } }
02:04:14.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:14.203038  5055 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6f2b89ee5244beeaaa2db11be25f552 [sys.catalog]: This master's current role is: LEADER
02:04:14.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:14.226579  4784 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskvuyF4C/build/tsan/bin/kudu
02:04:14.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskvuyF4C/build/tsan/bin/kudu
02:04:14.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/ts-0/wal
02:04:14.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/ts-0/data
02:04:14.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:04:14.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:04:14.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:04:14.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:04:14.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:04:14.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:04:14.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/ts-0/logs
02:04:14.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/ts-0/data/info.pb
02:04:14.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:04:14.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:04:14.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:04:14.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:04:14.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:04:14.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:04:14.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:04:14.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:04:14.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
02:04:14.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:04:14.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.172.1:0
02:04:14.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.4.172.1
02:04:14.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.172.1
02:04:14.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:04:14.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.4.172.62:36045,127.4.172.61:37983,127.4.172.60:40569
02:04:14.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.172.20:42163
02:04:14.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:04:14.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:04:14.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
02:04:14.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:14.264747  5082 catalog_manager.cc:1294] Loaded cluster ID: ce43e541935c409f9ce78ec60053a02d
02:04:14.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:14.265436  5082 catalog_manager.cc:1587] T 00000000000000000000000000000000 P b8523780db2546d582e8872c0a74aac4: loading cluster ID for follower catalog manager: success
02:04:14.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:14.273288  5082 catalog_manager.cc:1609] T 00000000000000000000000000000000 P b8523780db2546d582e8872c0a74aac4: acquiring CA information for follower catalog manager: success
02:04:14.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:14.288139  5082 catalog_manager.cc:1637] T 00000000000000000000000000000000 P b8523780db2546d582e8872c0a74aac4: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
02:04:14.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:14.574364  5053 catalog_manager.cc:1294] Loaded cluster ID: ce43e541935c409f9ce78ec60053a02d
02:04:14.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:14.575096  5053 catalog_manager.cc:1587] T 00000000000000000000000000000000 P ed926c19a2c045aa8dde57409b7638fc: loading cluster ID for follower catalog manager: success
02:04:14.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:14.583163  5053 catalog_manager.cc:1609] T 00000000000000000000000000000000 P ed926c19a2c045aa8dde57409b7638fc: acquiring CA information for follower catalog manager: success
02:04:14.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:14.601771  5053 catalog_manager.cc:1637] T 00000000000000000000000000000000 P ed926c19a2c045aa8dde57409b7638fc: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
02:04:14.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:14.916956  5081 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:04:14.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:14.917979  5081 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:04:14.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:14.918897  5081 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:04:14.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:14.979125  5081 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:04:14.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:14.980823  5081 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.172.1
02:04:15.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:15.046638  5081 tablet_server_runner.cc:78] Tablet server non-default flags:
02:04:15.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:04:15.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.172.20:42163
02:04:15.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:04:15.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:04:15.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/ts-0/data
02:04:15.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/ts-0/wal
02:04:15.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:04:15.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:04:15.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.172.1:0
02:04:15.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:04:15.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:04:15.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:04:15.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/ts-0/data/info.pb
02:04:15.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.172.1
02:04:15.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:04:15.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.4.172.62:36045,127.4.172.61:37983,127.4.172.60:40569
02:04:15.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:04:15.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:04:15.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:04:15.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:04:15.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:04:15.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.4.172.1
02:04:15.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/ts-0/logs
02:04:15.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:04:15.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:04:15.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:04:15.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
02:04:15.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:04:15.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
02:04:15.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:04:15.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 01:43:23 UTC on e7f111948823
02:04:15.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11951
02:04:15.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:04:15.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:15.049985  5081 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:04:15.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:15.052454  5081 file_cache.cc:492] Constructed file cache file cache with capacity 419430
02:04:15.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:15.086127  5089 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:16.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:15.103344  5093 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:16.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:15.096572  5090 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:16.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:16.535400  5081 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
02:04:16.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:16.534910  5091 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection timed out after 1441 milliseconds
02:04:16.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:16.539430  5081 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:04:16.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:16.542456  5081 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:04:16.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:16.544191  5081 hybrid_clock.cc:648] HybridClock initialized: now 1779069856544134 us; error 43 us; skew 500 ppm
02:04:16.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:16.545296  5081 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:04:16.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:16.553097  5081 webserver.cc:533] Webserver started at http://127.4.172.1:35721/ using document root <none> and password file <none>
02:04:16.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:16.554440  5081 fs_manager.cc:362] Metadata directory not provided
02:04:16.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:16.554862  5081 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:04:16.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:16.555464  5081 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:04:16.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:16.562290  5081 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/ts-0/data/instance:
02:04:16.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "a25d9c881e7a43b3abaacad5670175de"
02:04:16.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:04:16 on dist-test-slave-m4h6"
02:04:16.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:16.563896  5081 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/ts-0/wal/instance:
02:04:16.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "a25d9c881e7a43b3abaacad5670175de"
02:04:16.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:04:16 on dist-test-slave-m4h6"
02:04:16.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:16.574000  5081 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.005s	sys 0.004s
02:04:16.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:16.581627  5099 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:04:16.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:16.582986  5081 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
02:04:16.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:16.583354  5081 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/ts-0/data,/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/ts-0/wal
02:04:16.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "a25d9c881e7a43b3abaacad5670175de"
02:04:16.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:04:16 on dist-test-slave-m4h6"
02:04:16.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:16.583745  5081 fs_report.cc:389] FS layout report
02:04:16.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:04:16.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/ts-0/wal
02:04:16.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/ts-0/wal
02:04:16.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/ts-0/data/data
02:04:16.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:04:16.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:04:16.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:04:16.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:04:16.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:04:16.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:04:16.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:04:16.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:04:16.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:04:16.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:04:16.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:04:16.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:16.637261  5081 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:04:16.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:16.638893  5081 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:04:16.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:16.639427  5081 kserver.cc:163] Server-wide thread pool size limit: 3276
02:04:16.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:16.642369  5081 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
02:04:16.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:16.647136  5081 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
02:04:16.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:16.647379  5081 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
02:04:16.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:16.647661  5081 ts_tablet_manager.cc:616] Registered 0 tablets
02:04:16.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:16.647851  5081 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
02:04:16.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:16.809723  5081 rpc_server.cc:307] RPC server started. Bound to: 127.4.172.1:34313
02:04:16.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:16.809841  5211 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.172.1:34313 every 8 connection(s)
02:04:16.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:16.812527  5081 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/ts-0/data/info.pb
02:04:16.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:16.814608  4784 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskvuyF4C/build/tsan/bin/kudu as pid 5081
02:04:16.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:16.815059  4784 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/ts-0/wal/instance
02:04:16.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:16.837764  4784 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskvuyF4C/build/tsan/bin/kudu
02:04:16.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskvuyF4C/build/tsan/bin/kudu
02:04:16.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/ts-1/wal
02:04:16.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/ts-1/data
02:04:16.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:04:16.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:04:16.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:04:16.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:04:16.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:04:16.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:04:16.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/ts-1/logs
02:04:16.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/ts-1/data/info.pb
02:04:16.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:04:16.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:04:16.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:04:16.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:04:16.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:04:16.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:04:16.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:04:16.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:04:16.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
02:04:16.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:04:16.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.172.2:0
02:04:16.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.4.172.2
02:04:16.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.172.2
02:04:16.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:04:16.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.4.172.62:36045,127.4.172.61:37983,127.4.172.60:40569
02:04:16.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.172.20:42163
02:04:16.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:04:16.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:04:16.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
02:04:16.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:16.893101  5212 heartbeater.cc:344] Connected to a master server at 127.4.172.61:37983
02:04:16.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:16.893646  5212 heartbeater.cc:461] Registering TS with master...
02:04:16.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:16.894546  5216 heartbeater.cc:344] Connected to a master server at 127.4.172.62:36045
02:04:16.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:16.894912  5216 heartbeater.cc:461] Registering TS with master...
02:04:16.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:16.895380  5212 heartbeater.cc:507] Master 127.4.172.61:37983 requested a full tablet report, sending...
02:04:16.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:16.896166  5216 heartbeater.cc:507] Master 127.4.172.62:36045 requested a full tablet report, sending...
02:04:16.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:16.898981  4904 ts_manager.cc:194] Registered new tserver with Master: a25d9c881e7a43b3abaacad5670175de (127.4.172.1:34313)
02:04:16.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:16.899099  4828 ts_manager.cc:194] Registered new tserver with Master: a25d9c881e7a43b3abaacad5670175de (127.4.172.1:34313)
02:04:16.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:16.899789  5213 heartbeater.cc:344] Connected to a master server at 127.4.172.60:40569
02:04:16.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:16.900136  5213 heartbeater.cc:461] Registering TS with master...
02:04:16.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:16.900978  5213 heartbeater.cc:507] Master 127.4.172.60:40569 requested a full tablet report, sending...
02:04:16.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:16.903112  4983 ts_manager.cc:194] Registered new tserver with Master: a25d9c881e7a43b3abaacad5670175de (127.4.172.1:34313)
02:04:16.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:16.905071  4983 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.4.172.1:54607
02:04:17.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:17.196681  5222 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:04:17.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:17.197129  5222 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:04:17.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:17.197528  5222 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:04:17.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:17.230454  5222 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:04:17.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:17.231244  5222 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.172.2
02:04:17.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:17.268832  5222 tablet_server_runner.cc:78] Tablet server non-default flags:
02:04:17.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:04:17.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.172.20:42163
02:04:17.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:04:17.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:04:17.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/ts-1/data
02:04:17.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/ts-1/wal
02:04:17.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:04:17.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:04:17.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.172.2:0
02:04:17.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:04:17.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:04:17.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:04:17.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/ts-1/data/info.pb
02:04:17.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.172.2
02:04:17.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:04:17.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.4.172.62:36045,127.4.172.61:37983,127.4.172.60:40569
02:04:17.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:04:17.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:04:17.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:04:17.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:04:17.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:04:17.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.4.172.2
02:04:17.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/ts-1/logs
02:04:17.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:04:17.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:04:17.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:04:17.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
02:04:17.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:04:17.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
02:04:17.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:04:17.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 01:43:23 UTC on e7f111948823
02:04:17.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11951
02:04:17.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:04:17.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:17.270092  5222 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:04:17.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:17.271667  5222 file_cache.cc:492] Constructed file cache file cache with capacity 419430
02:04:17.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:17.284471  5228 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:17.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:17.908632  5213 heartbeater.cc:499] Master 127.4.172.60:40569 was elected leader, sending a full tablet report...
02:04:18.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:18.688185  5227 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 5222
02:04:18.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:18.739641  5222 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.455s	user 0.575s	sys 0.847s
02:04:18.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:18.740010  5222 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.456s	user 0.575s	sys 0.847s
02:04:18.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:17.285141  5229 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:18.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:18.741299  5230 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1455 milliseconds
02:04:18.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:18.742549  5231 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:18.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:18.742496  5222 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
02:04:18.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:18.745116  5222 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:04:18.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:18.747289  5222 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:04:18.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:18.748708  5222 hybrid_clock.cc:648] HybridClock initialized: now 1779069858748649 us; error 60 us; skew 500 ppm
02:04:18.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:18.749653  5222 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:04:18.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:18.756117  5222 webserver.cc:533] Webserver started at http://127.4.172.2:37141/ using document root <none> and password file <none>
02:04:18.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:18.757201  5222 fs_manager.cc:362] Metadata directory not provided
02:04:18.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:18.757459  5222 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:04:18.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:18.757853  5222 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:04:18.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:18.762370  5222 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/ts-1/data/instance:
02:04:18.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f71ad43707cf454ea1cd4a0b13449671"
02:04:18.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:04:18 on dist-test-slave-m4h6"
02:04:18.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:18.763471  5222 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/ts-1/wal/instance:
02:04:18.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f71ad43707cf454ea1cd4a0b13449671"
02:04:18.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:04:18 on dist-test-slave-m4h6"
02:04:18.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:18.770759  5222 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.000s
02:04:18.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:18.776182  5241 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:04:18.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:18.777369  5222 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.001s
02:04:18.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:18.777685  5222 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/ts-1/data,/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/ts-1/wal
02:04:18.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f71ad43707cf454ea1cd4a0b13449671"
02:04:18.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:04:18 on dist-test-slave-m4h6"
02:04:18.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:18.778054  5222 fs_report.cc:389] FS layout report
02:04:18.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:04:18.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/ts-1/wal
02:04:18.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/ts-1/wal
02:04:18.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/ts-1/data/data
02:04:18.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:04:18.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:04:18.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:04:18.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:04:18.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:04:18.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:04:18.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:04:18.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:04:18.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:04:18.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:04:18.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:04:18.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:18.843524  5222 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:04:18.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:18.845165  5222 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:04:18.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:18.845707  5222 kserver.cc:163] Server-wide thread pool size limit: 3276
02:04:18.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:18.848624  5222 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
02:04:18.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:18.853048  5222 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
02:04:18.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:18.853276  5222 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
02:04:18.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:18.853560  5222 ts_tablet_manager.cc:616] Registered 0 tablets
02:04:18.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:18.853763  5222 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
02:04:18.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:18.988499  5222 rpc_server.cc:307] RPC server started. Bound to: 127.4.172.2:42077
02:04:18.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:18.988626  5354 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.172.2:42077 every 8 connection(s)
02:04:18.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:18.991181  5222 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/ts-1/data/info.pb
02:04:18.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:18.993180  4784 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskvuyF4C/build/tsan/bin/kudu as pid 5222
02:04:18.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:18.993834  4784 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/ts-1/wal/instance
02:04:19.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:19.007198  4784 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskvuyF4C/build/tsan/bin/kudu
02:04:19.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskvuyF4C/build/tsan/bin/kudu
02:04:19.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/ts-2/wal
02:04:19.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/ts-2/data
02:04:19.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:04:19.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:04:19.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:04:19.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:04:19.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:04:19.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:04:19.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/ts-2/logs
02:04:19.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/ts-2/data/info.pb
02:04:19.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:04:19.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:04:19.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:04:19.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:04:19.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:04:19.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:04:19.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:04:19.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:04:19.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
02:04:19.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:04:19.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.172.3:0
02:04:19.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.4.172.3
02:04:19.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.172.3
02:04:19.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:04:19.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.4.172.62:36045,127.4.172.61:37983,127.4.172.60:40569
02:04:19.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.172.20:42163
02:04:19.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:04:19.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:04:19.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
02:04:19.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:19.034945  5357 heartbeater.cc:344] Connected to a master server at 127.4.172.62:36045
02:04:19.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:19.035478  5357 heartbeater.cc:461] Registering TS with master...
02:04:19.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:19.035636  5356 heartbeater.cc:344] Connected to a master server at 127.4.172.60:40569
02:04:19.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:19.035938  5356 heartbeater.cc:461] Registering TS with master...
02:04:19.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:19.036906  5357 heartbeater.cc:507] Master 127.4.172.62:36045 requested a full tablet report, sending...
02:04:19.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:19.036964  5356 heartbeater.cc:507] Master 127.4.172.60:40569 requested a full tablet report, sending...
02:04:19.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:19.039058  5355 heartbeater.cc:344] Connected to a master server at 127.4.172.61:37983
02:04:19.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:19.039400  5355 heartbeater.cc:461] Registering TS with master...
02:04:19.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:19.040169  4983 ts_manager.cc:194] Registered new tserver with Master: f71ad43707cf454ea1cd4a0b13449671 (127.4.172.2:42077)
02:04:19.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:19.040280  5355 heartbeater.cc:507] Master 127.4.172.61:37983 requested a full tablet report, sending...
02:04:19.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:19.040714  4828 ts_manager.cc:194] Registered new tserver with Master: f71ad43707cf454ea1cd4a0b13449671 (127.4.172.2:42077)
02:04:19.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:19.041793  4983 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.4.172.2:45013
02:04:19.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:19.042800  4904 ts_manager.cc:194] Registered new tserver with Master: f71ad43707cf454ea1cd4a0b13449671 (127.4.172.2:42077)
02:04:19.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:19.351665  5365 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:04:19.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:19.352334  5365 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:04:19.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:19.352986  5365 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:04:19.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:19.386451  5365 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:04:19.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:19.387249  5365 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.4.172.3
02:04:19.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:19.425153  5365 tablet_server_runner.cc:78] Tablet server non-default flags:
02:04:19.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:04:19.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.172.20:42163
02:04:19.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:04:19.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:04:19.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/ts-2/data
02:04:19.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/ts-2/wal
02:04:19.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:04:19.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:04:19.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.172.3:0
02:04:19.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:04:19.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:04:19.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:04:19.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/ts-2/data/info.pb
02:04:19.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.172.3
02:04:19.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:04:19.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.4.172.62:36045,127.4.172.61:37983,127.4.172.60:40569
02:04:19.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:04:19.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:04:19.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:04:19.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:04:19.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:04:19.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.4.172.3
02:04:19.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/ts-2/logs
02:04:19.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:04:19.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:04:19.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:04:19.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
02:04:19.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:04:19.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
02:04:19.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:04:19.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 01:43:23 UTC on e7f111948823
02:04:19.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11951
02:04:19.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:04:19.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:19.426832  5365 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:04:19.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:19.428530  5365 file_cache.cc:492] Constructed file cache file cache with capacity 419430
02:04:19.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:19.441251  5372 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:20.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:20.045039  5356 heartbeater.cc:499] Master 127.4.172.60:40569 was elected leader, sending a full tablet report...
02:04:20.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:20.501305  5014 debug-util.cc:398] Leaking SignalData structure 0x7b08000b6740 after lost signal to thread 4946
02:04:20.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:20.501977  5014 debug-util.cc:398] Leaking SignalData structure 0x7b08000b7320 after lost signal to thread 5017
02:04:20.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:19.441843  5373 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:20.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:20.601848  5375 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:20.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:20.606050  5374 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1158 milliseconds
02:04:20.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:20.606148  5365 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
02:04:20.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:20.607829  5365 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:04:20.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:20.610455  5365 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:04:20.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:20.612095  5365 hybrid_clock.cc:648] HybridClock initialized: now 1779069860612023 us; error 82 us; skew 500 ppm
02:04:20.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:20.613015  5365 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:04:20.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:20.620069  5365 webserver.cc:533] Webserver started at http://127.4.172.3:33437/ using document root <none> and password file <none>
02:04:20.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:20.621673  5365 fs_manager.cc:362] Metadata directory not provided
02:04:20.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:20.622210  5365 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:04:20.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:20.622905  5365 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:04:20.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:20.627437  5365 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/ts-2/data/instance:
02:04:20.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3b4884da27c64e099240e577c795c0e4"
02:04:20.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:04:20 on dist-test-slave-m4h6"
02:04:20.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:20.628692  5365 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/ts-2/wal/instance:
02:04:20.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3b4884da27c64e099240e577c795c0e4"
02:04:20.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:04:20 on dist-test-slave-m4h6"
02:04:20.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:20.636574  5365 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.007s	sys 0.001s
02:04:20.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:20.642704  5385 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:04:20.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:20.643815  5365 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.006s	sys 0.000s
02:04:20.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:20.644170  5365 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/ts-2/data,/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/ts-2/wal
02:04:20.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3b4884da27c64e099240e577c795c0e4"
02:04:20.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:04:20 on dist-test-slave-m4h6"
02:04:20.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:20.644495  5365 fs_report.cc:389] FS layout report
02:04:20.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:04:20.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/ts-2/wal
02:04:20.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/ts-2/wal
02:04:20.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/ts-2/data/data
02:04:20.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:04:20.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:04:20.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:04:20.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:04:20.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:04:20.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:04:20.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:04:20.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:04:20.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:04:20.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:04:20.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:04:20.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:20.696030  5365 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:04:20.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:20.697544  5365 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:04:20.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:20.697950  5365 kserver.cc:163] Server-wide thread pool size limit: 3276
02:04:20.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:20.700644  5365 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
02:04:20.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:20.705117  5365 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
02:04:20.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:20.705330  5365 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
02:04:20.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:20.705528  5365 ts_tablet_manager.cc:616] Registered 0 tablets
02:04:20.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:20.705658  5365 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
02:04:20.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:20.877761  5365 rpc_server.cc:307] RPC server started. Bound to: 127.4.172.3:39281
02:04:20.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:20.877887  5497 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.172.3:39281 every 8 connection(s)
02:04:20.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:20.881865  5365 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/ts-2/data/info.pb
02:04:20.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:20.891250  4784 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskvuyF4C/build/tsan/bin/kudu as pid 5365
02:04:20.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:20.891727  4784 external_mini_cluster.cc:1442] Reading /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/ts-2/wal/instance
02:04:20.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:20.925912  5499 heartbeater.cc:344] Connected to a master server at 127.4.172.60:40569
02:04:20.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:20.926501  5499 heartbeater.cc:461] Registering TS with master...
02:04:20.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:20.928093  5499 heartbeater.cc:507] Master 127.4.172.60:40569 requested a full tablet report, sending...
02:04:20.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:20.931030  4982 ts_manager.cc:194] Registered new tserver with Master: 3b4884da27c64e099240e577c795c0e4 (127.4.172.3:39281)
02:04:20.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:20.932861  4982 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.4.172.3:46235
02:04:20.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:20.940995  5498 heartbeater.cc:344] Connected to a master server at 127.4.172.61:37983
02:04:20.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:20.941970  5498 heartbeater.cc:461] Registering TS with master...
02:04:20.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:20.942607  5498 heartbeater.cc:507] Master 127.4.172.61:37983 requested a full tablet report, sending...
02:04:20.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:20.945271  4904 ts_manager.cc:194] Registered new tserver with Master: 3b4884da27c64e099240e577c795c0e4 (127.4.172.3:39281)
02:04:20.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:20.947088  5500 heartbeater.cc:344] Connected to a master server at 127.4.172.62:36045
02:04:20.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:20.947384  5500 heartbeater.cc:461] Registering TS with master...
02:04:20.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:20.948019  5500 heartbeater.cc:507] Master 127.4.172.62:36045 requested a full tablet report, sending...
02:04:20.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:20.950038  4828 ts_manager.cc:194] Registered new tserver with Master: 3b4884da27c64e099240e577c795c0e4 (127.4.172.3:39281)
02:04:20.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:20.961905  4784 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
02:04:20.977 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
02:04:20.978 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

02:04:20.981 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.4.172.62"
      port: 36045
    }
    bound_http_address {
      host: "127.4.172.62"
      port: 40609
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.4.172.61"
      port: 37983
    }
    bound_http_address {
      host: "127.4.172.61"
      port: 39085
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.4.172.60"
      port: 40569
    }
    bound_http_address {
      host: "127.4.172.60"
      port: 46099
    }
  }
}

02:04:20.981 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

02:04:20.982 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.4.172.1"
      port: 34313
    }
    bound_http_address {
      host: "127.4.172.1"
      port: 35721
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.4.172.2"
      port: 42077
    }
    bound_http_address {
      host: "127.4.172.2"
      port: 37141
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.4.172.3"
      port: 39281
    }
    bound_http_address {
      host: "127.4.172.3"
      port: 33437
    }
  }
}

02:04:20.982 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
02:04:20.985 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
02:04:20.988 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.4.172.60:40569(127.4.172.60:40569)] connecting to peer
02:04:20.991 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.4.172.61:37983(127.4.172.61:37983)] connecting to peer
02:04:20.993 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.4.172.60:40569(127.4.172.60:40569)] Successfully connected to peer
02:04:21.003 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.172.60
02:04:21.008 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.4.172.62:36045(127.4.172.62:36045)] connecting to peer
02:04:21.011 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.4.172.61:37983(127.4.172.61:37983)] Successfully connected to peer
02:04:21.020 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.172.61
02:04:21.023 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.4.172.62:36045(127.4.172.62:36045)] Successfully connected to peer
02:04:21.029 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.172.62
02:04:21.041 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x2abf7e60, L:/127.0.0.1:53906 - R:/127.4.172.60:40569] using SASL/PLAIN
02:04:21.047 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
02:04:21.047 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=60), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.172.60:40569, [3ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.172.61:37983, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.172.62:36045, [59ms] Sub RPC ConnectToMaster: received response from server master-127.4.172.60:40569: OK, deferred=null) after lookup
02:04:21.048 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x459185e1, L:/127.0.0.1:44614 - R:/127.4.172.61:37983] using SASL/PLAIN
02:04:21.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.049817  4982 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53906:
02:04:21.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "org.apache.kudu.client.TestClientFailoverSupport-RESTART"
02:04:21.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
02:04:21.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
02:04:21.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key"
02:04:21.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
02:04:21.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
02:04:21.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
02:04:21.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
02:04:21.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
02:04:21.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
02:04:21.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:04:21.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
02:04:21.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column1_i"
02:04:21.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
02:04:21.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
02:04:21.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
02:04:21.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
02:04:21.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
02:04:21.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
02:04:21.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:04:21.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
02:04:21.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column2_i"
02:04:21.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
02:04:21.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
02:04:21.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
02:04:21.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
02:04:21.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
02:04:21.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
02:04:21.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:04:21.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
02:04:21.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column3_s"
02:04:21.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
02:04:21.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
02:04:21.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: true
02:04:21.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: DICT_ENCODING
02:04:21.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: LZ4
02:04:21.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 4096
02:04:21.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
02:04:21.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
02:04:21.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:04:21.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
02:04:21.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column4_b"
02:04:21.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BOOL
02:04:21.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
02:04:21.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
02:04:21.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
02:04:21.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
02:04:21.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
02:04:21.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:04:21.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
02:04:21.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
02:04:21.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
02:04:21.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
02:04:21.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key"
02:04:21.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
02:04:21.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:04:21.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
02:04:21.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:21.053824  4982 catalog_manager.cc:7058] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table org.apache.kudu.client.TestClientFailoverSupport-RESTART in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
02:04:21.080 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x3890d4f4, L:/127.0.0.1:56876 - R:/127.4.172.62:36045] using SASL/PLAIN
02:04:21.140 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table ba402652a6ce4f0aa516493f4fe888ad
02:04:21.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.192050  5290 tablet_service.cc:1511] Processing CreateTablet for tablet 6da76b905c764e518ed89b5004b493c7 (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-RESTART [id=ba402652a6ce4f0aa516493f4fe888ad]), partition=RANGE (key) PARTITION UNBOUNDED
02:04:21.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.194135  5290 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6da76b905c764e518ed89b5004b493c7. 1 dirs total, 0 dirs full, 0 dirs failed
02:04:21.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.201879  5433 tablet_service.cc:1511] Processing CreateTablet for tablet 6da76b905c764e518ed89b5004b493c7 (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-RESTART [id=ba402652a6ce4f0aa516493f4fe888ad]), partition=RANGE (key) PARTITION UNBOUNDED
02:04:21.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.204267  5433 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6da76b905c764e518ed89b5004b493c7. 1 dirs total, 0 dirs full, 0 dirs failed
02:04:21.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.205549  5147 tablet_service.cc:1511] Processing CreateTablet for tablet 6da76b905c764e518ed89b5004b493c7 (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-RESTART [id=ba402652a6ce4f0aa516493f4fe888ad]), partition=RANGE (key) PARTITION UNBOUNDED
02:04:21.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.207382  5147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6da76b905c764e518ed89b5004b493c7. 1 dirs total, 0 dirs full, 0 dirs failed
02:04:21.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.232774  5529 tablet_bootstrap.cc:492] T 6da76b905c764e518ed89b5004b493c7 P f71ad43707cf454ea1cd4a0b13449671: Bootstrap starting.
02:04:21.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.236835  5530 tablet_bootstrap.cc:492] T 6da76b905c764e518ed89b5004b493c7 P 3b4884da27c64e099240e577c795c0e4: Bootstrap starting.
02:04:21.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.243312  5529 tablet_bootstrap.cc:654] T 6da76b905c764e518ed89b5004b493c7 P f71ad43707cf454ea1cd4a0b13449671: Neither blocks nor log segments found. Creating new log.
02:04:21.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.245326  5530 tablet_bootstrap.cc:654] T 6da76b905c764e518ed89b5004b493c7 P 3b4884da27c64e099240e577c795c0e4: Neither blocks nor log segments found. Creating new log.
02:04:21.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.245764  5529 log.cc:826] T 6da76b905c764e518ed89b5004b493c7 P f71ad43707cf454ea1cd4a0b13449671: Log is configured to *not* fsync() on all Append() calls
02:04:21.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.248061  5530 log.cc:826] T 6da76b905c764e518ed89b5004b493c7 P 3b4884da27c64e099240e577c795c0e4: Log is configured to *not* fsync() on all Append() calls
02:04:21.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.251536  5531 tablet_bootstrap.cc:492] T 6da76b905c764e518ed89b5004b493c7 P a25d9c881e7a43b3abaacad5670175de: Bootstrap starting.
02:04:21.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.258037  5529 tablet_bootstrap.cc:492] T 6da76b905c764e518ed89b5004b493c7 P f71ad43707cf454ea1cd4a0b13449671: No bootstrap required, opened a new log
02:04:21.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.258587  5529 ts_tablet_manager.cc:1403] T 6da76b905c764e518ed89b5004b493c7 P f71ad43707cf454ea1cd4a0b13449671: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.007s
02:04:21.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.259699  5531 tablet_bootstrap.cc:654] T 6da76b905c764e518ed89b5004b493c7 P a25d9c881e7a43b3abaacad5670175de: Neither blocks nor log segments found. Creating new log.
02:04:21.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.262041  5531 log.cc:826] T 6da76b905c764e518ed89b5004b493c7 P a25d9c881e7a43b3abaacad5670175de: Log is configured to *not* fsync() on all Append() calls
02:04:21.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.263793  5530 tablet_bootstrap.cc:492] T 6da76b905c764e518ed89b5004b493c7 P 3b4884da27c64e099240e577c795c0e4: No bootstrap required, opened a new log
02:04:21.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.264654  5530 ts_tablet_manager.cc:1403] T 6da76b905c764e518ed89b5004b493c7 P 3b4884da27c64e099240e577c795c0e4: Time spent bootstrapping tablet: real 0.029s	user 0.017s	sys 0.008s
02:04:21.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.280179  5531 tablet_bootstrap.cc:492] T 6da76b905c764e518ed89b5004b493c7 P a25d9c881e7a43b3abaacad5670175de: No bootstrap required, opened a new log
02:04:21.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.280747  5531 ts_tablet_manager.cc:1403] T 6da76b905c764e518ed89b5004b493c7 P a25d9c881e7a43b3abaacad5670175de: Time spent bootstrapping tablet: real 0.030s	user 0.017s	sys 0.007s
02:04:21.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.287037  5529 raft_consensus.cc:359] T 6da76b905c764e518ed89b5004b493c7 P f71ad43707cf454ea1cd4a0b13449671 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f71ad43707cf454ea1cd4a0b13449671" member_type: VOTER last_known_addr { host: "127.4.172.2" port: 42077 } } peers { permanent_uuid: "3b4884da27c64e099240e577c795c0e4" member_type: VOTER last_known_addr { host: "127.4.172.3" port: 39281 } } peers { permanent_uuid: "a25d9c881e7a43b3abaacad5670175de" member_type: VOTER last_known_addr { host: "127.4.172.1" port: 34313 } }
02:04:21.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.287945  5529 raft_consensus.cc:385] T 6da76b905c764e518ed89b5004b493c7 P f71ad43707cf454ea1cd4a0b13449671 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:04:21.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.288288  5529 raft_consensus.cc:740] T 6da76b905c764e518ed89b5004b493c7 P f71ad43707cf454ea1cd4a0b13449671 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f71ad43707cf454ea1cd4a0b13449671, State: Initialized, Role: FOLLOWER
02:04:21.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.292899  5529 consensus_queue.cc:260] T 6da76b905c764e518ed89b5004b493c7 P f71ad43707cf454ea1cd4a0b13449671 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f71ad43707cf454ea1cd4a0b13449671" member_type: VOTER last_known_addr { host: "127.4.172.2" port: 42077 } } peers { permanent_uuid: "3b4884da27c64e099240e577c795c0e4" member_type: VOTER last_known_addr { host: "127.4.172.3" port: 39281 } } peers { permanent_uuid: "a25d9c881e7a43b3abaacad5670175de" member_type: VOTER last_known_addr { host: "127.4.172.1" port: 34313 } }
02:04:21.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.297309  5530 raft_consensus.cc:359] T 6da76b905c764e518ed89b5004b493c7 P 3b4884da27c64e099240e577c795c0e4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f71ad43707cf454ea1cd4a0b13449671" member_type: VOTER last_known_addr { host: "127.4.172.2" port: 42077 } } peers { permanent_uuid: "3b4884da27c64e099240e577c795c0e4" member_type: VOTER last_known_addr { host: "127.4.172.3" port: 39281 } } peers { permanent_uuid: "a25d9c881e7a43b3abaacad5670175de" member_type: VOTER last_known_addr { host: "127.4.172.1" port: 34313 } }
02:04:21.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.298529  5530 raft_consensus.cc:385] T 6da76b905c764e518ed89b5004b493c7 P 3b4884da27c64e099240e577c795c0e4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:04:21.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.298990  5530 raft_consensus.cc:740] T 6da76b905c764e518ed89b5004b493c7 P 3b4884da27c64e099240e577c795c0e4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3b4884da27c64e099240e577c795c0e4, State: Initialized, Role: FOLLOWER
02:04:21.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.300197  5530 consensus_queue.cc:260] T 6da76b905c764e518ed89b5004b493c7 P 3b4884da27c64e099240e577c795c0e4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f71ad43707cf454ea1cd4a0b13449671" member_type: VOTER last_known_addr { host: "127.4.172.2" port: 42077 } } peers { permanent_uuid: "3b4884da27c64e099240e577c795c0e4" member_type: VOTER last_known_addr { host: "127.4.172.3" port: 39281 } } peers { permanent_uuid: "a25d9c881e7a43b3abaacad5670175de" member_type: VOTER last_known_addr { host: "127.4.172.1" port: 34313 } }
02:04:21.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.310904  5529 ts_tablet_manager.cc:1434] T 6da76b905c764e518ed89b5004b493c7 P f71ad43707cf454ea1cd4a0b13449671: Time spent starting tablet: real 0.052s	user 0.036s	sys 0.014s
02:04:21.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.320175  5531 raft_consensus.cc:359] T 6da76b905c764e518ed89b5004b493c7 P a25d9c881e7a43b3abaacad5670175de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f71ad43707cf454ea1cd4a0b13449671" member_type: VOTER last_known_addr { host: "127.4.172.2" port: 42077 } } peers { permanent_uuid: "3b4884da27c64e099240e577c795c0e4" member_type: VOTER last_known_addr { host: "127.4.172.3" port: 39281 } } peers { permanent_uuid: "a25d9c881e7a43b3abaacad5670175de" member_type: VOTER last_known_addr { host: "127.4.172.1" port: 34313 } }
02:04:21.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.321262  5531 raft_consensus.cc:385] T 6da76b905c764e518ed89b5004b493c7 P a25d9c881e7a43b3abaacad5670175de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:04:21.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.321560  5531 raft_consensus.cc:740] T 6da76b905c764e518ed89b5004b493c7 P a25d9c881e7a43b3abaacad5670175de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a25d9c881e7a43b3abaacad5670175de, State: Initialized, Role: FOLLOWER
02:04:21.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.322460  5531 consensus_queue.cc:260] T 6da76b905c764e518ed89b5004b493c7 P a25d9c881e7a43b3abaacad5670175de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f71ad43707cf454ea1cd4a0b13449671" member_type: VOTER last_known_addr { host: "127.4.172.2" port: 42077 } } peers { permanent_uuid: "3b4884da27c64e099240e577c795c0e4" member_type: VOTER last_known_addr { host: "127.4.172.3" port: 39281 } } peers { permanent_uuid: "a25d9c881e7a43b3abaacad5670175de" member_type: VOTER last_known_addr { host: "127.4.172.1" port: 34313 } }
02:04:21.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.325765  5499 heartbeater.cc:499] Master 127.4.172.60:40569 was elected leader, sending a full tablet report...
02:04:21.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.327431  5530 ts_tablet_manager.cc:1434] T 6da76b905c764e518ed89b5004b493c7 P 3b4884da27c64e099240e577c795c0e4: Time spent starting tablet: real 0.062s	user 0.038s	sys 0.008s
02:04:21.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.331729  5531 ts_tablet_manager.cc:1434] T 6da76b905c764e518ed89b5004b493c7 P a25d9c881e7a43b3abaacad5670175de: Time spent starting tablet: real 0.051s	user 0.030s	sys 0.006s
02:04:21.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.348515  5535 raft_consensus.cc:493] T 6da76b905c764e518ed89b5004b493c7 P f71ad43707cf454ea1cd4a0b13449671 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
02:04:21.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.349113  5535 raft_consensus.cc:515] T 6da76b905c764e518ed89b5004b493c7 P f71ad43707cf454ea1cd4a0b13449671 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f71ad43707cf454ea1cd4a0b13449671" member_type: VOTER last_known_addr { host: "127.4.172.2" port: 42077 } } peers { permanent_uuid: "3b4884da27c64e099240e577c795c0e4" member_type: VOTER last_known_addr { host: "127.4.172.3" port: 39281 } } peers { permanent_uuid: "a25d9c881e7a43b3abaacad5670175de" member_type: VOTER last_known_addr { host: "127.4.172.1" port: 34313 } }
02:04:21.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.352229  5535 leader_election.cc:290] T 6da76b905c764e518ed89b5004b493c7 P f71ad43707cf454ea1cd4a0b13449671 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3b4884da27c64e099240e577c795c0e4 (127.4.172.3:39281), a25d9c881e7a43b3abaacad5670175de (127.4.172.1:34313)
02:04:21.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:21.357894  5219 tablet.cc:2404] T 6da76b905c764e518ed89b5004b493c7 P a25d9c881e7a43b3abaacad5670175de: Can't schedule compaction. Clean time has not been advanced past its initial value.
02:04:21.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.368072  5453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da76b905c764e518ed89b5004b493c7" candidate_uuid: "f71ad43707cf454ea1cd4a0b13449671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b4884da27c64e099240e577c795c0e4" is_pre_election: true
02:04:21.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.368999  5453 raft_consensus.cc:2468] T 6da76b905c764e518ed89b5004b493c7 P 3b4884da27c64e099240e577c795c0e4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f71ad43707cf454ea1cd4a0b13449671 in term 0.
02:04:21.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.369503  5167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da76b905c764e518ed89b5004b493c7" candidate_uuid: "f71ad43707cf454ea1cd4a0b13449671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a25d9c881e7a43b3abaacad5670175de" is_pre_election: true
02:04:21.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.370325  5167 raft_consensus.cc:2468] T 6da76b905c764e518ed89b5004b493c7 P a25d9c881e7a43b3abaacad5670175de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f71ad43707cf454ea1cd4a0b13449671 in term 0.
02:04:21.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.370548  5244 leader_election.cc:304] T 6da76b905c764e518ed89b5004b493c7 P f71ad43707cf454ea1cd4a0b13449671 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3b4884da27c64e099240e577c795c0e4, f71ad43707cf454ea1cd4a0b13449671; no voters: 
02:04:21.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.371428  5535 raft_consensus.cc:2804] T 6da76b905c764e518ed89b5004b493c7 P f71ad43707cf454ea1cd4a0b13449671 [term 0 FOLLOWER]: Leader pre-election won for term 1
02:04:21.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.371785  5535 raft_consensus.cc:493] T 6da76b905c764e518ed89b5004b493c7 P f71ad43707cf454ea1cd4a0b13449671 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
02:04:21.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.372150  5535 raft_consensus.cc:3060] T 6da76b905c764e518ed89b5004b493c7 P f71ad43707cf454ea1cd4a0b13449671 [term 0 FOLLOWER]: Advancing to term 1
02:04:21.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.378924  5535 raft_consensus.cc:515] T 6da76b905c764e518ed89b5004b493c7 P f71ad43707cf454ea1cd4a0b13449671 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f71ad43707cf454ea1cd4a0b13449671" member_type: VOTER last_known_addr { host: "127.4.172.2" port: 42077 } } peers { permanent_uuid: "3b4884da27c64e099240e577c795c0e4" member_type: VOTER last_known_addr { host: "127.4.172.3" port: 39281 } } peers { permanent_uuid: "a25d9c881e7a43b3abaacad5670175de" member_type: VOTER last_known_addr { host: "127.4.172.1" port: 34313 } }
02:04:21.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.380834  5535 leader_election.cc:290] T 6da76b905c764e518ed89b5004b493c7 P f71ad43707cf454ea1cd4a0b13449671 [CANDIDATE]: Term 1 election: Requested vote from peers 3b4884da27c64e099240e577c795c0e4 (127.4.172.3:39281), a25d9c881e7a43b3abaacad5670175de (127.4.172.1:34313)
02:04:21.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.381693  5453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da76b905c764e518ed89b5004b493c7" candidate_uuid: "f71ad43707cf454ea1cd4a0b13449671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3b4884da27c64e099240e577c795c0e4"
02:04:21.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.382231  5453 raft_consensus.cc:3060] T 6da76b905c764e518ed89b5004b493c7 P 3b4884da27c64e099240e577c795c0e4 [term 0 FOLLOWER]: Advancing to term 1
02:04:21.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.382707  5167 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da76b905c764e518ed89b5004b493c7" candidate_uuid: "f71ad43707cf454ea1cd4a0b13449671" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a25d9c881e7a43b3abaacad5670175de"
02:04:21.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.383229  5167 raft_consensus.cc:3060] T 6da76b905c764e518ed89b5004b493c7 P a25d9c881e7a43b3abaacad5670175de [term 0 FOLLOWER]: Advancing to term 1
02:04:21.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.389995  5167 raft_consensus.cc:2468] T 6da76b905c764e518ed89b5004b493c7 P a25d9c881e7a43b3abaacad5670175de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f71ad43707cf454ea1cd4a0b13449671 in term 1.
02:04:21.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.391479  5244 leader_election.cc:304] T 6da76b905c764e518ed89b5004b493c7 P f71ad43707cf454ea1cd4a0b13449671 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a25d9c881e7a43b3abaacad5670175de, f71ad43707cf454ea1cd4a0b13449671; no voters: 
02:04:21.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.389904  5453 raft_consensus.cc:2468] T 6da76b905c764e518ed89b5004b493c7 P 3b4884da27c64e099240e577c795c0e4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f71ad43707cf454ea1cd4a0b13449671 in term 1.
02:04:21.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.393038  5535 raft_consensus.cc:2804] T 6da76b905c764e518ed89b5004b493c7 P f71ad43707cf454ea1cd4a0b13449671 [term 1 FOLLOWER]: Leader election won for term 1
02:04:21.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.395295  5535 raft_consensus.cc:697] T 6da76b905c764e518ed89b5004b493c7 P f71ad43707cf454ea1cd4a0b13449671 [term 1 LEADER]: Becoming Leader. State: Replica: f71ad43707cf454ea1cd4a0b13449671, State: Running, Role: LEADER
02:04:21.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.396318  5535 consensus_queue.cc:237] T 6da76b905c764e518ed89b5004b493c7 P f71ad43707cf454ea1cd4a0b13449671 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f71ad43707cf454ea1cd4a0b13449671" member_type: VOTER last_known_addr { host: "127.4.172.2" port: 42077 } } peers { permanent_uuid: "3b4884da27c64e099240e577c795c0e4" member_type: VOTER last_known_addr { host: "127.4.172.3" port: 39281 } } peers { permanent_uuid: "a25d9c881e7a43b3abaacad5670175de" member_type: VOTER last_known_addr { host: "127.4.172.1" port: 34313 } }
02:04:21.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.410127  4982 catalog_manager.cc:5696] T 6da76b905c764e518ed89b5004b493c7 P f71ad43707cf454ea1cd4a0b13449671 reported cstate change: term changed from 0 to 1, leader changed from <none> to f71ad43707cf454ea1cd4a0b13449671 (127.4.172.2). New cstate: current_term: 1 leader_uuid: "f71ad43707cf454ea1cd4a0b13449671" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f71ad43707cf454ea1cd4a0b13449671" member_type: VOTER last_known_addr { host: "127.4.172.2" port: 42077 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3b4884da27c64e099240e577c795c0e4" member_type: VOTER last_known_addr { host: "127.4.172.3" port: 39281 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a25d9c881e7a43b3abaacad5670175de" member_type: VOTER last_known_addr { host: "127.4.172.1" port: 34313 } health_report { overall_health: UNKNOWN } } }
02:04:21.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:21.441462  5505 tablet.cc:2404] T 6da76b905c764e518ed89b5004b493c7 P 3b4884da27c64e099240e577c795c0e4: Can't schedule compaction. Clean time has not been advanced past its initial value.
02:04:21.475 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table ba402652a6ce4f0aa516493f4fe888ad
02:04:21.480 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 6da76b905c764e518ed89b5004b493c7 for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
02:04:21.480 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=6da76b905c764e518ed89b5004b493c7@[3b4884da27c64e099240e577c795c0e4(127.4.172.3:39281),a25d9c881e7a43b3abaacad5670175de(127.4.172.1:34313),f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077)[L]]}]
02:04:21.481 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=5), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.4.172.60:40569, [5ms] Sub RPC GetTableLocations: received response from server master-127.4.172.60:40569: OK, deferred=null) after lookup
02:04:21.482 [DEBUG - kudu-nio-0] (Connection.java:748) [peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077)] connecting to peer
02:04:21.484 [DEBUG - kudu-nio-3] (Connection.java:757) [peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077)] Successfully connected to peer
02:04:21.515 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x1f23949e, L:/127.0.0.1:53568 - R:/127.4.172.2:42077] using TOKEN/null
02:04:21.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:21.515955  5364 tablet.cc:2404] T 6da76b905c764e518ed89b5004b493c7 P f71ad43707cf454ea1cd4a0b13449671: Can't schedule compaction. Clean time has not been advanced past its initial value.
02:04:21.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.536687  5167 raft_consensus.cc:1275] T 6da76b905c764e518ed89b5004b493c7 P a25d9c881e7a43b3abaacad5670175de [term 1 FOLLOWER]: Refusing update from remote peer f71ad43707cf454ea1cd4a0b13449671: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
02:04:21.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.537853  5453 raft_consensus.cc:1275] T 6da76b905c764e518ed89b5004b493c7 P 3b4884da27c64e099240e577c795c0e4 [term 1 FOLLOWER]: Refusing update from remote peer f71ad43707cf454ea1cd4a0b13449671: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
02:04:21.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.539047  5535 consensus_queue.cc:1048] T 6da76b905c764e518ed89b5004b493c7 P f71ad43707cf454ea1cd4a0b13449671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a25d9c881e7a43b3abaacad5670175de" member_type: VOTER last_known_addr { host: "127.4.172.1" port: 34313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
02:04:21.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.540033  5540 consensus_queue.cc:1048] T 6da76b905c764e518ed89b5004b493c7 P f71ad43707cf454ea1cd4a0b13449671 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3b4884da27c64e099240e577c795c0e4" member_type: VOTER last_known_addr { host: "127.4.172.3" port: 39281 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
02:04:21.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.598943  5545 mvcc.cc:204] Tried to move back new op lower bound from 7287070152827097088 to 7287070152280494080. Current Snapshot: MvccSnapshot[applied={T|T < 7287070152827097088}]
02:04:21.905 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 10 rows, more = false) for scanner KuduScanner(table=org.apache.kudu.client.TestClientFailoverSupport-RESTART, tablet=6da76b905c764e518ed89b5004b493c7, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
02:04:21.906 [INFO - Time-limited test] (MiniKuduCluster.java:399) Killing master server 127.4.172.60:40569
02:04:21.906 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: stop_daemon {
  id {
    type: MASTER
    index: 2
  }
}

02:04:21.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.906960  4784 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskvuyF4C/build/tsan/bin/kudu with pid 4941
02:04:21.958 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.4.172.60:40569(127.4.172.60:40569)] handling channelInactive
02:04:21.958 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.4.172.60:40569(127.4.172.60:40569)] cleaning up while in state READY due to: connection closed
02:04:21.960 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
02:04:21.960 [INFO - Time-limited test] (MiniKuduCluster.java:380) Starting master server 127.4.172.60:40569
02:04:21.963 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: start_daemon {
  id {
    type: MASTER
    index: 2
  }
}

02:04:21.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.964883  4784 external_mini_cluster.cc:1366] Running /tmp/dist-test-taskvuyF4C/build/tsan/bin/kudu
02:04:21.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskvuyF4C/build/tsan/bin/kudu
02:04:21.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/master-2/wal
02:04:21.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/master-2/data
02:04:21.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:04:21.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:04:21.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:04:21.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:04:21.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:04:21.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:04:21.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/master-2/logs
02:04:21.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/master-2/data/info.pb
02:04:21.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:04:21.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:04:21.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:04:21.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:04:21.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:04:21.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:04:21.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:04:21.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:04:21.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
02:04:21.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:04:21.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:04:21.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:04:21.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.172.60:40569
02:04:21.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.172.60
02:04:21.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=46099
02:04:21.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.172.20:42163
02:04:21.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:04:21.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:04:21.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:04:21.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:04:21.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.4.172.62:36045,127.4.172.61:37983,127.4.172.60:40569
02:04:21.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:04:21.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34017/jwks.json with env {}
02:04:22.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:22.305452  5557 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:04:22.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:22.306093  5557 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:04:22.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:22.306766  5557 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:04:22.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:22.343585  5557 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
02:04:22.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:22.344007  5557 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:04:22.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:22.344383  5557 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
02:04:22.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:22.344695  5557 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
02:04:22.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:22.345005  5557 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
02:04:22.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:22.345250  5557 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:34017/jwks.json
02:04:22.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:22.384289  5557 master_runner.cc:387] Master server non-default flags:
02:04:22.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:04:22.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.4.172.20:42163
02:04:22.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:04:22.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:04:22.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/master-2/data
02:04:22.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/master-2/wal
02:04:22.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:04:22.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.4.172.62:36045,127.4.172.61:37983,127.4.172.60:40569
02:04:22.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:04:22.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:04:22.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:04:22.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.4.172.60:40569
02:04:22.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:04:22.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:04:22.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:04:22.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34017/jwks.json
02:04:22.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:04:22.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:04:22.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/master-2/data/info.pb
02:04:22.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.4.172.60
02:04:22.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=46099
02:04:22.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:04:22.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:04:22.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:04:22.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:04:22.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:04:22.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/master-2/logs
02:04:22.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:04:22.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:04:22.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:04:22.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
02:04:22.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:04:22.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
02:04:22.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:04:22.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 01:43:23 UTC on e7f111948823
02:04:22.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11951
02:04:22.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:04:22.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:22.385982  5557 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:04:22.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:22.388114  5557 file_cache.cc:492] Constructed file cache file cache with capacity 419430
02:04:22.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:22.399710  5563 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:22.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:22.649199  5213 heartbeater.cc:646] Failed to heartbeat to 127.4.172.60:40569 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.4.172.60:40569: connect: Connection refused (error 111)
02:04:22.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:22.670646  5356 heartbeater.cc:646] Failed to heartbeat to 127.4.172.60:40569 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.4.172.60:40569: connect: Connection refused (error 111)
02:04:22.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:22.681128  5499 heartbeater.cc:646] Failed to heartbeat to 127.4.172.60:40569 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.4.172.60:40569: connect: Connection refused (error 111)
02:04:22.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:22.945315  5572 raft_consensus.cc:493] T 00000000000000000000000000000000 P ed926c19a2c045aa8dde57409b7638fc [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6f2b89ee5244beeaaa2db11be25f552)
02:04:22.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:22.946571  5572 raft_consensus.cc:515] T 00000000000000000000000000000000 P ed926c19a2c045aa8dde57409b7638fc [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed926c19a2c045aa8dde57409b7638fc" member_type: VOTER last_known_addr { host: "127.4.172.62" port: 36045 } } peers { permanent_uuid: "b8523780db2546d582e8872c0a74aac4" member_type: VOTER last_known_addr { host: "127.4.172.61" port: 37983 } } peers { permanent_uuid: "c6f2b89ee5244beeaaa2db11be25f552" member_type: VOTER last_known_addr { host: "127.4.172.60" port: 40569 } }
02:04:22.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:22.951511  4913 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ed926c19a2c045aa8dde57409b7638fc" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "b8523780db2546d582e8872c0a74aac4" is_pre_election: true
02:04:22.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:22.967028  5572 leader_election.cc:290] T 00000000000000000000000000000000 P ed926c19a2c045aa8dde57409b7638fc [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b8523780db2546d582e8872c0a74aac4 (127.4.172.61:37983), c6f2b89ee5244beeaaa2db11be25f552 (127.4.172.60:40569)
02:04:22.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:22.970489  4815 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.172.60:40569: connect: Connection refused (error 111) [suppressed 12 similar messages]
02:04:22.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:22.996793  4815 leader_election.cc:336] T 00000000000000000000000000000000 P ed926c19a2c045aa8dde57409b7638fc [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c6f2b89ee5244beeaaa2db11be25f552 (127.4.172.60:40569): Network error: Client connection negotiation failed: client connection to 127.4.172.60:40569: connect: Connection refused (error 111)
02:04:22.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:22.997730  4815 leader_election.cc:304] T 00000000000000000000000000000000 P ed926c19a2c045aa8dde57409b7638fc [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed926c19a2c045aa8dde57409b7638fc; no voters: b8523780db2546d582e8872c0a74aac4, c6f2b89ee5244beeaaa2db11be25f552
02:04:23.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:23.000567  5572 raft_consensus.cc:2749] T 00000000000000000000000000000000 P ed926c19a2c045aa8dde57409b7638fc [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
02:04:23.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:23.388926  5575 raft_consensus.cc:493] T 00000000000000000000000000000000 P b8523780db2546d582e8872c0a74aac4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6f2b89ee5244beeaaa2db11be25f552)
02:04:23.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:23.390133  5575 raft_consensus.cc:515] T 00000000000000000000000000000000 P b8523780db2546d582e8872c0a74aac4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed926c19a2c045aa8dde57409b7638fc" member_type: VOTER last_known_addr { host: "127.4.172.62" port: 36045 } } peers { permanent_uuid: "b8523780db2546d582e8872c0a74aac4" member_type: VOTER last_known_addr { host: "127.4.172.61" port: 37983 } } peers { permanent_uuid: "c6f2b89ee5244beeaaa2db11be25f552" member_type: VOTER last_known_addr { host: "127.4.172.60" port: 40569 } }
02:04:23.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:23.393872  5575 leader_election.cc:290] T 00000000000000000000000000000000 P b8523780db2546d582e8872c0a74aac4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed926c19a2c045aa8dde57409b7638fc (127.4.172.62:36045), c6f2b89ee5244beeaaa2db11be25f552 (127.4.172.60:40569)
02:04:23.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:23.394284  4839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b8523780db2546d582e8872c0a74aac4" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "ed926c19a2c045aa8dde57409b7638fc" is_pre_election: true
02:04:23.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:23.395015  4839 raft_consensus.cc:2468] T 00000000000000000000000000000000 P ed926c19a2c045aa8dde57409b7638fc [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b8523780db2546d582e8872c0a74aac4 in term 1.
02:04:23.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:23.397101  4888 leader_election.cc:304] T 00000000000000000000000000000000 P b8523780db2546d582e8872c0a74aac4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8523780db2546d582e8872c0a74aac4, ed926c19a2c045aa8dde57409b7638fc; no voters: 
02:04:23.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:23.398103  5575 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b8523780db2546d582e8872c0a74aac4 [term 1 FOLLOWER]: Leader pre-election won for term 2
02:04:23.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:23.398463  5575 raft_consensus.cc:493] T 00000000000000000000000000000000 P b8523780db2546d582e8872c0a74aac4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c6f2b89ee5244beeaaa2db11be25f552)
02:04:23.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:23.398788  5575 raft_consensus.cc:3060] T 00000000000000000000000000000000 P b8523780db2546d582e8872c0a74aac4 [term 1 FOLLOWER]: Advancing to term 2
02:04:23.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:23.408178  5575 raft_consensus.cc:515] T 00000000000000000000000000000000 P b8523780db2546d582e8872c0a74aac4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed926c19a2c045aa8dde57409b7638fc" member_type: VOTER last_known_addr { host: "127.4.172.62" port: 36045 } } peers { permanent_uuid: "b8523780db2546d582e8872c0a74aac4" member_type: VOTER last_known_addr { host: "127.4.172.61" port: 37983 } } peers { permanent_uuid: "c6f2b89ee5244beeaaa2db11be25f552" member_type: VOTER last_known_addr { host: "127.4.172.60" port: 40569 } }
02:04:23.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:23.411715  5575 leader_election.cc:290] T 00000000000000000000000000000000 P b8523780db2546d582e8872c0a74aac4 [CANDIDATE]: Term 2 election: Requested vote from peers ed926c19a2c045aa8dde57409b7638fc (127.4.172.62:36045), c6f2b89ee5244beeaaa2db11be25f552 (127.4.172.60:40569)
02:04:23.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:23.411621  4839 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "b8523780db2546d582e8872c0a74aac4" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "ed926c19a2c045aa8dde57409b7638fc"
02:04:23.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:23.412308  4839 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ed926c19a2c045aa8dde57409b7638fc [term 1 FOLLOWER]: Advancing to term 2
02:04:23.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:23.414451  4890 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.172.60:40569: connect: Connection refused (error 111) [suppressed 6 similar messages]
02:04:23.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:23.420908  4839 raft_consensus.cc:2468] T 00000000000000000000000000000000 P ed926c19a2c045aa8dde57409b7638fc [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b8523780db2546d582e8872c0a74aac4 in term 2.
02:04:23.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:23.422670  4888 leader_election.cc:304] T 00000000000000000000000000000000 P b8523780db2546d582e8872c0a74aac4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b8523780db2546d582e8872c0a74aac4, ed926c19a2c045aa8dde57409b7638fc; no voters: 
02:04:23.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:23.423539  5575 raft_consensus.cc:2804] T 00000000000000000000000000000000 P b8523780db2546d582e8872c0a74aac4 [term 2 FOLLOWER]: Leader election won for term 2
02:04:23.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:23.431284  4890 leader_election.cc:336] T 00000000000000000000000000000000 P b8523780db2546d582e8872c0a74aac4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c6f2b89ee5244beeaaa2db11be25f552 (127.4.172.60:40569): Network error: Client connection negotiation failed: client connection to 127.4.172.60:40569: connect: Connection refused (error 111)
02:04:23.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:23.432597  4890 leader_election.cc:336] T 00000000000000000000000000000000 P b8523780db2546d582e8872c0a74aac4 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c6f2b89ee5244beeaaa2db11be25f552 (127.4.172.60:40569): Network error: Client connection negotiation failed: client connection to 127.4.172.60:40569: connect: Connection refused (error 111)
02:04:23.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:23.441339  5575 raft_consensus.cc:697] T 00000000000000000000000000000000 P b8523780db2546d582e8872c0a74aac4 [term 2 LEADER]: Becoming Leader. State: Replica: b8523780db2546d582e8872c0a74aac4, State: Running, Role: LEADER
02:04:23.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:23.442711  5575 consensus_queue.cc:237] T 00000000000000000000000000000000 P b8523780db2546d582e8872c0a74aac4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed926c19a2c045aa8dde57409b7638fc" member_type: VOTER last_known_addr { host: "127.4.172.62" port: 36045 } } peers { permanent_uuid: "b8523780db2546d582e8872c0a74aac4" member_type: VOTER last_known_addr { host: "127.4.172.61" port: 37983 } } peers { permanent_uuid: "c6f2b89ee5244beeaaa2db11be25f552" member_type: VOTER last_known_addr { host: "127.4.172.60" port: 40569 } }
02:04:23.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:23.455979  5578 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8523780db2546d582e8872c0a74aac4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b8523780db2546d582e8872c0a74aac4. Latest consensus state: current_term: 2 leader_uuid: "b8523780db2546d582e8872c0a74aac4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed926c19a2c045aa8dde57409b7638fc" member_type: VOTER last_known_addr { host: "127.4.172.62" port: 36045 } } peers { permanent_uuid: "b8523780db2546d582e8872c0a74aac4" member_type: VOTER last_known_addr { host: "127.4.172.61" port: 37983 } } peers { permanent_uuid: "c6f2b89ee5244beeaaa2db11be25f552" member_type: VOTER last_known_addr { host: "127.4.172.60" port: 40569 } } }
02:04:23.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:23.457132  5578 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8523780db2546d582e8872c0a74aac4 [sys.catalog]: This master's current role is: LEADER
02:04:23.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:23.467507  5580 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
02:04:23.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:23.477065  5580 catalog_manager.cc:679] Loaded metadata for table org.apache.kudu.client.TestClientFailoverSupport-RESTART [id=ba402652a6ce4f0aa516493f4fe888ad]
02:04:23.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:23.494675  5580 tablet_loader.cc:96] loaded metadata for tablet 6da76b905c764e518ed89b5004b493c7 (table org.apache.kudu.client.TestClientFailoverSupport-RESTART [id=ba402652a6ce4f0aa516493f4fe888ad])
02:04:23.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:23.505357  5580 catalog_manager.cc:1519] Initializing Kudu cluster ID...
02:04:23.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:23.509990  5580 catalog_manager.cc:1294] Loaded cluster ID: ce43e541935c409f9ce78ec60053a02d
02:04:23.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:23.524132  5580 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
02:04:23.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:23.529367  5580 catalog_manager.cc:1539] Loading token signing keys...
02:04:23.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:23.533878  5580 catalog_manager.cc:6080] T 00000000000000000000000000000000 P b8523780db2546d582e8872c0a74aac4: Loaded TSK: 0
02:04:23.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:23.535463  5580 catalog_manager.cc:1549] Initializing in-progress tserver states...
02:04:23.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:23.855569  4839 raft_consensus.cc:1275] T 00000000000000000000000000000000 P ed926c19a2c045aa8dde57409b7638fc [term 2 FOLLOWER]: Refusing update from remote peer b8523780db2546d582e8872c0a74aac4: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 2 index: 8. (index mismatch)
02:04:23.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:23.859875  5578 consensus_queue.cc:1048] T 00000000000000000000000000000000 P b8523780db2546d582e8872c0a74aac4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed926c19a2c045aa8dde57409b7638fc" member_type: VOTER last_known_addr { host: "127.4.172.62" port: 36045 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
02:04:23.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:23.930733  5578 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8523780db2546d582e8872c0a74aac4 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "b8523780db2546d582e8872c0a74aac4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed926c19a2c045aa8dde57409b7638fc" member_type: VOTER last_known_addr { host: "127.4.172.62" port: 36045 } } peers { permanent_uuid: "b8523780db2546d582e8872c0a74aac4" member_type: VOTER last_known_addr { host: "127.4.172.61" port: 37983 } } peers { permanent_uuid: "c6f2b89ee5244beeaaa2db11be25f552" member_type: VOTER last_known_addr { host: "127.4.172.60" port: 40569 } } }
02:04:23.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:23.933202  5578 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8523780db2546d582e8872c0a74aac4 [sys.catalog]: This master's current role is: LEADER
02:04:23.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:23.937693  5585 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed926c19a2c045aa8dde57409b7638fc [sys.catalog]: SysCatalogTable state changed. Reason: New leader b8523780db2546d582e8872c0a74aac4. Latest consensus state: current_term: 2 leader_uuid: "b8523780db2546d582e8872c0a74aac4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed926c19a2c045aa8dde57409b7638fc" member_type: VOTER last_known_addr { host: "127.4.172.62" port: 36045 } } peers { permanent_uuid: "b8523780db2546d582e8872c0a74aac4" member_type: VOTER last_known_addr { host: "127.4.172.61" port: 37983 } } peers { permanent_uuid: "c6f2b89ee5244beeaaa2db11be25f552" member_type: VOTER last_known_addr { host: "127.4.172.60" port: 40569 } } }
02:04:23.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:23.939911  5585 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed926c19a2c045aa8dde57409b7638fc [sys.catalog]: This master's current role is: FOLLOWER
02:04:23.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:23.935956  5592 sys_catalog.cc:455] T 00000000000000000000000000000000 P ed926c19a2c045aa8dde57409b7638fc [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "b8523780db2546d582e8872c0a74aac4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed926c19a2c045aa8dde57409b7638fc" member_type: VOTER last_known_addr { host: "127.4.172.62" port: 36045 } } peers { permanent_uuid: "b8523780db2546d582e8872c0a74aac4" member_type: VOTER last_known_addr { host: "127.4.172.61" port: 37983 } } peers { permanent_uuid: "c6f2b89ee5244beeaaa2db11be25f552" member_type: VOTER last_known_addr { host: "127.4.172.60" port: 40569 } } }
02:04:23.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:23.957496  4890 consensus_peers.cc:597] T 00000000000000000000000000000000 P b8523780db2546d582e8872c0a74aac4 -> Peer c6f2b89ee5244beeaaa2db11be25f552 (127.4.172.60:40569): Couldn't send request to peer c6f2b89ee5244beeaaa2db11be25f552. Status: Network error: Client connection negotiation failed: client connection to 127.4.172.60:40569: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
02:04:23.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:23.958539  5592 sys_catalog.cc:458] T 00000000000000000000000000000000 P ed926c19a2c045aa8dde57409b7638fc [sys.catalog]: This master's current role is: FOLLOWER
02:04:24.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:23.801509  5562 debug-util.cc:398] Leaking SignalData structure 0x7b08000271e0 after lost signal to thread 5557
02:04:24.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:24.142976  5562 kernel_stack_watchdog.cc:198] Thread 5557 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 398ms:
02:04:24.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
02:04:24.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
02:04:24.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
02:04:24.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
02:04:24.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:22.400945  5564 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:24.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:24.143676  5557 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.743s	user 0.655s	sys 0.950s
02:04:24.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:24.144135  5557 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.743s	user 0.656s	sys 0.950s
02:04:24.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:24.145982  5566 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:24.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:24.150727  5565 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1749 milliseconds
02:04:24.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:24.150812  5557 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
02:04:24.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:24.152441  5557 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:04:24.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:24.155501  5557 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:04:24.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:24.156978  5557 hybrid_clock.cc:648] HybridClock initialized: now 1779069864156819 us; error 156 us; skew 500 ppm
02:04:24.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:24.158071  5557 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:04:24.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:24.165774  5557 webserver.cc:533] Webserver started at http://127.4.172.60:46099/ using document root <none> and password file <none>
02:04:24.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:24.167047  5557 fs_manager.cc:362] Metadata directory not provided
02:04:24.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:24.167368  5557 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:04:24.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:24.178388  5557 fs_manager.cc:714] Time spent opening directory manager: real 0.007s	user 0.010s	sys 0.000s
02:04:24.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:24.184446  5598 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:04:24.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:24.185807  5557 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.004s	sys 0.000s
02:04:24.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:24.186232  5557 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/master-2/data,/tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/master-2/wal
02:04:24.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c6f2b89ee5244beeaaa2db11be25f552"
02:04:24.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:04:13 on dist-test-slave-m4h6"
02:04:24.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:24.189108  5557 fs_report.cc:389] FS layout report
02:04:24.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:04:24.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/master-2/wal
02:04:24.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/master-2/wal
02:04:24.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/master-2/data/data
02:04:24.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:04:24.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:04:24.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:04:24.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:04:24.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:04:24.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:04:24.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:04:24.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:04:24.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:04:24.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:04:24.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:04:24.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:24.259168  5557 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:04:24.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:24.261304  5557 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:04:24.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:24.261883  5557 kserver.cc:163] Server-wide thread pool size limit: 3276
02:04:24.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:24.347502  5557 rpc_server.cc:307] RPC server started. Bound to: 127.4.172.60:40569
02:04:24.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:24.347569  5649 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.172.60:40569 every 8 connection(s)
02:04:24.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:24.350454  5557 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskvuyF4C/test-tmp/mini-kudu-cluster16151278743941090801/master-2/data/info.pb
02:04:24.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:24.356554  4784 external_mini_cluster.cc:1428] Started /tmp/dist-test-taskvuyF4C/build/tsan/bin/kudu as pid 5557
02:04:24.357 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
02:04:24.358 [INFO - Time-limited test] (MiniKuduCluster.java:475) Killing tablet server 127.4.172.2:42077
02:04:24.358 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: stop_daemon {
  id {
    type: TSERVER
    index: 1
  }
}

02:04:24.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:24.359100  4784 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskvuyF4C/build/tsan/bin/kudu with pid 5222
02:04:24.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:24.363145  5650 sys_catalog.cc:263] Verifying existing consensus state
02:04:24.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:24.368868  5650 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c6f2b89ee5244beeaaa2db11be25f552: Bootstrap starting.
02:04:24.386 [DEBUG - kudu-nio-3] (Connection.java:239) [peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077)] handling channelInactive
02:04:24.386 [DEBUG - kudu-nio-3] (Connection.java:709) [peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077)] cleaning up while in state READY due to: connection closed
02:04:24.387 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
02:04:24.388 [DEBUG - Time-limited test] (Connection.java:748) [peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077)] connecting to peer
02:04:24.394 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077): Connection refused: /127.4.172.2:42077
02:04:24.394 [DEBUG - kudu-nio-4] (Connection.java:709) [peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077)] cleaning up while in state CONNECTING due to: Failed to connect to peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077): Connection refused: /127.4.172.2:42077
02:04:24.394 [INFO - kudu-nio-4] (AsyncKuduClient.java:2355) Invalidating location f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077) for tablet 6da76b905c764e518ed89b5004b493c7: Failed to connect to peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077): Connection refused: /127.4.172.2:42077
02:04:24.408 [DEBUG - pool-4-thread-1] (Connection.java:748) [peer master-127.4.172.60:40569(127.4.172.60:40569)] connecting to peer
02:04:24.410 [DEBUG - kudu-nio-5] (Connection.java:757) [peer master-127.4.172.60:40569(127.4.172.60:40569)] Successfully connected to peer
02:04:24.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:24.412277  5650 log.cc:826] T 00000000000000000000000000000000 P c6f2b89ee5244beeaaa2db11be25f552: Log is configured to *not* fsync() on all Append() calls
02:04:24.418 [DEBUG - kudu-nio-5] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.4.172.60
02:04:24.441 [DEBUG - kudu-nio-5] (Negotiator.java:919) Authenticated connection [id: 0x9bc0bf09, L:/127.0.0.1:50586 - R:/127.4.172.60:40569] using SASL/PLAIN
02:04:24.445 [DEBUG - kudu-nio-5] (RemoteTablet.java:166) master-127.4.172.60:40569 was demoted as the leader for Kudu Master
02:04:24.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:24.445703  5650 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c6f2b89ee5244beeaaa2db11be25f552: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=5 ignored=0} mutations{seen=2 ignored=0} orphaned_commits=0. Pending: 0 replicates
02:04:24.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:24.446584  5650 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c6f2b89ee5244beeaaa2db11be25f552: Bootstrap complete.
02:04:24.451 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.4.172.60:40569: Catalog manager is not initialized. State: Starting
02:04:24.455 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
02:04:24.455 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableLocations, tablet=Kudu Master, attempt=2, TimeoutTracker(timeout=29981, elapsed=47), Traces: [0ms] sending RPC to server master-127.4.172.60:40569, [37ms] delaying RPC due to: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [38ms] received response from server master-127.4.172.60:40569: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.172.60:40569, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.172.61:37983, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.172.62:36045, [43ms] Sub RPC ConnectToMaster: received response from server master-127.4.172.60:40569: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [46ms] Sub RPC ConnectToMaster: received response from server master-127.4.172.61:37983: OK, deferred=Deferred@186634334(state=PENDING, result=null, callback=get tablet locations from the master for table org.apache.kudu.client.TestClientFailoverSupport-RESTART -> release master lookup permit -> retry RPC, errback=passthrough -> release master lookup permit -> retry RPC after error)) after lookup
02:04:24.460 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 6da76b905c764e518ed89b5004b493c7 for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
02:04:24.461 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=6da76b905c764e518ed89b5004b493c7@[3b4884da27c64e099240e577c795c0e4(127.4.172.3:39281),a25d9c881e7a43b3abaacad5670175de(127.4.172.1:34313),f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077)[L]]}]
02:04:24.461 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=6da76b905c764e518ed89b5004b493c7, attempt=2, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=73), Traces: [0ms] sending RPC to server f71ad43707cf454ea1cd4a0b13449671, [6ms] received response from server f71ad43707cf454ea1cd4a0b13449671: Network error: Failed to connect to peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077): Connection refused: /127.4.172.2:42077, [7ms] delaying RPC due to: Network error: Failed to connect to peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077): Connection refused: /127.4.172.2:42077, [19ms] refreshing cache from master, [20ms] Sub RPC GetTableLocations: sending RPC to server master-127.4.172.60:40569, [57ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [58ms] Sub RPC GetTableLocations: received response from server master-127.4.172.60:40569: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [60ms] Sub RPC GetTableLocations: refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.172.60:40569, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.172.61:37983, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.172.62:36045, [63ms] Sub RPC ConnectToMaster: received response from server master-127.4.172.60:40569: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [66ms] Sub RPC ConnectToMaster: received response from server master-127.4.172.61:37983: OK, [67ms] Sub RPC ConnectToMaster: received response from server master-127.4.172.62:36045: OK, [68ms] Sub RPC GetTableLocations: sending RPC to server master-127.4.172.61:37983, [72ms] Sub RPC GetTableLocations: received response from server master-127.4.172.61:37983: OK, deferred=Deferred@1514149274(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$238/0x00007fa390336f90@d7fdfbf -> passthrough -> wakeup thread Time-limited test, errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@7897736e -> wakeup thread Time-limited test)) after lookup
02:04:24.463 [DEBUG - kudu-nio-1] (Connection.java:748) [peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077)] connecting to peer
02:04:24.465 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077): Connection refused: /127.4.172.2:42077
02:04:24.465 [DEBUG - kudu-nio-6] (Connection.java:709) [peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077)] cleaning up while in state CONNECTING due to: Failed to connect to peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077): Connection refused: /127.4.172.2:42077
02:04:24.466 [INFO - kudu-nio-6] (AsyncKuduClient.java:2355) Invalidating location f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077) for tablet 6da76b905c764e518ed89b5004b493c7: Failed to connect to peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077): Connection refused: /127.4.172.2:42077
02:04:24.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:24.477360  5650 raft_consensus.cc:359] T 00000000000000000000000000000000 P c6f2b89ee5244beeaaa2db11be25f552 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed926c19a2c045aa8dde57409b7638fc" member_type: VOTER last_known_addr { host: "127.4.172.62" port: 36045 } } peers { permanent_uuid: "b8523780db2546d582e8872c0a74aac4" member_type: VOTER last_known_addr { host: "127.4.172.61" port: 37983 } } peers { permanent_uuid: "c6f2b89ee5244beeaaa2db11be25f552" member_type: VOTER last_known_addr { host: "127.4.172.60" port: 40569 } }
02:04:24.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:24.480240  5650 raft_consensus.cc:740] T 00000000000000000000000000000000 P c6f2b89ee5244beeaaa2db11be25f552 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6f2b89ee5244beeaaa2db11be25f552, State: Initialized, Role: FOLLOWER
02:04:24.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:24.480988  5650 consensus_queue.cc:260] T 00000000000000000000000000000000 P c6f2b89ee5244beeaaa2db11be25f552 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed926c19a2c045aa8dde57409b7638fc" member_type: VOTER last_known_addr { host: "127.4.172.62" port: 36045 } } peers { permanent_uuid: "b8523780db2546d582e8872c0a74aac4" member_type: VOTER last_known_addr { host: "127.4.172.61" port: 37983 } } peers { permanent_uuid: "c6f2b89ee5244beeaaa2db11be25f552" member_type: VOTER last_known_addr { host: "127.4.172.60" port: 40569 } }
02:04:24.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:24.483522  5658 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6f2b89ee5244beeaaa2db11be25f552 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed926c19a2c045aa8dde57409b7638fc" member_type: VOTER last_known_addr { host: "127.4.172.62" port: 36045 } } peers { permanent_uuid: "b8523780db2546d582e8872c0a74aac4" member_type: VOTER last_known_addr { host: "127.4.172.61" port: 37983 } } peers { permanent_uuid: "c6f2b89ee5244beeaaa2db11be25f552" member_type: VOTER last_known_addr { host: "127.4.172.60" port: 40569 } } }
02:04:24.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:24.484616  5658 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6f2b89ee5244beeaaa2db11be25f552 [sys.catalog]: This master's current role is: FOLLOWER
02:04:24.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:24.484683  5650 sys_catalog.cc:565] T 00000000000000000000000000000000 P c6f2b89ee5244beeaaa2db11be25f552 [sys.catalog]: configured and running, proceeding with master startup.
02:04:24.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:24.485319  5625 raft_consensus.cc:3060] T 00000000000000000000000000000000 P c6f2b89ee5244beeaaa2db11be25f552 [term 1 FOLLOWER]: Advancing to term 2
02:04:24.493 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 6da76b905c764e518ed89b5004b493c7 for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
02:04:24.493 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=6da76b905c764e518ed89b5004b493c7@[3b4884da27c64e099240e577c795c0e4(127.4.172.3:39281),a25d9c881e7a43b3abaacad5670175de(127.4.172.1:34313),f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077)[L]]}]
02:04:24.494 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=6da76b905c764e518ed89b5004b493c7, attempt=4, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=105), Traces: [0ms] sending RPC to server f71ad43707cf454ea1cd4a0b13449671, [6ms] received response from server f71ad43707cf454ea1cd4a0b13449671: Network error: Failed to connect to peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077): Connection refused: /127.4.172.2:42077, [7ms] delaying RPC due to: Network error: Failed to connect to peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077): Connection refused: /127.4.172.2:42077, [19ms] refreshing cache from master, [20ms] Sub RPC GetTableLocations: sending RPC to server master-127.4.172.60:40569, [57ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [58ms] Sub RPC GetTableLocations: received response from server master-127.4.172.60:40569: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [60ms] Sub RPC GetTableLocations: refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.172.60:40569, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.172.61:37983, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.172.62:36045, [63ms] Sub RPC ConnectToMaster: received response from server master-127.4.172.60:40569: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [66ms] Sub RPC ConnectToMaster: received response from server master-127.4.172.61:37983: OK, [67ms] Sub RPC ConnectToMaster: received response from server master-127.4.172.62:36045: OK, [68ms] Sub RPC GetTableLocations: sending RPC to server master-127.4.172.61:37983, [72ms] Sub RPC GetTableLocations: received response from server master-127.4.172.61:37983: OK, [75ms] sending RPC to server f71ad43707cf454ea1cd4a0b13449671, [77ms] received response from server f71ad43707cf454ea1cd4a0b13449671: Network error: Failed to connect to peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077): Connection refused: /127.4.172.2:42077, [78ms] delaying RPC due to: Network error: Failed to connect to peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077): Connection refused: /127.4.172.2:42077, [99ms] refreshing cache from master, [99ms] Sub RPC GetTableLocations: sending RPC to server master-127.4.172.61:37983, [104ms] Sub RPC GetTableLocations: received response from server master-127.4.172.61:37983: OK, deferred=Deferred@1514149274(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$238/0x00007fa390336f90@d7fdfbf -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@186634334 after retry RPC@1857032168), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@7897736e -> wakeup thread Time-limited test -> (continuation of Deferred@186634334 after retry RPC@1857032168))) after lookup
02:04:24.496 [DEBUG - kudu-nio-1] (Connection.java:748) [peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077)] connecting to peer
02:04:24.502 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077): Connection refused: /127.4.172.2:42077
02:04:24.502 [DEBUG - kudu-nio-7] (Connection.java:709) [peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077)] cleaning up while in state CONNECTING due to: Failed to connect to peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077): Connection refused: /127.4.172.2:42077
02:04:24.502 [INFO - kudu-nio-7] (AsyncKuduClient.java:2355) Invalidating location f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077) for tablet 6da76b905c764e518ed89b5004b493c7: Failed to connect to peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077): Connection refused: /127.4.172.2:42077
02:04:24.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:24.505890  5668 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6f2b89ee5244beeaaa2db11be25f552 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "b8523780db2546d582e8872c0a74aac4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed926c19a2c045aa8dde57409b7638fc" member_type: VOTER last_known_addr { host: "127.4.172.62" port: 36045 } } peers { permanent_uuid: "b8523780db2546d582e8872c0a74aac4" member_type: VOTER last_known_addr { host: "127.4.172.61" port: 37983 } } peers { permanent_uuid: "c6f2b89ee5244beeaaa2db11be25f552" member_type: VOTER last_known_addr { host: "127.4.172.60" port: 40569 } } }
02:04:24.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:24.506685  5668 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6f2b89ee5244beeaaa2db11be25f552 [sys.catalog]: This master's current role is: FOLLOWER
02:04:24.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:24.511722  5658 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6f2b89ee5244beeaaa2db11be25f552 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b8523780db2546d582e8872c0a74aac4. Latest consensus state: current_term: 2 leader_uuid: "b8523780db2546d582e8872c0a74aac4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed926c19a2c045aa8dde57409b7638fc" member_type: VOTER last_known_addr { host: "127.4.172.62" port: 36045 } } peers { permanent_uuid: "b8523780db2546d582e8872c0a74aac4" member_type: VOTER last_known_addr { host: "127.4.172.61" port: 37983 } } peers { permanent_uuid: "c6f2b89ee5244beeaaa2db11be25f552" member_type: VOTER last_known_addr { host: "127.4.172.60" port: 40569 } } }
02:04:24.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:24.512523  5658 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6f2b89ee5244beeaaa2db11be25f552 [sys.catalog]: This master's current role is: FOLLOWER
02:04:24.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:24.531450  5673 catalog_manager.cc:1294] Loaded cluster ID: ce43e541935c409f9ce78ec60053a02d
02:04:24.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:24.532038  5673 catalog_manager.cc:1587] T 00000000000000000000000000000000 P c6f2b89ee5244beeaaa2db11be25f552: loading cluster ID for follower catalog manager: success
02:04:24.533 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 6da76b905c764e518ed89b5004b493c7 for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
02:04:24.533 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=6da76b905c764e518ed89b5004b493c7@[3b4884da27c64e099240e577c795c0e4(127.4.172.3:39281),a25d9c881e7a43b3abaacad5670175de(127.4.172.1:34313),f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077)[L]]}]
02:04:24.534 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=6da76b905c764e518ed89b5004b493c7, attempt=6, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=145), Traces: [0ms] sending RPC to server f71ad43707cf454ea1cd4a0b13449671, [6ms] received response from server f71ad43707cf454ea1cd4a0b13449671: Network error: Failed to connect to peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077): Connection refused: /127.4.172.2:42077, [7ms] delaying RPC due to: Network error: Failed to connect to peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077): Connection refused: /127.4.172.2:42077, [19ms] refreshing cache from master, [20ms] Sub RPC GetTableLocations: sending RPC to server master-127.4.172.60:40569, [57ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [58ms] Sub RPC GetTableLocations: received response from server master-127.4.172.60:40569: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [60ms] Sub RPC GetTableLocations: refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.172.60:40569, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.172.61:37983, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.172.62:36045, [63ms] Sub RPC ConnectToMaster: received response from server master-127.4.172.60:40569: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [66ms] Sub RPC ConnectToMaster: received response from server master-127.4.172.61:37983: OK, [67ms] Sub RPC ConnectToMaster: received response from server master-127.4.172.62:36045: OK, [68ms] Sub RPC GetTableLocations: sending RPC to server master-127.4.172.61:37983, [72ms] Sub RPC GetTableLocations: received response from server master-127.4.172.61:37983: OK, [75ms] sending RPC to server f71ad43707cf454ea1cd4a0b13449671, [77ms] received response from server f71ad43707cf454ea1cd4a0b13449671: Network error: Failed to connect to peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077): Connection refused: /127.4.172.2:42077, [78ms] delaying RPC due to: Network error: Failed to connect to peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077): Connection refused: /127.4.172.2:42077, [99ms] refreshing cache from master, [99ms] Sub RPC GetTableLocations: sending RPC to server master-127.4.172.61:37983, [104ms] Sub RPC GetTableLocations: received response from server master-127.4.172.61:37983: OK, [107ms] sending RPC to server f71ad43707cf454ea1cd4a0b13449671, [114ms] received response from server f71ad43707cf454ea1cd4a0b13449671: Network error: Failed to connect to peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077): Connection refused: /127.4.172.2:42077, [115ms] delaying RPC due to: Network error: Failed to connect to peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077): Connection refused: /127.4.172.2:42077, [140ms] refreshing cache from master, [140ms] Sub RPC GetTableLocations: sending RPC to server master-127.4.172.61:37983, [144ms] Sub RPC GetTableLocations: received response from server master-127.4.172.61:37983: OK, deferred=Deferred@1514149274(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$238/0x00007fa390336f90@d7fdfbf -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@186634334 after retry RPC@1857032168) -> (continuation of Deferred@1040293692 after retry RPC@2142467758), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@7897736e -> wakeup thread Time-limited test -> (continuation of Deferred@186634334 after retry RPC@1857032168) -> (continuation of Deferred@1040293692 after retry RPC@2142467758))) after lookup
02:04:24.537 [DEBUG - kudu-nio-1] (Connection.java:748) [peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077)] connecting to peer
02:04:24.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:24.540639  5673 catalog_manager.cc:1609] T 00000000000000000000000000000000 P c6f2b89ee5244beeaaa2db11be25f552: acquiring CA information for follower catalog manager: success
02:04:24.546 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077): Connection refused: /127.4.172.2:42077
02:04:24.547 [DEBUG - kudu-nio-0] (Connection.java:709) [peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077)] cleaning up while in state CONNECTING due to: Failed to connect to peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077): Connection refused: /127.4.172.2:42077
02:04:24.547 [INFO - kudu-nio-0] (AsyncKuduClient.java:2355) Invalidating location f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077) for tablet 6da76b905c764e518ed89b5004b493c7: Failed to connect to peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077): Connection refused: /127.4.172.2:42077
02:04:24.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:24.547149  5673 catalog_manager.cc:1637] T 00000000000000000000000000000000 P c6f2b89ee5244beeaaa2db11be25f552: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
02:04:24.615 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 6da76b905c764e518ed89b5004b493c7 for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
02:04:24.616 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=6da76b905c764e518ed89b5004b493c7@[3b4884da27c64e099240e577c795c0e4(127.4.172.3:39281),a25d9c881e7a43b3abaacad5670175de(127.4.172.1:34313),f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077)[L]]}]
02:04:24.616 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=6da76b905c764e518ed89b5004b493c7, attempt=8, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=228), Traces: [0ms] sending RPC to server f71ad43707cf454ea1cd4a0b13449671, [6ms] received response from server f71ad43707cf454ea1cd4a0b13449671: Network error: Failed to connect to peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077): Connection refused: /127.4.172.2:42077, [7ms] delaying RPC due to: Network error: Failed to connect to peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077): Connection refused: /127.4.172.2:42077, [19ms] refreshing cache from master, [20ms] Sub RPC GetTableLocations: sending RPC to server master-127.4.172.60:40569, [57ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [58ms] Sub RPC GetTableLocations: received response from server master-127.4.172.60:40569: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [60ms] Sub RPC GetTableLocations: refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.172.60:40569, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.172.61:37983, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.172.62:36045, [63ms] Sub RPC ConnectToMaster: received response from server master-127.4.172.60:40569: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [66ms] Sub RPC ConnectToMaster: received response from server master-127.4.172.61:37983: OK, [67ms] Sub RPC ConnectToMaster: received response from server master-127.4.172.62:36045: OK, [68ms] Sub RPC GetTableLocations: sending RPC to server master-127.4.172.61:37983, [72ms] Sub RPC GetTableLocations: received response from server master-127.4.172.61:37983: OK, [75ms] sending RPC to server f71ad43707cf454ea1cd4a0b13449671, [77ms] received response from server f71ad43707cf454ea1cd4a0b13449671: Network error: Failed to connect to peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077): Connection refused: /127.4.172.2:42077, [78ms] delaying RPC due to: Network error: Failed to connect to peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077): Connection refused: /127.4.172.2:42077, [99ms] refreshing cache from master, [99ms] Sub RPC GetTableLocations: sending RPC to server master-127.4.172.61:37983, [104ms] Sub RPC GetTableLocations: received response from server master-127.4.172.61:37983: OK, [107ms] sending RPC to server f71ad43707cf454ea1cd4a0b13449671, [114ms] received response from server f71ad43707cf454ea1cd4a0b13449671: Network error: Failed to connect to peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077): Connection refused: /127.4.172.2:42077, [115ms] delaying RPC due to: Network error: Failed to connect to peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077): Connection refused: /127.4.172.2:42077, [140ms] refreshing cache from master, [140ms] Sub RPC GetTableLocations: sending RPC to server master-127.4.172.61:37983, [144ms] Sub RPC GetTableLocations: received response from server master-127.4.172.61:37983: OK, [148ms] sending RPC to server f71ad43707cf454ea1cd4a0b13449671, [159ms] received response from server f71ad43707cf454ea1cd4a0b13449671: Network error: Failed to connect to peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077): Connection refused: /127.4.172.2:42077, [159ms] delaying RPC due to: Network error: Failed to connect to peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077): Connection refused: /127.4.172.2:42077, [220ms] refreshing cache from master, [220ms] Sub RPC GetTableLocations: sending RPC to server master-127.4.172.61:37983, [227ms] Sub RPC GetTableLocations: received response from server master-127.4.172.61:37983: OK, deferred=Deferred@1514149274(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$238/0x00007fa390336f90@d7fdfbf -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@186634334 after retry RPC@1857032168) -> (continuation of Deferred@1040293692 after retry RPC@2142467758) -> (continuation of Deferred@11384336 after retry RPC@1691334317), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@7897736e -> wakeup thread Time-limited test -> (continuation of Deferred@186634334 after retry RPC@1857032168) -> (continuation of Deferred@1040293692 after retry RPC@2142467758) -> (continuation of Deferred@11384336 after retry RPC@1691334317))) after lookup
02:04:24.617 [DEBUG - kudu-nio-1] (Connection.java:748) [peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077)] connecting to peer
02:04:24.618 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077): Connection refused: /127.4.172.2:42077
02:04:24.619 [DEBUG - kudu-nio-1] (Connection.java:709) [peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077)] cleaning up while in state CONNECTING due to: Failed to connect to peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077): Connection refused: /127.4.172.2:42077
02:04:24.619 [INFO - kudu-nio-1] (AsyncKuduClient.java:2355) Invalidating location f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077) for tablet 6da76b905c764e518ed89b5004b493c7: Failed to connect to peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077): Connection refused: /127.4.172.2:42077
02:04:24.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:24.638201  5212 heartbeater.cc:499] Master 127.4.172.61:37983 was elected leader, sending a full tablet report...
02:04:24.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:24.668457  5498 heartbeater.cc:499] Master 127.4.172.61:37983 was elected leader, sending a full tablet report...
02:04:24.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:24.693742  5213 heartbeater.cc:344] Connected to a master server at 127.4.172.60:40569
02:04:24.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:24.700289  5615 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "a25d9c881e7a43b3abaacad5670175de" instance_seqno: 1779069856773384) as {username='slave'} at 127.4.172.1:34111; Asking this server to re-register.
02:04:24.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:24.701946  5213 heartbeater.cc:461] Registering TS with master...
02:04:24.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:24.705687  5615 ts_manager.cc:194] Registered new tserver with Master: a25d9c881e7a43b3abaacad5670175de (127.4.172.1:34313)
02:04:24.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:24.713708  5499 heartbeater.cc:344] Connected to a master server at 127.4.172.60:40569
02:04:24.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:24.716361  5615 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "3b4884da27c64e099240e577c795c0e4" instance_seqno: 1779069860835113) as {username='slave'} at 127.4.172.3:58329; Asking this server to re-register.
02:04:24.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:24.717476  5499 heartbeater.cc:461] Registering TS with master...
02:04:24.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:24.719950  5615 ts_manager.cc:194] Registered new tserver with Master: 3b4884da27c64e099240e577c795c0e4 (127.4.172.3:39281)
02:04:24.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:24.869467  5578 sys_catalog.cc:455] T 00000000000000000000000000000000 P b8523780db2546d582e8872c0a74aac4 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "b8523780db2546d582e8872c0a74aac4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed926c19a2c045aa8dde57409b7638fc" member_type: VOTER last_known_addr { host: "127.4.172.62" port: 36045 } } peers { permanent_uuid: "b8523780db2546d582e8872c0a74aac4" member_type: VOTER last_known_addr { host: "127.4.172.61" port: 37983 } } peers { permanent_uuid: "c6f2b89ee5244beeaaa2db11be25f552" member_type: VOTER last_known_addr { host: "127.4.172.60" port: 40569 } } }
02:04:24.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:24.870163  5578 sys_catalog.cc:458] T 00000000000000000000000000000000 P b8523780db2546d582e8872c0a74aac4 [sys.catalog]: This master's current role is: LEADER
02:04:25.052 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 6da76b905c764e518ed89b5004b493c7 for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
02:04:25.052 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=6da76b905c764e518ed89b5004b493c7@[3b4884da27c64e099240e577c795c0e4(127.4.172.3:39281),a25d9c881e7a43b3abaacad5670175de(127.4.172.1:34313),f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077)[L]]}]
02:04:25.053 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=6da76b905c764e518ed89b5004b493c7, attempt=10, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=664), Traces: [0ms] sending RPC to server f71ad43707cf454ea1cd4a0b13449671, [6ms] received response from server f71ad43707cf454ea1cd4a0b13449671: Network error: Failed to connect to peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077): Connection refused: /127.4.172.2:42077, [7ms] delaying RPC due to: Network error: Failed to connect to peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077): Connection refused: /127.4.172.2:42077, [19ms] refreshing cache from master, [20ms] Sub RPC GetTableLocations: sending RPC to server master-127.4.172.60:40569, [57ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [58ms] Sub RPC GetTableLocations: received response from server master-127.4.172.60:40569: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [60ms] Sub RPC GetTableLocations: refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.172.60:40569, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.172.61:37983, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.172.62:36045, [63ms] Sub RPC ConnectToMaster: received response from server master-127.4.172.60:40569: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [66ms] Sub RPC ConnectToMaster: received response from server master-127.4.172.61:37983: OK, [67ms] Sub RPC ConnectToMaster: received response from server master-127.4.172.62:36045: OK, [68ms] Sub RPC GetTableLocations: sending RPC to server master-127.4.172.61:37983, [72ms] Sub RPC GetTableLocations: received response from server master-127.4.172.61:37983: OK, [75ms] sending RPC to server f71ad43707cf454ea1cd4a0b13449671, [77ms] received response from server f71ad43707cf454ea1cd4a0b13449671: Network error: Failed to connect to peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077): Connection refused: /127.4.172.2:42077, [78ms] delaying RPC due to: Network error: Failed to connect to peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077): Connection refused: /127.4.172.2:42077, [99ms] refreshing cache from master, [99ms] Sub RPC GetTableLocations: sending RPC to server master-127.4.172.61:37983, [104ms] Sub RPC GetTableLocations: received response from server master-127.4.172.61:37983: OK, [107ms] sending RPC to server f71ad43707cf454ea1cd4a0b13449671, [114ms] received response from server f71ad43707cf454ea1cd4a0b13449671: Network error: Failed to connect to peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077): Connection refused: /127.4.172.2:42077, [115ms] delaying RPC due to: Network error: Failed to connect to peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077): Connection refused: /127.4.172.2:42077, [140ms] refreshing cache from master, [140ms] Sub RPC GetTableLocations: sending RPC to server master-127.4.172.61:37983, [144ms] Sub RPC GetTableLocations: received response from server master-127.4.172.61:37983: OK, [148ms] sending RPC to server f71ad43707cf454ea1cd4a0b13449671, [159ms] received response from server f71ad43707cf454ea1cd4a0b13449671: Network error: Failed to connect to peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077): Connection refused: /127.4.172.2:42077, [159ms] delaying RPC due to: Network error: Failed to connect to peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077): Connection refused: /127.4.172.2:42077, [220ms] refreshing cache from master, [220ms] Sub RPC GetTableLocations: sending RPC to server master-127.4.172.61:37983, [227ms] Sub RPC GetTableLocations: received response from server master-127.4.172.61:37983: OK, [229ms] sending RPC to server f71ad43707cf454ea1cd4a0b13449671, [231ms] received response from server f71ad43707cf454ea1cd4a0b13449671: Network error: Failed to connect to peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077): Connection refused: /127.4.172.2:42077, [231ms] delaying RPC due to: Network error: Failed to connect to peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077): Connection refused: /127.4.172.2:42077, [659ms] refreshing cache from master, [660ms] Sub RPC GetTableLocations: sending RPC to server master-127.4.172.61:37983, [663ms] Sub RPC GetTableLocations: received response from server master-127.4.172.61:37983: OK, deferred=Deferred@1514149274(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$238/0x00007fa390336f90@d7fdfbf -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@186634334 after retry RPC@1857032168) -> (continuation of Deferred@1040293692 after retry RPC@2142467758) -> (continuation of Deferred@11384336 after retry RPC@1691334317) -> (continuation of Deferred@897675305 after retry RPC@218093623), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@7897736e -> wakeup thread Time-limited test -> (continuation of Deferred@186634334 after retry RPC@1857032168) -> (continuation of Deferred@1040293692 after retry RPC@2142467758) -> (continuation of Deferred@11384336 after retry RPC@1691334317) -> (continuation of Deferred@897675305 after retry RPC@218093623))) after lookup
02:04:25.054 [DEBUG - kudu-nio-1] (Connection.java:748) [peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077)] connecting to peer
02:04:25.055 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077): Connection refused: /127.4.172.2:42077
02:04:25.055 [DEBUG - kudu-nio-2] (Connection.java:709) [peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077)] cleaning up while in state CONNECTING due to: Failed to connect to peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077): Connection refused: /127.4.172.2:42077
02:04:25.056 [INFO - kudu-nio-2] (AsyncKuduClient.java:2355) Invalidating location f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077) for tablet 6da76b905c764e518ed89b5004b493c7: Failed to connect to peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077): Connection refused: /127.4.172.2:42077
02:04:25.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:25.365033  5684 raft_consensus.cc:493] T 6da76b905c764e518ed89b5004b493c7 P a25d9c881e7a43b3abaacad5670175de [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f71ad43707cf454ea1cd4a0b13449671)
02:04:25.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:25.365728  5684 raft_consensus.cc:515] T 6da76b905c764e518ed89b5004b493c7 P a25d9c881e7a43b3abaacad5670175de [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f71ad43707cf454ea1cd4a0b13449671" member_type: VOTER last_known_addr { host: "127.4.172.2" port: 42077 } } peers { permanent_uuid: "3b4884da27c64e099240e577c795c0e4" member_type: VOTER last_known_addr { host: "127.4.172.3" port: 39281 } } peers { permanent_uuid: "a25d9c881e7a43b3abaacad5670175de" member_type: VOTER last_known_addr { host: "127.4.172.1" port: 34313 } }
02:04:25.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:25.375041  5684 leader_election.cc:290] T 6da76b905c764e518ed89b5004b493c7 P a25d9c881e7a43b3abaacad5670175de [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f71ad43707cf454ea1cd4a0b13449671 (127.4.172.2:42077), 3b4884da27c64e099240e577c795c0e4 (127.4.172.3:39281)
02:04:25.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:25.398187  5103 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.172.2:42077: connect: Connection refused (error 111)
02:04:25.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:25.409147  5453 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da76b905c764e518ed89b5004b493c7" candidate_uuid: "a25d9c881e7a43b3abaacad5670175de" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "3b4884da27c64e099240e577c795c0e4" is_pre_election: true
02:04:25.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:25.414811  5103 leader_election.cc:336] T 6da76b905c764e518ed89b5004b493c7 P a25d9c881e7a43b3abaacad5670175de [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f71ad43707cf454ea1cd4a0b13449671 (127.4.172.2:42077): Network error: Client connection negotiation failed: client connection to 127.4.172.2:42077: connect: Connection refused (error 111)
02:04:25.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:25.415284  5103 leader_election.cc:304] T 6da76b905c764e518ed89b5004b493c7 P a25d9c881e7a43b3abaacad5670175de [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a25d9c881e7a43b3abaacad5670175de; no voters: 3b4884da27c64e099240e577c795c0e4, f71ad43707cf454ea1cd4a0b13449671
02:04:25.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:25.416115  5684 raft_consensus.cc:2749] T 6da76b905c764e518ed89b5004b493c7 P a25d9c881e7a43b3abaacad5670175de [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
02:04:25.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:25.762687  5689 raft_consensus.cc:493] T 6da76b905c764e518ed89b5004b493c7 P 3b4884da27c64e099240e577c795c0e4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f71ad43707cf454ea1cd4a0b13449671)
02:04:25.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:25.763087  5689 raft_consensus.cc:515] T 6da76b905c764e518ed89b5004b493c7 P 3b4884da27c64e099240e577c795c0e4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f71ad43707cf454ea1cd4a0b13449671" member_type: VOTER last_known_addr { host: "127.4.172.2" port: 42077 } } peers { permanent_uuid: "3b4884da27c64e099240e577c795c0e4" member_type: VOTER last_known_addr { host: "127.4.172.3" port: 39281 } } peers { permanent_uuid: "a25d9c881e7a43b3abaacad5670175de" member_type: VOTER last_known_addr { host: "127.4.172.1" port: 34313 } }
02:04:25.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:25.765415  5689 leader_election.cc:290] T 6da76b905c764e518ed89b5004b493c7 P 3b4884da27c64e099240e577c795c0e4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f71ad43707cf454ea1cd4a0b13449671 (127.4.172.2:42077), a25d9c881e7a43b3abaacad5670175de (127.4.172.1:34313)
02:04:25.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:25.770717  5389 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.172.2:42077: connect: Connection refused (error 111)
02:04:25.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:25.775662  5389 leader_election.cc:336] T 6da76b905c764e518ed89b5004b493c7 P 3b4884da27c64e099240e577c795c0e4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f71ad43707cf454ea1cd4a0b13449671 (127.4.172.2:42077): Network error: Client connection negotiation failed: client connection to 127.4.172.2:42077: connect: Connection refused (error 111)
02:04:25.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:25.781224  5166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da76b905c764e518ed89b5004b493c7" candidate_uuid: "3b4884da27c64e099240e577c795c0e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "a25d9c881e7a43b3abaacad5670175de" is_pre_election: true
02:04:25.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:25.781880  5166 raft_consensus.cc:2468] T 6da76b905c764e518ed89b5004b493c7 P a25d9c881e7a43b3abaacad5670175de [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3b4884da27c64e099240e577c795c0e4 in term 1.
02:04:25.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:25.783155  5388 leader_election.cc:304] T 6da76b905c764e518ed89b5004b493c7 P 3b4884da27c64e099240e577c795c0e4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b4884da27c64e099240e577c795c0e4, a25d9c881e7a43b3abaacad5670175de; no voters: f71ad43707cf454ea1cd4a0b13449671
02:04:25.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:25.783915  5689 raft_consensus.cc:2804] T 6da76b905c764e518ed89b5004b493c7 P 3b4884da27c64e099240e577c795c0e4 [term 1 FOLLOWER]: Leader pre-election won for term 2
02:04:25.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:25.784292  5689 raft_consensus.cc:493] T 6da76b905c764e518ed89b5004b493c7 P 3b4884da27c64e099240e577c795c0e4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f71ad43707cf454ea1cd4a0b13449671)
02:04:25.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:25.784534  5689 raft_consensus.cc:3060] T 6da76b905c764e518ed89b5004b493c7 P 3b4884da27c64e099240e577c795c0e4 [term 1 FOLLOWER]: Advancing to term 2
02:04:25.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:25.789019  5689 raft_consensus.cc:515] T 6da76b905c764e518ed89b5004b493c7 P 3b4884da27c64e099240e577c795c0e4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f71ad43707cf454ea1cd4a0b13449671" member_type: VOTER last_known_addr { host: "127.4.172.2" port: 42077 } } peers { permanent_uuid: "3b4884da27c64e099240e577c795c0e4" member_type: VOTER last_known_addr { host: "127.4.172.3" port: 39281 } } peers { permanent_uuid: "a25d9c881e7a43b3abaacad5670175de" member_type: VOTER last_known_addr { host: "127.4.172.1" port: 34313 } }
02:04:25.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:25.790511  5689 leader_election.cc:290] T 6da76b905c764e518ed89b5004b493c7 P 3b4884da27c64e099240e577c795c0e4 [CANDIDATE]: Term 2 election: Requested vote from peers f71ad43707cf454ea1cd4a0b13449671 (127.4.172.2:42077), a25d9c881e7a43b3abaacad5670175de (127.4.172.1:34313)
02:04:25.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:25.791636  5166 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6da76b905c764e518ed89b5004b493c7" candidate_uuid: "3b4884da27c64e099240e577c795c0e4" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "a25d9c881e7a43b3abaacad5670175de"
02:04:25.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:25.792209  5166 raft_consensus.cc:3060] T 6da76b905c764e518ed89b5004b493c7 P a25d9c881e7a43b3abaacad5670175de [term 1 FOLLOWER]: Advancing to term 2
02:04:25.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:25.794896  5389 leader_election.cc:336] T 6da76b905c764e518ed89b5004b493c7 P 3b4884da27c64e099240e577c795c0e4 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer f71ad43707cf454ea1cd4a0b13449671 (127.4.172.2:42077): Network error: Client connection negotiation failed: client connection to 127.4.172.2:42077: connect: Connection refused (error 111)
02:04:25.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:25.797518  5166 raft_consensus.cc:2468] T 6da76b905c764e518ed89b5004b493c7 P a25d9c881e7a43b3abaacad5670175de [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3b4884da27c64e099240e577c795c0e4 in term 2.
02:04:25.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:25.798413  5388 leader_election.cc:304] T 6da76b905c764e518ed89b5004b493c7 P 3b4884da27c64e099240e577c795c0e4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3b4884da27c64e099240e577c795c0e4, a25d9c881e7a43b3abaacad5670175de; no voters: f71ad43707cf454ea1cd4a0b13449671
02:04:25.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:25.799052  5689 raft_consensus.cc:2804] T 6da76b905c764e518ed89b5004b493c7 P 3b4884da27c64e099240e577c795c0e4 [term 2 FOLLOWER]: Leader election won for term 2
02:04:25.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:25.800807  5689 raft_consensus.cc:697] T 6da76b905c764e518ed89b5004b493c7 P 3b4884da27c64e099240e577c795c0e4 [term 2 LEADER]: Becoming Leader. State: Replica: 3b4884da27c64e099240e577c795c0e4, State: Running, Role: LEADER
02:04:25.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:25.801903  5689 consensus_queue.cc:237] T 6da76b905c764e518ed89b5004b493c7 P 3b4884da27c64e099240e577c795c0e4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 1.11, Last appended by leader: 11, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f71ad43707cf454ea1cd4a0b13449671" member_type: VOTER last_known_addr { host: "127.4.172.2" port: 42077 } } peers { permanent_uuid: "3b4884da27c64e099240e577c795c0e4" member_type: VOTER last_known_addr { host: "127.4.172.3" port: 39281 } } peers { permanent_uuid: "a25d9c881e7a43b3abaacad5670175de" member_type: VOTER last_known_addr { host: "127.4.172.1" port: 34313 } }
02:04:25.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:25.812652  4904 catalog_manager.cc:5696] T 6da76b905c764e518ed89b5004b493c7 P 3b4884da27c64e099240e577c795c0e4 reported cstate change: term changed from 1 to 2, leader changed from f71ad43707cf454ea1cd4a0b13449671 (127.4.172.2) to 3b4884da27c64e099240e577c795c0e4 (127.4.172.3). New cstate: current_term: 2 leader_uuid: "3b4884da27c64e099240e577c795c0e4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f71ad43707cf454ea1cd4a0b13449671" member_type: VOTER last_known_addr { host: "127.4.172.2" port: 42077 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3b4884da27c64e099240e577c795c0e4" member_type: VOTER last_known_addr { host: "127.4.172.3" port: 39281 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a25d9c881e7a43b3abaacad5670175de" member_type: VOTER last_known_addr { host: "127.4.172.1" port: 34313 } health_report { overall_health: UNKNOWN } } }
02:04:26.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:26.207010  4860 debug-util.cc:398] Leaking SignalData structure 0x7b0800070060 after lost signal to thread 4797
02:04:26.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:26.207693  4860 debug-util.cc:398] Leaking SignalData structure 0x7b08000b2320 after lost signal to thread 4863
02:04:26.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:26.208042  5166 raft_consensus.cc:1275] T 6da76b905c764e518ed89b5004b493c7 P a25d9c881e7a43b3abaacad5670175de [term 2 FOLLOWER]: Refusing update from remote peer 3b4884da27c64e099240e577c795c0e4: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 2 index: 12. (index mismatch)
02:04:26.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:26.209673  5689 consensus_queue.cc:1048] T 6da76b905c764e518ed89b5004b493c7 P 3b4884da27c64e099240e577c795c0e4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a25d9c881e7a43b3abaacad5670175de" member_type: VOTER last_known_addr { host: "127.4.172.1" port: 34313 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
02:04:26.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:26.210852  5389 consensus_peers.cc:597] T 6da76b905c764e518ed89b5004b493c7 P 3b4884da27c64e099240e577c795c0e4 -> Peer f71ad43707cf454ea1cd4a0b13449671 (127.4.172.2:42077): Couldn't send request to peer f71ad43707cf454ea1cd4a0b13449671. Status: Network error: Client connection negotiation failed: client connection to 127.4.172.2:42077: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
02:04:26.632 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 6da76b905c764e518ed89b5004b493c7 for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
02:04:26.632 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=6da76b905c764e518ed89b5004b493c7@[3b4884da27c64e099240e577c795c0e4(127.4.172.3:39281)[L],a25d9c881e7a43b3abaacad5670175de(127.4.172.1:34313),f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077)]}]
02:04:26.633 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=6da76b905c764e518ed89b5004b493c7, attempt=12, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=2245), Traces: [0ms] sending RPC to server f71ad43707cf454ea1cd4a0b13449671, [6ms] received response from server f71ad43707cf454ea1cd4a0b13449671: Network error: Failed to connect to peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077): Connection refused: /127.4.172.2:42077, [7ms] delaying RPC due to: Network error: Failed to connect to peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077): Connection refused: /127.4.172.2:42077, [19ms] refreshing cache from master, [20ms] Sub RPC GetTableLocations: sending RPC to server master-127.4.172.60:40569, [57ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [58ms] Sub RPC GetTableLocations: received response from server master-127.4.172.60:40569: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [60ms] Sub RPC GetTableLocations: refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.172.60:40569, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.172.61:37983, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.4.172.62:36045, [63ms] Sub RPC ConnectToMaster: received response from server master-127.4.172.60:40569: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [66ms] Sub RPC ConnectToMaster: received response from server master-127.4.172.61:37983: OK, [67ms] Sub RPC ConnectToMaster: received response from server master-127.4.172.62:36045: OK, [68ms] Sub RPC GetTableLocations: sending RPC to server master-127.4.172.61:37983, [72ms] Sub RPC GetTableLocations: received response from server master-127.4.172.61:37983: OK, [75ms] sending RPC to server f71ad43707cf454ea1cd4a0b13449671, [77ms] received response from server f71ad43707cf454ea1cd4a0b13449671: Network error: Failed to connect to peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077): Connection refused: /127.4.172.2:42077, [78ms] delaying RPC due to: Network error: Failed to connect to peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077): Connection refused: /127.4.172.2:42077, [99ms] refreshing cache from master, [99ms] Sub RPC GetTableLocations: sending RPC to server master-127.4.172.61:37983, [104ms] Sub RPC GetTableLocations: received response from server master-127.4.172.61:37983: OK, [107ms] sending RPC to server f71ad43707cf454ea1cd4a0b13449671, [114ms] received response from server f71ad43707cf454ea1cd4a0b13449671: Network error: Failed to connect to peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077): Connection refused: /127.4.172.2:42077, [115ms] delaying RPC due to: Network error: Failed to connect to peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077): Connection refused: /127.4.172.2:42077, [140ms] refreshing cache from master, [140ms] Sub RPC GetTableLocations: sending RPC to server master-127.4.172.61:37983, [144ms] Sub RPC GetTableLocations: received response from server master-127.4.172.61:37983: OK, [148ms] sending RPC to server f71ad43707cf454ea1cd4a0b13449671, [159ms] received response from server f71ad43707cf454ea1cd4a0b13449671: Network error: Failed to connect to peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077): Connection refused: /127.4.172.2:42077, [159ms] delaying RPC due to: Network error: Failed to connect to peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077): Connection refused: /127.4.172.2:42077, [220ms] refreshing cache from master, [220ms] Sub RPC GetTableLocations: sending RPC to server master-127.4.172.61:37983, [227ms] Sub RPC GetTableLocations: received response from server master-127.4.172.61:37983: OK, [229ms] sending RPC to server f71ad43707cf454ea1cd4a0b13449671, [231ms] received response from server f71ad43707cf454ea1cd4a0b13449671: Network error: Failed to connect to peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077): Connection refused: /127.4.172.2:42077, [231ms] delaying RPC due to: Network error: Failed to connect to peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077): Connection refused: /127.4.172.2:42077, [659ms] refreshing cache from master, [660ms] Sub RPC GetTableLocations: sending RPC to server master-127.4.172.61:37983, [663ms] Sub RPC GetTableLocations: received response from server master-127.4.172.61:37983: OK, [665ms] sending RPC to server f71ad43707cf454ea1cd4a0b13449671, [667ms] received response from server f71ad43707cf454ea1cd4a0b13449671: Network error: Failed to connect to peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077): Connection refused: /127.4.172.2:42077, [668ms] delaying RPC due to: Network error: Failed to connect to peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077): Connection refused: /127.4.172.2:42077, [2240ms] refreshing cache from master, [2240ms] Sub RPC GetTableLocations: sending RPC to server master-127.4.172.61:37983, [2244ms] Sub RPC GetTableLocations: received response from server master-127.4.172.61:37983: OK, deferred=Deferred@1514149274(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$238/0x00007fa390336f90@d7fdfbf -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@186634334 after retry RPC@1857032168) -> (continuation of Deferred@1040293692 after retry RPC@2142467758) -> (continuation of Deferred@11384336 after retry RPC@1691334317) -> (continuation of Deferred@897675305 after retry RPC@218093623) -> (continuation of Deferred@909874748 after retry RPC@1148702380), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@7897736e -> wakeup thread Time-limited test -> (continuation of Deferred@186634334 after retry RPC@1857032168) -> (continuation of Deferred@1040293692 after retry RPC@2142467758) -> (continuation of Deferred@11384336 after retry RPC@1691334317) -> (continuation of Deferred@897675305 after retry RPC@218093623) -> (continuation of Deferred@909874748 after retry RPC@1148702380))) after lookup
02:04:26.634 [DEBUG - kudu-nio-1] (Connection.java:748) [peer 3b4884da27c64e099240e577c795c0e4(127.4.172.3:39281)] connecting to peer
02:04:26.635 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 3b4884da27c64e099240e577c795c0e4(127.4.172.3:39281)] Successfully connected to peer
02:04:26.658 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x8c8a515a, L:/127.0.0.1:60596 - R:/127.4.172.3:39281] using TOKEN/null
02:04:26.824 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 20 rows, more = false) for scanner KuduScanner(table=org.apache.kudu.client.TestClientFailoverSupport-RESTART, tablet=6da76b905c764e518ed89b5004b493c7, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
02:04:26.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:26.827112  4904 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44614:
02:04:26.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "org.apache.kudu.client.TestClientFailoverSupport-RESTART" }
02:04:26.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:26.827819  4904 catalog_manager.cc:2780] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44614:
02:04:26.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "org.apache.kudu.client.TestClientFailoverSupport-RESTART" }
02:04:26.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:26.909984  4904 catalog_manager.cc:5983] T 00000000000000000000000000000000 P b8523780db2546d582e8872c0a74aac4: Sending DeleteTablet for 3 replicas of tablet 6da76b905c764e518ed89b5004b493c7
02:04:26.930 [DEBUG - main] (Connection.java:575) [peer master-127.4.172.60:40569(127.4.172.60:40569)] disconnecting while in state READY
02:04:26.930 [DEBUG - main] (Connection.java:575) [peer 3b4884da27c64e099240e577c795c0e4(127.4.172.3:39281)] disconnecting while in state READY
02:04:26.931 [DEBUG - main] (Connection.java:575) [peer master-127.4.172.61:37983(127.4.172.61:37983)] disconnecting while in state READY
02:04:26.931 [DEBUG - main] (Connection.java:575) [peer f71ad43707cf454ea1cd4a0b13449671(127.4.172.2:42077)] disconnecting while in state TERMINATED
02:04:26.931 [DEBUG - main] (Connection.java:575) [peer master-127.4.172.62:36045(127.4.172.62:36045)] disconnecting while in state READY
02:04:26.933 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 3b4884da27c64e099240e577c795c0e4(127.4.172.3:39281)] handling channelInactive
02:04:26.933 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 3b4884da27c64e099240e577c795c0e4(127.4.172.3:39281)] cleaning up while in state READY due to: connection closed
02:04:26.934 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.4.172.62:36045(127.4.172.62:36045)] handling channelInactive
02:04:26.934 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.4.172.62:36045(127.4.172.62:36045)] cleaning up while in state READY due to: connection closed
02:04:26.941 [DEBUG - kudu-nio-5] (Connection.java:239) [peer master-127.4.172.60:40569(127.4.172.60:40569)] handling channelInactive
02:04:26.941 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.4.172.60:40569(127.4.172.60:40569)] cleaning up while in state READY due to: connection closed
02:04:26.945 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
02:04:26.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:26.947470  4891 catalog_manager.cc:4754] TS f71ad43707cf454ea1cd4a0b13449671 (127.4.172.2:42077): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 6da76b905c764e518ed89b5004b493c7: Network error: Client connection negotiation failed: client connection to 127.4.172.2:42077: connect: Connection refused (error 111)
02:04:26.948 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.4.172.61:37983(127.4.172.61:37983)] handling channelInactive
02:04:26.948 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.4.172.61:37983(127.4.172.61:37983)] cleaning up while in state READY due to: connection closed
02:04:26.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:26.948899  4784 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskvuyF4C/build/tsan/bin/kudu with pid 5081
02:04:26.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:26.978008  5433 tablet_service.cc:1558] Processing DeleteTablet for tablet 6da76b905c764e518ed89b5004b493c7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-05-18 02:04:26 UTC) from {username='slave'} at 127.0.0.1:60606
02:04:26.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:26.995028  5729 tablet_replica.cc:333] T 6da76b905c764e518ed89b5004b493c7 P 3b4884da27c64e099240e577c795c0e4: stopping tablet replica
02:04:27.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:26.996374  5729 raft_consensus.cc:2243] T 6da76b905c764e518ed89b5004b493c7 P 3b4884da27c64e099240e577c795c0e4 [term 2 LEADER]: Raft consensus shutting down.
02:04:27.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:26.998332  5725 negotiation.cc:336] Failed RPC negotiation. Trace:
02:04:27.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0518 02:04:26.956540 (+     0us) reactor.cc:678] Submitting negotiation task for client connection to 127.4.172.1:34313 (local address 127.0.0.1:53372)
02:04:27.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0518 02:04:26.957877 (+  1337us) negotiation.cc:107] Waiting for socket to connect
02:04:27.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0518 02:04:26.957922 (+    45us) client_negotiation.cc:175] Beginning negotiation
02:04:27.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0518 02:04:26.958220 (+   298us) client_negotiation.cc:253] Sending NEGOTIATE NegotiatePB request
02:04:27.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0518 02:04:26.997299 (+ 39079us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.4.172.1:34313: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
02:04:27.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"client-negotiator.queue_time_us":764}
02:04:27.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:26.998356  5729 raft_consensus.cc:2272] T 6da76b905c764e518ed89b5004b493c7 P 3b4884da27c64e099240e577c795c0e4 [term 2 FOLLOWER]: Raft consensus is shut down!
02:04:27.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:27.001744  5729 ts_tablet_manager.cc:1916] T 6da76b905c764e518ed89b5004b493c7 P 3b4884da27c64e099240e577c795c0e4: Deleting tablet data with delete state TABLET_DATA_DELETED
02:04:27.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:27.006278  4784 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskvuyF4C/build/tsan/bin/kudu with pid 5365
02:04:27.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:27.045697  4784 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskvuyF4C/build/tsan/bin/kudu with pid 4796
02:04:27.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:27.070353  4784 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskvuyF4C/build/tsan/bin/kudu with pid 4866
02:04:27.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:27.100245  4784 external_mini_cluster.cc:1658] Killing /tmp/dist-test-taskvuyF4C/build/tsan/bin/kudu with pid 5557
02:04:28.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T02:04:28Z chronyd exiting

Time: 43.849

OK (2 tests)

