JUnit version 4.13.2
.14:05:46.872 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1783519546863
14:05:46.904 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
14:05:46.962 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
14:05:46.974 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskM8Xy4F/test-tmp
14:05:46.979 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
14:05:46.982 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskM8Xy4F/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
14:05:47.184 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: true
  cluster_root: "/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497"
  extra_master_flags: "--webserver_require_spnego=false"
  extra_tserver_flags: "--webserver_require_spnego=false"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

14:05:47.362 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
14:05:47.363 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

14:05:47.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:47.369180 11082 mini_oidc.cc:150] Starting JWKS server
14:05:47.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:47.373240 11082 webserver.cc:533] Webserver started at http://127.0.0.1:38757/ using document root <none> and password file <none>
14:05:47.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:47.373824 11082 mini_oidc.cc:186] Starting OIDC Discovery server
14:05:47.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:47.375890 11082 webserver.cc:533] Webserver started at http://127.0.0.1:35965/ using document root <none> and password file <none>
14:05:47.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Loading random data
14:05:47.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Initializing database '/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/krb5kdc/principal' for realm 'KRBTEST.COM',
14:05:47.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master key name 'K/M@KRBTEST.COM'
14:05:47.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 08 14:05:47 dist-test-slave-h3x3 krb5kdc[11093](info): setting up network...
14:05:47.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
14:05:47.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 08 14:05:47 dist-test-slave-h3x3 krb5kdc[11093](info): set up 2 sockets
14:05:47.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 08 14:05:47 dist-test-slave-h3x3 krb5kdc[11093](info): commencing operation
14:05:47.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) krb5kdc: starting...
14:05:49.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:49.448956 11082 mini_kdc.cc:121] Time spent starting KDC: real 2.034s	user 0.006s	sys 0.011s
14:05:49.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
14:05:49.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal slave/admin@KRBTEST.COM with password.
14:05:49.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "test-admin@KRBTEST.COM" created.
14:05:49.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
14:05:49.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal slave/admin@KRBTEST.COM with password.
14:05:49.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "test-user@KRBTEST.COM" created.
14:05:49.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
14:05:49.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal slave/admin@KRBTEST.COM with password.
14:05:49.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "joe-interloper@KRBTEST.COM" created.
14:05:49.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal slave/admin@KRBTEST.COM with password.
14:05:49.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/krb5kdc/test-user.keytab.
14:05:49.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/krb5kdc/test-user.keytab.
14:05:49.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 08 14:05:49 dist-test-slave-h3x3 krb5kdc[11093](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1783519549, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
14:05:49.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Password for test-admin@KRBTEST.COM: 
14:05:49.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T14:05:49Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
14:05:49.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T14:05:49Z Disabled control of system clock
14:05:49.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for kudu/127.10.210.190@KRBTEST.COM; defaulting to no policy
14:05:49.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
14:05:49.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "kudu/127.10.210.190@KRBTEST.COM" created.
14:05:49.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
14:05:49.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.10.210.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/krb5kdc/kudu.keytab.
14:05:49.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.10.210.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/krb5kdc/kudu.keytab.
14:05:49.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for HTTP/127.10.210.190@KRBTEST.COM; defaulting to no policy
14:05:49.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
14:05:49.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "HTTP/127.10.210.190@KRBTEST.COM" created.
14:05:49.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
14:05:49.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.10.210.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/krb5kdc/kudu.keytab.
14:05:49.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.10.210.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/krb5kdc/kudu.keytab.
14:05:49.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:49.660800 11082 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskM8Xy4F/build/tsan/bin/kudu
14:05:49.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskM8Xy4F/build/tsan/bin/kudu
14:05:49.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/master-0/wal
14:05:49.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/master-0/data
14:05:49.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:05:49.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:05:49.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:05:49.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:05:49.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:05:49.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:05:49.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/master-0/logs
14:05:49.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/master-0/data/info.pb
14:05:49.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:05:49.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:05:49.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:05:49.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:05:49.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:05:49.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:05:49.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:05:49.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:05:49.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
14:05:49.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:05:49.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:05:49.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:05:49.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.10.210.190:45057
14:05:49.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.10.210.190
14:05:49.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:05:49.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/krb5kdc/kudu.keytab
14:05:49.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.10.210.190
14:05:49.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
14:05:49.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=test-admin
14:05:49.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=test-user
14:05:49.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=true
14:05:49.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.10.210.148:43957
14:05:49.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:05:49.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:05:49.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:05:49.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:05:49.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.10.210.190:45057,127.10.210.189:36029,127.10.210.188:34571
14:05:49.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:05:49.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:38757/jwks.json
14:05:49.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=false with env {KRB5CCNAME=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
14:05:49.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:49.958105 11109 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:05:49.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:49.958801 11109 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:05:49.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:49.959688 11109 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:05:49.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:49.992388 11109 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
14:05:49.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:49.992878 11109 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:05:49.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:49.993211 11109 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
14:05:49.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:49.993566 11109 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
14:05:49.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:49.993930 11109 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
14:05:49.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:49.994236 11109 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:38757/jwks.json
14:05:50.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.032686 11109 master_runner.cc:387] Master server non-default flags:
14:05:50.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:05:50.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.10.210.148:43957
14:05:50.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:05:50.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:05:50.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/master-0/data
14:05:50.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/master-0/wal
14:05:50.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:05:50.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.10.210.190:45057,127.10.210.189:36029,127.10.210.188:34571
14:05:50.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/krb5kdc/kudu.keytab
14:05:50.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.10.210.190
14:05:50.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:05:50.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:05:50.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:05:50.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.10.210.190:45057
14:05:50.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:05:50.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:05:50.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:05:50.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:38757/jwks.json
14:05:50.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
14:05:50.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=<redacted>
14:05:50.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=<redacted>
14:05:50.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:05:50.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:05:50.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/master-0/data/info.pb
14:05:50.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.10.210.190
14:05:50.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:05:50.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:05:50.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:05:50.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:05:50.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:05:50.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:05:50.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/master-0/logs
14:05:50.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:05:50.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:05:50.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:05:50.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
14:05:50.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:05:50.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
14:05:50.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:05:50.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 13:43:23 UTC on e7f111948823
14:05:50.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12775
14:05:50.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:05:50.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.034376 11109 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:05:50.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.035817 11109 file_cache.cc:504] Constructed file cache file cache with capacity 419430
14:05:50.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:50.049039 11115 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:05:51.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:51.453277 11114 debug-util.cc:398] Leaking SignalData structure 0x7b0800037100 after lost signal to thread 11109
14:05:51.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:51.856099 11114 kernel_stack_watchdog.cc:198] Thread 11109 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 398ms:
14:05:51.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
14:05:51.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
14:05:51.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
14:05:51.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
14:05:51.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:50.050943 11116 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:05:51.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:51.857034 11109 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.805s	user 0.000s	sys 0.002s
14:05:51.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:51.857429 11109 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.805s	user 0.000s	sys 0.002s
14:05:51.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:51.860277 11119 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:05:51.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:51.862294 11117 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1811 milliseconds
14:05:51.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:51.862300 11109 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:05:51.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:51.863741 11109 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:05:51.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:51.866288 11109 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:05:51.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:51.867662 11109 hybrid_clock.cc:648] HybridClock initialized: now 1783519551867623 us; error 33 us; skew 500 ppm
14:05:51.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:51.868698 11109 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:05:51.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 08 14:05:51 dist-test-slave-h3x3 krb5kdc[11093](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1783519551, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.210.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
14:05:51.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:51.877336 11109 init.cc:377] Logged in from keytab as kudu/127.10.210.190@KRBTEST.COM (short username kudu)
14:05:51.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:51.883044 11109 webserver.cc:533] Webserver started at http://127.10.210.190:35769/ using document root <none> and password file <none>
14:05:51.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:51.884212 11109 fs_manager.cc:362] Metadata directory not provided
14:05:51.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:51.884470 11109 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:05:51.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:51.885057 11109 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:05:51.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:51.889437 11109 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/master-0/data/instance:
14:05:51.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d6ea2bb847a645ababe9466f05e915a6"
14:05:51.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:05:51 on dist-test-slave-h3x3"
14:05:51.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:51.890894 11109 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/master-0/wal/instance:
14:05:51.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d6ea2bb847a645ababe9466f05e915a6"
14:05:51.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:05:51 on dist-test-slave-h3x3"
14:05:51.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:51.898741 11109 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.002s	sys 0.005s
14:05:51.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:51.904156 11126 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:05:51.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:51.905292 11109 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.001s
14:05:51.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:51.905575 11109 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/master-0/data,/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/master-0/wal
14:05:51.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d6ea2bb847a645ababe9466f05e915a6"
14:05:51.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:05:51 on dist-test-slave-h3x3"
14:05:51.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:51.905895 11109 fs_report.cc:389] FS layout report
14:05:51.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:05:51.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/master-0/wal
14:05:51.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/master-0/wal
14:05:51.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/master-0/data/data
14:05:51.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:05:51.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:05:51.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:05:51.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:05:51.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:05:51.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:05:51.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:05:51.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:05:51.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:05:51.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:05:51.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:05:51.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:51.960333 11109 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:05:51.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:51.965749 11109 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:05:51.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:51.966213 11109 kserver.cc:163] Server-wide thread pool size limit: 3276
14:05:52.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:52.037146 11109 rpc_server.cc:307] RPC server started. Bound to: 127.10.210.190:45057
14:05:52.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:52.037184 11177 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.210.190:45057 every 8 connection(s)
14:05:52.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:52.039865 11109 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/master-0/data/info.pb
14:05:52.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:52.043457 11082 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskM8Xy4F/build/tsan/bin/kudu as pid 11109
14:05:52.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:52.043920 11082 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/master-0/wal/instance
14:05:52.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:52.046026 11178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
14:05:52.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:52.057216 11178 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.210.190" port: 45057 } has no permanent_uuid. Determining permanent_uuid...
14:05:52.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for kudu/127.10.210.189@KRBTEST.COM; defaulting to no policy
14:05:52.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
14:05:52.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "kudu/127.10.210.189@KRBTEST.COM" created.
14:05:52.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 08 14:05:52 dist-test-slave-h3x3 krb5kdc[11093](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1783519551, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.210.190@KRBTEST.COM for kudu/127.10.210.190@KRBTEST.COM
14:05:52.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
14:05:52.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.10.210.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/krb5kdc/kudu.keytab.
14:05:52.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.10.210.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/krb5kdc/kudu.keytab.
14:05:52.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:52.095304 11178 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.210.189" port: 36029 } has no permanent_uuid. Determining permanent_uuid...
14:05:52.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:52.098215 11130 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.210.189:36029: connect: Connection refused (error 111)
14:05:52.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for HTTP/127.10.210.189@KRBTEST.COM; defaulting to no policy
14:05:52.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
14:05:52.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "HTTP/127.10.210.189@KRBTEST.COM" created.
14:05:52.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:52.102681 11178 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.210.189:36029: Network error: Client connection negotiation failed: client connection to 127.10.210.189:36029: connect: Connection refused (error 111)
14:05:52.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
14:05:52.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.10.210.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/krb5kdc/kudu.keytab.
14:05:52.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.10.210.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/krb5kdc/kudu.keytab.
14:05:52.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:52.123457 11082 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskM8Xy4F/build/tsan/bin/kudu
14:05:52.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskM8Xy4F/build/tsan/bin/kudu
14:05:52.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/master-1/wal
14:05:52.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/master-1/data
14:05:52.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:05:52.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:05:52.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:05:52.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:05:52.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:05:52.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:05:52.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/master-1/logs
14:05:52.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/master-1/data/info.pb
14:05:52.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:05:52.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:05:52.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:05:52.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:05:52.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:05:52.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:05:52.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:05:52.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:05:52.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
14:05:52.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:05:52.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:05:52.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:05:52.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.10.210.189:36029
14:05:52.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.10.210.189
14:05:52.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:05:52.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/krb5kdc/kudu.keytab
14:05:52.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.10.210.189
14:05:52.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
14:05:52.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=test-admin
14:05:52.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=test-user
14:05:52.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=true
14:05:52.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.10.210.148:43957
14:05:52.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:05:52.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:05:52.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:05:52.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:05:52.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.10.210.190:45057,127.10.210.189:36029,127.10.210.188:34571
14:05:52.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:05:52.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:38757/jwks.json
14:05:52.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=false with env {KRB5CCNAME=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
14:05:52.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:52.152205 11178 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.210.189" port: 36029 } attempt: 1
14:05:52.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:52.156845 11178 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.210.189:36029: Network error: Client connection negotiation failed: client connection to 127.10.210.189:36029: connect: Connection refused (error 111)
14:05:52.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:52.225239 11178 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.210.189" port: 36029 } attempt: 2
14:05:52.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:52.229821 11178 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.210.189:36029: Network error: Client connection negotiation failed: client connection to 127.10.210.189:36029: connect: Connection refused (error 111)
14:05:52.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:52.321283 11178 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.210.189" port: 36029 } attempt: 3
14:05:52.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:52.326102 11178 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.210.189:36029: Network error: Client connection negotiation failed: client connection to 127.10.210.189:36029: connect: Connection refused (error 111)
14:05:52.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:52.430608 11187 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:05:52.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:52.431382 11187 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:05:52.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:52.432250 11187 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:05:52.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:52.464908 11187 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
14:05:52.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:52.465410 11187 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:05:52.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:52.465744 11187 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
14:05:52.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:52.466137 11187 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
14:05:52.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:52.466581 11187 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
14:05:52.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:52.466869 11187 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:38757/jwks.json
14:05:52.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:52.469483 11178 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.210.189" port: 36029 } attempt: 4
14:05:52.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:52.473711 11178 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.210.189:36029: Network error: Client connection negotiation failed: client connection to 127.10.210.189:36029: connect: Connection refused (error 111)
14:05:52.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:52.505381 11187 master_runner.cc:387] Master server non-default flags:
14:05:52.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:05:52.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.10.210.148:43957
14:05:52.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:05:52.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:05:52.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/master-1/data
14:05:52.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/master-1/wal
14:05:52.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:05:52.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.10.210.190:45057,127.10.210.189:36029,127.10.210.188:34571
14:05:52.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/krb5kdc/kudu.keytab
14:05:52.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.10.210.189
14:05:52.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:05:52.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:05:52.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:05:52.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.10.210.189:36029
14:05:52.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:05:52.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:05:52.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:05:52.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:38757/jwks.json
14:05:52.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
14:05:52.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=<redacted>
14:05:52.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=<redacted>
14:05:52.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:05:52.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:05:52.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/master-1/data/info.pb
14:05:52.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.10.210.189
14:05:52.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:05:52.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:05:52.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:05:52.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:05:52.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:05:52.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:05:52.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/master-1/logs
14:05:52.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:05:52.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:05:52.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:05:52.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
14:05:52.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:05:52.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
14:05:52.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:05:52.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 13:43:23 UTC on e7f111948823
14:05:52.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12775
14:05:52.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:05:52.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:52.507077 11187 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:05:52.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:52.508569 11187 file_cache.cc:504] Constructed file cache file cache with capacity 419430
14:05:52.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:52.522899 11193 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:05:52.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:52.773133 11178 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.210.189" port: 36029 } attempt: 5
14:05:52.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:52.780303 11178 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.210.189:36029: Network error: Client connection negotiation failed: client connection to 127.10.210.189:36029: connect: Connection refused (error 111)
14:05:53.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:53.327847 11178 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.210.189" port: 36029 } attempt: 6
14:05:53.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:53.338186 11178 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.210.189:36029: Network error: Client connection negotiation failed: client connection to 127.10.210.189:36029: connect: Connection refused (error 111)
14:05:53.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:52.524084 11194 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:05:53.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:53.725979 11187 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 1.204s	user 0.475s	sys 0.727s
14:05:53.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:53.726315 11187 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 1.205s	user 0.477s	sys 0.727s
14:05:53.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:53.727800 11187 server_base.cc:1061] running on GCE node
14:05:53.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:53.729638 11200 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:05:53.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:53.730906 11187 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:05:53.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:53.733445 11187 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:05:53.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:53.734819 11187 hybrid_clock.cc:648] HybridClock initialized: now 1783519553734780 us; error 41 us; skew 500 ppm
14:05:53.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:53.735718 11187 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:05:53.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 08 14:05:53 dist-test-slave-h3x3 krb5kdc[11093](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1783519553, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.210.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
14:05:53.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:53.742844 11187 init.cc:377] Logged in from keytab as kudu/127.10.210.189@KRBTEST.COM (short username kudu)
14:05:53.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:53.757143 11187 webserver.cc:533] Webserver started at http://127.10.210.189:41849/ using document root <none> and password file <none>
14:05:53.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:53.758311 11187 fs_manager.cc:362] Metadata directory not provided
14:05:53.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:53.758586 11187 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:05:53.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:53.759119 11187 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:05:53.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:53.763469 11187 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/master-1/data/instance:
14:05:53.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "7d961010c6d84eeaa356026bd3ef2160"
14:05:53.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:05:53 on dist-test-slave-h3x3"
14:05:53.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:53.764474 11187 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/master-1/wal/instance:
14:05:53.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "7d961010c6d84eeaa356026bd3ef2160"
14:05:53.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:05:53 on dist-test-slave-h3x3"
14:05:53.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:53.772264 11187 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.004s	sys 0.004s
14:05:53.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:53.778139 11206 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:05:53.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:53.779265 11187 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.001s
14:05:53.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:53.779538 11187 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/master-1/data,/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/master-1/wal
14:05:53.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "7d961010c6d84eeaa356026bd3ef2160"
14:05:53.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:05:53 on dist-test-slave-h3x3"
14:05:53.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:53.779829 11187 fs_report.cc:389] FS layout report
14:05:53.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:05:53.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/master-1/wal
14:05:53.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/master-1/wal
14:05:53.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/master-1/data/data
14:05:53.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:05:53.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:05:53.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:05:53.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:05:53.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:05:53.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:05:53.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:05:53.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:05:53.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:05:53.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:05:53.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:05:53.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:53.847048 11187 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:05:53.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:53.858227 11187 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:05:53.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:53.858639 11187 kserver.cc:163] Server-wide thread pool size limit: 3276
14:05:53.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:53.927353 11187 rpc_server.cc:307] RPC server started. Bound to: 127.10.210.189:36029
14:05:53.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:53.927449 11257 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.210.189:36029 every 8 connection(s)
14:05:53.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:53.930025 11187 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/master-1/data/info.pb
14:05:53.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:53.935655 11258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
14:05:53.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:53.938645 11082 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskM8Xy4F/build/tsan/bin/kudu as pid 11187
14:05:53.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:53.939127 11082 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/master-1/wal/instance
14:05:53.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:53.946450 11258 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.210.190" port: 45057 } has no permanent_uuid. Determining permanent_uuid...
14:05:53.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for kudu/127.10.210.188@KRBTEST.COM; defaulting to no policy
14:05:53.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
14:05:53.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "kudu/127.10.210.188@KRBTEST.COM" created.
14:05:53.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 08 14:05:53 dist-test-slave-h3x3 krb5kdc[11093](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1783519553, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.210.189@KRBTEST.COM for kudu/127.10.210.190@KRBTEST.COM
14:05:53.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:53.982743 11258 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.210.189" port: 36029 } has no permanent_uuid. Determining permanent_uuid...
14:05:53.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
14:05:53.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.10.210.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/krb5kdc/kudu.keytab.
14:05:53.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.10.210.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/krb5kdc/kudu.keytab.
14:05:53.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 08 14:05:53 dist-test-slave-h3x3 krb5kdc[11093](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1783519553, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.210.189@KRBTEST.COM for kudu/127.10.210.189@KRBTEST.COM
14:05:54.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for HTTP/127.10.210.188@KRBTEST.COM; defaulting to no policy
14:05:54.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
14:05:54.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "HTTP/127.10.210.188@KRBTEST.COM" created.
14:05:54.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:54.009543 11258 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.210.188" port: 34571 } has no permanent_uuid. Determining permanent_uuid...
14:05:54.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:54.012048 11210 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.10.210.188:34571: connect: Connection refused (error 111)
14:05:54.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:54.016332 11258 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.210.188:34571: Network error: Client connection negotiation failed: client connection to 127.10.210.188:34571: connect: Connection refused (error 111)
14:05:54.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
14:05:54.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.10.210.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/krb5kdc/kudu.keytab.
14:05:54.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.10.210.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/krb5kdc/kudu.keytab.
14:05:54.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:54.024150 11082 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskM8Xy4F/build/tsan/bin/kudu
14:05:54.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskM8Xy4F/build/tsan/bin/kudu
14:05:54.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/master-2/wal
14:05:54.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/master-2/data
14:05:54.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:05:54.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:05:54.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:05:54.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:05:54.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:05:54.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:05:54.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/master-2/logs
14:05:54.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/master-2/data/info.pb
14:05:54.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:05:54.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:05:54.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:05:54.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:05:54.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:05:54.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:05:54.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:05:54.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:05:54.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
14:05:54.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:05:54.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:05:54.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:05:54.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.10.210.188:34571
14:05:54.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.10.210.188
14:05:54.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:05:54.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/krb5kdc/kudu.keytab
14:05:54.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.10.210.188
14:05:54.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
14:05:54.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=test-admin
14:05:54.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=test-user
14:05:54.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=true
14:05:54.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.10.210.148:43957
14:05:54.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:05:54.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:05:54.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:05:54.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:05:54.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.10.210.190:45057,127.10.210.189:36029,127.10.210.188:34571
14:05:54.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:05:54.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:38757/jwks.json
14:05:54.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=false with env {KRB5CCNAME=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
14:05:54.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:54.065762 11258 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.210.188" port: 34571 } attempt: 1
14:05:54.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:54.070596 11258 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.210.188:34571: Network error: Client connection negotiation failed: client connection to 127.10.210.188:34571: connect: Connection refused (error 111)
14:05:54.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:54.138983 11258 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.210.188" port: 34571 } attempt: 2
14:05:54.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:54.143669 11258 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.210.188:34571: Network error: Client connection negotiation failed: client connection to 127.10.210.188:34571: connect: Connection refused (error 111)
14:05:54.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:54.235038 11258 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.210.188" port: 34571 } attempt: 3
14:05:54.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:54.239351 11258 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.210.188:34571: Network error: Client connection negotiation failed: client connection to 127.10.210.188:34571: connect: Connection refused (error 111)
14:05:54.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:54.326925 11268 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:05:54.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:54.327643 11268 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:05:54.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:54.328411 11268 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:05:54.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:54.360102 11268 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
14:05:54.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:54.360587 11268 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:05:54.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:54.360951 11268 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
14:05:54.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:54.361333 11268 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
14:05:54.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:54.361738 11268 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
14:05:54.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:54.361986 11268 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:38757/jwks.json
14:05:54.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:54.382766 11258 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.210.188" port: 34571 } attempt: 4
14:05:54.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:54.387061 11258 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.210.188:34571: Network error: Client connection negotiation failed: client connection to 127.10.210.188:34571: connect: Connection refused (error 111)
14:05:54.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:54.398715 11178 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.210.189" port: 36029 } attempt: 7
14:05:54.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:54.402731 11268 master_runner.cc:387] Master server non-default flags:
14:05:54.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:05:54.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.10.210.148:43957
14:05:54.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:05:54.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:05:54.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/master-2/data
14:05:54.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/master-2/wal
14:05:54.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:05:54.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.10.210.190:45057,127.10.210.189:36029,127.10.210.188:34571
14:05:54.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/krb5kdc/kudu.keytab
14:05:54.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.10.210.188
14:05:54.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:05:54.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:05:54.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:05:54.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.10.210.188:34571
14:05:54.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:05:54.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:05:54.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:05:54.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:38757/jwks.json
14:05:54.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
14:05:54.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=<redacted>
14:05:54.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=<redacted>
14:05:54.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:05:54.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:05:54.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/master-2/data/info.pb
14:05:54.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.10.210.188
14:05:54.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:05:54.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:05:54.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:05:54.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:05:54.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:05:54.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:05:54.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/master-2/logs
14:05:54.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:05:54.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:05:54.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:05:54.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
14:05:54.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:05:54.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
14:05:54.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:05:54.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 13:43:23 UTC on e7f111948823
14:05:54.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12775
14:05:54.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:05:54.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:54.404496 11268 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:05:54.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:54.405830 11268 file_cache.cc:504] Constructed file cache file cache with capacity 419430
14:05:54.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 08 14:05:54 dist-test-slave-h3x3 krb5kdc[11093](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1783519551, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.210.190@KRBTEST.COM for kudu/127.10.210.189@KRBTEST.COM
14:05:54.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:54.421414 11276 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:05:54.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:54.427839 11178 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.210.188" port: 34571 } has no permanent_uuid. Determining permanent_uuid...
14:05:54.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:54.436483 11178 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.210.188:34571: Network error: Client connection negotiation failed: client connection to 127.10.210.188:34571: connect: Connection refused (error 111)
14:05:54.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:54.494930 11178 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.210.188" port: 34571 } attempt: 1
14:05:54.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:54.499157 11178 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.210.188:34571: Network error: Client connection negotiation failed: client connection to 127.10.210.188:34571: connect: Connection refused (error 111)
14:05:54.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:54.580606 11178 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.210.188" port: 34571 } attempt: 2
14:05:54.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:54.587726 11178 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.210.188:34571: Network error: Client connection negotiation failed: client connection to 127.10.210.188:34571: connect: Connection refused (error 111)
14:05:54.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:54.673342 11178 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.210.188" port: 34571 } attempt: 3
14:05:54.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:54.680282 11178 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.210.188:34571: Network error: Client connection negotiation failed: client connection to 127.10.210.188:34571: connect: Connection refused (error 111)
14:05:54.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:54.697222 11258 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.210.188" port: 34571 } attempt: 5
14:05:54.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:54.705574 11258 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.210.188:34571: Network error: Client connection negotiation failed: client connection to 127.10.210.188:34571: connect: Connection refused (error 111)
14:05:54.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:54.820851 11178 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.210.188" port: 34571 } attempt: 4
14:05:54.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:54.828120 11178 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.210.188:34571: Network error: Client connection negotiation failed: client connection to 127.10.210.188:34571: connect: Connection refused (error 111)
14:05:55.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:55.111640 11178 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.210.188" port: 34571 } attempt: 5
14:05:55.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:55.118734 11178 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.210.188:34571: Network error: Client connection negotiation failed: client connection to 127.10.210.188:34571: connect: Connection refused (error 111)
14:05:55.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:55.253142 11258 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.210.188" port: 34571 } attempt: 6
14:05:55.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:55.266455 11258 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.210.188:34571: Network error: Client connection negotiation failed: client connection to 127.10.210.188:34571: connect: Connection refused (error 111)
14:05:55.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:55.671299 11178 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.210.188" port: 34571 } attempt: 6
14:05:55.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:55.679983 11178 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.10.210.188:34571: Network error: Client connection negotiation failed: client connection to 127.10.210.188:34571: connect: Connection refused (error 111)
14:05:55.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:54.423096 11275 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:05:55.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:54.425885 11278 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:05:55.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:55.710022 11277 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1281 milliseconds
14:05:55.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:55.710186 11268 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:05:55.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:55.711447 11268 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:05:55.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:55.714382 11268 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:05:55.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:55.715802 11268 hybrid_clock.cc:648] HybridClock initialized: now 1783519555715756 us; error 61 us; skew 500 ppm
14:05:55.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:55.716562 11268 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:05:55.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 08 14:05:55 dist-test-slave-h3x3 krb5kdc[11093](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1783519555, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.210.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
14:05:55.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:55.723187 11268 init.cc:377] Logged in from keytab as kudu/127.10.210.188@KRBTEST.COM (short username kudu)
14:05:55.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:55.728317 11268 webserver.cc:533] Webserver started at http://127.10.210.188:35603/ using document root <none> and password file <none>
14:05:55.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:55.729506 11268 fs_manager.cc:362] Metadata directory not provided
14:05:55.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:55.729802 11268 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:05:55.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:55.730463 11268 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:05:55.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:55.736548 11268 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/master-2/data/instance:
14:05:55.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "2ab7747eab764321be260729421b1f20"
14:05:55.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:05:55 on dist-test-slave-h3x3"
14:05:55.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:55.738085 11268 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/master-2/wal/instance:
14:05:55.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "2ab7747eab764321be260729421b1f20"
14:05:55.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:05:55 on dist-test-slave-h3x3"
14:05:55.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:55.747829 11268 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.005s	sys 0.003s
14:05:55.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:55.753193 11291 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:05:55.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:55.754523 11268 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
14:05:55.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:55.754828 11268 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/master-2/data,/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/master-2/wal
14:05:55.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "2ab7747eab764321be260729421b1f20"
14:05:55.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:05:55 on dist-test-slave-h3x3"
14:05:55.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:55.755110 11268 fs_report.cc:389] FS layout report
14:05:55.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:05:55.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/master-2/wal
14:05:55.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/master-2/wal
14:05:55.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/master-2/data/data
14:05:55.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:05:55.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:05:55.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:05:55.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:05:55.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:05:55.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:05:55.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:05:55.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:05:55.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:05:55.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:05:55.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:05:55.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:55.806980 11268 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:05:55.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:55.812083 11268 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:05:55.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:55.812568 11268 kserver.cc:163] Server-wide thread pool size limit: 3276
14:05:55.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:55.882702 11268 rpc_server.cc:307] RPC server started. Bound to: 127.10.210.188:34571
14:05:55.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:55.882773 11342 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.210.188:34571 every 8 connection(s)
14:05:55.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:55.885206 11268 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/master-2/data/info.pb
14:05:55.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:55.891041 11343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
14:05:55.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:55.894412 11082 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskM8Xy4F/build/tsan/bin/kudu as pid 11268
14:05:55.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:55.894752 11082 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/master-2/wal/instance
14:05:55.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:55.902945 11343 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.210.190" port: 45057 } has no permanent_uuid. Determining permanent_uuid...
14:05:55.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 08 14:05:55 dist-test-slave-h3x3 krb5kdc[11093](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1783519549, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.210.190@KRBTEST.COM
14:05:55.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 08 14:05:55 dist-test-slave-h3x3 krb5kdc[11093](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1783519555, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.210.188@KRBTEST.COM for kudu/127.10.210.190@KRBTEST.COM
14:05:55.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:55.949867 11343 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.210.189" port: 36029 } has no permanent_uuid. Determining permanent_uuid...
14:05:55.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 08 14:05:55 dist-test-slave-h3x3 krb5kdc[11093](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1783519549, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.210.189@KRBTEST.COM
14:05:55.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 08 14:05:55 dist-test-slave-h3x3 krb5kdc[11093](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1783519555, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.210.188@KRBTEST.COM for kudu/127.10.210.189@KRBTEST.COM
14:05:55.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 08 14:05:55 dist-test-slave-h3x3 krb5kdc[11093](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1783519549, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.210.188@KRBTEST.COM
14:05:55.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:55.972645 11343 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.10.210.188" port: 34571 } has no permanent_uuid. Determining permanent_uuid...
14:05:55.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 08 14:05:55 dist-test-slave-h3x3 krb5kdc[11093](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1783519555, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.210.188@KRBTEST.COM for kudu/127.10.210.188@KRBTEST.COM
14:05:56.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.004573 11343 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ab7747eab764321be260729421b1f20: Bootstrap starting.
14:05:56.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.011117 11343 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2ab7747eab764321be260729421b1f20: Neither blocks nor log segments found. Creating new log.
14:05:56.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.013091 11343 log.cc:826] T 00000000000000000000000000000000 P 2ab7747eab764321be260729421b1f20: Log is configured to *not* fsync() on all Append() calls
14:05:56.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.018842 11343 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2ab7747eab764321be260729421b1f20: No bootstrap required, opened a new log
14:05:56.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.037789 11343 raft_consensus.cc:359] T 00000000000000000000000000000000 P 2ab7747eab764321be260729421b1f20 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6ea2bb847a645ababe9466f05e915a6" member_type: VOTER last_known_addr { host: "127.10.210.190" port: 45057 } } peers { permanent_uuid: "7d961010c6d84eeaa356026bd3ef2160" member_type: VOTER last_known_addr { host: "127.10.210.189" port: 36029 } } peers { permanent_uuid: "2ab7747eab764321be260729421b1f20" member_type: VOTER last_known_addr { host: "127.10.210.188" port: 34571 } }
14:05:56.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.038544 11343 raft_consensus.cc:385] T 00000000000000000000000000000000 P 2ab7747eab764321be260729421b1f20 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:05:56.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.038856 11343 raft_consensus.cc:740] T 00000000000000000000000000000000 P 2ab7747eab764321be260729421b1f20 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ab7747eab764321be260729421b1f20, State: Initialized, Role: FOLLOWER
14:05:56.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.039848 11343 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2ab7747eab764321be260729421b1f20 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6ea2bb847a645ababe9466f05e915a6" member_type: VOTER last_known_addr { host: "127.10.210.190" port: 45057 } } peers { permanent_uuid: "7d961010c6d84eeaa356026bd3ef2160" member_type: VOTER last_known_addr { host: "127.10.210.189" port: 36029 } } peers { permanent_uuid: "2ab7747eab764321be260729421b1f20" member_type: VOTER last_known_addr { host: "127.10.210.188" port: 34571 } }
14:05:56.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.044341 11354 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ab7747eab764321be260729421b1f20 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6ea2bb847a645ababe9466f05e915a6" member_type: VOTER last_known_addr { host: "127.10.210.190" port: 45057 } } peers { permanent_uuid: "7d961010c6d84eeaa356026bd3ef2160" member_type: VOTER last_known_addr { host: "127.10.210.189" port: 36029 } } peers { permanent_uuid: "2ab7747eab764321be260729421b1f20" member_type: VOTER last_known_addr { host: "127.10.210.188" port: 34571 } } }
14:05:56.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.044955 11343 sys_catalog.cc:565] T 00000000000000000000000000000000 P 2ab7747eab764321be260729421b1f20 [sys.catalog]: configured and running, proceeding with master startup.
14:05:56.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.045445 11354 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ab7747eab764321be260729421b1f20 [sys.catalog]: This master's current role is: FOLLOWER
14:05:56.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.054210 11354 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2ab7747eab764321be260729421b1f20 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:05:56.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.055002 11354 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2ab7747eab764321be260729421b1f20 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6ea2bb847a645ababe9466f05e915a6" member_type: VOTER last_known_addr { host: "127.10.210.190" port: 45057 } } peers { permanent_uuid: "7d961010c6d84eeaa356026bd3ef2160" member_type: VOTER last_known_addr { host: "127.10.210.189" port: 36029 } } peers { permanent_uuid: "2ab7747eab764321be260729421b1f20" member_type: VOTER last_known_addr { host: "127.10.210.188" port: 34571 } }
14:05:56.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.058149 11354 leader_election.cc:290] T 00000000000000000000000000000000 P 2ab7747eab764321be260729421b1f20 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d6ea2bb847a645ababe9466f05e915a6 (127.10.210.190:45057), 7d961010c6d84eeaa356026bd3ef2160 (127.10.210.189:36029)
14:05:56.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:56.067499 11297 tablet.cc:2406] T 00000000000000000000000000000000 P 2ab7747eab764321be260729421b1f20: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:05:56.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:56.077639 11365 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 2ab7747eab764321be260729421b1f20: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
14:05:56.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:56.078303 11365 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
14:05:56.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.076567 11268 master_runner.cc:187] Error getting master registration for 127.10.210.190:45057: OK, instance_id { permanent_uuid: "d6ea2bb847a645ababe9466f05e915a6" instance_seqno: 1783519552016869 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
14:05:56.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.101943 11268 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
14:05:56.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.326922 11258 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.210.188" port: 34571 } attempt: 7
14:05:56.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 08 14:05:56 dist-test-slave-h3x3 krb5kdc[11093](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1783519553, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.210.189@KRBTEST.COM for kudu/127.10.210.188@KRBTEST.COM
14:05:56.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.363459 11258 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7d961010c6d84eeaa356026bd3ef2160: Bootstrap starting.
14:05:56.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.370651 11258 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7d961010c6d84eeaa356026bd3ef2160: Neither blocks nor log segments found. Creating new log.
14:05:56.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.373302 11258 log.cc:826] T 00000000000000000000000000000000 P 7d961010c6d84eeaa356026bd3ef2160: Log is configured to *not* fsync() on all Append() calls
14:05:56.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.378371 11258 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7d961010c6d84eeaa356026bd3ef2160: No bootstrap required, opened a new log
14:05:56.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.405064 11258 raft_consensus.cc:359] T 00000000000000000000000000000000 P 7d961010c6d84eeaa356026bd3ef2160 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6ea2bb847a645ababe9466f05e915a6" member_type: VOTER last_known_addr { host: "127.10.210.190" port: 45057 } } peers { permanent_uuid: "7d961010c6d84eeaa356026bd3ef2160" member_type: VOTER last_known_addr { host: "127.10.210.189" port: 36029 } } peers { permanent_uuid: "2ab7747eab764321be260729421b1f20" member_type: VOTER last_known_addr { host: "127.10.210.188" port: 34571 } }
14:05:56.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.405893 11258 raft_consensus.cc:385] T 00000000000000000000000000000000 P 7d961010c6d84eeaa356026bd3ef2160 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:05:56.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.406220 11258 raft_consensus.cc:740] T 00000000000000000000000000000000 P 7d961010c6d84eeaa356026bd3ef2160 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d961010c6d84eeaa356026bd3ef2160, State: Initialized, Role: FOLLOWER
14:05:56.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.407130 11258 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7d961010c6d84eeaa356026bd3ef2160 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6ea2bb847a645ababe9466f05e915a6" member_type: VOTER last_known_addr { host: "127.10.210.190" port: 45057 } } peers { permanent_uuid: "7d961010c6d84eeaa356026bd3ef2160" member_type: VOTER last_known_addr { host: "127.10.210.189" port: 36029 } } peers { permanent_uuid: "2ab7747eab764321be260729421b1f20" member_type: VOTER last_known_addr { host: "127.10.210.188" port: 34571 } }
14:05:56.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.412635 11258 sys_catalog.cc:565] T 00000000000000000000000000000000 P 7d961010c6d84eeaa356026bd3ef2160 [sys.catalog]: configured and running, proceeding with master startup.
14:05:56.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.410846 11370 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7d961010c6d84eeaa356026bd3ef2160 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6ea2bb847a645ababe9466f05e915a6" member_type: VOTER last_known_addr { host: "127.10.210.190" port: 45057 } } peers { permanent_uuid: "7d961010c6d84eeaa356026bd3ef2160" member_type: VOTER last_known_addr { host: "127.10.210.189" port: 36029 } } peers { permanent_uuid: "2ab7747eab764321be260729421b1f20" member_type: VOTER last_known_addr { host: "127.10.210.188" port: 34571 } } }
14:05:56.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.413522 11370 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7d961010c6d84eeaa356026bd3ef2160 [sys.catalog]: This master's current role is: FOLLOWER
14:05:56.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.415591 11233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2ab7747eab764321be260729421b1f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d961010c6d84eeaa356026bd3ef2160" is_pre_election: true
14:05:56.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.416765 11233 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 7d961010c6d84eeaa356026bd3ef2160 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ab7747eab764321be260729421b1f20 in term 0.
14:05:56.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.418121 11295 leader_election.cc:304] T 00000000000000000000000000000000 P 2ab7747eab764321be260729421b1f20 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ab7747eab764321be260729421b1f20, 7d961010c6d84eeaa356026bd3ef2160; no voters: 
14:05:56.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.418923 11354 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 2ab7747eab764321be260729421b1f20 [term 0 FOLLOWER]: Leader pre-election won for term 1
14:05:56.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.419358 11354 raft_consensus.cc:493] T 00000000000000000000000000000000 P 2ab7747eab764321be260729421b1f20 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:05:56.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.419718 11354 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2ab7747eab764321be260729421b1f20 [term 0 FOLLOWER]: Advancing to term 1
14:05:56.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.427389 11354 raft_consensus.cc:515] T 00000000000000000000000000000000 P 2ab7747eab764321be260729421b1f20 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6ea2bb847a645ababe9466f05e915a6" member_type: VOTER last_known_addr { host: "127.10.210.190" port: 45057 } } peers { permanent_uuid: "7d961010c6d84eeaa356026bd3ef2160" member_type: VOTER last_known_addr { host: "127.10.210.189" port: 36029 } } peers { permanent_uuid: "2ab7747eab764321be260729421b1f20" member_type: VOTER last_known_addr { host: "127.10.210.188" port: 34571 } }
14:05:56.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.436362 11354 leader_election.cc:290] T 00000000000000000000000000000000 P 2ab7747eab764321be260729421b1f20 [CANDIDATE]: Term 1 election: Requested vote from peers d6ea2bb847a645ababe9466f05e915a6 (127.10.210.190:45057), 7d961010c6d84eeaa356026bd3ef2160 (127.10.210.189:36029)
14:05:56.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.436985 11233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2ab7747eab764321be260729421b1f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d961010c6d84eeaa356026bd3ef2160"
14:05:56.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.437541 11233 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7d961010c6d84eeaa356026bd3ef2160 [term 0 FOLLOWER]: Advancing to term 1
14:05:56.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.448252 11233 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 7d961010c6d84eeaa356026bd3ef2160 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ab7747eab764321be260729421b1f20 in term 1.
14:05:56.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.449973 11295 leader_election.cc:304] T 00000000000000000000000000000000 P 2ab7747eab764321be260729421b1f20 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ab7747eab764321be260729421b1f20, 7d961010c6d84eeaa356026bd3ef2160; no voters: 
14:05:56.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.450747 11354 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 2ab7747eab764321be260729421b1f20 [term 1 FOLLOWER]: Leader election won for term 1
14:05:56.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.466207 11354 raft_consensus.cc:697] T 00000000000000000000000000000000 P 2ab7747eab764321be260729421b1f20 [term 1 LEADER]: Becoming Leader. State: Replica: 2ab7747eab764321be260729421b1f20, State: Running, Role: LEADER
14:05:56.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.467608 11354 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2ab7747eab764321be260729421b1f20 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6ea2bb847a645ababe9466f05e915a6" member_type: VOTER last_known_addr { host: "127.10.210.190" port: 45057 } } peers { permanent_uuid: "7d961010c6d84eeaa356026bd3ef2160" member_type: VOTER last_known_addr { host: "127.10.210.189" port: 36029 } } peers { permanent_uuid: "2ab7747eab764321be260729421b1f20" member_type: VOTER last_known_addr { host: "127.10.210.188" port: 34571 } }
14:05:56.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:56.469568 11381 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 7d961010c6d84eeaa356026bd3ef2160: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
14:05:56.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:56.469915 11381 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
14:05:56.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.439229 11187 master_runner.cc:187] Error getting master registration for 127.10.210.190:45057: OK, instance_id { permanent_uuid: "d6ea2bb847a645ababe9466f05e915a6" instance_seqno: 1783519552016869 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
14:05:56.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.478909 11382 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ab7747eab764321be260729421b1f20 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2ab7747eab764321be260729421b1f20. Latest consensus state: current_term: 1 leader_uuid: "2ab7747eab764321be260729421b1f20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6ea2bb847a645ababe9466f05e915a6" member_type: VOTER last_known_addr { host: "127.10.210.190" port: 45057 } } peers { permanent_uuid: "7d961010c6d84eeaa356026bd3ef2160" member_type: VOTER last_known_addr { host: "127.10.210.189" port: 36029 } } peers { permanent_uuid: "2ab7747eab764321be260729421b1f20" member_type: VOTER last_known_addr { host: "127.10.210.188" port: 34571 } } }
14:05:56.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.479671 11187 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
14:05:56.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.479622 11382 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ab7747eab764321be260729421b1f20 [sys.catalog]: This master's current role is: LEADER
14:05:56.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.492714 11385 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
14:05:56.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.498925 11385 catalog_manager.cc:1520] Initializing Kudu cluster ID...
14:05:56.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.516328 11233 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 7d961010c6d84eeaa356026bd3ef2160 [term 1 FOLLOWER]: Refusing update from remote peer 2ab7747eab764321be260729421b1f20: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
14:05:56.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.518846 11354 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 2ab7747eab764321be260729421b1f20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d961010c6d84eeaa356026bd3ef2160" member_type: VOTER last_known_addr { host: "127.10.210.189" port: 36029 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:05:56.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.541461 11370 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7d961010c6d84eeaa356026bd3ef2160 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2ab7747eab764321be260729421b1f20. Latest consensus state: current_term: 1 leader_uuid: "2ab7747eab764321be260729421b1f20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6ea2bb847a645ababe9466f05e915a6" member_type: VOTER last_known_addr { host: "127.10.210.190" port: 45057 } } peers { permanent_uuid: "7d961010c6d84eeaa356026bd3ef2160" member_type: VOTER last_known_addr { host: "127.10.210.189" port: 36029 } } peers { permanent_uuid: "2ab7747eab764321be260729421b1f20" member_type: VOTER last_known_addr { host: "127.10.210.188" port: 34571 } } }
14:05:56.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.542177 11370 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7d961010c6d84eeaa356026bd3ef2160 [sys.catalog]: This master's current role is: FOLLOWER
14:05:56.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.544591 11386 mvcc.cc:204] Tried to move back new op lower bound from 7305296103468531712 to 7305296103302823936. Current Snapshot: MvccSnapshot[applied={T|T < 7305296103468531712}]
14:05:56.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.554241 11382 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ab7747eab764321be260729421b1f20 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2ab7747eab764321be260729421b1f20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6ea2bb847a645ababe9466f05e915a6" member_type: VOTER last_known_addr { host: "127.10.210.190" port: 45057 } } peers { permanent_uuid: "7d961010c6d84eeaa356026bd3ef2160" member_type: VOTER last_known_addr { host: "127.10.210.189" port: 36029 } } peers { permanent_uuid: "2ab7747eab764321be260729421b1f20" member_type: VOTER last_known_addr { host: "127.10.210.188" port: 34571 } } }
14:05:56.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.555194 11382 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ab7747eab764321be260729421b1f20 [sys.catalog]: This master's current role is: LEADER
14:05:56.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.557020 11385 catalog_manager.cc:1383] Generated new cluster ID: 4771b8bb49db418a9a314afd0e12b9b4
14:05:56.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.557304 11385 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
14:05:56.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.564904 11370 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7d961010c6d84eeaa356026bd3ef2160 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2ab7747eab764321be260729421b1f20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6ea2bb847a645ababe9466f05e915a6" member_type: VOTER last_known_addr { host: "127.10.210.190" port: 45057 } } peers { permanent_uuid: "7d961010c6d84eeaa356026bd3ef2160" member_type: VOTER last_known_addr { host: "127.10.210.189" port: 36029 } } peers { permanent_uuid: "2ab7747eab764321be260729421b1f20" member_type: VOTER last_known_addr { host: "127.10.210.188" port: 34571 } } }
14:05:56.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.565583 11370 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7d961010c6d84eeaa356026bd3ef2160 [sys.catalog]: This master's current role is: FOLLOWER
14:05:56.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.620884 11385 catalog_manager.cc:1406] Generated new certificate authority record
14:05:56.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.623122 11385 catalog_manager.cc:1540] Loading token signing keys...
14:05:56.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.671550 11385 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 2ab7747eab764321be260729421b1f20: Generated new TSK 0
14:05:56.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.672623 11385 catalog_manager.cc:1550] Initializing in-progress tserver states...
14:05:56.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.715158 11178 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.10.210.188" port: 34571 } attempt: 7
14:05:56.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for kudu/127.10.210.129@KRBTEST.COM; defaulting to no policy
14:05:56.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
14:05:56.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "kudu/127.10.210.129@KRBTEST.COM" created.
14:05:56.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 08 14:05:56 dist-test-slave-h3x3 krb5kdc[11093](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1783519551, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.210.190@KRBTEST.COM for kudu/127.10.210.188@KRBTEST.COM
14:05:56.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
14:05:56.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.10.210.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/krb5kdc/kudu.keytab.
14:05:56.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.10.210.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/krb5kdc/kudu.keytab.
14:05:56.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.777892 11178 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6ea2bb847a645ababe9466f05e915a6: Bootstrap starting.
14:05:56.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for HTTP/127.10.210.129@KRBTEST.COM; defaulting to no policy
14:05:56.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.792953 11178 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d6ea2bb847a645ababe9466f05e915a6: Neither blocks nor log segments found. Creating new log.
14:05:56.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
14:05:56.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "HTTP/127.10.210.129@KRBTEST.COM" created.
14:05:56.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.795805 11178 log.cc:826] T 00000000000000000000000000000000 P d6ea2bb847a645ababe9466f05e915a6: Log is configured to *not* fsync() on all Append() calls
14:05:56.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.806311 11178 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d6ea2bb847a645ababe9466f05e915a6: No bootstrap required, opened a new log
14:05:56.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.834928 11178 raft_consensus.cc:359] T 00000000000000000000000000000000 P d6ea2bb847a645ababe9466f05e915a6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6ea2bb847a645ababe9466f05e915a6" member_type: VOTER last_known_addr { host: "127.10.210.190" port: 45057 } } peers { permanent_uuid: "7d961010c6d84eeaa356026bd3ef2160" member_type: VOTER last_known_addr { host: "127.10.210.189" port: 36029 } } peers { permanent_uuid: "2ab7747eab764321be260729421b1f20" member_type: VOTER last_known_addr { host: "127.10.210.188" port: 34571 } }
14:05:56.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.835753 11178 raft_consensus.cc:385] T 00000000000000000000000000000000 P d6ea2bb847a645ababe9466f05e915a6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:05:56.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.836035 11178 raft_consensus.cc:740] T 00000000000000000000000000000000 P d6ea2bb847a645ababe9466f05e915a6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d6ea2bb847a645ababe9466f05e915a6, State: Initialized, Role: FOLLOWER
14:05:56.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.837073 11178 consensus_queue.cc:260] T 00000000000000000000000000000000 P d6ea2bb847a645ababe9466f05e915a6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6ea2bb847a645ababe9466f05e915a6" member_type: VOTER last_known_addr { host: "127.10.210.190" port: 45057 } } peers { permanent_uuid: "7d961010c6d84eeaa356026bd3ef2160" member_type: VOTER last_known_addr { host: "127.10.210.189" port: 36029 } } peers { permanent_uuid: "2ab7747eab764321be260729421b1f20" member_type: VOTER last_known_addr { host: "127.10.210.188" port: 34571 } }
14:05:56.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
14:05:56.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.10.210.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/krb5kdc/kudu.keytab.
14:05:56.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.10.210.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/krb5kdc/kudu.keytab.
14:05:56.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.843369 11082 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskM8Xy4F/build/tsan/bin/kudu
14:05:56.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskM8Xy4F/build/tsan/bin/kudu
14:05:56.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/ts-0/wal
14:05:56.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/ts-0/data
14:05:56.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:05:56.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:05:56.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:05:56.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:05:56.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:05:56.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:05:56.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/ts-0/logs
14:05:56.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/ts-0/data/info.pb
14:05:56.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:05:56.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:05:56.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:05:56.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:05:56.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:05:56.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:05:56.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:05:56.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:05:56.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
14:05:56.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:05:56.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.10.210.129:0
14:05:56.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.10.210.129
14:05:56.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.10.210.129
14:05:56.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:05:56.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.10.210.190:45057,127.10.210.189:36029,127.10.210.188:34571
14:05:56.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/krb5kdc/kudu.keytab
14:05:56.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.10.210.129
14:05:56.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
14:05:56.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=test-admin
14:05:56.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=test-user
14:05:56.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=true
14:05:56.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.10.210.148:43957
14:05:56.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:05:56.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:05:56.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:05:56.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=false with env {KRB5CCNAME=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
14:05:56.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.848311 11178 sys_catalog.cc:565] T 00000000000000000000000000000000 P d6ea2bb847a645ababe9466f05e915a6 [sys.catalog]: configured and running, proceeding with master startup.
14:05:56.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.850878 11151 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d6ea2bb847a645ababe9466f05e915a6 [term 0 FOLLOWER]: Advancing to term 1
14:05:56.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.845238 11398 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6ea2bb847a645ababe9466f05e915a6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6ea2bb847a645ababe9466f05e915a6" member_type: VOTER last_known_addr { host: "127.10.210.190" port: 45057 } } peers { permanent_uuid: "7d961010c6d84eeaa356026bd3ef2160" member_type: VOTER last_known_addr { host: "127.10.210.189" port: 36029 } } peers { permanent_uuid: "2ab7747eab764321be260729421b1f20" member_type: VOTER last_known_addr { host: "127.10.210.188" port: 34571 } } }
14:05:56.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.852674 11398 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6ea2bb847a645ababe9466f05e915a6 [sys.catalog]: This master's current role is: FOLLOWER
14:05:56.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.854604 11153 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2ab7747eab764321be260729421b1f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6ea2bb847a645ababe9466f05e915a6" is_pre_election: true
14:05:56.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.856981 11152 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "2ab7747eab764321be260729421b1f20" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d6ea2bb847a645ababe9466f05e915a6"
14:05:56.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.863520 11151 raft_consensus.cc:1275] T 00000000000000000000000000000000 P d6ea2bb847a645ababe9466f05e915a6 [term 1 FOLLOWER]: Refusing update from remote peer 2ab7747eab764321be260729421b1f20: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
14:05:56.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.869102 11354 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 2ab7747eab764321be260729421b1f20 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d6ea2bb847a645ababe9466f05e915a6" member_type: VOTER last_known_addr { host: "127.10.210.190" port: 45057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:05:56.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.925060 11404 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6ea2bb847a645ababe9466f05e915a6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "2ab7747eab764321be260729421b1f20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6ea2bb847a645ababe9466f05e915a6" member_type: VOTER last_known_addr { host: "127.10.210.190" port: 45057 } } peers { permanent_uuid: "7d961010c6d84eeaa356026bd3ef2160" member_type: VOTER last_known_addr { host: "127.10.210.189" port: 36029 } } peers { permanent_uuid: "2ab7747eab764321be260729421b1f20" member_type: VOTER last_known_addr { host: "127.10.210.188" port: 34571 } } }
14:05:56.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.926837 11398 sys_catalog.cc:455] T 00000000000000000000000000000000 P d6ea2bb847a645ababe9466f05e915a6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2ab7747eab764321be260729421b1f20. Latest consensus state: current_term: 1 leader_uuid: "2ab7747eab764321be260729421b1f20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6ea2bb847a645ababe9466f05e915a6" member_type: VOTER last_known_addr { host: "127.10.210.190" port: 45057 } } peers { permanent_uuid: "7d961010c6d84eeaa356026bd3ef2160" member_type: VOTER last_known_addr { host: "127.10.210.189" port: 36029 } } peers { permanent_uuid: "2ab7747eab764321be260729421b1f20" member_type: VOTER last_known_addr { host: "127.10.210.188" port: 34571 } } }
14:05:56.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.927547 11398 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6ea2bb847a645ababe9466f05e915a6 [sys.catalog]: This master's current role is: FOLLOWER
14:05:56.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.928503 11404 sys_catalog.cc:458] T 00000000000000000000000000000000 P d6ea2bb847a645ababe9466f05e915a6 [sys.catalog]: This master's current role is: FOLLOWER
14:05:57.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:57.026139 11414 catalog_manager.cc:1295] Loaded cluster ID: 4771b8bb49db418a9a314afd0e12b9b4
14:05:57.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:57.026837 11414 catalog_manager.cc:1588] T 00000000000000000000000000000000 P d6ea2bb847a645ababe9466f05e915a6: loading cluster ID for follower catalog manager: success
14:05:57.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:57.051283 11414 catalog_manager.cc:1610] T 00000000000000000000000000000000 P d6ea2bb847a645ababe9466f05e915a6: acquiring CA information for follower catalog manager: success
14:05:57.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:57.063772 11414 catalog_manager.cc:1638] T 00000000000000000000000000000000 P d6ea2bb847a645ababe9466f05e915a6: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
14:05:57.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:57.296502 11354 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2ab7747eab764321be260729421b1f20 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "2ab7747eab764321be260729421b1f20" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d6ea2bb847a645ababe9466f05e915a6" member_type: VOTER last_known_addr { host: "127.10.210.190" port: 45057 } } peers { permanent_uuid: "7d961010c6d84eeaa356026bd3ef2160" member_type: VOTER last_known_addr { host: "127.10.210.189" port: 36029 } } peers { permanent_uuid: "2ab7747eab764321be260729421b1f20" member_type: VOTER last_known_addr { host: "127.10.210.188" port: 34571 } } }
14:05:57.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:57.297325 11354 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2ab7747eab764321be260729421b1f20 [sys.catalog]: This master's current role is: LEADER
14:05:57.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:57.422576 11400 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:05:57.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:57.423646 11400 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:05:57.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:57.424835 11400 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:05:57.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:57.476118 11381 catalog_manager.cc:1295] Loaded cluster ID: 4771b8bb49db418a9a314afd0e12b9b4
14:05:57.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:57.476770 11381 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 7d961010c6d84eeaa356026bd3ef2160: loading cluster ID for follower catalog manager: success
14:05:57.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:57.483939 11381 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 7d961010c6d84eeaa356026bd3ef2160: acquiring CA information for follower catalog manager: success
14:05:57.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:57.494328 11381 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 7d961010c6d84eeaa356026bd3ef2160: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
14:05:57.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:57.505759 11400 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:05:57.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:57.507771 11400 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.210.129
14:05:57.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:57.574095 11400 tablet_server_runner.cc:78] Tablet server non-default flags:
14:05:57.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:05:57.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.10.210.148:43957
14:05:57.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:05:57.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:05:57.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/ts-0/data
14:05:57.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/ts-0/wal
14:05:57.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/krb5kdc/kudu.keytab
14:05:57.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.10.210.129
14:05:57.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:05:57.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:05:57.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.10.210.129:0
14:05:57.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:05:57.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
14:05:57.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=<redacted>
14:05:57.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=<redacted>
14:05:57.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:05:57.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:05:57.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/ts-0/data/info.pb
14:05:57.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.10.210.129
14:05:57.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:05:57.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.10.210.190:45057,127.10.210.189:36029,127.10.210.188:34571
14:05:57.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:05:57.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:05:57.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:05:57.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:05:57.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:05:57.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.10.210.129
14:05:57.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/ts-0/logs
14:05:57.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:05:57.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:05:57.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:05:57.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
14:05:57.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:05:57.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
14:05:57.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:05:57.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 13:43:23 UTC on e7f111948823
14:05:57.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12775
14:05:57.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:05:57.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:57.583869 11400 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:05:57.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:57.585697 11400 file_cache.cc:504] Constructed file cache file cache with capacity 419430
14:05:57.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:57.625206 11424 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:05:59.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:57.626799 11425 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:05:59.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:59.017422 11423 debug-util.cc:398] Leaking SignalData structure 0x7b08000370e0 after lost signal to thread 11400
14:05:59.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:59.451799 11400 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 1.828s	user 0.469s	sys 0.866s
14:05:59.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:59.458760 11400 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 1.835s	user 0.470s	sys 0.867s
14:05:59.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.470294 11400 server_base.cc:1061] running on GCE node
14:05:59.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:59.472393 11434 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:05:59.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.474112 11400 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:05:59.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.482604 11400 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:05:59.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.486434 11400 hybrid_clock.cc:648] HybridClock initialized: now 1783519559486373 us; error 61 us; skew 500 ppm
14:05:59.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.487782 11400 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:05:59.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 08 14:05:59 dist-test-slave-h3x3 krb5kdc[11093](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1783519559, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.210.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
14:05:59.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.496341 11400 init.cc:377] Logged in from keytab as kudu/127.10.210.129@KRBTEST.COM (short username kudu)
14:05:59.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.540050 11400 webserver.cc:533] Webserver started at http://127.10.210.129:38539/ using document root <none> and password file <none>
14:05:59.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.542145 11400 fs_manager.cc:362] Metadata directory not provided
14:05:59.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.542833 11400 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:05:59.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.543717 11400 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:05:59.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.550086 11400 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/ts-0/data/instance:
14:05:59.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3968c0160f2041dd90333601be26b143"
14:05:59.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:05:59 on dist-test-slave-h3x3"
14:05:59.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.551908 11400 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/ts-0/wal/instance:
14:05:59.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3968c0160f2041dd90333601be26b143"
14:05:59.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:05:59 on dist-test-slave-h3x3"
14:05:59.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.568017 11400 fs_manager.cc:696] Time spent creating directory manager: real 0.015s	user 0.013s	sys 0.000s
14:05:59.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.581080 11440 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:05:59.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.582710 11400 fs_manager.cc:730] Time spent opening block manager: real 0.010s	user 0.002s	sys 0.008s
14:05:59.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.583298 11400 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/ts-0/data,/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/ts-0/wal
14:05:59.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3968c0160f2041dd90333601be26b143"
14:05:59.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:05:59 on dist-test-slave-h3x3"
14:05:59.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.584017 11400 fs_report.cc:389] FS layout report
14:05:59.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:05:59.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/ts-0/wal
14:05:59.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/ts-0/wal
14:05:59.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/ts-0/data/data
14:05:59.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:05:59.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:05:59.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:05:59.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:05:59.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:05:59.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:05:59.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:05:59.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:05:59.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:05:59.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:05:59.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:05:59.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.673301 11400 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:05:59.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.685113 11400 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:05:59.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.686007 11400 kserver.cc:163] Server-wide thread pool size limit: 3276
14:05:59.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.695484 11400 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
14:05:59.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.707129 11400 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
14:05:59.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.708022 11400 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s	user 0.000s	sys 0.000s
14:05:59.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.708525 11400 ts_tablet_manager.cc:616] Registered 0 tablets
14:05:59.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.708910 11400 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
14:05:59.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:59.821065 11339 debug-util.cc:398] Leaking SignalData structure 0x7b080003ec40 after lost signal to thread 11269
14:05:59.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:59.821774 11339 debug-util.cc:398] Leaking SignalData structure 0x7b08000b43c0 after lost signal to thread 11342
14:06:00.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:00.606158 11400 rpc_server.cc:307] RPC server started. Bound to: 127.10.210.129:39331
14:06:00.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:00.606293 11554 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.210.129:39331 every 8 connection(s)
14:06:00.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:00.610287 11400 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/ts-0/data/info.pb
14:06:00.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:00.617738 11082 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskM8Xy4F/build/tsan/bin/kudu as pid 11400
14:06:00.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:00.618391 11082 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/ts-0/wal/instance
14:06:00.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 08 14:06:00 dist-test-slave-h3x3 krb5kdc[11093](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1783519559, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.210.129@KRBTEST.COM for kudu/127.10.210.188@KRBTEST.COM
14:06:00.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 08 14:06:00 dist-test-slave-h3x3 krb5kdc[11093](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1783519559, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.210.129@KRBTEST.COM for kudu/127.10.210.189@KRBTEST.COM
14:06:00.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:00.693418 11555 heartbeater.cc:344] Connected to a master server at 127.10.210.188:34571
14:06:00.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:00.693941 11555 heartbeater.cc:461] Registering TS with master...
14:06:00.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:00.695286 11555 heartbeater.cc:507] Master 127.10.210.188:34571 requested a full tablet report, sending...
14:06:00.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:00.698864 11308 ts_manager.cc:194] Registered new tserver with Master: 3968c0160f2041dd90333601be26b143 (127.10.210.129:39331)
14:06:00.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:00.701529 11308 master_service.cc:502] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.210.129@KRBTEST.COM'} at 127.10.210.129:46895
14:06:00.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for kudu/127.10.210.130@KRBTEST.COM; defaulting to no policy
14:06:00.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:00.704751 11556 heartbeater.cc:344] Connected to a master server at 127.10.210.189:36029
14:06:00.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:00.705108 11556 heartbeater.cc:461] Registering TS with master...
14:06:00.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:00.705770 11556 heartbeater.cc:507] Master 127.10.210.189:36029 requested a full tablet report, sending...
14:06:00.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 08 14:06:00 dist-test-slave-h3x3 krb5kdc[11093](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1783519559, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.210.129@KRBTEST.COM for kudu/127.10.210.190@KRBTEST.COM
14:06:00.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:00.710132 11223 ts_manager.cc:194] Registered new tserver with Master: 3968c0160f2041dd90333601be26b143 (127.10.210.129:39331)
14:06:00.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
14:06:00.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "kudu/127.10.210.130@KRBTEST.COM" created.
14:06:00.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:00.724217 11561 heartbeater.cc:344] Connected to a master server at 127.10.210.190:45057
14:06:00.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:00.724644 11561 heartbeater.cc:461] Registering TS with master...
14:06:00.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:00.725363 11561 heartbeater.cc:507] Master 127.10.210.190:45057 requested a full tablet report, sending...
14:06:00.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:00.729214 11143 ts_manager.cc:194] Registered new tserver with Master: 3968c0160f2041dd90333601be26b143 (127.10.210.129:39331)
14:06:00.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
14:06:00.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.10.210.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/krb5kdc/kudu.keytab.
14:06:00.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.10.210.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/krb5kdc/kudu.keytab.
14:06:00.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:00.744393 11082 mini_kdc.cc:268] Time spent creating service keytab for kudu/127.10.210.130: real 0.110s	user 0.003s	sys 0.010s
14:06:00.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for HTTP/127.10.210.130@KRBTEST.COM; defaulting to no policy
14:06:00.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
14:06:00.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "HTTP/127.10.210.130@KRBTEST.COM" created.
14:06:00.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
14:06:00.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.10.210.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/krb5kdc/kudu.keytab.
14:06:00.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.10.210.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/krb5kdc/kudu.keytab.
14:06:00.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:00.790900 11082 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskM8Xy4F/build/tsan/bin/kudu
14:06:00.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskM8Xy4F/build/tsan/bin/kudu
14:06:00.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/ts-1/wal
14:06:00.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/ts-1/data
14:06:00.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:06:00.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:06:00.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:06:00.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:06:00.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:06:00.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:06:00.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/ts-1/logs
14:06:00.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/ts-1/data/info.pb
14:06:00.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:06:00.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:06:00.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:06:00.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:06:00.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:06:00.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:06:00.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:06:00.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:06:00.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
14:06:00.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:06:00.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.10.210.130:0
14:06:00.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.10.210.130
14:06:00.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.10.210.130
14:06:00.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:06:00.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.10.210.190:45057,127.10.210.189:36029,127.10.210.188:34571
14:06:00.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/krb5kdc/kudu.keytab
14:06:00.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.10.210.130
14:06:00.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
14:06:00.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=test-admin
14:06:00.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=test-user
14:06:00.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=true
14:06:00.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.10.210.148:43957
14:06:00.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:06:00.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:06:00.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:06:00.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=false with env {KRB5CCNAME=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
14:06:01.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:01.252326 11569 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:06:01.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:01.252771 11569 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:06:01.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:01.253297 11569 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:06:01.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:01.285444 11569 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:06:01.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:01.286396 11569 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.210.130
14:06:01.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:01.323386 11569 tablet_server_runner.cc:78] Tablet server non-default flags:
14:06:01.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:06:01.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.10.210.148:43957
14:06:01.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:06:01.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:06:01.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/ts-1/data
14:06:01.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/ts-1/wal
14:06:01.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/krb5kdc/kudu.keytab
14:06:01.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.10.210.130
14:06:01.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:06:01.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:06:01.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.10.210.130:0
14:06:01.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:06:01.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
14:06:01.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=<redacted>
14:06:01.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=<redacted>
14:06:01.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:06:01.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:06:01.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/ts-1/data/info.pb
14:06:01.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.10.210.130
14:06:01.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:06:01.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.10.210.190:45057,127.10.210.189:36029,127.10.210.188:34571
14:06:01.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:06:01.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:06:01.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:06:01.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:06:01.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:06:01.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.10.210.130
14:06:01.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/ts-1/logs
14:06:01.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:06:01.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:06:01.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:06:01.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
14:06:01.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:06:01.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
14:06:01.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:06:01.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 13:43:23 UTC on e7f111948823
14:06:01.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12775
14:06:01.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:06:01.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:01.324585 11569 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:06:01.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:01.325639 11569 file_cache.cc:504] Constructed file cache file cache with capacity 419430
14:06:01.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:01.339622 11576 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:06:01.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:01.705582 11555 heartbeater.cc:499] Master 127.10.210.188:34571 was elected leader, sending a full tablet report...
14:06:03.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:02.743456 11575 debug-util.cc:398] Leaking SignalData structure 0x7b08000370e0 after lost signal to thread 11569
14:06:03.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:03.168294 11575 kernel_stack_watchdog.cc:198] Thread 11569 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 398ms:
14:06:03.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
14:06:03.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
14:06:03.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
14:06:03.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
14:06:03.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:01.341182 11577 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:06:03.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:03.169867 11569 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.827s	user 0.001s	sys 0.000s
14:06:03.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:03.170274 11569 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.828s	user 0.002s	sys 0.000s
14:06:03.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:03.172240 11579 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:06:03.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:03.175475 11578 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1827 milliseconds
14:06:03.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:03.175478 11569 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:06:03.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:03.176998 11569 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:06:03.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:03.180552 11569 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:06:03.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:03.182178 11569 hybrid_clock.cc:648] HybridClock initialized: now 1783519563182102 us; error 83 us; skew 500 ppm
14:06:03.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:03.183413 11569 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:06:03.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 08 14:06:03 dist-test-slave-h3x3 krb5kdc[11093](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1783519563, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.210.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
14:06:03.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:03.191521 11569 init.cc:377] Logged in from keytab as kudu/127.10.210.130@KRBTEST.COM (short username kudu)
14:06:03.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:03.197371 11569 webserver.cc:533] Webserver started at http://127.10.210.130:32975/ using document root <none> and password file <none>
14:06:03.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:03.198704 11569 fs_manager.cc:362] Metadata directory not provided
14:06:03.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:03.199028 11569 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:06:03.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:03.199615 11569 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:06:03.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:03.206238 11569 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/ts-1/data/instance:
14:06:03.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "514e459c15d4455798109eaa76746753"
14:06:03.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:06:03 on dist-test-slave-h3x3"
14:06:03.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:03.207831 11569 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/ts-1/wal/instance:
14:06:03.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "514e459c15d4455798109eaa76746753"
14:06:03.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:06:03 on dist-test-slave-h3x3"
14:06:03.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:03.217338 11569 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.010s	sys 0.000s
14:06:03.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:03.224996 11588 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:06:03.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:03.226310 11569 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.003s
14:06:03.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:03.226717 11569 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/ts-1/data,/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/ts-1/wal
14:06:03.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "514e459c15d4455798109eaa76746753"
14:06:03.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:06:03 on dist-test-slave-h3x3"
14:06:03.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:03.227164 11569 fs_report.cc:389] FS layout report
14:06:03.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:06:03.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/ts-1/wal
14:06:03.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/ts-1/wal
14:06:03.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/ts-1/data/data
14:06:03.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:06:03.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:06:03.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:06:03.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:06:03.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:06:03.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:06:03.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:06:03.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:06:03.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:06:03.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:06:03.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:06:03.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:03.303485 11569 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:06:03.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:03.311324 11569 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:06:03.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:03.311898 11569 kserver.cc:163] Server-wide thread pool size limit: 3276
14:06:03.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:03.315553 11569 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
14:06:03.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:03.321781 11569 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
14:06:03.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:03.322110 11569 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
14:06:03.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:03.322420 11569 ts_tablet_manager.cc:616] Registered 0 tablets
14:06:03.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:03.322643 11569 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
14:06:03.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:03.506649 11569 rpc_server.cc:307] RPC server started. Bound to: 127.10.210.130:45421
14:06:03.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:03.506704 11701 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.210.130:45421 every 8 connection(s)
14:06:03.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:03.509167 11569 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/ts-1/data/info.pb
14:06:03.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:03.518795 11082 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskM8Xy4F/build/tsan/bin/kudu as pid 11569
14:06:03.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:03.519402 11082 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/ts-1/wal/instance
14:06:03.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 08 14:06:03 dist-test-slave-h3x3 krb5kdc[11093](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1783519563, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.210.130@KRBTEST.COM for kudu/127.10.210.188@KRBTEST.COM
14:06:03.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 08 14:06:03 dist-test-slave-h3x3 krb5kdc[11093](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1783519563, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.210.130@KRBTEST.COM for kudu/127.10.210.190@KRBTEST.COM
14:06:03.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for kudu/127.10.210.131@KRBTEST.COM; defaulting to no policy
14:06:03.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
14:06:03.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "kudu/127.10.210.131@KRBTEST.COM" created.
14:06:03.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 08 14:06:03 dist-test-slave-h3x3 krb5kdc[11093](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1783519563, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.210.130@KRBTEST.COM for kudu/127.10.210.189@KRBTEST.COM
14:06:03.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:03.567612 11702 heartbeater.cc:344] Connected to a master server at 127.10.210.188:34571
14:06:03.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:03.568084 11702 heartbeater.cc:461] Registering TS with master...
14:06:03.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:03.569819 11702 heartbeater.cc:507] Master 127.10.210.188:34571 requested a full tablet report, sending...
14:06:03.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:03.570338 11704 heartbeater.cc:344] Connected to a master server at 127.10.210.190:45057
14:06:03.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:03.570699 11704 heartbeater.cc:461] Registering TS with master...
14:06:03.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:03.571679 11704 heartbeater.cc:507] Master 127.10.210.190:45057 requested a full tablet report, sending...
14:06:03.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:03.572501 11308 ts_manager.cc:194] Registered new tserver with Master: 514e459c15d4455798109eaa76746753 (127.10.210.130:45421)
14:06:03.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:03.574297 11143 ts_manager.cc:194] Registered new tserver with Master: 514e459c15d4455798109eaa76746753 (127.10.210.130:45421)
14:06:03.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:03.574692 11308 master_service.cc:502] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.210.130@KRBTEST.COM'} at 127.10.210.130:47277
14:06:03.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:03.582121 11703 heartbeater.cc:344] Connected to a master server at 127.10.210.189:36029
14:06:03.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:03.582866 11703 heartbeater.cc:461] Registering TS with master...
14:06:03.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:03.583424 11703 heartbeater.cc:507] Master 127.10.210.189:36029 requested a full tablet report, sending...
14:06:03.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:03.585830 11223 ts_manager.cc:194] Registered new tserver with Master: 514e459c15d4455798109eaa76746753 (127.10.210.130:45421)
14:06:03.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
14:06:03.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.10.210.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/krb5kdc/kudu.keytab.
14:06:03.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.10.210.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/krb5kdc/kudu.keytab.
14:06:03.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for HTTP/127.10.210.131@KRBTEST.COM; defaulting to no policy
14:06:03.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
14:06:03.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "HTTP/127.10.210.131@KRBTEST.COM" created.
14:06:03.624 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
14:06:03.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.10.210.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/krb5kdc/kudu.keytab.
14:06:03.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.10.210.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/krb5kdc/kudu.keytab.
14:06:03.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:03.626751 11082 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskM8Xy4F/build/tsan/bin/kudu
14:06:03.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskM8Xy4F/build/tsan/bin/kudu
14:06:03.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/ts-2/wal
14:06:03.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/ts-2/data
14:06:03.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:06:03.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:06:03.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:06:03.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:06:03.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:06:03.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:06:03.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/ts-2/logs
14:06:03.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/ts-2/data/info.pb
14:06:03.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:06:03.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:06:03.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:06:03.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:06:03.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:06:03.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:06:03.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:06:03.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:06:03.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
14:06:03.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:06:03.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.10.210.131:0
14:06:03.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.10.210.131
14:06:03.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.10.210.131
14:06:03.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:06:03.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.10.210.190:45057,127.10.210.189:36029,127.10.210.188:34571
14:06:03.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/krb5kdc/kudu.keytab
14:06:03.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.10.210.131
14:06:03.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
14:06:03.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=test-admin
14:06:03.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=test-user
14:06:03.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=true
14:06:03.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.10.210.148:43957
14:06:03.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:06:03.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:06:03.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:06:03.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=false with env {KRB5CCNAME=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
14:06:03.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:03.937630 11716 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:06:03.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:03.938174 11716 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:06:03.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:03.938699 11716 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:06:03.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:03.972935 11716 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:06:03.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:03.973807 11716 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.10.210.131
14:06:04.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:04.011157 11716 tablet_server_runner.cc:78] Tablet server non-default flags:
14:06:04.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:06:04.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.10.210.148:43957
14:06:04.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:06:04.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:06:04.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/ts-2/data
14:06:04.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/ts-2/wal
14:06:04.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/krb5kdc/kudu.keytab
14:06:04.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.10.210.131
14:06:04.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:06:04.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:06:04.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.10.210.131:0
14:06:04.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:06:04.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
14:06:04.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=<redacted>
14:06:04.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=<redacted>
14:06:04.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:06:04.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:06:04.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/ts-2/data/info.pb
14:06:04.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.10.210.131
14:06:04.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:06:04.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.10.210.190:45057,127.10.210.189:36029,127.10.210.188:34571
14:06:04.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:06:04.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:06:04.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:06:04.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:06:04.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:06:04.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.10.210.131
14:06:04.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/ts-2/logs
14:06:04.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:06:04.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:06:04.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:06:04.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
14:06:04.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:06:04.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
14:06:04.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:06:04.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 13:43:23 UTC on e7f111948823
14:06:04.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12775
14:06:04.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:06:04.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:04.012626 11716 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:06:04.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:04.014001 11716 file_cache.cc:504] Constructed file cache file cache with capacity 419430
14:06:04.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:04.029320 11722 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:06:04.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:04.580651 11702 heartbeater.cc:499] Master 127.10.210.188:34571 was elected leader, sending a full tablet report...
14:06:05.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:04.031756 11723 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:06:05.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:05.821264 11716 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.790s	user 0.001s	sys 0.000s
14:06:05.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:05.822381 11716 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.791s	user 0.002s	sys 0.000s
14:06:05.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:05.434289 11721 debug-util.cc:398] Leaking SignalData structure 0x7b08000370e0 after lost signal to thread 11716
14:06:05.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:05.824649 11725 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:06:05.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:05.826905 11724 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1790 milliseconds
14:06:05.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:05.826937 11716 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:06:05.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:05.831599 11716 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:06:05.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:05.834793 11716 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:06:05.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:05.836603 11716 hybrid_clock.cc:648] HybridClock initialized: now 1783519565836556 us; error 65 us; skew 500 ppm
14:06:05.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:05.838150 11716 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:06:05.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 08 14:06:05 dist-test-slave-h3x3 krb5kdc[11093](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1783519565, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.210.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
14:06:05.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:05.845844 11716 init.cc:377] Logged in from keytab as kudu/127.10.210.131@KRBTEST.COM (short username kudu)
14:06:05.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:05.851677 11716 webserver.cc:533] Webserver started at http://127.10.210.131:33705/ using document root <none> and password file <none>
14:06:05.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:05.852674 11716 fs_manager.cc:362] Metadata directory not provided
14:06:05.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:05.852957 11716 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:06:05.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:05.853494 11716 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:06:05.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:05.857857 11716 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/ts-2/data/instance:
14:06:05.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "03adf5bb00f74afe86ababcbf3bf1093"
14:06:05.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:06:05 on dist-test-slave-h3x3"
14:06:05.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:05.859246 11716 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/ts-2/wal/instance:
14:06:05.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "03adf5bb00f74afe86ababcbf3bf1093"
14:06:05.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:06:05 on dist-test-slave-h3x3"
14:06:05.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:05.866845 11716 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.007s	sys 0.000s
14:06:05.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:05.874282 11734 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:06:05.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:05.875634 11716 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.001s
14:06:05.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:05.876000 11716 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/ts-2/data,/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/ts-2/wal
14:06:05.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "03adf5bb00f74afe86ababcbf3bf1093"
14:06:05.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:06:05 on dist-test-slave-h3x3"
14:06:05.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:05.876386 11716 fs_report.cc:389] FS layout report
14:06:05.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:06:05.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/ts-2/wal
14:06:05.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/ts-2/wal
14:06:05.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/ts-2/data/data
14:06:05.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:06:05.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:06:05.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:06:05.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:06:05.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:06:05.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:06:05.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:06:05.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:06:05.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:06:05.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:06:05.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:06:05.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:05.928525 11716 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:06:05.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:05.939450 11716 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:06:05.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:05.939970 11716 kserver.cc:163] Server-wide thread pool size limit: 3276
14:06:05.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:05.943603 11716 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
14:06:05.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:05.948068 11716 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
14:06:05.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:05.948305 11716 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
14:06:05.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:05.948665 11716 ts_tablet_manager.cc:616] Registered 0 tablets
14:06:05.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:05.948858 11716 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
14:06:06.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:06.107488 11716 rpc_server.cc:307] RPC server started. Bound to: 127.10.210.131:39957
14:06:06.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:06.107610 11847 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.10.210.131:39957 every 8 connection(s)
14:06:06.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:06.110155 11716 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/ts-2/data/info.pb
14:06:06.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:06.110618 11082 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskM8Xy4F/build/tsan/bin/kudu as pid 11716
14:06:06.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:06.111021 11082 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/ts-2/wal/instance
14:06:06.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 08 14:06:06 dist-test-slave-h3x3 krb5kdc[11093](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1783519565, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.210.131@KRBTEST.COM for kudu/127.10.210.190@KRBTEST.COM
14:06:06.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 08 14:06:06 dist-test-slave-h3x3 krb5kdc[11093](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1783519565, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.210.131@KRBTEST.COM for kudu/127.10.210.188@KRBTEST.COM
14:06:06.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 08 14:06:06 dist-test-slave-h3x3 krb5kdc[11093](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1783519565, etypes {rep=17 tkt=17 ses=17}, kudu/127.10.210.131@KRBTEST.COM for kudu/127.10.210.189@KRBTEST.COM
14:06:06.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:06.173281 11849 heartbeater.cc:344] Connected to a master server at 127.10.210.189:36029
14:06:06.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:06.173804 11849 heartbeater.cc:461] Registering TS with master...
14:06:06.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:06.173980 11850 heartbeater.cc:344] Connected to a master server at 127.10.210.190:45057
14:06:06.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:06.174351 11850 heartbeater.cc:461] Registering TS with master...
14:06:06.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:06.175514 11849 heartbeater.cc:507] Master 127.10.210.189:36029 requested a full tablet report, sending...
14:06:06.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:06.175993 11850 heartbeater.cc:507] Master 127.10.210.190:45057 requested a full tablet report, sending...
14:06:06.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:06.179128 11223 ts_manager.cc:194] Registered new tserver with Master: 03adf5bb00f74afe86ababcbf3bf1093 (127.10.210.131:39957)
14:06:06.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:06.180387 11848 heartbeater.cc:344] Connected to a master server at 127.10.210.188:34571
14:06:06.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:06.180346 11143 ts_manager.cc:194] Registered new tserver with Master: 03adf5bb00f74afe86ababcbf3bf1093 (127.10.210.131:39957)
14:06:06.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:06.180716 11848 heartbeater.cc:461] Registering TS with master...
14:06:06.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:06.181586 11848 heartbeater.cc:507] Master 127.10.210.188:34571 requested a full tablet report, sending...
14:06:06.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:06.183705 11308 ts_manager.cc:194] Registered new tserver with Master: 03adf5bb00f74afe86ababcbf3bf1093 (127.10.210.131:39957)
14:06:06.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:06.185322 11308 master_service.cc:502] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.10.210.131@KRBTEST.COM'} at 127.10.210.131:36869
14:06:06.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:06.200537 11082 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
14:06:06.212 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
14:06:06.213 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_kdc_env_vars {
}

14:06:06.221 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_kdc_env_vars {
  env_vars {
    key: "KRB5CCNAME"
    value: "/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/krb5kdc/krb5cc"
  }
  env_vars {
    key: "KRB5_CONFIG"
    value: "/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/krb5kdc/krb5.conf"
  }
  env_vars {
    key: "KRB5_KDC_PROFILE"
    value: "/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/krb5kdc/kdc.conf"
  }
  env_vars {
    key: "KUDU_ENABLE_KRB5_REALM_FIX"
    value: "yes"
  }
}

14:06:06.222 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

14:06:06.231 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.10.210.190"
      port: 45057
    }
    bound_http_address {
      host: "127.10.210.190"
      port: 35769
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.10.210.189"
      port: 36029
    }
    bound_http_address {
      host: "127.10.210.189"
      port: 41849
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.10.210.188"
      port: 34571
    }
    bound_http_address {
      host: "127.10.210.188"
      port: 35603
    }
  }
}

14:06:06.234 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

14:06:06.237 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.10.210.129"
      port: 39331
    }
    bound_http_address {
      host: "127.10.210.129"
      port: 38539
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.10.210.130"
      port: 45421
    }
    bound_http_address {
      host: "127.10.210.130"
      port: 32975
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.10.210.131"
      port: 39957
    }
    bound_http_address {
      host: "127.10.210.131"
      port: 33705
    }
  }
}

14:06:06.237 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
14:06:06.418 [DEBUG - main] (CompositeStrategy.java:59) Unable to load modern Subject methods, relying only on legacy methods
java.lang.NoSuchMethodException: javax.security.auth.Subject.current()
	at java.base/java.lang.Class.getDeclaredMethod(Class.java:2677)
	at org.apache.kudu.client.internals.ModernStrategy.<init>(ModernStrategy.java:51)
	at org.apache.kudu.client.internals.CompositeStrategy.<init>(CompositeStrategy.java:52)
	at org.apache.kudu.client.internals.CompositeStrategy.<clinit>(CompositeStrategy.java:41)
	at org.apache.kudu.client.internals.SecurityManagerCompatibility.get(SecurityManagerCompatibility.java:43)
	at org.apache.kudu.client.SecurityContext.setupSubject(SecurityContext.java:155)
	at org.apache.kudu.client.SecurityContext.<init>(SecurityContext.java:138)
	at org.apache.kudu.client.AsyncKuduClient.<init>(AsyncKuduClient.java:431)
	at org.apache.kudu.client.AsyncKuduClient$AsyncKuduClientBuilder.build(AsyncKuduClient.java:3109)
	at org.apache.kudu.test.KuduTestHarness.before(KuduTestHarness.java:161)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:50)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.doOneAttemptAndReport(RetryRule.java:184)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.evaluate(RetryRule.java:244)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runners.Suite.runChild(Suite.java:128)
	at org.junit.runners.Suite.runChild(Suite.java:27)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
	at org.junit.runner.JUnitCore.runMain(JUnitCore.java:77)
	at org.junit.runner.JUnitCore.main(JUnitCore.java:36)
14:06:06.437 [DEBUG - main] (SecurityUtil.java:105) Using ticketCache: /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster10585678235163887497/krb5kdc/krb5cc
14:06:06.481 [DEBUG - main] (SecurityUtil.java:119) Logged in as subject: test-admin@KRBTEST.COM
14:06:06.631 [DEBUG - main] (Connection.java:748) [peer master-127.10.210.188:34571(127.10.210.188:34571)] connecting to peer
14:06:06.683 [DEBUG - main] (Connection.java:748) [peer master-127.10.210.190:45057(127.10.210.190:45057)] connecting to peer
14:06:06.697 [DEBUG - main] (Connection.java:748) [peer master-127.10.210.189:36029(127.10.210.189:36029)] connecting to peer
14:06:06.710 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.10.210.188:34571(127.10.210.188:34571)] Successfully connected to peer
14:06:06.711 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.10.210.189:36029(127.10.210.189:36029)] Successfully connected to peer
14:06:06.713 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.10.210.190:45057(127.10.210.190:45057)] Successfully connected to peer
14:06:06.829 [DEBUG - kudu-nio-1] (Negotiator.java:528) SASL mechanism GSSAPI chosen for peer 127.10.210.190
14:06:06.829 [DEBUG - kudu-nio-2] (Negotiator.java:528) SASL mechanism GSSAPI chosen for peer 127.10.210.189
14:06:06.832 [DEBUG - kudu-nio-0] (Negotiator.java:528) SASL mechanism GSSAPI chosen for peer 127.10.210.188
14:06:07.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 08 14:06:07 dist-test-slave-h3x3 krb5kdc[11093](info): TGS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1783519549, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.210.188@KRBTEST.COM
14:06:07.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 08 14:06:07 dist-test-slave-h3x3 krb5kdc[11093](info): TGS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1783519549, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.210.189@KRBTEST.COM
14:06:07.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 08 14:06:07 dist-test-slave-h3x3 krb5kdc[11093](info): TGS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1783519549, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.10.210.190@KRBTEST.COM
14:06:07.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:07.188818 11848 heartbeater.cc:499] Master 127.10.210.188:34571 was elected leader, sending a full tablet report...
14:06:07.227 [DEBUG - kudu-nio-0] (Negotiator.java:918) Authenticated connection [id: 0xcffb0cbf, L:/127.0.0.1:35440 - R:/127.10.210.188:34571] using SASL/GSSAPI
14:06:07.227 [DEBUG - kudu-nio-2] (Negotiator.java:918) Authenticated connection [id: 0xabd2ad83, L:/127.0.0.1:59260 - R:/127.10.210.189:36029] using SASL/GSSAPI
14:06:07.227 [DEBUG - kudu-nio-1] (Negotiator.java:918) Authenticated connection [id: 0xd131e6cf, L:/127.0.0.1:57902 - R:/127.10.210.190:45057] using SASL/GSSAPI
14:06:07.267 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:06:07.268 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=678), Traces: [0ms] refreshing cache from master, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.210.188:34571, [91ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.210.190:45057, [105ms] Sub RPC ConnectToMaster: sending RPC to server master-127.10.210.189:36029, [652ms] Sub RPC ConnectToMaster: received response from server master-127.10.210.190:45057: OK, [652ms] Sub RPC ConnectToMaster: received response from server master-127.10.210.189:36029: OK, [653ms] Sub RPC ConnectToMaster: received response from server master-127.10.210.188:34571: OK, deferred=null) after lookup
14:06:07.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:07.340250 11308 catalog_manager.cc:2283] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:35440:
14:06:07.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "TestAuthzTokenCache-table"
14:06:07.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
14:06:07.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:06:07.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key"
14:06:07.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
14:06:07.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
14:06:07.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:06:07.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:06:07.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:06:07.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:06:07.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:06:07.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:06:07.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column1_i"
14:06:07.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
14:06:07.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:06:07.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:06:07.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:06:07.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:06:07.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:06:07.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:06:07.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:06:07.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column2_i"
14:06:07.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
14:06:07.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:06:07.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:06:07.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:06:07.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:06:07.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:06:07.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:06:07.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:06:07.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column3_s"
14:06:07.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
14:06:07.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:06:07.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: true
14:06:07.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: DICT_ENCODING
14:06:07.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: LZ4
14:06:07.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 4096
14:06:07.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:06:07.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:06:07.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:06:07.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:06:07.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column4_b"
14:06:07.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BOOL
14:06:07.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:06:07.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:06:07.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:06:07.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:06:07.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:06:07.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:06:07.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
14:06:07.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
14:06:07.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
14:06:07.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
14:06:07.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key"
14:06:07.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
14:06:07.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:06:07.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
14:06:07.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:07.344889 11308 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table TestAuthzTokenCache-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
14:06:07.439 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 1c52ffb0aa97445e8b66e7d747cc66e8
14:06:07.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:07.515870 11783 tablet_service.cc:1511] Processing CreateTablet for tablet 7384e84aa78543899c26122f897c559e (DEFAULT_TABLE table=TestAuthzTokenCache-table [id=1c52ffb0aa97445e8b66e7d747cc66e8]), partition=RANGE (key) PARTITION UNBOUNDED
14:06:07.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:07.519968 11783 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7384e84aa78543899c26122f897c559e. 1 dirs total, 0 dirs full, 0 dirs failed
14:06:07.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:07.519219 11490 tablet_service.cc:1511] Processing CreateTablet for tablet 7384e84aa78543899c26122f897c559e (DEFAULT_TABLE table=TestAuthzTokenCache-table [id=1c52ffb0aa97445e8b66e7d747cc66e8]), partition=RANGE (key) PARTITION UNBOUNDED
14:06:07.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:07.521476 11490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7384e84aa78543899c26122f897c559e. 1 dirs total, 0 dirs full, 0 dirs failed
14:06:07.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:07.528024 11637 tablet_service.cc:1511] Processing CreateTablet for tablet 7384e84aa78543899c26122f897c559e (DEFAULT_TABLE table=TestAuthzTokenCache-table [id=1c52ffb0aa97445e8b66e7d747cc66e8]), partition=RANGE (key) PARTITION UNBOUNDED
14:06:07.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:07.535640 11637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7384e84aa78543899c26122f897c559e. 1 dirs total, 0 dirs full, 0 dirs failed
14:06:07.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:07.558182 11886 tablet_bootstrap.cc:492] T 7384e84aa78543899c26122f897c559e P 03adf5bb00f74afe86ababcbf3bf1093: Bootstrap starting.
14:06:07.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:07.563885 11887 tablet_bootstrap.cc:492] T 7384e84aa78543899c26122f897c559e P 3968c0160f2041dd90333601be26b143: Bootstrap starting.
14:06:07.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:07.568003 11886 tablet_bootstrap.cc:654] T 7384e84aa78543899c26122f897c559e P 03adf5bb00f74afe86ababcbf3bf1093: Neither blocks nor log segments found. Creating new log.
14:06:07.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:07.570803 11886 log.cc:826] T 7384e84aa78543899c26122f897c559e P 03adf5bb00f74afe86ababcbf3bf1093: Log is configured to *not* fsync() on all Append() calls
14:06:07.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:07.576054 11887 tablet_bootstrap.cc:654] T 7384e84aa78543899c26122f897c559e P 3968c0160f2041dd90333601be26b143: Neither blocks nor log segments found. Creating new log.
14:06:07.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:07.579282 11887 log.cc:826] T 7384e84aa78543899c26122f897c559e P 3968c0160f2041dd90333601be26b143: Log is configured to *not* fsync() on all Append() calls
14:06:07.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:07.583926 11886 tablet_bootstrap.cc:492] T 7384e84aa78543899c26122f897c559e P 03adf5bb00f74afe86ababcbf3bf1093: No bootstrap required, opened a new log
14:06:07.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:07.584913 11886 ts_tablet_manager.cc:1403] T 7384e84aa78543899c26122f897c559e P 03adf5bb00f74afe86ababcbf3bf1093: Time spent bootstrapping tablet: real 0.027s	user 0.018s	sys 0.006s
14:06:07.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:07.591250 11887 tablet_bootstrap.cc:492] T 7384e84aa78543899c26122f897c559e P 3968c0160f2041dd90333601be26b143: No bootstrap required, opened a new log
14:06:07.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:07.591790 11887 ts_tablet_manager.cc:1403] T 7384e84aa78543899c26122f897c559e P 3968c0160f2041dd90333601be26b143: Time spent bootstrapping tablet: real 0.029s	user 0.017s	sys 0.005s
14:06:07.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:07.612047 11890 tablet_bootstrap.cc:492] T 7384e84aa78543899c26122f897c559e P 514e459c15d4455798109eaa76746753: Bootstrap starting.
14:06:07.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:07.616709 11886 raft_consensus.cc:359] T 7384e84aa78543899c26122f897c559e P 03adf5bb00f74afe86ababcbf3bf1093 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03adf5bb00f74afe86ababcbf3bf1093" member_type: VOTER last_known_addr { host: "127.10.210.131" port: 39957 } } peers { permanent_uuid: "3968c0160f2041dd90333601be26b143" member_type: VOTER last_known_addr { host: "127.10.210.129" port: 39331 } } peers { permanent_uuid: "514e459c15d4455798109eaa76746753" member_type: VOTER last_known_addr { host: "127.10.210.130" port: 45421 } }
14:06:07.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:07.617938 11886 raft_consensus.cc:385] T 7384e84aa78543899c26122f897c559e P 03adf5bb00f74afe86ababcbf3bf1093 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:06:07.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:07.618880 11886 raft_consensus.cc:740] T 7384e84aa78543899c26122f897c559e P 03adf5bb00f74afe86ababcbf3bf1093 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 03adf5bb00f74afe86ababcbf3bf1093, State: Initialized, Role: FOLLOWER
14:06:07.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:07.620584 11886 consensus_queue.cc:260] T 7384e84aa78543899c26122f897c559e P 03adf5bb00f74afe86ababcbf3bf1093 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03adf5bb00f74afe86ababcbf3bf1093" member_type: VOTER last_known_addr { host: "127.10.210.131" port: 39957 } } peers { permanent_uuid: "3968c0160f2041dd90333601be26b143" member_type: VOTER last_known_addr { host: "127.10.210.129" port: 39331 } } peers { permanent_uuid: "514e459c15d4455798109eaa76746753" member_type: VOTER last_known_addr { host: "127.10.210.130" port: 45421 } }
14:06:07.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:07.622777 11890 tablet_bootstrap.cc:654] T 7384e84aa78543899c26122f897c559e P 514e459c15d4455798109eaa76746753: Neither blocks nor log segments found. Creating new log.
14:06:07.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:07.631987 11890 log.cc:826] T 7384e84aa78543899c26122f897c559e P 514e459c15d4455798109eaa76746753: Log is configured to *not* fsync() on all Append() calls
14:06:07.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:07.639146 11886 ts_tablet_manager.cc:1434] T 7384e84aa78543899c26122f897c559e P 03adf5bb00f74afe86ababcbf3bf1093: Time spent starting tablet: real 0.053s	user 0.033s	sys 0.014s
14:06:07.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:07.639500 11857 tablet.cc:2406] T 7384e84aa78543899c26122f897c559e P 03adf5bb00f74afe86ababcbf3bf1093: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:06:07.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:07.642795 11890 tablet_bootstrap.cc:492] T 7384e84aa78543899c26122f897c559e P 514e459c15d4455798109eaa76746753: No bootstrap required, opened a new log
14:06:07.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:07.643517 11890 ts_tablet_manager.cc:1403] T 7384e84aa78543899c26122f897c559e P 514e459c15d4455798109eaa76746753: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.006s
14:06:07.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:07.649466 11887 raft_consensus.cc:359] T 7384e84aa78543899c26122f897c559e P 3968c0160f2041dd90333601be26b143 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03adf5bb00f74afe86ababcbf3bf1093" member_type: VOTER last_known_addr { host: "127.10.210.131" port: 39957 } } peers { permanent_uuid: "3968c0160f2041dd90333601be26b143" member_type: VOTER last_known_addr { host: "127.10.210.129" port: 39331 } } peers { permanent_uuid: "514e459c15d4455798109eaa76746753" member_type: VOTER last_known_addr { host: "127.10.210.130" port: 45421 } }
14:06:07.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:07.650473 11887 raft_consensus.cc:385] T 7384e84aa78543899c26122f897c559e P 3968c0160f2041dd90333601be26b143 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:06:07.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:07.650807 11887 raft_consensus.cc:740] T 7384e84aa78543899c26122f897c559e P 3968c0160f2041dd90333601be26b143 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3968c0160f2041dd90333601be26b143, State: Initialized, Role: FOLLOWER
14:06:07.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:07.653942 11887 consensus_queue.cc:260] T 7384e84aa78543899c26122f897c559e P 3968c0160f2041dd90333601be26b143 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03adf5bb00f74afe86ababcbf3bf1093" member_type: VOTER last_known_addr { host: "127.10.210.131" port: 39957 } } peers { permanent_uuid: "3968c0160f2041dd90333601be26b143" member_type: VOTER last_known_addr { host: "127.10.210.129" port: 39331 } } peers { permanent_uuid: "514e459c15d4455798109eaa76746753" member_type: VOTER last_known_addr { host: "127.10.210.130" port: 45421 } }
14:06:07.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:07.675125 11890 raft_consensus.cc:359] T 7384e84aa78543899c26122f897c559e P 514e459c15d4455798109eaa76746753 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03adf5bb00f74afe86ababcbf3bf1093" member_type: VOTER last_known_addr { host: "127.10.210.131" port: 39957 } } peers { permanent_uuid: "3968c0160f2041dd90333601be26b143" member_type: VOTER last_known_addr { host: "127.10.210.129" port: 39331 } } peers { permanent_uuid: "514e459c15d4455798109eaa76746753" member_type: VOTER last_known_addr { host: "127.10.210.130" port: 45421 } }
14:06:07.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:07.676339 11887 ts_tablet_manager.cc:1434] T 7384e84aa78543899c26122f897c559e P 3968c0160f2041dd90333601be26b143: Time spent starting tablet: real 0.084s	user 0.028s	sys 0.017s
14:06:07.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:07.676409 11890 raft_consensus.cc:385] T 7384e84aa78543899c26122f897c559e P 514e459c15d4455798109eaa76746753 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:06:07.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:07.677058 11890 raft_consensus.cc:740] T 7384e84aa78543899c26122f897c559e P 514e459c15d4455798109eaa76746753 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514e459c15d4455798109eaa76746753, State: Initialized, Role: FOLLOWER
14:06:07.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:07.678025 11890 consensus_queue.cc:260] T 7384e84aa78543899c26122f897c559e P 514e459c15d4455798109eaa76746753 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03adf5bb00f74afe86ababcbf3bf1093" member_type: VOTER last_known_addr { host: "127.10.210.131" port: 39957 } } peers { permanent_uuid: "3968c0160f2041dd90333601be26b143" member_type: VOTER last_known_addr { host: "127.10.210.129" port: 39331 } } peers { permanent_uuid: "514e459c15d4455798109eaa76746753" member_type: VOTER last_known_addr { host: "127.10.210.130" port: 45421 } }
14:06:07.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:07.691843 11890 ts_tablet_manager.cc:1434] T 7384e84aa78543899c26122f897c559e P 514e459c15d4455798109eaa76746753: Time spent starting tablet: real 0.047s	user 0.032s	sys 0.012s
14:06:07.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:07.792529 11707 tablet.cc:2406] T 7384e84aa78543899c26122f897c559e P 514e459c15d4455798109eaa76746753: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:06:07.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:07.898578 11562 tablet.cc:2406] T 7384e84aa78543899c26122f897c559e P 3968c0160f2041dd90333601be26b143: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:06:08.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:08.035112 11893 raft_consensus.cc:493] T 7384e84aa78543899c26122f897c559e P 3968c0160f2041dd90333601be26b143 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:06:08.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:08.035600 11893 raft_consensus.cc:515] T 7384e84aa78543899c26122f897c559e P 3968c0160f2041dd90333601be26b143 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03adf5bb00f74afe86ababcbf3bf1093" member_type: VOTER last_known_addr { host: "127.10.210.131" port: 39957 } } peers { permanent_uuid: "3968c0160f2041dd90333601be26b143" member_type: VOTER last_known_addr { host: "127.10.210.129" port: 39331 } } peers { permanent_uuid: "514e459c15d4455798109eaa76746753" member_type: VOTER last_known_addr { host: "127.10.210.130" port: 45421 } }
14:06:08.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:08.038312 11893 leader_election.cc:290] T 7384e84aa78543899c26122f897c559e P 3968c0160f2041dd90333601be26b143 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 03adf5bb00f74afe86ababcbf3bf1093 (127.10.210.131:39957), 514e459c15d4455798109eaa76746753 (127.10.210.130:45421)
14:06:08.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:08.060137 11803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7384e84aa78543899c26122f897c559e" candidate_uuid: "3968c0160f2041dd90333601be26b143" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03adf5bb00f74afe86ababcbf3bf1093" is_pre_election: true
14:06:08.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:08.060844 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7384e84aa78543899c26122f897c559e" candidate_uuid: "3968c0160f2041dd90333601be26b143" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514e459c15d4455798109eaa76746753" is_pre_election: true
14:06:08.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:08.061048 11803 raft_consensus.cc:2468] T 7384e84aa78543899c26122f897c559e P 03adf5bb00f74afe86ababcbf3bf1093 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3968c0160f2041dd90333601be26b143 in term 0.
14:06:08.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:08.061666 11657 raft_consensus.cc:2468] T 7384e84aa78543899c26122f897c559e P 514e459c15d4455798109eaa76746753 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3968c0160f2041dd90333601be26b143 in term 0.
14:06:08.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:08.062454 11443 leader_election.cc:304] T 7384e84aa78543899c26122f897c559e P 3968c0160f2041dd90333601be26b143 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03adf5bb00f74afe86ababcbf3bf1093, 3968c0160f2041dd90333601be26b143; no voters: 
14:06:08.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:08.063134 11893 raft_consensus.cc:2804] T 7384e84aa78543899c26122f897c559e P 3968c0160f2041dd90333601be26b143 [term 0 FOLLOWER]: Leader pre-election won for term 1
14:06:08.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:08.063467 11893 raft_consensus.cc:493] T 7384e84aa78543899c26122f897c559e P 3968c0160f2041dd90333601be26b143 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:06:08.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:08.063814 11893 raft_consensus.cc:3060] T 7384e84aa78543899c26122f897c559e P 3968c0160f2041dd90333601be26b143 [term 0 FOLLOWER]: Advancing to term 1
14:06:08.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:08.068048 11893 raft_consensus.cc:515] T 7384e84aa78543899c26122f897c559e P 3968c0160f2041dd90333601be26b143 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03adf5bb00f74afe86ababcbf3bf1093" member_type: VOTER last_known_addr { host: "127.10.210.131" port: 39957 } } peers { permanent_uuid: "3968c0160f2041dd90333601be26b143" member_type: VOTER last_known_addr { host: "127.10.210.129" port: 39331 } } peers { permanent_uuid: "514e459c15d4455798109eaa76746753" member_type: VOTER last_known_addr { host: "127.10.210.130" port: 45421 } }
14:06:08.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:08.069519 11893 leader_election.cc:290] T 7384e84aa78543899c26122f897c559e P 3968c0160f2041dd90333601be26b143 [CANDIDATE]: Term 1 election: Requested vote from peers 03adf5bb00f74afe86ababcbf3bf1093 (127.10.210.131:39957), 514e459c15d4455798109eaa76746753 (127.10.210.130:45421)
14:06:08.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:08.070174 11803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7384e84aa78543899c26122f897c559e" candidate_uuid: "3968c0160f2041dd90333601be26b143" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "03adf5bb00f74afe86ababcbf3bf1093"
14:06:08.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:08.070681 11803 raft_consensus.cc:3060] T 7384e84aa78543899c26122f897c559e P 03adf5bb00f74afe86ababcbf3bf1093 [term 0 FOLLOWER]: Advancing to term 1
14:06:08.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:08.070652 11657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7384e84aa78543899c26122f897c559e" candidate_uuid: "3968c0160f2041dd90333601be26b143" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514e459c15d4455798109eaa76746753"
14:06:08.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:08.071115 11657 raft_consensus.cc:3060] T 7384e84aa78543899c26122f897c559e P 514e459c15d4455798109eaa76746753 [term 0 FOLLOWER]: Advancing to term 1
14:06:08.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:08.075526 11803 raft_consensus.cc:2468] T 7384e84aa78543899c26122f897c559e P 03adf5bb00f74afe86ababcbf3bf1093 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3968c0160f2041dd90333601be26b143 in term 1.
14:06:08.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:08.076413 11443 leader_election.cc:304] T 7384e84aa78543899c26122f897c559e P 3968c0160f2041dd90333601be26b143 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 03adf5bb00f74afe86ababcbf3bf1093, 3968c0160f2041dd90333601be26b143; no voters: 
14:06:08.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:08.077019 11893 raft_consensus.cc:2804] T 7384e84aa78543899c26122f897c559e P 3968c0160f2041dd90333601be26b143 [term 1 FOLLOWER]: Leader election won for term 1
14:06:08.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:08.077340 11657 raft_consensus.cc:2468] T 7384e84aa78543899c26122f897c559e P 514e459c15d4455798109eaa76746753 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3968c0160f2041dd90333601be26b143 in term 1.
14:06:08.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:08.079294 11893 raft_consensus.cc:697] T 7384e84aa78543899c26122f897c559e P 3968c0160f2041dd90333601be26b143 [term 1 LEADER]: Becoming Leader. State: Replica: 3968c0160f2041dd90333601be26b143, State: Running, Role: LEADER
14:06:08.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:08.080195 11893 consensus_queue.cc:237] T 7384e84aa78543899c26122f897c559e P 3968c0160f2041dd90333601be26b143 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03adf5bb00f74afe86ababcbf3bf1093" member_type: VOTER last_known_addr { host: "127.10.210.131" port: 39957 } } peers { permanent_uuid: "3968c0160f2041dd90333601be26b143" member_type: VOTER last_known_addr { host: "127.10.210.129" port: 39331 } } peers { permanent_uuid: "514e459c15d4455798109eaa76746753" member_type: VOTER last_known_addr { host: "127.10.210.130" port: 45421 } }
14:06:08.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:08.095482 11308 catalog_manager.cc:5697] T 7384e84aa78543899c26122f897c559e P 3968c0160f2041dd90333601be26b143 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3968c0160f2041dd90333601be26b143 (127.10.210.129). New cstate: current_term: 1 leader_uuid: "3968c0160f2041dd90333601be26b143" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "03adf5bb00f74afe86ababcbf3bf1093" member_type: VOTER last_known_addr { host: "127.10.210.131" port: 39957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3968c0160f2041dd90333601be26b143" member_type: VOTER last_known_addr { host: "127.10.210.129" port: 39331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "514e459c15d4455798109eaa76746753" member_type: VOTER last_known_addr { host: "127.10.210.130" port: 45421 } health_report { overall_health: UNKNOWN } } }
14:06:08.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:08.462338 11893 consensus_queue.cc:1048] T 7384e84aa78543899c26122f897c559e P 3968c0160f2041dd90333601be26b143 [LEADER]: Connected to new peer: Peer: permanent_uuid: "03adf5bb00f74afe86ababcbf3bf1093" member_type: VOTER last_known_addr { host: "127.10.210.131" port: 39957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:06:08.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:08.488041 11893 consensus_queue.cc:1048] T 7384e84aa78543899c26122f897c559e P 3968c0160f2041dd90333601be26b143 [LEADER]: Connected to new peer: Peer: permanent_uuid: "514e459c15d4455798109eaa76746753" member_type: VOTER last_known_addr { host: "127.10.210.130" port: 45421 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:06:09.612 [DEBUG - main] (AuthzTokenCache.java:153) sending RPC to retrieve token for table ID 1c52ffb0aa97445e8b66e7d747cc66e8
14:06:09.617 [DEBUG - kudu-nio-0] (AuthzTokenCache.java:193) retrieved authz token for 1c52ffb0aa97445e8b66e7d747cc66e8
14:06:09.625 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet 7384e84aa78543899c26122f897c559e for table 'TestAuthzTokenCache-table' with partition [<start>, <end>)
14:06:09.630 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299995, tablet=7384e84aa78543899c26122f897c559e@[03adf5bb00f74afe86ababcbf3bf1093(127.10.210.131:39957),3968c0160f2041dd90333601be26b143(127.10.210.129:39331)[L],514e459c15d4455798109eaa76746753(127.10.210.130:45421)]}]
14:06:09.639 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=20), Traces: [0ms] sending RPC to server master-127.10.210.188:34571, [5ms] received response from server master-127.10.210.188:34571: OK, [5ms] Sub RPC Scan: refreshing cache from master, [5ms] Sub RPC GetTableLocations: sending RPC to server master-127.10.210.188:34571, [13ms] Sub RPC GetTableLocations: received response from server master-127.10.210.188:34571: OK, deferred=Deferred@692055006(state=PENDING, result=null, callback=wakeup thread main, errback=wakeup thread main))) after lookup
14:06:09.649 [DEBUG - kudu-nio-0] (Connection.java:748) [peer 3968c0160f2041dd90333601be26b143(127.10.210.129:39331)] connecting to peer
14:06:09.651 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 3968c0160f2041dd90333601be26b143(127.10.210.129:39331)] Successfully connected to peer
14:06:09.708 [DEBUG - kudu-nio-3] (Negotiator.java:918) Authenticated connection [id: 0x50787be0, L:/127.0.0.1:34726 - R:/127.10.210.129:39331] using TOKEN/null
14:06:09.739 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestAuthzTokenCache-table, tablet=7384e84aa78543899c26122f897c559e, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:06:09.741 [DEBUG - main] (Connection.java:575) [peer master-127.10.210.189:36029(127.10.210.189:36029)] disconnecting while in state READY
14:06:09.742 [DEBUG - main] (Connection.java:575) [peer master-127.10.210.190:45057(127.10.210.190:45057)] disconnecting while in state READY
14:06:09.742 [DEBUG - main] (Connection.java:575) [peer master-127.10.210.188:34571(127.10.210.188:34571)] disconnecting while in state READY
14:06:09.743 [DEBUG - main] (Connection.java:575) [peer 3968c0160f2041dd90333601be26b143(127.10.210.129:39331)] disconnecting while in state READY
14:06:09.747 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:06:09.747 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.10.210.189:36029(127.10.210.189:36029)] handling channelInactive
14:06:09.747 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.10.210.189:36029(127.10.210.189:36029)] cleaning up while in state READY due to: connection closed
14:06:09.748 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.10.210.188:34571(127.10.210.188:34571)] handling channelInactive
14:06:09.748 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.10.210.188:34571(127.10.210.188:34571)] cleaning up while in state READY due to: connection closed
14:06:09.750 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.10.210.190:45057(127.10.210.190:45057)] handling channelInactive
14:06:09.750 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.10.210.190:45057(127.10.210.190:45057)] cleaning up while in state READY due to: connection closed
14:06:09.752 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 3968c0160f2041dd90333601be26b143(127.10.210.129:39331)] handling channelInactive
14:06:09.752 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 3968c0160f2041dd90333601be26b143(127.10.210.129:39331)] cleaning up while in state READY due to: connection closed
14:06:09.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:09.753151 11082 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskM8Xy4F/build/tsan/bin/kudu with pid 11400
14:06:09.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:09.779078 11082 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskM8Xy4F/build/tsan/bin/kudu with pid 11569
14:06:09.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:09.807657 11082 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskM8Xy4F/build/tsan/bin/kudu with pid 11716
14:06:09.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:09.833027 11082 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskM8Xy4F/build/tsan/bin/kudu with pid 11109
14:06:09.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:09.860041 11082 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskM8Xy4F/build/tsan/bin/kudu with pid 11187
14:06:09.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:09.884821 11082 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskM8Xy4F/build/tsan/bin/kudu with pid 11268
14:06:11.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T14:06:11Z chronyd exiting
.14:06:12.327 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1783519572327
14:06:12.330 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
14:06:12.331 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
14:06:12.331 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskM8Xy4F/test-tmp
14:06:12.332 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
14:06:12.332 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskM8Xy4F/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
14:06:12.335 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: true
  cluster_root: "/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381"
  extra_master_flags: "--webserver_require_spnego=false"
  extra_tserver_flags: "--webserver_require_spnego=false"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

14:06:12.657 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
14:06:12.658 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

14:06:12.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:12.661375 11927 mini_oidc.cc:150] Starting JWKS server
14:06:12.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:12.664431 11927 webserver.cc:533] Webserver started at http://127.0.0.1:32871/ using document root <none> and password file <none>
14:06:12.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:12.664873 11927 mini_oidc.cc:186] Starting OIDC Discovery server
14:06:12.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:12.666481 11927 webserver.cc:533] Webserver started at http://127.0.0.1:39931/ using document root <none> and password file <none>
14:06:13.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Loading random data
14:06:13.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Initializing database '/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/krb5kdc/principal' for realm 'KRBTEST.COM',
14:06:13.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master key name 'K/M@KRBTEST.COM'
14:06:13.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 08 14:06:13 dist-test-slave-h3x3 krb5kdc[11938](info): setting up network...
14:06:13.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
14:06:13.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 08 14:06:13 dist-test-slave-h3x3 krb5kdc[11938](info): set up 2 sockets
14:06:13.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 08 14:06:13 dist-test-slave-h3x3 krb5kdc[11938](info): commencing operation
14:06:13.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) krb5kdc: starting...
14:06:15.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:15.084576 11927 mini_kdc.cc:121] Time spent starting KDC: real 2.379s	user 0.005s	sys 0.013s
14:06:15.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
14:06:15.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal slave/admin@KRBTEST.COM with password.
14:06:15.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "test-admin@KRBTEST.COM" created.
14:06:15.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
14:06:15.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal slave/admin@KRBTEST.COM with password.
14:06:15.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "test-user@KRBTEST.COM" created.
14:06:15.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
14:06:15.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal slave/admin@KRBTEST.COM with password.
14:06:15.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "joe-interloper@KRBTEST.COM" created.
14:06:15.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal slave/admin@KRBTEST.COM with password.
14:06:15.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/krb5kdc/test-user.keytab.
14:06:15.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/krb5kdc/test-user.keytab.
14:06:15.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 08 14:06:15 dist-test-slave-h3x3 krb5kdc[11938](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1783519575, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
14:06:15.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Password for test-admin@KRBTEST.COM: 
14:06:15.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T14:06:15Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
14:06:15.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T14:06:15Z Disabled control of system clock
14:06:15.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for kudu/127.11.165.254@KRBTEST.COM; defaulting to no policy
14:06:15.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
14:06:15.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "kudu/127.11.165.254@KRBTEST.COM" created.
14:06:15.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
14:06:15.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.11.165.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/krb5kdc/kudu.keytab.
14:06:15.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.11.165.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/krb5kdc/kudu.keytab.
14:06:15.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for HTTP/127.11.165.254@KRBTEST.COM; defaulting to no policy
14:06:15.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
14:06:15.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "HTTP/127.11.165.254@KRBTEST.COM" created.
14:06:15.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
14:06:15.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.11.165.254 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/krb5kdc/kudu.keytab.
14:06:15.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.11.165.254 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/krb5kdc/kudu.keytab.
14:06:15.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:15.302951 11927 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskM8Xy4F/build/tsan/bin/kudu
14:06:15.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskM8Xy4F/build/tsan/bin/kudu
14:06:15.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/master-0/wal
14:06:15.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/master-0/data
14:06:15.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:06:15.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:06:15.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:06:15.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:06:15.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:06:15.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:06:15.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/master-0/logs
14:06:15.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/master-0/data/info.pb
14:06:15.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:06:15.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:06:15.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:06:15.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:06:15.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:06:15.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:06:15.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:06:15.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:06:15.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
14:06:15.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:06:15.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:06:15.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:06:15.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.165.254:38921
14:06:15.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.165.254
14:06:15.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:06:15.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/krb5kdc/kudu.keytab
14:06:15.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.11.165.254
14:06:15.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
14:06:15.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=test-admin
14:06:15.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=test-user
14:06:15.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=true
14:06:15.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.165.212:36083
14:06:15.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:06:15.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:06:15.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:06:15.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:06:15.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.11.165.254:38921,127.11.165.253:43175,127.11.165.252:44325
14:06:15.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:06:15.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:32871/jwks.json
14:06:15.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=false with env {KRB5CCNAME=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
14:06:15.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:15.603276 11954 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:06:15.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:15.603806 11954 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:06:15.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:15.604344 11954 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:06:15.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:15.636570 11954 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
14:06:15.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:15.636926 11954 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:06:15.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:15.637123 11954 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
14:06:15.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:15.637334 11954 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
14:06:15.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:15.637526 11954 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
14:06:15.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:15.637674 11954 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:32871/jwks.json
14:06:15.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:15.678306 11954 master_runner.cc:387] Master server non-default flags:
14:06:15.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:06:15.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.165.212:36083
14:06:15.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:06:15.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:06:15.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/master-0/data
14:06:15.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/master-0/wal
14:06:15.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:06:15.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.11.165.254:38921,127.11.165.253:43175,127.11.165.252:44325
14:06:15.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/krb5kdc/kudu.keytab
14:06:15.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.11.165.254
14:06:15.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:06:15.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:06:15.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:06:15.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.165.254:38921
14:06:15.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:06:15.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:06:15.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:06:15.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:32871/jwks.json
14:06:15.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
14:06:15.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=<redacted>
14:06:15.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=<redacted>
14:06:15.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:06:15.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:06:15.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/master-0/data/info.pb
14:06:15.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.165.254
14:06:15.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:06:15.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:06:15.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:06:15.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:06:15.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:06:15.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:06:15.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/master-0/logs
14:06:15.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:06:15.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:06:15.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:06:15.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
14:06:15.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:06:15.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
14:06:15.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:06:15.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 13:43:23 UTC on e7f111948823
14:06:15.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12775
14:06:15.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:06:15.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:15.679615 11954 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:06:15.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:15.680979 11954 file_cache.cc:504] Constructed file cache file cache with capacity 419430
14:06:15.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:15.693996 11960 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:06:16.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:15.694844 11961 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:06:16.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:16.915697 11963 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:06:16.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:16.917984 11962 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1218 milliseconds
14:06:16.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:16.918228 11954 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:06:16.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:16.919427 11954 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:06:16.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:16.922457 11954 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:06:16.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:16.923836 11954 hybrid_clock.cc:648] HybridClock initialized: now 1783519576923783 us; error 55 us; skew 500 ppm
14:06:16.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:16.924718 11954 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:06:16.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 08 14:06:16 dist-test-slave-h3x3 krb5kdc[11938](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1783519576, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.165.254@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
14:06:16.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:16.930898 11954 init.cc:377] Logged in from keytab as kudu/127.11.165.254@KRBTEST.COM (short username kudu)
14:06:16.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:16.936177 11954 webserver.cc:533] Webserver started at http://127.11.165.254:35565/ using document root <none> and password file <none>
14:06:16.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:16.937053 11954 fs_manager.cc:362] Metadata directory not provided
14:06:16.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:16.937237 11954 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:06:16.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:16.937624 11954 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:06:16.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:16.941779 11954 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/master-0/data/instance:
14:06:16.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "7faaac60f84747d0b0ef931df71fc8c2"
14:06:16.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:06:16 on dist-test-slave-h3x3"
14:06:16.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:16.942919 11954 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/master-0/wal/instance:
14:06:16.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "7faaac60f84747d0b0ef931df71fc8c2"
14:06:16.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:06:16 on dist-test-slave-h3x3"
14:06:16.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:16.950156 11954 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.001s
14:06:16.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:16.955363 11971 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:06:16.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:16.956442 11954 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.000s	sys 0.005s
14:06:16.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:16.956722 11954 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/master-0/data,/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/master-0/wal
14:06:16.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "7faaac60f84747d0b0ef931df71fc8c2"
14:06:16.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:06:16 on dist-test-slave-h3x3"
14:06:16.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:16.957002 11954 fs_report.cc:389] FS layout report
14:06:16.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:06:16.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/master-0/wal
14:06:16.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/master-0/wal
14:06:16.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/master-0/data/data
14:06:16.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:06:16.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:06:16.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:06:16.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:06:16.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:06:16.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:06:16.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:06:16.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:06:16.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:06:16.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:06:16.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:06:17.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:17.026504 11954 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:06:17.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:17.032060 11954 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:06:17.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:17.032475 11954 kserver.cc:163] Server-wide thread pool size limit: 3276
14:06:17.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:17.103008 11954 rpc_server.cc:307] RPC server started. Bound to: 127.11.165.254:38921
14:06:17.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:17.103112 12023 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.165.254:38921 every 8 connection(s)
14:06:17.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:17.105542 11954 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/master-0/data/info.pb
14:06:17.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:17.106582 11927 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskM8Xy4F/build/tsan/bin/kudu as pid 11954
14:06:17.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:17.107052 11927 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/master-0/wal/instance
14:06:17.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:17.112466 12024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
14:06:17.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for kudu/127.11.165.253@KRBTEST.COM; defaulting to no policy
14:06:17.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:17.123284 12024 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.165.254" port: 38921 } has no permanent_uuid. Determining permanent_uuid...
14:06:17.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
14:06:17.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "kudu/127.11.165.253@KRBTEST.COM" created.
14:06:17.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 08 14:06:17 dist-test-slave-h3x3 krb5kdc[11938](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1783519576, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.165.254@KRBTEST.COM for kudu/127.11.165.254@KRBTEST.COM
14:06:17.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
14:06:17.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.11.165.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/krb5kdc/kudu.keytab.
14:06:17.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.11.165.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/krb5kdc/kudu.keytab.
14:06:17.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:17.163836 12024 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.165.253" port: 43175 } has no permanent_uuid. Determining permanent_uuid...
14:06:17.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:17.166646 11975 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.165.253:43175: connect: Connection refused (error 111)
14:06:17.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for HTTP/127.11.165.253@KRBTEST.COM; defaulting to no policy
14:06:17.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
14:06:17.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "HTTP/127.11.165.253@KRBTEST.COM" created.
14:06:17.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:17.171051 12024 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.165.253:43175: Network error: Client connection negotiation failed: client connection to 127.11.165.253:43175: connect: Connection refused (error 111)
14:06:17.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
14:06:17.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.11.165.253 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/krb5kdc/kudu.keytab.
14:06:17.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.11.165.253 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/krb5kdc/kudu.keytab.
14:06:17.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:17.193966 11927 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskM8Xy4F/build/tsan/bin/kudu
14:06:17.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskM8Xy4F/build/tsan/bin/kudu
14:06:17.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/master-1/wal
14:06:17.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/master-1/data
14:06:17.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:06:17.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:06:17.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:06:17.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:06:17.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:06:17.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:06:17.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/master-1/logs
14:06:17.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/master-1/data/info.pb
14:06:17.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:06:17.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:06:17.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:06:17.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:06:17.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:06:17.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:06:17.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:06:17.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:06:17.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
14:06:17.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:06:17.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:06:17.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:06:17.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.165.253:43175
14:06:17.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.165.253
14:06:17.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:06:17.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/krb5kdc/kudu.keytab
14:06:17.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.11.165.253
14:06:17.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
14:06:17.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=test-admin
14:06:17.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=test-user
14:06:17.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=true
14:06:17.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.165.212:36083
14:06:17.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:06:17.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:06:17.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:06:17.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:06:17.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.11.165.254:38921,127.11.165.253:43175,127.11.165.252:44325
14:06:17.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:06:17.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:32871/jwks.json
14:06:17.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=false with env {KRB5CCNAME=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
14:06:17.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:17.220679 12024 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.165.253" port: 43175 } attempt: 1
14:06:17.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:17.224738 12024 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.165.253:43175: Network error: Client connection negotiation failed: client connection to 127.11.165.253:43175: connect: Connection refused (error 111)
14:06:17.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:17.293126 12024 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.165.253" port: 43175 } attempt: 2
14:06:17.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:17.297518 12024 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.165.253:43175: Network error: Client connection negotiation failed: client connection to 127.11.165.253:43175: connect: Connection refused (error 111)
14:06:17.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:17.388933 12024 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.165.253" port: 43175 } attempt: 3
14:06:17.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:17.393203 12024 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.165.253:43175: Network error: Client connection negotiation failed: client connection to 127.11.165.253:43175: connect: Connection refused (error 111)
14:06:17.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:17.503217 12033 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:06:17.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:17.504022 12033 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:06:17.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:17.504629 12033 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:06:17.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:17.536574 12024 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.165.253" port: 43175 } attempt: 4
14:06:17.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:17.536870 12033 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
14:06:17.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:17.537186 12033 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:06:17.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:17.537463 12033 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
14:06:17.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:17.537817 12033 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
14:06:17.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:17.538173 12033 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
14:06:17.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:17.538406 12033 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:32871/jwks.json
14:06:17.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:17.541107 12024 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.165.253:43175: Network error: Client connection negotiation failed: client connection to 127.11.165.253:43175: connect: Connection refused (error 111)
14:06:17.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:17.576803 12033 master_runner.cc:387] Master server non-default flags:
14:06:17.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:06:17.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.165.212:36083
14:06:17.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:06:17.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:06:17.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/master-1/data
14:06:17.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/master-1/wal
14:06:17.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:06:17.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.11.165.254:38921,127.11.165.253:43175,127.11.165.252:44325
14:06:17.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/krb5kdc/kudu.keytab
14:06:17.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.11.165.253
14:06:17.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:06:17.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:06:17.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:06:17.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.165.253:43175
14:06:17.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:06:17.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:06:17.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:06:17.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:32871/jwks.json
14:06:17.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
14:06:17.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=<redacted>
14:06:17.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=<redacted>
14:06:17.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:06:17.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:06:17.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/master-1/data/info.pb
14:06:17.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.165.253
14:06:17.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:06:17.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:06:17.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:06:17.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:06:17.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:06:17.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:06:17.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/master-1/logs
14:06:17.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:06:17.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:06:17.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:06:17.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
14:06:17.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:06:17.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
14:06:17.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:06:17.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 13:43:23 UTC on e7f111948823
14:06:17.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12775
14:06:17.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:06:17.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:17.578166 12033 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:06:17.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:17.579090 12033 file_cache.cc:504] Constructed file cache file cache with capacity 419430
14:06:17.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:17.588833 12039 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:06:17.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:17.840554 12024 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.165.253" port: 43175 } attempt: 5
14:06:17.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:17.847520 12024 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.165.253:43175: Network error: Client connection negotiation failed: client connection to 127.11.165.253:43175: connect: Connection refused (error 111)
14:06:18.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:18.395071 12024 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.165.253" port: 43175 } attempt: 6
14:06:18.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:18.406390 12024 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.165.253:43175: Network error: Client connection negotiation failed: client connection to 127.11.165.253:43175: connect: Connection refused (error 111)
14:06:18.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:17.590824 12040 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:06:18.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:18.803103 12042 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:06:18.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:18.805583 12041 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1210 milliseconds
14:06:18.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:18.805716 12033 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:06:18.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:18.806978 12033 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:06:18.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:18.809374 12033 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:06:18.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:18.810695 12033 hybrid_clock.cc:648] HybridClock initialized: now 1783519578810677 us; error 61 us; skew 500 ppm
14:06:18.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:18.811467 12033 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:06:18.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 08 14:06:18 dist-test-slave-h3x3 krb5kdc[11938](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1783519578, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.165.253@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
14:06:18.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:18.817363 12033 init.cc:377] Logged in from keytab as kudu/127.11.165.253@KRBTEST.COM (short username kudu)
14:06:18.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:18.822510 12033 webserver.cc:533] Webserver started at http://127.11.165.253:38277/ using document root <none> and password file <none>
14:06:18.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:18.823521 12033 fs_manager.cc:362] Metadata directory not provided
14:06:18.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:18.823765 12033 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:06:18.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:18.824277 12033 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:06:18.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:18.828936 12033 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/master-1/data/instance:
14:06:18.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d066de8000024b8a80c0a337f655e38f"
14:06:18.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:06:18 on dist-test-slave-h3x3"
14:06:18.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:18.830286 12033 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/master-1/wal/instance:
14:06:18.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d066de8000024b8a80c0a337f655e38f"
14:06:18.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:06:18 on dist-test-slave-h3x3"
14:06:18.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:18.838135 12033 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.001s
14:06:18.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:18.843892 12052 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:06:18.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:18.844995 12033 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.003s
14:06:18.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:18.845408 12033 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/master-1/data,/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/master-1/wal
14:06:18.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d066de8000024b8a80c0a337f655e38f"
14:06:18.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:06:18 on dist-test-slave-h3x3"
14:06:18.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:18.845798 12033 fs_report.cc:389] FS layout report
14:06:18.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:06:18.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/master-1/wal
14:06:18.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/master-1/wal
14:06:18.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/master-1/data/data
14:06:18.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:06:18.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:06:18.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:06:18.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:06:18.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:06:18.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:06:18.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:06:18.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:06:18.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:06:18.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:06:18.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:06:18.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:18.918419 12033 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:06:18.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:18.928923 12033 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:06:18.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:18.929448 12033 kserver.cc:163] Server-wide thread pool size limit: 3276
14:06:19.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:18.999842 12033 rpc_server.cc:307] RPC server started. Bound to: 127.11.165.253:43175
14:06:19.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:18.999939 12103 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.165.253:43175 every 8 connection(s)
14:06:19.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:19.002699 12033 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/master-1/data/info.pb
14:06:19.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:19.007737 11927 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskM8Xy4F/build/tsan/bin/kudu as pid 12033
14:06:19.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:19.008216 11927 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/master-1/wal/instance
14:06:19.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:19.008519 12104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
14:06:19.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:19.018851 12104 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.165.254" port: 38921 } has no permanent_uuid. Determining permanent_uuid...
14:06:19.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for kudu/127.11.165.252@KRBTEST.COM; defaulting to no policy
14:06:19.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
14:06:19.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "kudu/127.11.165.252@KRBTEST.COM" created.
14:06:19.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 08 14:06:19 dist-test-slave-h3x3 krb5kdc[11938](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1783519578, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.165.253@KRBTEST.COM for kudu/127.11.165.254@KRBTEST.COM
14:06:19.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
14:06:19.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.11.165.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/krb5kdc/kudu.keytab.
14:06:19.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.11.165.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/krb5kdc/kudu.keytab.
14:06:19.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:19.060153 12104 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.165.253" port: 43175 } has no permanent_uuid. Determining permanent_uuid...
14:06:19.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for HTTP/127.11.165.252@KRBTEST.COM; defaulting to no policy
14:06:19.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
14:06:19.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "HTTP/127.11.165.252@KRBTEST.COM" created.
14:06:19.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 08 14:06:19 dist-test-slave-h3x3 krb5kdc[11938](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1783519578, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.165.253@KRBTEST.COM for kudu/127.11.165.253@KRBTEST.COM
14:06:19.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:19.087725 12104 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.165.252" port: 44325 } has no permanent_uuid. Determining permanent_uuid...
14:06:19.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:19.090576 12055 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.165.252:44325: connect: Connection refused (error 111)
14:06:19.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
14:06:19.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.11.165.252 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/krb5kdc/kudu.keytab.
14:06:19.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.11.165.252 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/krb5kdc/kudu.keytab.
14:06:19.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:19.094880 12104 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.165.252:44325: Network error: Client connection negotiation failed: client connection to 127.11.165.252:44325: connect: Connection refused (error 111)
14:06:19.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:19.096060 11927 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskM8Xy4F/build/tsan/bin/kudu
14:06:19.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskM8Xy4F/build/tsan/bin/kudu
14:06:19.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/master-2/wal
14:06:19.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/master-2/data
14:06:19.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:06:19.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:06:19.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:06:19.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:06:19.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:06:19.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:06:19.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/master-2/logs
14:06:19.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/master-2/data/info.pb
14:06:19.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:06:19.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:06:19.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:06:19.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:06:19.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:06:19.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:06:19.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:06:19.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:06:19.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
14:06:19.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:06:19.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:06:19.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:06:19.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.165.252:44325
14:06:19.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.165.252
14:06:19.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:06:19.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/krb5kdc/kudu.keytab
14:06:19.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.11.165.252
14:06:19.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
14:06:19.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=test-admin
14:06:19.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=test-user
14:06:19.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=true
14:06:19.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.165.212:36083
14:06:19.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:06:19.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:06:19.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:06:19.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:06:19.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.11.165.254:38921,127.11.165.253:43175,127.11.165.252:44325
14:06:19.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:06:19.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:32871/jwks.json
14:06:19.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=false with env {KRB5CCNAME=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
14:06:19.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:19.144340 12104 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.165.252" port: 44325 } attempt: 1
14:06:19.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:19.149236 12104 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.165.252:44325: Network error: Client connection negotiation failed: client connection to 127.11.165.252:44325: connect: Connection refused (error 111)
14:06:19.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:19.217705 12104 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.165.252" port: 44325 } attempt: 2
14:06:19.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:19.222492 12104 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.165.252:44325: Network error: Client connection negotiation failed: client connection to 127.11.165.252:44325: connect: Connection refused (error 111)
14:06:19.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:19.313910 12104 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.165.252" port: 44325 } attempt: 3
14:06:19.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:19.318682 12104 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.165.252:44325: Network error: Client connection negotiation failed: client connection to 127.11.165.252:44325: connect: Connection refused (error 111)
14:06:19.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:19.411616 12114 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:06:19.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:19.412148 12114 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:06:19.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:19.412699 12114 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:06:19.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:19.444455 12114 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
14:06:19.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:19.444797 12114 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:06:19.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:19.445001 12114 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
14:06:19.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:19.445201 12114 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
14:06:19.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:19.445389 12114 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
14:06:19.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:19.445535 12114 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:32871/jwks.json
14:06:19.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:19.462126 12104 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.165.252" port: 44325 } attempt: 4
14:06:19.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:19.466639 12104 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.165.252:44325: Network error: Client connection negotiation failed: client connection to 127.11.165.252:44325: connect: Connection refused (error 111)
14:06:19.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:19.467008 12024 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.165.253" port: 43175 } attempt: 7
14:06:19.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 08 14:06:19 dist-test-slave-h3x3 krb5kdc[11938](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1783519576, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.165.254@KRBTEST.COM for kudu/127.11.165.253@KRBTEST.COM
14:06:19.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:19.489573 12024 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.165.252" port: 44325 } has no permanent_uuid. Determining permanent_uuid...
14:06:19.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:19.492694 12114 master_runner.cc:387] Master server non-default flags:
14:06:19.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:06:19.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.165.212:36083
14:06:19.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:06:19.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:06:19.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/master-2/data
14:06:19.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/master-2/wal
14:06:19.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:06:19.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.11.165.254:38921,127.11.165.253:43175,127.11.165.252:44325
14:06:19.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/krb5kdc/kudu.keytab
14:06:19.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.11.165.252
14:06:19.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:06:19.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:06:19.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:06:19.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.165.252:44325
14:06:19.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:06:19.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:06:19.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:06:19.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:32871/jwks.json
14:06:19.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
14:06:19.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=<redacted>
14:06:19.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=<redacted>
14:06:19.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:06:19.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:06:19.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/master-2/data/info.pb
14:06:19.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.165.252
14:06:19.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:06:19.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:06:19.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:06:19.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:06:19.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:06:19.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:06:19.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/master-2/logs
14:06:19.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:06:19.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:06:19.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:06:19.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
14:06:19.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:06:19.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
14:06:19.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:06:19.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 13:43:23 UTC on e7f111948823
14:06:19.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12775
14:06:19.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:06:19.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:19.494397 12114 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:06:19.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:19.495438 12024 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.165.252:44325: Network error: Client connection negotiation failed: client connection to 127.11.165.252:44325: connect: Connection refused (error 111)
14:06:19.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:19.495752 12114 file_cache.cc:504] Constructed file cache file cache with capacity 419430
14:06:19.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:19.507308 12122 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:06:19.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:19.553841 12024 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.165.252" port: 44325 } attempt: 1
14:06:19.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:19.562366 12024 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.165.252:44325: Network error: Client connection negotiation failed: client connection to 127.11.165.252:44325: connect: Connection refused (error 111)
14:06:19.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:19.643898 12024 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.165.252" port: 44325 } attempt: 2
14:06:19.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:19.651716 12024 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.165.252:44325: Network error: Client connection negotiation failed: client connection to 127.11.165.252:44325: connect: Connection refused (error 111)
14:06:19.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:19.737237 12024 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.165.252" port: 44325 } attempt: 3
14:06:19.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:19.745328 12024 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.165.252:44325: Network error: Client connection negotiation failed: client connection to 127.11.165.252:44325: connect: Connection refused (error 111)
14:06:19.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:19.766108 12104 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.165.252" port: 44325 } attempt: 5
14:06:19.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:19.773937 12104 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.165.252:44325: Network error: Client connection negotiation failed: client connection to 127.11.165.252:44325: connect: Connection refused (error 111)
14:06:19.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:19.885865 12024 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.165.252" port: 44325 } attempt: 4
14:06:19.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:19.893713 12024 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.165.252:44325: Network error: Client connection negotiation failed: client connection to 127.11.165.252:44325: connect: Connection refused (error 111)
14:06:20.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:20.177378 12024 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.165.252" port: 44325 } attempt: 5
14:06:20.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:20.185758 12024 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.165.252:44325: Network error: Client connection negotiation failed: client connection to 127.11.165.252:44325: connect: Connection refused (error 111)
14:06:20.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:20.321527 12104 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.165.252" port: 44325 } attempt: 6
14:06:20.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:20.352094 12104 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.165.252:44325: Network error: Client connection negotiation failed: client connection to 127.11.165.252:44325: connect: Connection refused (error 111)
14:06:20.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:20.738293 12024 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.165.252" port: 44325 } attempt: 6
14:06:20.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:20.770202 12024 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.165.252:44325: Network error: Client connection negotiation failed: client connection to 127.11.165.252:44325: connect: Connection refused (error 111)
14:06:21.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:20.909652 12121 debug-util.cc:398] Leaking SignalData structure 0x7b0800037100 after lost signal to thread 12114
14:06:21.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:21.307235 12114 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.800s	user 0.626s	sys 1.163s
14:06:21.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:19.508095 12123 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:06:21.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:21.308450 12114 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.801s	user 0.627s	sys 1.164s
14:06:21.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:21.309324 12124 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1800 milliseconds
14:06:21.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.310163 12114 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:06:21.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:21.310236 12125 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:06:21.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.314216 12114 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:06:21.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.316635 12114 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:06:21.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.318008 12114 hybrid_clock.cc:648] HybridClock initialized: now 1783519581317958 us; error 52 us; skew 500 ppm
14:06:21.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.318908 12114 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:06:21.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 08 14:06:21 dist-test-slave-h3x3 krb5kdc[11938](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1783519581, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.165.252@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
14:06:21.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.325075 12114 init.cc:377] Logged in from keytab as kudu/127.11.165.252@KRBTEST.COM (short username kudu)
14:06:21.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.330370 12114 webserver.cc:533] Webserver started at http://127.11.165.252:35285/ using document root <none> and password file <none>
14:06:21.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.331389 12114 fs_manager.cc:362] Metadata directory not provided
14:06:21.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.331635 12114 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:06:21.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.332139 12114 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:06:21.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.336252 12114 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/master-2/data/instance:
14:06:21.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "378eb9c8b9854096b3974138a01f4575"
14:06:21.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:06:21 on dist-test-slave-h3x3"
14:06:21.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.337392 12114 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/master-2/wal/instance:
14:06:21.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "378eb9c8b9854096b3974138a01f4575"
14:06:21.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:06:21 on dist-test-slave-h3x3"
14:06:21.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.344712 12114 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.008s	sys 0.002s
14:06:21.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.350010 12137 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:06:21.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.351090 12114 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
14:06:21.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.351449 12114 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/master-2/data,/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/master-2/wal
14:06:21.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "378eb9c8b9854096b3974138a01f4575"
14:06:21.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:06:21 on dist-test-slave-h3x3"
14:06:21.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.351745 12114 fs_report.cc:389] FS layout report
14:06:21.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:06:21.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/master-2/wal
14:06:21.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/master-2/wal
14:06:21.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/master-2/data/data
14:06:21.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:06:21.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:06:21.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:06:21.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:06:21.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:06:21.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:06:21.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:06:21.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:06:21.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:06:21.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:06:21.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:06:21.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.412638 12104 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.165.252" port: 44325 } attempt: 7
14:06:21.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:21.419866 12104 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.11.165.252:44325: Network error: Client connection negotiation failed: client connection to 127.11.165.252:44325: connect: Connection refused (error 111)
14:06:21.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.421720 12114 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:06:21.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.427424 12114 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:06:21.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.427834 12114 kserver.cc:163] Server-wide thread pool size limit: 3276
14:06:21.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.497274 12114 rpc_server.cc:307] RPC server started. Bound to: 127.11.165.252:44325
14:06:21.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.497349 12191 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.165.252:44325 every 8 connection(s)
14:06:21.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.499845 12114 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/master-2/data/info.pb
14:06:21.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.504673 11927 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskM8Xy4F/build/tsan/bin/kudu as pid 12114
14:06:21.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.505193 11927 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/master-2/wal/instance
14:06:21.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.506361 12192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
14:06:21.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.522521 12192 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.165.254" port: 38921 } has no permanent_uuid. Determining permanent_uuid...
14:06:21.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 08 14:06:21 dist-test-slave-h3x3 krb5kdc[11938](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1783519575, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.165.254@KRBTEST.COM
14:06:21.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 08 14:06:21 dist-test-slave-h3x3 krb5kdc[11938](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1783519581, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.165.252@KRBTEST.COM for kudu/127.11.165.254@KRBTEST.COM
14:06:21.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 08 14:06:21 dist-test-slave-h3x3 krb5kdc[11938](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1783519575, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.165.253@KRBTEST.COM
14:06:21.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.562276 12192 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.165.253" port: 43175 } has no permanent_uuid. Determining permanent_uuid...
14:06:21.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 08 14:06:21 dist-test-slave-h3x3 krb5kdc[11938](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1783519581, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.165.252@KRBTEST.COM for kudu/127.11.165.253@KRBTEST.COM
14:06:21.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 08 14:06:21 dist-test-slave-h3x3 krb5kdc[11938](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1783519575, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.165.252@KRBTEST.COM
14:06:21.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.584676 12192 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.11.165.252" port: 44325 } has no permanent_uuid. Determining permanent_uuid...
14:06:21.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 08 14:06:21 dist-test-slave-h3x3 krb5kdc[11938](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1783519581, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.165.252@KRBTEST.COM for kudu/127.11.165.252@KRBTEST.COM
14:06:21.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.613443 12192 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 378eb9c8b9854096b3974138a01f4575: Bootstrap starting.
14:06:21.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.619278 12192 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 378eb9c8b9854096b3974138a01f4575: Neither blocks nor log segments found. Creating new log.
14:06:21.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.620904 12192 log.cc:826] T 00000000000000000000000000000000 P 378eb9c8b9854096b3974138a01f4575: Log is configured to *not* fsync() on all Append() calls
14:06:21.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.626008 12192 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 378eb9c8b9854096b3974138a01f4575: No bootstrap required, opened a new log
14:06:21.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.644465 12192 raft_consensus.cc:359] T 00000000000000000000000000000000 P 378eb9c8b9854096b3974138a01f4575 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7faaac60f84747d0b0ef931df71fc8c2" member_type: VOTER last_known_addr { host: "127.11.165.254" port: 38921 } } peers { permanent_uuid: "d066de8000024b8a80c0a337f655e38f" member_type: VOTER last_known_addr { host: "127.11.165.253" port: 43175 } } peers { permanent_uuid: "378eb9c8b9854096b3974138a01f4575" member_type: VOTER last_known_addr { host: "127.11.165.252" port: 44325 } }
14:06:21.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.645345 12192 raft_consensus.cc:385] T 00000000000000000000000000000000 P 378eb9c8b9854096b3974138a01f4575 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:06:21.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.645676 12192 raft_consensus.cc:740] T 00000000000000000000000000000000 P 378eb9c8b9854096b3974138a01f4575 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 378eb9c8b9854096b3974138a01f4575, State: Initialized, Role: FOLLOWER
14:06:21.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.646602 12192 consensus_queue.cc:260] T 00000000000000000000000000000000 P 378eb9c8b9854096b3974138a01f4575 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7faaac60f84747d0b0ef931df71fc8c2" member_type: VOTER last_known_addr { host: "127.11.165.254" port: 38921 } } peers { permanent_uuid: "d066de8000024b8a80c0a337f655e38f" member_type: VOTER last_known_addr { host: "127.11.165.253" port: 43175 } } peers { permanent_uuid: "378eb9c8b9854096b3974138a01f4575" member_type: VOTER last_known_addr { host: "127.11.165.252" port: 44325 } }
14:06:21.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.649044 12203 sys_catalog.cc:455] T 00000000000000000000000000000000 P 378eb9c8b9854096b3974138a01f4575 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7faaac60f84747d0b0ef931df71fc8c2" member_type: VOTER last_known_addr { host: "127.11.165.254" port: 38921 } } peers { permanent_uuid: "d066de8000024b8a80c0a337f655e38f" member_type: VOTER last_known_addr { host: "127.11.165.253" port: 43175 } } peers { permanent_uuid: "378eb9c8b9854096b3974138a01f4575" member_type: VOTER last_known_addr { host: "127.11.165.252" port: 44325 } } }
14:06:21.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.649611 12203 sys_catalog.cc:458] T 00000000000000000000000000000000 P 378eb9c8b9854096b3974138a01f4575 [sys.catalog]: This master's current role is: FOLLOWER
14:06:21.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.650535 12192 sys_catalog.cc:565] T 00000000000000000000000000000000 P 378eb9c8b9854096b3974138a01f4575 [sys.catalog]: configured and running, proceeding with master startup.
14:06:21.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:21.674475 12214 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 378eb9c8b9854096b3974138a01f4575: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
14:06:21.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:21.674853 12214 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
14:06:21.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:21.682835 12145 tablet.cc:2406] T 00000000000000000000000000000000 P 378eb9c8b9854096b3974138a01f4575: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:06:21.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.670339 12114 master_runner.cc:187] Error getting master registration for 127.11.165.254:38921: OK, instance_id { permanent_uuid: "7faaac60f84747d0b0ef931df71fc8c2" instance_seqno: 1783519577083377 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
14:06:21.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.695505 12114 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
14:06:21.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.803809 12024 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.165.252" port: 44325 } attempt: 7
14:06:21.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 08 14:06:21 dist-test-slave-h3x3 krb5kdc[11938](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1783519576, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.165.254@KRBTEST.COM for kudu/127.11.165.252@KRBTEST.COM
14:06:21.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.834354 12024 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7faaac60f84747d0b0ef931df71fc8c2: Bootstrap starting.
14:06:21.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.839502 12024 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7faaac60f84747d0b0ef931df71fc8c2: Neither blocks nor log segments found. Creating new log.
14:06:21.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.841153 12024 log.cc:826] T 00000000000000000000000000000000 P 7faaac60f84747d0b0ef931df71fc8c2: Log is configured to *not* fsync() on all Append() calls
14:06:21.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.845373 12024 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7faaac60f84747d0b0ef931df71fc8c2: No bootstrap required, opened a new log
14:06:21.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.864387 12024 raft_consensus.cc:359] T 00000000000000000000000000000000 P 7faaac60f84747d0b0ef931df71fc8c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7faaac60f84747d0b0ef931df71fc8c2" member_type: VOTER last_known_addr { host: "127.11.165.254" port: 38921 } } peers { permanent_uuid: "d066de8000024b8a80c0a337f655e38f" member_type: VOTER last_known_addr { host: "127.11.165.253" port: 43175 } } peers { permanent_uuid: "378eb9c8b9854096b3974138a01f4575" member_type: VOTER last_known_addr { host: "127.11.165.252" port: 44325 } }
14:06:21.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.865018 12024 raft_consensus.cc:385] T 00000000000000000000000000000000 P 7faaac60f84747d0b0ef931df71fc8c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:06:21.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.865204 12024 raft_consensus.cc:740] T 00000000000000000000000000000000 P 7faaac60f84747d0b0ef931df71fc8c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7faaac60f84747d0b0ef931df71fc8c2, State: Initialized, Role: FOLLOWER
14:06:21.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.865849 12024 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7faaac60f84747d0b0ef931df71fc8c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7faaac60f84747d0b0ef931df71fc8c2" member_type: VOTER last_known_addr { host: "127.11.165.254" port: 38921 } } peers { permanent_uuid: "d066de8000024b8a80c0a337f655e38f" member_type: VOTER last_known_addr { host: "127.11.165.253" port: 43175 } } peers { permanent_uuid: "378eb9c8b9854096b3974138a01f4575" member_type: VOTER last_known_addr { host: "127.11.165.252" port: 44325 } }
14:06:21.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.868722 12218 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7faaac60f84747d0b0ef931df71fc8c2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7faaac60f84747d0b0ef931df71fc8c2" member_type: VOTER last_known_addr { host: "127.11.165.254" port: 38921 } } peers { permanent_uuid: "d066de8000024b8a80c0a337f655e38f" member_type: VOTER last_known_addr { host: "127.11.165.253" port: 43175 } } peers { permanent_uuid: "378eb9c8b9854096b3974138a01f4575" member_type: VOTER last_known_addr { host: "127.11.165.252" port: 44325 } } }
14:06:21.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.869537 12218 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7faaac60f84747d0b0ef931df71fc8c2 [sys.catalog]: This master's current role is: FOLLOWER
14:06:21.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.870523 12024 sys_catalog.cc:565] T 00000000000000000000000000000000 P 7faaac60f84747d0b0ef931df71fc8c2 [sys.catalog]: configured and running, proceeding with master startup.
14:06:21.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:21.899034 12229 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 7faaac60f84747d0b0ef931df71fc8c2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
14:06:21.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:21.905783 12229 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
14:06:21.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.897616 11954 master_runner.cc:187] Error getting master registration for 127.11.165.253:43175: OK, instance_id { permanent_uuid: "d066de8000024b8a80c0a337f655e38f" instance_seqno: 1783519578980738 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
14:06:21.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.928805 11954 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
14:06:22.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:22.043035 11977 tablet.cc:2406] T 00000000000000000000000000000000 P 7faaac60f84747d0b0ef931df71fc8c2: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:06:22.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:22.119508 12203 raft_consensus.cc:493] T 00000000000000000000000000000000 P 378eb9c8b9854096b3974138a01f4575 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:06:22.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:22.120106 12203 raft_consensus.cc:515] T 00000000000000000000000000000000 P 378eb9c8b9854096b3974138a01f4575 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7faaac60f84747d0b0ef931df71fc8c2" member_type: VOTER last_known_addr { host: "127.11.165.254" port: 38921 } } peers { permanent_uuid: "d066de8000024b8a80c0a337f655e38f" member_type: VOTER last_known_addr { host: "127.11.165.253" port: 43175 } } peers { permanent_uuid: "378eb9c8b9854096b3974138a01f4575" member_type: VOTER last_known_addr { host: "127.11.165.252" port: 44325 } }
14:06:22.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:22.125926 11998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "378eb9c8b9854096b3974138a01f4575" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7faaac60f84747d0b0ef931df71fc8c2" is_pre_election: true
14:06:22.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:22.126874 11998 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 7faaac60f84747d0b0ef931df71fc8c2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 378eb9c8b9854096b3974138a01f4575 in term 0.
14:06:22.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:22.128870 12140 leader_election.cc:304] T 00000000000000000000000000000000 P 378eb9c8b9854096b3974138a01f4575 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 378eb9c8b9854096b3974138a01f4575, 7faaac60f84747d0b0ef931df71fc8c2; no voters: 
14:06:22.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:22.130749 12203 leader_election.cc:290] T 00000000000000000000000000000000 P 378eb9c8b9854096b3974138a01f4575 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7faaac60f84747d0b0ef931df71fc8c2 (127.11.165.254:38921), d066de8000024b8a80c0a337f655e38f (127.11.165.253:43175)
14:06:22.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:22.131816 12203 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 378eb9c8b9854096b3974138a01f4575 [term 0 FOLLOWER]: Leader pre-election won for term 1
14:06:22.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:22.133563 12203 raft_consensus.cc:493] T 00000000000000000000000000000000 P 378eb9c8b9854096b3974138a01f4575 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:06:22.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:22.134395 12203 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 378eb9c8b9854096b3974138a01f4575 [term 0 FOLLOWER]: Advancing to term 1
14:06:22.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:22.158885 12203 raft_consensus.cc:515] T 00000000000000000000000000000000 P 378eb9c8b9854096b3974138a01f4575 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7faaac60f84747d0b0ef931df71fc8c2" member_type: VOTER last_known_addr { host: "127.11.165.254" port: 38921 } } peers { permanent_uuid: "d066de8000024b8a80c0a337f655e38f" member_type: VOTER last_known_addr { host: "127.11.165.253" port: 43175 } } peers { permanent_uuid: "378eb9c8b9854096b3974138a01f4575" member_type: VOTER last_known_addr { host: "127.11.165.252" port: 44325 } }
14:06:22.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:22.162451 12203 leader_election.cc:290] T 00000000000000000000000000000000 P 378eb9c8b9854096b3974138a01f4575 [CANDIDATE]: Term 1 election: Requested vote from peers 7faaac60f84747d0b0ef931df71fc8c2 (127.11.165.254:38921), d066de8000024b8a80c0a337f655e38f (127.11.165.253:43175)
14:06:22.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:22.162389 11998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "378eb9c8b9854096b3974138a01f4575" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7faaac60f84747d0b0ef931df71fc8c2"
14:06:22.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:22.162950 11998 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 7faaac60f84747d0b0ef931df71fc8c2 [term 0 FOLLOWER]: Advancing to term 1
14:06:22.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:22.170712 11998 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 7faaac60f84747d0b0ef931df71fc8c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 378eb9c8b9854096b3974138a01f4575 in term 1.
14:06:22.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:22.171983 12140 leader_election.cc:304] T 00000000000000000000000000000000 P 378eb9c8b9854096b3974138a01f4575 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 378eb9c8b9854096b3974138a01f4575, 7faaac60f84747d0b0ef931df71fc8c2; no voters: 
14:06:22.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:22.172909 12203 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 378eb9c8b9854096b3974138a01f4575 [term 1 FOLLOWER]: Leader election won for term 1
14:06:22.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:22.173367 12203 raft_consensus.cc:697] T 00000000000000000000000000000000 P 378eb9c8b9854096b3974138a01f4575 [term 1 LEADER]: Becoming Leader. State: Replica: 378eb9c8b9854096b3974138a01f4575, State: Running, Role: LEADER
14:06:22.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:22.174315 12203 consensus_queue.cc:237] T 00000000000000000000000000000000 P 378eb9c8b9854096b3974138a01f4575 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7faaac60f84747d0b0ef931df71fc8c2" member_type: VOTER last_known_addr { host: "127.11.165.254" port: 38921 } } peers { permanent_uuid: "d066de8000024b8a80c0a337f655e38f" member_type: VOTER last_known_addr { host: "127.11.165.253" port: 43175 } } peers { permanent_uuid: "378eb9c8b9854096b3974138a01f4575" member_type: VOTER last_known_addr { host: "127.11.165.252" port: 44325 } }
14:06:22.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:22.183787 12231 sys_catalog.cc:455] T 00000000000000000000000000000000 P 378eb9c8b9854096b3974138a01f4575 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 378eb9c8b9854096b3974138a01f4575. Latest consensus state: current_term: 1 leader_uuid: "378eb9c8b9854096b3974138a01f4575" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7faaac60f84747d0b0ef931df71fc8c2" member_type: VOTER last_known_addr { host: "127.11.165.254" port: 38921 } } peers { permanent_uuid: "d066de8000024b8a80c0a337f655e38f" member_type: VOTER last_known_addr { host: "127.11.165.253" port: 43175 } } peers { permanent_uuid: "378eb9c8b9854096b3974138a01f4575" member_type: VOTER last_known_addr { host: "127.11.165.252" port: 44325 } } }
14:06:22.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:22.184515 12231 sys_catalog.cc:458] T 00000000000000000000000000000000 P 378eb9c8b9854096b3974138a01f4575 [sys.catalog]: This master's current role is: LEADER
14:06:22.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:22.186691 12233 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
14:06:22.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:22.193624 12233 catalog_manager.cc:1520] Initializing Kudu cluster ID...
14:06:22.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:22.221714 11998 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 7faaac60f84747d0b0ef931df71fc8c2 [term 1 FOLLOWER]: Refusing update from remote peer 378eb9c8b9854096b3974138a01f4575: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
14:06:22.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:22.223452 12231 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 378eb9c8b9854096b3974138a01f4575 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7faaac60f84747d0b0ef931df71fc8c2" member_type: VOTER last_known_addr { host: "127.11.165.254" port: 38921 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:06:22.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:22.254390 12218 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7faaac60f84747d0b0ef931df71fc8c2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 378eb9c8b9854096b3974138a01f4575. Latest consensus state: current_term: 1 leader_uuid: "378eb9c8b9854096b3974138a01f4575" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7faaac60f84747d0b0ef931df71fc8c2" member_type: VOTER last_known_addr { host: "127.11.165.254" port: 38921 } } peers { permanent_uuid: "d066de8000024b8a80c0a337f655e38f" member_type: VOTER last_known_addr { host: "127.11.165.253" port: 43175 } } peers { permanent_uuid: "378eb9c8b9854096b3974138a01f4575" member_type: VOTER last_known_addr { host: "127.11.165.252" port: 44325 } } }
14:06:22.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:22.255096 12218 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7faaac60f84747d0b0ef931df71fc8c2 [sys.catalog]: This master's current role is: FOLLOWER
14:06:22.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:22.260651 12234 mvcc.cc:204] Tried to move back new op lower bound from 7305296208761368576 to 7305296208595873792. Current Snapshot: MvccSnapshot[applied={T|T < 7305296208761368576}]
14:06:22.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:22.264324 12235 mvcc.cc:204] Tried to move back new op lower bound from 7305296208761368576 to 7305296208595873792. Current Snapshot: MvccSnapshot[applied={T|T < 7305296208761368576}]
14:06:22.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:22.275490 12218 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7faaac60f84747d0b0ef931df71fc8c2 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "378eb9c8b9854096b3974138a01f4575" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7faaac60f84747d0b0ef931df71fc8c2" member_type: VOTER last_known_addr { host: "127.11.165.254" port: 38921 } } peers { permanent_uuid: "d066de8000024b8a80c0a337f655e38f" member_type: VOTER last_known_addr { host: "127.11.165.253" port: 43175 } } peers { permanent_uuid: "378eb9c8b9854096b3974138a01f4575" member_type: VOTER last_known_addr { host: "127.11.165.252" port: 44325 } } }
14:06:22.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:22.276188 12218 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7faaac60f84747d0b0ef931df71fc8c2 [sys.catalog]: This master's current role is: FOLLOWER
14:06:22.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:22.279381 12231 sys_catalog.cc:455] T 00000000000000000000000000000000 P 378eb9c8b9854096b3974138a01f4575 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "378eb9c8b9854096b3974138a01f4575" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7faaac60f84747d0b0ef931df71fc8c2" member_type: VOTER last_known_addr { host: "127.11.165.254" port: 38921 } } peers { permanent_uuid: "d066de8000024b8a80c0a337f655e38f" member_type: VOTER last_known_addr { host: "127.11.165.253" port: 43175 } } peers { permanent_uuid: "378eb9c8b9854096b3974138a01f4575" member_type: VOTER last_known_addr { host: "127.11.165.252" port: 44325 } } }
14:06:22.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:22.280081 12231 sys_catalog.cc:458] T 00000000000000000000000000000000 P 378eb9c8b9854096b3974138a01f4575 [sys.catalog]: This master's current role is: LEADER
14:06:22.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:22.282207 12233 catalog_manager.cc:1383] Generated new cluster ID: e87f03fc2e8145b5942be9a6f1f06976
14:06:22.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:22.282477 12233 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
14:06:22.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:22.386981 12233 catalog_manager.cc:1406] Generated new certificate authority record
14:06:22.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:22.389947 12233 catalog_manager.cc:1540] Loading token signing keys...
14:06:22.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:22.415978 12233 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 378eb9c8b9854096b3974138a01f4575: Generated new TSK 0
14:06:22.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:22.417090 12233 catalog_manager.cc:1550] Initializing in-progress tserver states...
14:06:22.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for kudu/127.11.165.193@KRBTEST.COM; defaulting to no policy
14:06:22.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
14:06:22.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "kudu/127.11.165.193@KRBTEST.COM" created.
14:06:22.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
14:06:22.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.11.165.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/krb5kdc/kudu.keytab.
14:06:22.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.11.165.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/krb5kdc/kudu.keytab.
14:06:22.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for HTTP/127.11.165.193@KRBTEST.COM; defaulting to no policy
14:06:22.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
14:06:22.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "HTTP/127.11.165.193@KRBTEST.COM" created.
14:06:22.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
14:06:22.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.11.165.193 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/krb5kdc/kudu.keytab.
14:06:22.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.11.165.193 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/krb5kdc/kudu.keytab.
14:06:22.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:22.615478 11927 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskM8Xy4F/build/tsan/bin/kudu
14:06:22.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskM8Xy4F/build/tsan/bin/kudu
14:06:22.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/ts-0/wal
14:06:22.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/ts-0/data
14:06:22.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:06:22.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:06:22.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:06:22.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:06:22.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:06:22.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:06:22.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/ts-0/logs
14:06:22.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/ts-0/data/info.pb
14:06:22.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:06:22.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:06:22.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:06:22.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:06:22.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:06:22.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:06:22.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:06:22.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:06:22.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
14:06:22.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:06:22.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.165.193:0
14:06:22.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.11.165.193
14:06:22.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.165.193
14:06:22.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:06:22.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.11.165.254:38921,127.11.165.253:43175,127.11.165.252:44325
14:06:22.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/krb5kdc/kudu.keytab
14:06:22.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.11.165.193
14:06:22.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
14:06:22.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=test-admin
14:06:22.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=test-user
14:06:22.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=true
14:06:22.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.165.212:36083
14:06:22.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:06:22.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:06:22.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:06:22.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=false with env {KRB5CCNAME=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
14:06:22.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:22.911863 12229 catalog_manager.cc:1295] Loaded cluster ID: e87f03fc2e8145b5942be9a6f1f06976
14:06:22.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:22.912560 12229 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 7faaac60f84747d0b0ef931df71fc8c2: loading cluster ID for follower catalog manager: success
14:06:22.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:22.919979 12229 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 7faaac60f84747d0b0ef931df71fc8c2: acquiring CA information for follower catalog manager: success
14:06:22.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:22.938951 12229 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 7faaac60f84747d0b0ef931df71fc8c2: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
14:06:23.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:23.119249 12245 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:06:23.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:23.119877 12245 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:06:23.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:23.120790 12245 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:06:23.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:23.182996 12245 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:06:23.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:23.184697 12245 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.165.193
14:06:23.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.258342 12245 tablet_server_runner.cc:78] Tablet server non-default flags:
14:06:23.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:06:23.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.165.212:36083
14:06:23.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:06:23.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:06:23.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/ts-0/data
14:06:23.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/ts-0/wal
14:06:23.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/krb5kdc/kudu.keytab
14:06:23.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.11.165.193
14:06:23.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:06:23.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:06:23.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.165.193:0
14:06:23.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:06:23.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
14:06:23.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=<redacted>
14:06:23.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=<redacted>
14:06:23.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:06:23.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:06:23.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/ts-0/data/info.pb
14:06:23.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.165.193
14:06:23.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:06:23.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.11.165.254:38921,127.11.165.253:43175,127.11.165.252:44325
14:06:23.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:06:23.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:06:23.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:06:23.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:06:23.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:06:23.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.11.165.193
14:06:23.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/ts-0/logs
14:06:23.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:06:23.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:06:23.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:06:23.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
14:06:23.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:06:23.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
14:06:23.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:06:23.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 13:43:23 UTC on e7f111948823
14:06:23.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12775
14:06:23.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:06:23.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.260143 12245 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:06:23.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.261538 12245 file_cache.cc:504] Constructed file cache file cache with capacity 419430
14:06:23.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:23.294014 12253 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:06:23.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.510298 12104 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.11.165.252" port: 44325 } attempt: 8
14:06:23.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 08 14:06:23 dist-test-slave-h3x3 krb5kdc[11938](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1783519578, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.165.253@KRBTEST.COM for kudu/127.11.165.252@KRBTEST.COM
14:06:23.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.705658 12104 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d066de8000024b8a80c0a337f655e38f: Bootstrap starting.
14:06:23.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.752920 12104 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d066de8000024b8a80c0a337f655e38f: Neither blocks nor log segments found. Creating new log.
14:06:23.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.763094 12104 log.cc:826] T 00000000000000000000000000000000 P d066de8000024b8a80c0a337f655e38f: Log is configured to *not* fsync() on all Append() calls
14:06:23.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.788993 12104 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d066de8000024b8a80c0a337f655e38f: No bootstrap required, opened a new log
14:06:23.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:23.818969 12141 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.165.253:43175 timed out after 1.654s (SENT)
14:06:23.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.820689 12104 raft_consensus.cc:359] T 00000000000000000000000000000000 P d066de8000024b8a80c0a337f655e38f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7faaac60f84747d0b0ef931df71fc8c2" member_type: VOTER last_known_addr { host: "127.11.165.254" port: 38921 } } peers { permanent_uuid: "d066de8000024b8a80c0a337f655e38f" member_type: VOTER last_known_addr { host: "127.11.165.253" port: 43175 } } peers { permanent_uuid: "378eb9c8b9854096b3974138a01f4575" member_type: VOTER last_known_addr { host: "127.11.165.252" port: 44325 } }
14:06:23.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.821734 12104 raft_consensus.cc:385] T 00000000000000000000000000000000 P d066de8000024b8a80c0a337f655e38f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:06:23.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.822094 12104 raft_consensus.cc:740] T 00000000000000000000000000000000 P d066de8000024b8a80c0a337f655e38f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d066de8000024b8a80c0a337f655e38f, State: Initialized, Role: FOLLOWER
14:06:23.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.823122 12104 consensus_queue.cc:260] T 00000000000000000000000000000000 P d066de8000024b8a80c0a337f655e38f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7faaac60f84747d0b0ef931df71fc8c2" member_type: VOTER last_known_addr { host: "127.11.165.254" port: 38921 } } peers { permanent_uuid: "d066de8000024b8a80c0a337f655e38f" member_type: VOTER last_known_addr { host: "127.11.165.253" port: 43175 } } peers { permanent_uuid: "378eb9c8b9854096b3974138a01f4575" member_type: VOTER last_known_addr { host: "127.11.165.252" port: 44325 } }
14:06:23.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.856585 12262 sys_catalog.cc:455] T 00000000000000000000000000000000 P d066de8000024b8a80c0a337f655e38f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7faaac60f84747d0b0ef931df71fc8c2" member_type: VOTER last_known_addr { host: "127.11.165.254" port: 38921 } } peers { permanent_uuid: "d066de8000024b8a80c0a337f655e38f" member_type: VOTER last_known_addr { host: "127.11.165.253" port: 43175 } } peers { permanent_uuid: "378eb9c8b9854096b3974138a01f4575" member_type: VOTER last_known_addr { host: "127.11.165.252" port: 44325 } } }
14:06:23.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.857384 12262 sys_catalog.cc:458] T 00000000000000000000000000000000 P d066de8000024b8a80c0a337f655e38f [sys.catalog]: This master's current role is: FOLLOWER
14:06:23.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.859630 12104 sys_catalog.cc:565] T 00000000000000000000000000000000 P d066de8000024b8a80c0a337f655e38f [sys.catalog]: configured and running, proceeding with master startup.
14:06:23.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.859900 12078 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "378eb9c8b9854096b3974138a01f4575" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d066de8000024b8a80c0a337f655e38f"
14:06:23.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.860999 12078 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d066de8000024b8a80c0a337f655e38f [term 0 FOLLOWER]: Advancing to term 1
14:06:23.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.866381 12076 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "378eb9c8b9854096b3974138a01f4575" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d066de8000024b8a80c0a337f655e38f"
14:06:23.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.868482 12079 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "378eb9c8b9854096b3974138a01f4575" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d066de8000024b8a80c0a337f655e38f" is_pre_election: true
14:06:23.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:23.869916 12079 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 1) took 1745 ms (client timeout 1959 ms). Trace:
14:06:23.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:23.870433 12079 rpcz_store.cc:269] 0708 14:06:22.124342 (+     0us) service_pool.cc:167] Inserting onto call queue
14:06:23.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 14:06:22.124490 (+   148us) service_pool.cc:224] Handling call
14:06:23.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 14:06:23.869820 (+1745330us) inbound_call.cc:177] Queueing success response
14:06:23.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {}
14:06:23.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.879835 12078 raft_consensus.cc:2468] T 00000000000000000000000000000000 P d066de8000024b8a80c0a337f655e38f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 378eb9c8b9854096b3974138a01f4575 in term 1.
14:06:23.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.883263 12077 raft_consensus.cc:1275] T 00000000000000000000000000000000 P d066de8000024b8a80c0a337f655e38f [term 1 FOLLOWER]: Refusing update from remote peer 378eb9c8b9854096b3974138a01f4575: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
14:06:23.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:23.892061 12078 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:44154 (request call id 2) took 1728 ms (client timeout 1654 ms). Trace:
14:06:23.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:23.892987 12078 rpcz_store.cc:269] 0708 14:06:22.164078 (+     0us) service_pool.cc:167] Inserting onto call queue
14:06:23.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 14:06:22.164223 (+   145us) service_pool.cc:224] Handling call
14:06:23.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 14:06:23.891991 (+1727768us) inbound_call.cc:177] Queueing success response
14:06:23.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {}
14:06:23.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.892639 12077 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:44154 (request call id 3) took 1672 ms. Trace:
14:06:23.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.894510 12077 rpcz_store.cc:276] 0708 14:06:22.220025 (+     0us) service_pool.cc:167] Inserting onto call queue
14:06:23.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 14:06:22.220157 (+   132us) service_pool.cc:224] Handling call
14:06:23.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 14:06:23.882447 (+1662290us) raft_consensus.cc:1471] Updating replica for 0 ops
14:06:23.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 14:06:23.883769 (+  1322us) raft_consensus.cc:1697] Filling consensus response to leader.
14:06:23.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 14:06:23.891596 (+  7827us) spinlock_profiling.cc:243] Waited 9.43 ms on lock 0x7b54000104d0. stack: 00007f02d8b0f543 00007f02d8b0f440 00007f02d86bf574 000000000050ee54 000000000050ede9 00007f02dfbf4951 00007f02dfc8ac8d 00007f02e0cbbb19 00007f02df36dd34 00007f02df36dcc2 00007f02df36dbf1 00007f02df36db6c 00007f02df36ce22 00007f02dd95bcac 00007f02dd95b0e6 00007f02dd95aa8f
14:06:23.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 14:06:23.891814 (+   218us) inbound_call.cc:177] Queueing success response
14:06:23.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"spinlock_wait_cycles":21691264}
14:06:23.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.896723 12259 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 378eb9c8b9854096b3974138a01f4575 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d066de8000024b8a80c0a337f655e38f" member_type: VOTER last_known_addr { host: "127.11.165.253" port: 43175 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:06:23.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:23.942376 12058 tablet.cc:2406] T 00000000000000000000000000000000 P d066de8000024b8a80c0a337f655e38f: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:06:23.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.989069 12262 sys_catalog.cc:455] T 00000000000000000000000000000000 P d066de8000024b8a80c0a337f655e38f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 378eb9c8b9854096b3974138a01f4575. Latest consensus state: current_term: 1 leader_uuid: "378eb9c8b9854096b3974138a01f4575" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7faaac60f84747d0b0ef931df71fc8c2" member_type: VOTER last_known_addr { host: "127.11.165.254" port: 38921 } } peers { permanent_uuid: "d066de8000024b8a80c0a337f655e38f" member_type: VOTER last_known_addr { host: "127.11.165.253" port: 43175 } } peers { permanent_uuid: "378eb9c8b9854096b3974138a01f4575" member_type: VOTER last_known_addr { host: "127.11.165.252" port: 44325 } } }
14:06:23.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.989836 12262 sys_catalog.cc:458] T 00000000000000000000000000000000 P d066de8000024b8a80c0a337f655e38f [sys.catalog]: This master's current role is: FOLLOWER
14:06:23.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.989274 12272 sys_catalog.cc:455] T 00000000000000000000000000000000 P d066de8000024b8a80c0a337f655e38f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "378eb9c8b9854096b3974138a01f4575" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7faaac60f84747d0b0ef931df71fc8c2" member_type: VOTER last_known_addr { host: "127.11.165.254" port: 38921 } } peers { permanent_uuid: "d066de8000024b8a80c0a337f655e38f" member_type: VOTER last_known_addr { host: "127.11.165.253" port: 43175 } } peers { permanent_uuid: "378eb9c8b9854096b3974138a01f4575" member_type: VOTER last_known_addr { host: "127.11.165.252" port: 44325 } } }
14:06:23.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.991189 12272 sys_catalog.cc:458] T 00000000000000000000000000000000 P d066de8000024b8a80c0a337f655e38f [sys.catalog]: This master's current role is: FOLLOWER
14:06:24.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.998134 12280 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
14:06:24.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:24.466215 12259 sys_catalog.cc:455] T 00000000000000000000000000000000 P 378eb9c8b9854096b3974138a01f4575 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "378eb9c8b9854096b3974138a01f4575" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7faaac60f84747d0b0ef931df71fc8c2" member_type: VOTER last_known_addr { host: "127.11.165.254" port: 38921 } } peers { permanent_uuid: "d066de8000024b8a80c0a337f655e38f" member_type: VOTER last_known_addr { host: "127.11.165.253" port: 43175 } } peers { permanent_uuid: "378eb9c8b9854096b3974138a01f4575" member_type: VOTER last_known_addr { host: "127.11.165.252" port: 44325 } } }
14:06:24.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:24.467013 12259 sys_catalog.cc:458] T 00000000000000000000000000000000 P 378eb9c8b9854096b3974138a01f4575 [sys.catalog]: This master's current role is: LEADER
14:06:25.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.024142 12280 catalog_manager.cc:1295] Loaded cluster ID: e87f03fc2e8145b5942be9a6f1f06976
14:06:25.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.024451 12280 catalog_manager.cc:1588] T 00000000000000000000000000000000 P d066de8000024b8a80c0a337f655e38f: loading cluster ID for follower catalog manager: success
14:06:25.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.040864 12280 catalog_manager.cc:1610] T 00000000000000000000000000000000 P d066de8000024b8a80c0a337f655e38f: acquiring CA information for follower catalog manager: success
14:06:25.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.065732 12280 catalog_manager.cc:1638] T 00000000000000000000000000000000 P d066de8000024b8a80c0a337f655e38f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
14:06:25.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:23.294224 12254 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:06:25.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:25.314384 12245 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 2.023s	user 0.569s	sys 1.109s
14:06:25.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:25.317303 12245 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 2.026s	user 0.569s	sys 1.109s
14:06:25.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:24.683219 12252 debug-util.cc:398] Leaking SignalData structure 0x7b08000370e0 after lost signal to thread 12245
14:06:25.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.333437 12245 server_base.cc:1061] running on GCE node
14:06:25.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:25.334808 12285 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:06:25.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.336336 12245 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:06:25.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.339128 12245 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:06:25.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.340559 12245 hybrid_clock.cc:648] HybridClock initialized: now 1783519585340511 us; error 47 us; skew 500 ppm
14:06:25.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.341663 12245 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:06:25.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 08 14:06:25 dist-test-slave-h3x3 krb5kdc[11938](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1783519585, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.165.193@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
14:06:25.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.349917 12245 init.cc:377] Logged in from keytab as kudu/127.11.165.193@KRBTEST.COM (short username kudu)
14:06:25.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.356002 12245 webserver.cc:533] Webserver started at http://127.11.165.193:45537/ using document root <none> and password file <none>
14:06:25.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.357214 12245 fs_manager.cc:362] Metadata directory not provided
14:06:25.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.357507 12245 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:06:25.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.358094 12245 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:06:25.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.364748 12245 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/ts-0/data/instance:
14:06:25.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "5a1549e96fec4c27b1395ab0e2335e18"
14:06:25.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:06:25 on dist-test-slave-h3x3"
14:06:25.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.366273 12245 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/ts-0/wal/instance:
14:06:25.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "5a1549e96fec4c27b1395ab0e2335e18"
14:06:25.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:06:25 on dist-test-slave-h3x3"
14:06:25.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.375950 12245 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.006s	sys 0.002s
14:06:25.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.384070 12291 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:06:25.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.385458 12245 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.005s	sys 0.001s
14:06:25.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.385893 12245 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/ts-0/data,/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/ts-0/wal
14:06:25.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "5a1549e96fec4c27b1395ab0e2335e18"
14:06:25.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:06:25 on dist-test-slave-h3x3"
14:06:25.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.386425 12245 fs_report.cc:389] FS layout report
14:06:25.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:06:25.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/ts-0/wal
14:06:25.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/ts-0/wal
14:06:25.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/ts-0/data/data
14:06:25.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:06:25.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:06:25.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:06:25.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:06:25.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:06:25.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:06:25.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:06:25.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:06:25.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:06:25.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:06:25.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:06:25.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.453733 12245 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:06:25.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.463011 12245 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:06:25.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.463543 12245 kserver.cc:163] Server-wide thread pool size limit: 3276
14:06:25.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.466325 12245 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
14:06:25.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.470616 12245 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
14:06:25.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.470888 12245 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
14:06:25.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.471195 12245 ts_tablet_manager.cc:616] Registered 0 tablets
14:06:25.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.471378 12245 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
14:06:25.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.651602 12245 rpc_server.cc:307] RPC server started. Bound to: 127.11.165.193:35709
14:06:25.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.651723 12404 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.165.193:35709 every 8 connection(s)
14:06:25.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.654448 12245 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/ts-0/data/info.pb
14:06:25.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.665059 11927 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskM8Xy4F/build/tsan/bin/kudu as pid 12245
14:06:25.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.665558 11927 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/ts-0/wal/instance
14:06:25.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for kudu/127.11.165.194@KRBTEST.COM; defaulting to no policy
14:06:25.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 08 14:06:25 dist-test-slave-h3x3 krb5kdc[11938](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1783519585, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.165.193@KRBTEST.COM for kudu/127.11.165.253@KRBTEST.COM
14:06:25.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 08 14:06:25 dist-test-slave-h3x3 krb5kdc[11938](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1783519585, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.165.193@KRBTEST.COM for kudu/127.11.165.252@KRBTEST.COM
14:06:25.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
14:06:25.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "kudu/127.11.165.194@KRBTEST.COM" created.
14:06:25.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 08 14:06:25 dist-test-slave-h3x3 krb5kdc[11938](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1783519585, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.165.193@KRBTEST.COM for kudu/127.11.165.254@KRBTEST.COM
14:06:25.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.732046 12406 heartbeater.cc:344] Connected to a master server at 127.11.165.253:43175
14:06:25.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.732550 12406 heartbeater.cc:461] Registering TS with master...
14:06:25.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.734056 12406 heartbeater.cc:507] Master 127.11.165.253:43175 requested a full tablet report, sending...
14:06:25.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.735224 12405 heartbeater.cc:344] Connected to a master server at 127.11.165.252:44325
14:06:25.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.735566 12405 heartbeater.cc:461] Registering TS with master...
14:06:25.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.736542 12405 heartbeater.cc:507] Master 127.11.165.252:44325 requested a full tablet report, sending...
14:06:25.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.737901 12069 ts_manager.cc:194] Registered new tserver with Master: 5a1549e96fec4c27b1395ab0e2335e18 (127.11.165.193:35709)
14:06:25.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.739558 12407 heartbeater.cc:344] Connected to a master server at 127.11.165.254:38921
14:06:25.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.739890 12407 heartbeater.cc:461] Registering TS with master...
14:06:25.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.740712 12156 ts_manager.cc:194] Registered new tserver with Master: 5a1549e96fec4c27b1395ab0e2335e18 (127.11.165.193:35709)
14:06:25.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.740763 12407 heartbeater.cc:507] Master 127.11.165.254:38921 requested a full tablet report, sending...
14:06:25.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.743475 12156 master_service.cc:502] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.165.193@KRBTEST.COM'} at 127.11.165.193:52715
14:06:25.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.743773 11988 ts_manager.cc:194] Registered new tserver with Master: 5a1549e96fec4c27b1395ab0e2335e18 (127.11.165.193:35709)
14:06:25.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
14:06:25.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.11.165.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/krb5kdc/kudu.keytab.
14:06:25.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.11.165.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/krb5kdc/kudu.keytab.
14:06:25.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for HTTP/127.11.165.194@KRBTEST.COM; defaulting to no policy
14:06:25.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
14:06:25.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "HTTP/127.11.165.194@KRBTEST.COM" created.
14:06:25.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
14:06:25.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.11.165.194 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/krb5kdc/kudu.keytab.
14:06:25.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.11.165.194 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/krb5kdc/kudu.keytab.
14:06:25.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.790557 11927 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskM8Xy4F/build/tsan/bin/kudu
14:06:25.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskM8Xy4F/build/tsan/bin/kudu
14:06:25.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/ts-1/wal
14:06:25.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/ts-1/data
14:06:25.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:06:25.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:06:25.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:06:25.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:06:25.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:06:25.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:06:25.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/ts-1/logs
14:06:25.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/ts-1/data/info.pb
14:06:25.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:06:25.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:06:25.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:06:25.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:06:25.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:06:25.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:06:25.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:06:25.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:06:25.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
14:06:25.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:06:25.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.165.194:0
14:06:25.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.11.165.194
14:06:25.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.165.194
14:06:25.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:06:25.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.11.165.254:38921,127.11.165.253:43175,127.11.165.252:44325
14:06:25.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/krb5kdc/kudu.keytab
14:06:25.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.11.165.194
14:06:25.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
14:06:25.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=test-admin
14:06:25.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=test-user
14:06:25.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=true
14:06:25.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.165.212:36083
14:06:25.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:06:25.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:06:25.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:06:25.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=false with env {KRB5CCNAME=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
14:06:26.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:26.143479 12419 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:06:26.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:26.144121 12419 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:06:26.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:26.145071 12419 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:06:26.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:26.180500 12419 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:06:26.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:26.181391 12419 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.165.194
14:06:26.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:26.219506 12419 tablet_server_runner.cc:78] Tablet server non-default flags:
14:06:26.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:06:26.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.165.212:36083
14:06:26.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:06:26.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:06:26.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/ts-1/data
14:06:26.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/ts-1/wal
14:06:26.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/krb5kdc/kudu.keytab
14:06:26.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.11.165.194
14:06:26.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:06:26.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:06:26.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.165.194:0
14:06:26.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:06:26.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
14:06:26.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=<redacted>
14:06:26.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=<redacted>
14:06:26.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:06:26.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:06:26.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/ts-1/data/info.pb
14:06:26.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.165.194
14:06:26.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:06:26.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.11.165.254:38921,127.11.165.253:43175,127.11.165.252:44325
14:06:26.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:06:26.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:06:26.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:06:26.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:06:26.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:06:26.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.11.165.194
14:06:26.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/ts-1/logs
14:06:26.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:06:26.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:06:26.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:06:26.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
14:06:26.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:06:26.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
14:06:26.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:06:26.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 13:43:23 UTC on e7f111948823
14:06:26.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12775
14:06:26.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:06:26.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:26.220784 12419 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:06:26.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:26.221921 12419 file_cache.cc:504] Constructed file cache file cache with capacity 419430
14:06:26.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:26.236454 12425 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:06:26.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:26.747529 12405 heartbeater.cc:499] Master 127.11.165.252:44325 was elected leader, sending a full tablet report...
14:06:27.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:27.639221 12424 debug-util.cc:398] Leaking SignalData structure 0x7b08000370e0 after lost signal to thread 12419
14:06:27.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:27.969730 12424 kernel_stack_watchdog.cc:198] Thread 12419 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 397ms:
14:06:27.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
14:06:27.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
14:06:27.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
14:06:27.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
14:06:27.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:26.237061 12426 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:06:27.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:27.975704 12419 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.736s	user 0.001s	sys 0.002s
14:06:27.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:27.976617 12419 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.737s	user 0.002s	sys 0.003s
14:06:27.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:27.977810 12429 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:06:27.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:27.977937 12419 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:06:27.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:27.977995 12427 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1739 milliseconds
14:06:27.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:27.979770 12419 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:06:27.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:27.982862 12419 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:06:27.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:27.984548 12419 hybrid_clock.cc:648] HybridClock initialized: now 1783519587984500 us; error 61 us; skew 500 ppm
14:06:27.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:27.985390 12419 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:06:27.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 08 14:06:27 dist-test-slave-h3x3 krb5kdc[11938](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1783519587, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.165.194@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
14:06:27.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:27.992399 12419 init.cc:377] Logged in from keytab as kudu/127.11.165.194@KRBTEST.COM (short username kudu)
14:06:27.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:27.998524 12419 webserver.cc:533] Webserver started at http://127.11.165.194:38179/ using document root <none> and password file <none>
14:06:28.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:27.999950 12419 fs_manager.cc:362] Metadata directory not provided
14:06:28.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:28.000234 12419 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:06:28.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:28.000793 12419 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:06:28.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:28.007120 12419 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/ts-1/data/instance:
14:06:28.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "5287145b6eb24f0585b6cb7b10a6b3b0"
14:06:28.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:06:27 on dist-test-slave-h3x3"
14:06:28.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:28.008584 12419 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/ts-1/wal/instance:
14:06:28.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "5287145b6eb24f0585b6cb7b10a6b3b0"
14:06:28.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:06:27 on dist-test-slave-h3x3"
14:06:28.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:28.018396 12419 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.004s	sys 0.004s
14:06:28.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:28.026041 12438 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:06:28.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:28.027586 12419 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.003s	sys 0.000s
14:06:28.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:28.028059 12419 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/ts-1/data,/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/ts-1/wal
14:06:28.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "5287145b6eb24f0585b6cb7b10a6b3b0"
14:06:28.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:06:27 on dist-test-slave-h3x3"
14:06:28.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:28.028524 12419 fs_report.cc:389] FS layout report
14:06:28.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:06:28.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/ts-1/wal
14:06:28.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/ts-1/wal
14:06:28.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/ts-1/data/data
14:06:28.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:06:28.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:06:28.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:06:28.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:06:28.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:06:28.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:06:28.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:06:28.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:06:28.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:06:28.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:06:28.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:06:28.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:28.102849 12419 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:06:28.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:28.108397 12419 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:06:28.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:28.108789 12419 kserver.cc:163] Server-wide thread pool size limit: 3276
14:06:28.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:28.111461 12419 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
14:06:28.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:28.115614 12419 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
14:06:28.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:28.115871 12419 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
14:06:28.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:28.116168 12419 ts_tablet_manager.cc:616] Registered 0 tablets
14:06:28.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:28.116351 12419 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
14:06:28.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:28.251891 12419 rpc_server.cc:307] RPC server started. Bound to: 127.11.165.194:42737
14:06:28.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:28.252012 12550 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.165.194:42737 every 8 connection(s)
14:06:28.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:28.254616 12419 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/ts-1/data/info.pb
14:06:28.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:28.257273 11927 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskM8Xy4F/build/tsan/bin/kudu as pid 12419
14:06:28.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:28.257745 11927 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/ts-1/wal/instance
14:06:28.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 08 14:06:28 dist-test-slave-h3x3 krb5kdc[11938](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1783519587, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.165.194@KRBTEST.COM for kudu/127.11.165.253@KRBTEST.COM
14:06:28.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 08 14:06:28 dist-test-slave-h3x3 krb5kdc[11938](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1783519587, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.165.194@KRBTEST.COM for kudu/127.11.165.252@KRBTEST.COM
14:06:28.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 08 14:06:28 dist-test-slave-h3x3 krb5kdc[11938](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1783519587, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.165.194@KRBTEST.COM for kudu/127.11.165.254@KRBTEST.COM
14:06:28.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for kudu/127.11.165.195@KRBTEST.COM; defaulting to no policy
14:06:28.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
14:06:28.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "kudu/127.11.165.195@KRBTEST.COM" created.
14:06:28.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:28.322165 12553 heartbeater.cc:344] Connected to a master server at 127.11.165.254:38921
14:06:28.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:28.322667 12553 heartbeater.cc:461] Registering TS with master...
14:06:28.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:28.323760 12552 heartbeater.cc:344] Connected to a master server at 127.11.165.253:43175
14:06:28.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:28.324106 12552 heartbeater.cc:461] Registering TS with master...
14:06:28.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:28.324044 12553 heartbeater.cc:507] Master 127.11.165.254:38921 requested a full tablet report, sending...
14:06:28.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:28.325067 12552 heartbeater.cc:507] Master 127.11.165.253:43175 requested a full tablet report, sending...
14:06:28.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:28.325439 12551 heartbeater.cc:344] Connected to a master server at 127.11.165.252:44325
14:06:28.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:28.325790 12551 heartbeater.cc:461] Registering TS with master...
14:06:28.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:28.326753 12551 heartbeater.cc:507] Master 127.11.165.252:44325 requested a full tablet report, sending...
14:06:28.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:28.327045 11988 ts_manager.cc:194] Registered new tserver with Master: 5287145b6eb24f0585b6cb7b10a6b3b0 (127.11.165.194:42737)
14:06:28.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:28.329186 12156 ts_manager.cc:194] Registered new tserver with Master: 5287145b6eb24f0585b6cb7b10a6b3b0 (127.11.165.194:42737)
14:06:28.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:28.329142 12069 ts_manager.cc:194] Registered new tserver with Master: 5287145b6eb24f0585b6cb7b10a6b3b0 (127.11.165.194:42737)
14:06:28.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:28.330757 12156 master_service.cc:502] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.165.194@KRBTEST.COM'} at 127.11.165.194:35851
14:06:28.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
14:06:28.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.11.165.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/krb5kdc/kudu.keytab.
14:06:28.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.11.165.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/krb5kdc/kudu.keytab.
14:06:28.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for HTTP/127.11.165.195@KRBTEST.COM; defaulting to no policy
14:06:28.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
14:06:28.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "HTTP/127.11.165.195@KRBTEST.COM" created.
14:06:28.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
14:06:28.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.11.165.195 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/krb5kdc/kudu.keytab.
14:06:28.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.11.165.195 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/krb5kdc/kudu.keytab.
14:06:28.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:28.376168 11927 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskM8Xy4F/build/tsan/bin/kudu
14:06:28.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskM8Xy4F/build/tsan/bin/kudu
14:06:28.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/ts-2/wal
14:06:28.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/ts-2/data
14:06:28.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:06:28.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:06:28.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:06:28.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:06:28.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:06:28.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:06:28.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/ts-2/logs
14:06:28.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/ts-2/data/info.pb
14:06:28.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:06:28.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:06:28.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:06:28.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:06:28.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:06:28.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:06:28.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:06:28.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:06:28.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
14:06:28.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:06:28.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.165.195:0
14:06:28.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.11.165.195
14:06:28.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.165.195
14:06:28.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:06:28.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.11.165.254:38921,127.11.165.253:43175,127.11.165.252:44325
14:06:28.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/krb5kdc/kudu.keytab
14:06:28.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.11.165.195
14:06:28.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
14:06:28.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=test-admin
14:06:28.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=test-user
14:06:28.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=true
14:06:28.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.165.212:36083
14:06:28.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:06:28.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:06:28.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:06:28.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=false with env {KRB5CCNAME=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
14:06:28.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:28.675563 12566 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:06:28.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:28.676131 12566 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:06:28.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:28.676834 12566 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:06:28.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:28.714479 12566 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:06:28.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:28.715536 12566 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.11.165.195
14:06:28.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:28.756623 12566 tablet_server_runner.cc:78] Tablet server non-default flags:
14:06:28.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:06:28.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.11.165.212:36083
14:06:28.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:06:28.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:06:28.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/ts-2/data
14:06:28.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/ts-2/wal
14:06:28.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/krb5kdc/kudu.keytab
14:06:28.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.11.165.195
14:06:28.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:06:28.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:06:28.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.11.165.195:0
14:06:28.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:06:28.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
14:06:28.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=<redacted>
14:06:28.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=<redacted>
14:06:28.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:06:28.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:06:28.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/ts-2/data/info.pb
14:06:28.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.11.165.195
14:06:28.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:06:28.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.11.165.254:38921,127.11.165.253:43175,127.11.165.252:44325
14:06:28.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:06:28.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:06:28.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:06:28.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:06:28.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:06:28.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.11.165.195
14:06:28.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/ts-2/logs
14:06:28.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:06:28.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:06:28.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:06:28.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
14:06:28.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:06:28.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
14:06:28.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:06:28.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 13:43:23 UTC on e7f111948823
14:06:28.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12775
14:06:28.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:06:28.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:28.760000 12566 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:06:28.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:28.761505 12566 file_cache.cc:504] Constructed file cache file cache with capacity 419430
14:06:28.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:28.779645 12572 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:06:29.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:29.333923 12551 heartbeater.cc:499] Master 127.11.165.252:44325 was elected leader, sending a full tablet report...
14:06:29.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:29.784706 12188 debug-util.cc:398] Leaking SignalData structure 0x7b08000991a0 after lost signal to thread 12115
14:06:29.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:29.787022 12188 debug-util.cc:398] Leaking SignalData structure 0x7b0800081880 after lost signal to thread 12191
14:06:30.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:30.181746 12571 debug-util.cc:398] Leaking SignalData structure 0x7b08000370e0 after lost signal to thread 12566
14:06:30.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:30.296169 12566 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.517s	user 0.511s	sys 0.844s
14:06:30.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:28.781545 12573 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:06:30.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:30.296582 12566 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.517s	user 0.511s	sys 0.844s
14:06:30.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:30.298370 12575 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:06:30.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:30.302699 12574 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1522 milliseconds
14:06:30.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:30.302737 12566 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:06:30.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:30.304356 12566 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:06:30.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:30.306954 12566 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:06:30.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:30.308414 12566 hybrid_clock.cc:648] HybridClock initialized: now 1783519590308372 us; error 35 us; skew 500 ppm
14:06:30.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:30.309652 12566 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:06:30.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 08 14:06:30 dist-test-slave-h3x3 krb5kdc[11938](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1783519590, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.165.195@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
14:06:30.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:30.317440 12566 init.cc:377] Logged in from keytab as kudu/127.11.165.195@KRBTEST.COM (short username kudu)
14:06:30.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:30.322741 12566 webserver.cc:533] Webserver started at http://127.11.165.195:42199/ using document root <none> and password file <none>
14:06:30.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:30.323575 12566 fs_manager.cc:362] Metadata directory not provided
14:06:30.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:30.323760 12566 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:06:30.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:30.324141 12566 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:06:30.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:30.328384 12566 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/ts-2/data/instance:
14:06:30.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e27688e4a9ee495cb4427df18f981e82"
14:06:30.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:06:30 on dist-test-slave-h3x3"
14:06:30.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:30.329375 12566 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/ts-2/wal/instance:
14:06:30.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e27688e4a9ee495cb4427df18f981e82"
14:06:30.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:06:30 on dist-test-slave-h3x3"
14:06:30.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:30.336762 12566 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.005s
14:06:30.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:30.342259 12584 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:06:30.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:30.343874 12566 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.001s
14:06:30.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:30.344445 12566 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/ts-2/data,/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/ts-2/wal
14:06:30.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e27688e4a9ee495cb4427df18f981e82"
14:06:30.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:06:30 on dist-test-slave-h3x3"
14:06:30.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:30.345139 12566 fs_report.cc:389] FS layout report
14:06:30.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:06:30.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/ts-2/wal
14:06:30.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/ts-2/wal
14:06:30.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/ts-2/data/data
14:06:30.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:06:30.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:06:30.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:06:30.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:06:30.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:06:30.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:06:30.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:06:30.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:06:30.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:06:30.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:06:30.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:06:30.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:30.421051 12566 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:06:30.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:30.428606 12566 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:06:30.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:30.429171 12566 kserver.cc:163] Server-wide thread pool size limit: 3276
14:06:30.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:30.432698 12566 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
14:06:30.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:30.437893 12566 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
14:06:30.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:30.438139 12566 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.001s
14:06:30.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:30.438412 12566 ts_tablet_manager.cc:616] Registered 0 tablets
14:06:30.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:30.438561 12566 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
14:06:30.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:30.615139 12566 rpc_server.cc:307] RPC server started. Bound to: 127.11.165.195:37817
14:06:30.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:30.615259 12696 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.165.195:37817 every 8 connection(s)
14:06:30.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:30.617722 12566 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/ts-2/data/info.pb
14:06:30.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:30.622674 11927 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskM8Xy4F/build/tsan/bin/kudu as pid 12566
14:06:30.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:30.623152 11927 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/ts-2/wal/instance
14:06:30.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 08 14:06:30 dist-test-slave-h3x3 krb5kdc[11938](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1783519590, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.165.195@KRBTEST.COM for kudu/127.11.165.253@KRBTEST.COM
14:06:30.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 08 14:06:30 dist-test-slave-h3x3 krb5kdc[11938](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1783519590, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.165.195@KRBTEST.COM for kudu/127.11.165.252@KRBTEST.COM
14:06:30.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 08 14:06:30 dist-test-slave-h3x3 krb5kdc[11938](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1783519590, etypes {rep=17 tkt=17 ses=17}, kudu/127.11.165.195@KRBTEST.COM for kudu/127.11.165.254@KRBTEST.COM
14:06:30.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:30.703258 12698 heartbeater.cc:344] Connected to a master server at 127.11.165.253:43175
14:06:30.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:30.703768 12698 heartbeater.cc:461] Registering TS with master...
14:06:30.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:30.705160 12698 heartbeater.cc:507] Master 127.11.165.253:43175 requested a full tablet report, sending...
14:06:30.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:30.708268 12069 ts_manager.cc:194] Registered new tserver with Master: e27688e4a9ee495cb4427df18f981e82 (127.11.165.195:37817)
14:06:30.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:30.713151 12699 heartbeater.cc:344] Connected to a master server at 127.11.165.254:38921
14:06:30.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:30.713456 12699 heartbeater.cc:461] Registering TS with master...
14:06:30.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:30.714411 12699 heartbeater.cc:507] Master 127.11.165.254:38921 requested a full tablet report, sending...
14:06:30.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:30.717037 11988 ts_manager.cc:194] Registered new tserver with Master: e27688e4a9ee495cb4427df18f981e82 (127.11.165.195:37817)
14:06:30.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:30.718026 12697 heartbeater.cc:344] Connected to a master server at 127.11.165.252:44325
14:06:30.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:30.718410 12697 heartbeater.cc:461] Registering TS with master...
14:06:30.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:30.719072 12697 heartbeater.cc:507] Master 127.11.165.252:44325 requested a full tablet report, sending...
14:06:30.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:30.721127 12156 ts_manager.cc:194] Registered new tserver with Master: e27688e4a9ee495cb4427df18f981e82 (127.11.165.195:37817)
14:06:30.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:30.723117 12156 master_service.cc:502] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.11.165.195@KRBTEST.COM'} at 127.11.165.195:57595
14:06:30.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:30.730794 11927 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
14:06:30.742 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
14:06:30.743 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_kdc_env_vars {
}

14:06:30.744 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_kdc_env_vars {
  env_vars {
    key: "KRB5CCNAME"
    value: "/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/krb5kdc/krb5cc"
  }
  env_vars {
    key: "KRB5_CONFIG"
    value: "/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/krb5kdc/krb5.conf"
  }
  env_vars {
    key: "KRB5_KDC_PROFILE"
    value: "/tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/krb5kdc/kdc.conf"
  }
  env_vars {
    key: "KUDU_ENABLE_KRB5_REALM_FIX"
    value: "yes"
  }
}

14:06:30.745 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

14:06:30.751 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.11.165.254"
      port: 38921
    }
    bound_http_address {
      host: "127.11.165.254"
      port: 35565
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.11.165.253"
      port: 43175
    }
    bound_http_address {
      host: "127.11.165.253"
      port: 38277
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.11.165.252"
      port: 44325
    }
    bound_http_address {
      host: "127.11.165.252"
      port: 35285
    }
  }
}

14:06:30.752 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

14:06:30.754 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.11.165.193"
      port: 35709
    }
    bound_http_address {
      host: "127.11.165.193"
      port: 45537
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.11.165.194"
      port: 42737
    }
    bound_http_address {
      host: "127.11.165.194"
      port: 38179
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.11.165.195"
      port: 37817
    }
    bound_http_address {
      host: "127.11.165.195"
      port: 42199
    }
  }
}

14:06:30.754 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
14:06:30.756 [DEBUG - main] (SecurityUtil.java:105) Using ticketCache: /tmp/dist-test-taskM8Xy4F/test-tmp/mini-kudu-cluster11717244617721934381/krb5kdc/krb5cc
14:06:30.759 [DEBUG - main] (SecurityUtil.java:119) Logged in as subject: test-admin@KRBTEST.COM
14:06:30.761 [DEBUG - main] (Connection.java:748) [peer master-127.11.165.253:43175(127.11.165.253:43175)] connecting to peer
14:06:30.762 [DEBUG - main] (Connection.java:748) [peer master-127.11.165.254:38921(127.11.165.254:38921)] connecting to peer
14:06:30.765 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.11.165.253:43175(127.11.165.253:43175)] Successfully connected to peer
14:06:30.771 [DEBUG - kudu-nio-0] (Negotiator.java:528) SASL mechanism GSSAPI chosen for peer 127.11.165.253
14:06:30.776 [DEBUG - main] (Connection.java:748) [peer master-127.11.165.252:44325(127.11.165.252:44325)] connecting to peer
14:06:30.786 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.11.165.254:38921(127.11.165.254:38921)] Successfully connected to peer
14:06:30.791 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.11.165.252:44325(127.11.165.252:44325)] Successfully connected to peer
14:06:30.792 [DEBUG - kudu-nio-1] (Negotiator.java:528) SASL mechanism GSSAPI chosen for peer 127.11.165.254
14:06:30.796 [DEBUG - kudu-nio-2] (Negotiator.java:528) SASL mechanism GSSAPI chosen for peer 127.11.165.252
14:06:30.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 08 14:06:30 dist-test-slave-h3x3 krb5kdc[11938](info): TGS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1783519575, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.165.253@KRBTEST.COM
14:06:30.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 08 14:06:30 dist-test-slave-h3x3 krb5kdc[11938](info): TGS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1783519575, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.165.252@KRBTEST.COM
14:06:30.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 08 14:06:30 dist-test-slave-h3x3 krb5kdc[11938](info): TGS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1783519575, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.11.165.254@KRBTEST.COM
14:06:30.888 [DEBUG - kudu-nio-1] (Negotiator.java:918) Authenticated connection [id: 0x8ce87c75, L:/127.0.0.1:46172 - R:/127.11.165.254:38921] using SASL/GSSAPI
14:06:30.893 [DEBUG - kudu-nio-0] (Negotiator.java:918) Authenticated connection [id: 0x9692355c, L:/127.0.0.1:49648 - R:/127.11.165.253:43175] using SASL/GSSAPI
14:06:30.902 [DEBUG - kudu-nio-2] (Negotiator.java:918) Authenticated connection [id: 0xf90db267, L:/127.0.0.1:57144 - R:/127.11.165.252:44325] using SASL/GSSAPI
14:06:30.913 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:06:30.913 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=153), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.165.253:43175, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.165.254:38921, [16ms] Sub RPC ConnectToMaster: sending RPC to server master-127.11.165.252:44325, [134ms] Sub RPC ConnectToMaster: received response from server master-127.11.165.254:38921: OK, [146ms] Sub RPC ConnectToMaster: received response from server master-127.11.165.253:43175: OK, [152ms] Sub RPC ConnectToMaster: received response from server master-127.11.165.252:44325: OK, deferred=null) after lookup
14:06:30.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:30.918581 12156 catalog_manager.cc:2283] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57144:
14:06:30.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "TestAuthzTokenCache-table"
14:06:30.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
14:06:30.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:06:30.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key"
14:06:30.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
14:06:30.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
14:06:30.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:06:30.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:06:30.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:06:30.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:06:30.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:06:30.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:06:30.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column1_i"
14:06:30.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
14:06:30.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:06:30.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:06:30.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:06:30.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:06:30.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:06:30.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:06:30.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:06:30.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column2_i"
14:06:30.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
14:06:30.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:06:30.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:06:30.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:06:30.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:06:30.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:06:30.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:06:30.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:06:30.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column3_s"
14:06:30.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
14:06:30.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:06:30.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: true
14:06:30.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: DICT_ENCODING
14:06:30.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: LZ4
14:06:30.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 4096
14:06:30.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:06:30.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:06:30.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:06:30.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:06:30.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column4_b"
14:06:30.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BOOL
14:06:30.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:06:30.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:06:30.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:06:30.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:06:30.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:06:30.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:06:30.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
14:06:30.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
14:06:30.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
14:06:30.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
14:06:30.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key"
14:06:30.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
14:06:30.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:06:30.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
14:06:30.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:30.923003 12156 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table TestAuthzTokenCache-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
14:06:30.993 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 5efc92a5e1b248d9ab52246def23415d
14:06:31.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:31.110034 12632 tablet_service.cc:1511] Processing CreateTablet for tablet 92c6da06f31041f5957cc7f6db119211 (DEFAULT_TABLE table=TestAuthzTokenCache-table [id=5efc92a5e1b248d9ab52246def23415d]), partition=RANGE (key) PARTITION UNBOUNDED
14:06:31.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:31.112165 12632 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92c6da06f31041f5957cc7f6db119211. 1 dirs total, 0 dirs full, 0 dirs failed
14:06:31.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:31.117796 12339 tablet_service.cc:1511] Processing CreateTablet for tablet 92c6da06f31041f5957cc7f6db119211 (DEFAULT_TABLE table=TestAuthzTokenCache-table [id=5efc92a5e1b248d9ab52246def23415d]), partition=RANGE (key) PARTITION UNBOUNDED
14:06:31.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:31.119655 12339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92c6da06f31041f5957cc7f6db119211. 1 dirs total, 0 dirs full, 0 dirs failed
14:06:31.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:31.129783 12486 tablet_service.cc:1511] Processing CreateTablet for tablet 92c6da06f31041f5957cc7f6db119211 (DEFAULT_TABLE table=TestAuthzTokenCache-table [id=5efc92a5e1b248d9ab52246def23415d]), partition=RANGE (key) PARTITION UNBOUNDED
14:06:31.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:31.131745 12486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92c6da06f31041f5957cc7f6db119211. 1 dirs total, 0 dirs full, 0 dirs failed
14:06:31.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:31.175446 12729 tablet_bootstrap.cc:492] T 92c6da06f31041f5957cc7f6db119211 P 5a1549e96fec4c27b1395ab0e2335e18: Bootstrap starting.
14:06:31.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:31.179103 12730 tablet_bootstrap.cc:492] T 92c6da06f31041f5957cc7f6db119211 P e27688e4a9ee495cb4427df18f981e82: Bootstrap starting.
14:06:31.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:31.184386 12729 tablet_bootstrap.cc:654] T 92c6da06f31041f5957cc7f6db119211 P 5a1549e96fec4c27b1395ab0e2335e18: Neither blocks nor log segments found. Creating new log.
14:06:31.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:31.186825 12729 log.cc:826] T 92c6da06f31041f5957cc7f6db119211 P 5a1549e96fec4c27b1395ab0e2335e18: Log is configured to *not* fsync() on all Append() calls
14:06:31.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:31.188297 12730 tablet_bootstrap.cc:654] T 92c6da06f31041f5957cc7f6db119211 P e27688e4a9ee495cb4427df18f981e82: Neither blocks nor log segments found. Creating new log.
14:06:31.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:31.190591 12730 log.cc:826] T 92c6da06f31041f5957cc7f6db119211 P e27688e4a9ee495cb4427df18f981e82: Log is configured to *not* fsync() on all Append() calls
14:06:31.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:31.193948 12732 tablet_bootstrap.cc:492] T 92c6da06f31041f5957cc7f6db119211 P 5287145b6eb24f0585b6cb7b10a6b3b0: Bootstrap starting.
14:06:31.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:31.205020 12732 tablet_bootstrap.cc:654] T 92c6da06f31041f5957cc7f6db119211 P 5287145b6eb24f0585b6cb7b10a6b3b0: Neither blocks nor log segments found. Creating new log.
14:06:31.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:31.205255 12729 tablet_bootstrap.cc:492] T 92c6da06f31041f5957cc7f6db119211 P 5a1549e96fec4c27b1395ab0e2335e18: No bootstrap required, opened a new log
14:06:31.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:31.205740 12730 tablet_bootstrap.cc:492] T 92c6da06f31041f5957cc7f6db119211 P e27688e4a9ee495cb4427df18f981e82: No bootstrap required, opened a new log
14:06:31.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:31.205835 12729 ts_tablet_manager.cc:1403] T 92c6da06f31041f5957cc7f6db119211 P 5a1549e96fec4c27b1395ab0e2335e18: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.009s
14:06:31.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:31.206274 12730 ts_tablet_manager.cc:1403] T 92c6da06f31041f5957cc7f6db119211 P e27688e4a9ee495cb4427df18f981e82: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.015s
14:06:31.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:31.208638 12732 log.cc:826] T 92c6da06f31041f5957cc7f6db119211 P 5287145b6eb24f0585b6cb7b10a6b3b0: Log is configured to *not* fsync() on all Append() calls
14:06:31.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:31.219372 12732 tablet_bootstrap.cc:492] T 92c6da06f31041f5957cc7f6db119211 P 5287145b6eb24f0585b6cb7b10a6b3b0: No bootstrap required, opened a new log
14:06:31.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:31.220049 12732 ts_tablet_manager.cc:1403] T 92c6da06f31041f5957cc7f6db119211 P 5287145b6eb24f0585b6cb7b10a6b3b0: Time spent bootstrapping tablet: real 0.027s	user 0.021s	sys 0.000s
14:06:31.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:31.235615 12730 raft_consensus.cc:359] T 92c6da06f31041f5957cc7f6db119211 P e27688e4a9ee495cb4427df18f981e82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27688e4a9ee495cb4427df18f981e82" member_type: VOTER last_known_addr { host: "127.11.165.195" port: 37817 } } peers { permanent_uuid: "5a1549e96fec4c27b1395ab0e2335e18" member_type: VOTER last_known_addr { host: "127.11.165.193" port: 35709 } } peers { permanent_uuid: "5287145b6eb24f0585b6cb7b10a6b3b0" member_type: VOTER last_known_addr { host: "127.11.165.194" port: 42737 } }
14:06:31.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:31.236616 12730 raft_consensus.cc:385] T 92c6da06f31041f5957cc7f6db119211 P e27688e4a9ee495cb4427df18f981e82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:06:31.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:31.236922 12730 raft_consensus.cc:740] T 92c6da06f31041f5957cc7f6db119211 P e27688e4a9ee495cb4427df18f981e82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e27688e4a9ee495cb4427df18f981e82, State: Initialized, Role: FOLLOWER
14:06:31.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:31.236686 12729 raft_consensus.cc:359] T 92c6da06f31041f5957cc7f6db119211 P 5a1549e96fec4c27b1395ab0e2335e18 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27688e4a9ee495cb4427df18f981e82" member_type: VOTER last_known_addr { host: "127.11.165.195" port: 37817 } } peers { permanent_uuid: "5a1549e96fec4c27b1395ab0e2335e18" member_type: VOTER last_known_addr { host: "127.11.165.193" port: 35709 } } peers { permanent_uuid: "5287145b6eb24f0585b6cb7b10a6b3b0" member_type: VOTER last_known_addr { host: "127.11.165.194" port: 42737 } }
14:06:31.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:31.237586 12729 raft_consensus.cc:385] T 92c6da06f31041f5957cc7f6db119211 P 5a1549e96fec4c27b1395ab0e2335e18 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:06:31.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:31.237903 12729 raft_consensus.cc:740] T 92c6da06f31041f5957cc7f6db119211 P 5a1549e96fec4c27b1395ab0e2335e18 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5a1549e96fec4c27b1395ab0e2335e18, State: Initialized, Role: FOLLOWER
14:06:31.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:31.237998 12730 consensus_queue.cc:260] T 92c6da06f31041f5957cc7f6db119211 P e27688e4a9ee495cb4427df18f981e82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27688e4a9ee495cb4427df18f981e82" member_type: VOTER last_known_addr { host: "127.11.165.195" port: 37817 } } peers { permanent_uuid: "5a1549e96fec4c27b1395ab0e2335e18" member_type: VOTER last_known_addr { host: "127.11.165.193" port: 35709 } } peers { permanent_uuid: "5287145b6eb24f0585b6cb7b10a6b3b0" member_type: VOTER last_known_addr { host: "127.11.165.194" port: 42737 } }
14:06:31.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:31.238950 12729 consensus_queue.cc:260] T 92c6da06f31041f5957cc7f6db119211 P 5a1549e96fec4c27b1395ab0e2335e18 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27688e4a9ee495cb4427df18f981e82" member_type: VOTER last_known_addr { host: "127.11.165.195" port: 37817 } } peers { permanent_uuid: "5a1549e96fec4c27b1395ab0e2335e18" member_type: VOTER last_known_addr { host: "127.11.165.193" port: 35709 } } peers { permanent_uuid: "5287145b6eb24f0585b6cb7b10a6b3b0" member_type: VOTER last_known_addr { host: "127.11.165.194" port: 42737 } }
14:06:31.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:31.251101 12697 heartbeater.cc:499] Master 127.11.165.252:44325 was elected leader, sending a full tablet report...
14:06:31.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:31.252130 12730 ts_tablet_manager.cc:1434] T 92c6da06f31041f5957cc7f6db119211 P e27688e4a9ee495cb4427df18f981e82: Time spent starting tablet: real 0.046s	user 0.042s	sys 0.000s
14:06:31.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:31.254891 12732 raft_consensus.cc:359] T 92c6da06f31041f5957cc7f6db119211 P 5287145b6eb24f0585b6cb7b10a6b3b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27688e4a9ee495cb4427df18f981e82" member_type: VOTER last_known_addr { host: "127.11.165.195" port: 37817 } } peers { permanent_uuid: "5a1549e96fec4c27b1395ab0e2335e18" member_type: VOTER last_known_addr { host: "127.11.165.193" port: 35709 } } peers { permanent_uuid: "5287145b6eb24f0585b6cb7b10a6b3b0" member_type: VOTER last_known_addr { host: "127.11.165.194" port: 42737 } }
14:06:31.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:31.255934 12732 raft_consensus.cc:385] T 92c6da06f31041f5957cc7f6db119211 P 5287145b6eb24f0585b6cb7b10a6b3b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:06:31.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:31.256368 12732 raft_consensus.cc:740] T 92c6da06f31041f5957cc7f6db119211 P 5287145b6eb24f0585b6cb7b10a6b3b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5287145b6eb24f0585b6cb7b10a6b3b0, State: Initialized, Role: FOLLOWER
14:06:31.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:31.257495 12732 consensus_queue.cc:260] T 92c6da06f31041f5957cc7f6db119211 P 5287145b6eb24f0585b6cb7b10a6b3b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27688e4a9ee495cb4427df18f981e82" member_type: VOTER last_known_addr { host: "127.11.165.195" port: 37817 } } peers { permanent_uuid: "5a1549e96fec4c27b1395ab0e2335e18" member_type: VOTER last_known_addr { host: "127.11.165.193" port: 35709 } } peers { permanent_uuid: "5287145b6eb24f0585b6cb7b10a6b3b0" member_type: VOTER last_known_addr { host: "127.11.165.194" port: 42737 } }
14:06:31.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:31.268987 12729 ts_tablet_manager.cc:1434] T 92c6da06f31041f5957cc7f6db119211 P 5a1549e96fec4c27b1395ab0e2335e18: Time spent starting tablet: real 0.063s	user 0.035s	sys 0.023s
14:06:31.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:31.329855 12737 raft_consensus.cc:493] T 92c6da06f31041f5957cc7f6db119211 P 5287145b6eb24f0585b6cb7b10a6b3b0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:06:31.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:31.331338 12732 ts_tablet_manager.cc:1434] T 92c6da06f31041f5957cc7f6db119211 P 5287145b6eb24f0585b6cb7b10a6b3b0: Time spent starting tablet: real 0.111s	user 0.062s	sys 0.038s
14:06:31.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:31.330839 12737 raft_consensus.cc:515] T 92c6da06f31041f5957cc7f6db119211 P 5287145b6eb24f0585b6cb7b10a6b3b0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27688e4a9ee495cb4427df18f981e82" member_type: VOTER last_known_addr { host: "127.11.165.195" port: 37817 } } peers { permanent_uuid: "5a1549e96fec4c27b1395ab0e2335e18" member_type: VOTER last_known_addr { host: "127.11.165.193" port: 35709 } } peers { permanent_uuid: "5287145b6eb24f0585b6cb7b10a6b3b0" member_type: VOTER last_known_addr { host: "127.11.165.194" port: 42737 } }
14:06:31.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:31.349224 12652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c6da06f31041f5957cc7f6db119211" candidate_uuid: "5287145b6eb24f0585b6cb7b10a6b3b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e27688e4a9ee495cb4427df18f981e82" is_pre_election: true
14:06:31.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:31.350303 12652 raft_consensus.cc:2468] T 92c6da06f31041f5957cc7f6db119211 P e27688e4a9ee495cb4427df18f981e82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5287145b6eb24f0585b6cb7b10a6b3b0 in term 0.
14:06:31.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:31.352487 12737 leader_election.cc:290] T 92c6da06f31041f5957cc7f6db119211 P 5287145b6eb24f0585b6cb7b10a6b3b0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e27688e4a9ee495cb4427df18f981e82 (127.11.165.195:37817), 5a1549e96fec4c27b1395ab0e2335e18 (127.11.165.193:35709)
14:06:31.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:31.354296 12441 leader_election.cc:304] T 92c6da06f31041f5957cc7f6db119211 P 5287145b6eb24f0585b6cb7b10a6b3b0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5287145b6eb24f0585b6cb7b10a6b3b0, e27688e4a9ee495cb4427df18f981e82; no voters: 
14:06:31.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:31.355299 12737 raft_consensus.cc:2804] T 92c6da06f31041f5957cc7f6db119211 P 5287145b6eb24f0585b6cb7b10a6b3b0 [term 0 FOLLOWER]: Leader pre-election won for term 1
14:06:31.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:31.355651 12737 raft_consensus.cc:493] T 92c6da06f31041f5957cc7f6db119211 P 5287145b6eb24f0585b6cb7b10a6b3b0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:06:31.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:31.355993 12737 raft_consensus.cc:3060] T 92c6da06f31041f5957cc7f6db119211 P 5287145b6eb24f0585b6cb7b10a6b3b0 [term 0 FOLLOWER]: Advancing to term 1
14:06:31.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:31.361302 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c6da06f31041f5957cc7f6db119211" candidate_uuid: "5287145b6eb24f0585b6cb7b10a6b3b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a1549e96fec4c27b1395ab0e2335e18" is_pre_election: true
14:06:31.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:31.362098 12359 raft_consensus.cc:2468] T 92c6da06f31041f5957cc7f6db119211 P 5a1549e96fec4c27b1395ab0e2335e18 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5287145b6eb24f0585b6cb7b10a6b3b0 in term 0.
14:06:31.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:31.363785 12737 raft_consensus.cc:515] T 92c6da06f31041f5957cc7f6db119211 P 5287145b6eb24f0585b6cb7b10a6b3b0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27688e4a9ee495cb4427df18f981e82" member_type: VOTER last_known_addr { host: "127.11.165.195" port: 37817 } } peers { permanent_uuid: "5a1549e96fec4c27b1395ab0e2335e18" member_type: VOTER last_known_addr { host: "127.11.165.193" port: 35709 } } peers { permanent_uuid: "5287145b6eb24f0585b6cb7b10a6b3b0" member_type: VOTER last_known_addr { host: "127.11.165.194" port: 42737 } }
14:06:31.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:31.365897 12737 leader_election.cc:290] T 92c6da06f31041f5957cc7f6db119211 P 5287145b6eb24f0585b6cb7b10a6b3b0 [CANDIDATE]: Term 1 election: Requested vote from peers e27688e4a9ee495cb4427df18f981e82 (127.11.165.195:37817), 5a1549e96fec4c27b1395ab0e2335e18 (127.11.165.193:35709)
14:06:31.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:31.367426 12359 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c6da06f31041f5957cc7f6db119211" candidate_uuid: "5287145b6eb24f0585b6cb7b10a6b3b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5a1549e96fec4c27b1395ab0e2335e18"
14:06:31.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:31.367549 12652 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92c6da06f31041f5957cc7f6db119211" candidate_uuid: "5287145b6eb24f0585b6cb7b10a6b3b0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e27688e4a9ee495cb4427df18f981e82"
14:06:31.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:31.367960 12359 raft_consensus.cc:3060] T 92c6da06f31041f5957cc7f6db119211 P 5a1549e96fec4c27b1395ab0e2335e18 [term 0 FOLLOWER]: Advancing to term 1
14:06:31.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:31.368080 12652 raft_consensus.cc:3060] T 92c6da06f31041f5957cc7f6db119211 P e27688e4a9ee495cb4427df18f981e82 [term 0 FOLLOWER]: Advancing to term 1
14:06:31.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:31.374733 12359 raft_consensus.cc:2468] T 92c6da06f31041f5957cc7f6db119211 P 5a1549e96fec4c27b1395ab0e2335e18 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5287145b6eb24f0585b6cb7b10a6b3b0 in term 1.
14:06:31.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:31.374737 12652 raft_consensus.cc:2468] T 92c6da06f31041f5957cc7f6db119211 P e27688e4a9ee495cb4427df18f981e82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5287145b6eb24f0585b6cb7b10a6b3b0 in term 1.
14:06:31.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:31.375751 12441 leader_election.cc:304] T 92c6da06f31041f5957cc7f6db119211 P 5287145b6eb24f0585b6cb7b10a6b3b0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5287145b6eb24f0585b6cb7b10a6b3b0, e27688e4a9ee495cb4427df18f981e82; no voters: 
14:06:31.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:31.376636 12737 raft_consensus.cc:2804] T 92c6da06f31041f5957cc7f6db119211 P 5287145b6eb24f0585b6cb7b10a6b3b0 [term 1 FOLLOWER]: Leader election won for term 1
14:06:31.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:31.377127 12737 raft_consensus.cc:697] T 92c6da06f31041f5957cc7f6db119211 P 5287145b6eb24f0585b6cb7b10a6b3b0 [term 1 LEADER]: Becoming Leader. State: Replica: 5287145b6eb24f0585b6cb7b10a6b3b0, State: Running, Role: LEADER
14:06:31.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:31.378065 12737 consensus_queue.cc:237] T 92c6da06f31041f5957cc7f6db119211 P 5287145b6eb24f0585b6cb7b10a6b3b0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27688e4a9ee495cb4427df18f981e82" member_type: VOTER last_known_addr { host: "127.11.165.195" port: 37817 } } peers { permanent_uuid: "5a1549e96fec4c27b1395ab0e2335e18" member_type: VOTER last_known_addr { host: "127.11.165.193" port: 35709 } } peers { permanent_uuid: "5287145b6eb24f0585b6cb7b10a6b3b0" member_type: VOTER last_known_addr { host: "127.11.165.194" port: 42737 } }
14:06:31.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:31.391847 12156 catalog_manager.cc:5697] T 92c6da06f31041f5957cc7f6db119211 P 5287145b6eb24f0585b6cb7b10a6b3b0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5287145b6eb24f0585b6cb7b10a6b3b0 (127.11.165.194). New cstate: current_term: 1 leader_uuid: "5287145b6eb24f0585b6cb7b10a6b3b0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e27688e4a9ee495cb4427df18f981e82" member_type: VOTER last_known_addr { host: "127.11.165.195" port: 37817 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5a1549e96fec4c27b1395ab0e2335e18" member_type: VOTER last_known_addr { host: "127.11.165.193" port: 35709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5287145b6eb24f0585b6cb7b10a6b3b0" member_type: VOTER last_known_addr { host: "127.11.165.194" port: 42737 } health_report { overall_health: HEALTHY } } }
14:06:31.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:31.396013 12702 tablet.cc:2406] T 92c6da06f31041f5957cc7f6db119211 P e27688e4a9ee495cb4427df18f981e82: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:06:31.428 [DEBUG - pool-6-thread-1] (AuthzTokenCache.java:153) sending RPC to retrieve token for table ID 5efc92a5e1b248d9ab52246def23415d
14:06:31.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:31.432044 12412 tablet.cc:2406] T 92c6da06f31041f5957cc7f6db119211 P 5a1549e96fec4c27b1395ab0e2335e18: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:06:31.434 [DEBUG - kudu-nio-2] (AuthzTokenCache.java:193) retrieved authz token for 5efc92a5e1b248d9ab52246def23415d
14:06:31.434 [DEBUG - pool-6-thread-7] (AuthzTokenCache.java:153) sending RPC to retrieve token for table ID 5efc92a5e1b248d9ab52246def23415d
14:06:31.447 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 92c6da06f31041f5957cc7f6db119211 for table 'TestAuthzTokenCache-table' with partition [<start>, <end>)
14:06:31.449 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299998, tablet=92c6da06f31041f5957cc7f6db119211@[5287145b6eb24f0585b6cb7b10a6b3b0(127.11.165.194:42737)[L],5a1549e96fec4c27b1395ab0e2335e18(127.11.165.193:35709),e27688e4a9ee495cb4427df18f981e82(127.11.165.195:37817)]}]
14:06:31.450 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=21), Traces: [0ms] sending RPC to server master-127.11.165.252:44325, [6ms] received response from server master-127.11.165.252:44325: OK, [6ms] Sub RPC Scan: refreshing cache from master, [6ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.165.252:44325, [18ms] Sub RPC GetTableLocations: received response from server master-127.11.165.252:44325: OK, deferred=Deferred@1722571198(state=PENDING, result=null, callback=wakeup thread pool-6-thread-1, errback=wakeup thread pool-6-thread-1))) after lookup
14:06:31.451 [DEBUG - kudu-nio-2] (Connection.java:748) [peer 5287145b6eb24f0585b6cb7b10a6b3b0(127.11.165.194:42737)] connecting to peer
14:06:31.458 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 92c6da06f31041f5957cc7f6db119211 for table 'TestAuthzTokenCache-table' with partition [<start>, <end>)
14:06:31.459 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=92c6da06f31041f5957cc7f6db119211@[5287145b6eb24f0585b6cb7b10a6b3b0(127.11.165.194:42737)[L],5a1549e96fec4c27b1395ab0e2335e18(127.11.165.193:35709),e27688e4a9ee495cb4427df18f981e82(127.11.165.195:37817)]}]
14:06:31.459 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=29), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.165.252:44325, [22ms] Sub RPC GetTableLocations: received response from server master-127.11.165.252:44325: OK, deferred=Deferred@2108191536(state=PENDING, result=null, callback=wakeup thread pool-6-thread-4, errback=wakeup thread pool-6-thread-4))) after lookup
14:06:31.461 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 92c6da06f31041f5957cc7f6db119211 for table 'TestAuthzTokenCache-table' with partition [<start>, <end>)
14:06:31.462 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=92c6da06f31041f5957cc7f6db119211@[5287145b6eb24f0585b6cb7b10a6b3b0(127.11.165.194:42737)[L],5a1549e96fec4c27b1395ab0e2335e18(127.11.165.193:35709),e27688e4a9ee495cb4427df18f981e82(127.11.165.195:37817)]}]
14:06:31.461 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 5287145b6eb24f0585b6cb7b10a6b3b0(127.11.165.194:42737)] Successfully connected to peer
14:06:31.462 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=34), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.165.252:44325, [24ms] Sub RPC GetTableLocations: received response from server master-127.11.165.252:44325: OK, deferred=Deferred@20616645(state=PENDING, result=null, callback=wakeup thread pool-6-thread-2, errback=wakeup thread pool-6-thread-2))) after lookup
14:06:31.463 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 92c6da06f31041f5957cc7f6db119211 for table 'TestAuthzTokenCache-table' with partition [<start>, <end>)
14:06:31.464 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=92c6da06f31041f5957cc7f6db119211@[5287145b6eb24f0585b6cb7b10a6b3b0(127.11.165.194:42737)[L],5a1549e96fec4c27b1395ab0e2335e18(127.11.165.193:35709),e27688e4a9ee495cb4427df18f981e82(127.11.165.195:37817)]}]
14:06:31.465 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=33), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.165.252:44325, [26ms] Sub RPC GetTableLocations: received response from server master-127.11.165.252:44325: OK, deferred=Deferred@726432979(state=PENDING, result=null, callback=wakeup thread pool-6-thread-5, errback=wakeup thread pool-6-thread-5))) after lookup
14:06:31.466 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 92c6da06f31041f5957cc7f6db119211 for table 'TestAuthzTokenCache-table' with partition [<start>, <end>)
14:06:31.467 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=92c6da06f31041f5957cc7f6db119211@[5287145b6eb24f0585b6cb7b10a6b3b0(127.11.165.194:42737)[L],5a1549e96fec4c27b1395ab0e2335e18(127.11.165.193:35709),e27688e4a9ee495cb4427df18f981e82(127.11.165.195:37817)]}]
14:06:31.469 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=38), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.165.252:44325, [31ms] Sub RPC GetTableLocations: received response from server master-127.11.165.252:44325: OK, deferred=Deferred@1997843542(state=PENDING, result=null, callback=wakeup thread pool-6-thread-3, errback=wakeup thread pool-6-thread-3))) after lookup
14:06:31.470 [DEBUG - kudu-nio-2] (AuthzTokenCache.java:193) retrieved authz token for 5efc92a5e1b248d9ab52246def23415d
14:06:31.473 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 92c6da06f31041f5957cc7f6db119211 for table 'TestAuthzTokenCache-table' with partition [<start>, <end>)
14:06:31.474 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=92c6da06f31041f5957cc7f6db119211@[5287145b6eb24f0585b6cb7b10a6b3b0(127.11.165.194:42737)[L],5a1549e96fec4c27b1395ab0e2335e18(127.11.165.193:35709),e27688e4a9ee495cb4427df18f981e82(127.11.165.195:37817)]}]
14:06:31.475 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=41), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.165.252:44325, [34ms] Sub RPC GetTableLocations: received response from server master-127.11.165.252:44325: OK, deferred=Deferred@1199153416(state=PENDING, result=null, callback=wakeup thread pool-6-thread-6, errback=wakeup thread pool-6-thread-6))) after lookup
14:06:31.476 [DEBUG - pool-6-thread-15] (AuthzTokenCache.java:153) sending RPC to retrieve token for table ID 5efc92a5e1b248d9ab52246def23415d
14:06:31.482 [DEBUG - kudu-nio-2] (AuthzTokenCache.java:193) retrieved authz token for 5efc92a5e1b248d9ab52246def23415d
14:06:31.486 [DEBUG - pool-6-thread-16] (AuthzTokenCache.java:153) sending RPC to retrieve token for table ID 5efc92a5e1b248d9ab52246def23415d
14:06:31.493 [DEBUG - kudu-nio-2] (AuthzTokenCache.java:193) retrieved authz token for 5efc92a5e1b248d9ab52246def23415d
14:06:31.494 [DEBUG - pool-6-thread-23] (AuthzTokenCache.java:153) sending RPC to retrieve token for table ID 5efc92a5e1b248d9ab52246def23415d
14:06:31.501 [DEBUG - kudu-nio-2] (AuthzTokenCache.java:193) retrieved authz token for 5efc92a5e1b248d9ab52246def23415d
14:06:31.502 [DEBUG - pool-6-thread-26] (AuthzTokenCache.java:153) sending RPC to retrieve token for table ID 5efc92a5e1b248d9ab52246def23415d
14:06:31.513 [DEBUG - kudu-nio-2] (AuthzTokenCache.java:193) retrieved authz token for 5efc92a5e1b248d9ab52246def23415d
14:06:31.514 [DEBUG - pool-6-thread-30] (AuthzTokenCache.java:153) sending RPC to retrieve token for table ID 5efc92a5e1b248d9ab52246def23415d
14:06:31.520 [DEBUG - kudu-nio-3] (Negotiator.java:918) Authenticated connection [id: 0x056a61c6, L:/127.0.0.1:34276 - R:/127.11.165.194:42737] using TOKEN/null
14:06:31.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:31.525283 12466 tablet_service.cc:3018] Rejecting scan request for tablet 92c6da06f31041f5957cc7f6db119211: Uninitialized: clean time has not yet been initialized
14:06:31.528 [DEBUG - kudu-nio-2] (AuthzTokenCache.java:193) retrieved authz token for 5efc92a5e1b248d9ab52246def23415d
14:06:31.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:31.530912 12465 tablet_service.cc:3018] Rejecting scan request for tablet 92c6da06f31041f5957cc7f6db119211: Uninitialized: clean time has not yet been initialized
14:06:31.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:31.531500 12464 tablet_service.cc:3018] Rejecting scan request for tablet 92c6da06f31041f5957cc7f6db119211: Uninitialized: clean time has not yet been initialized
14:06:31.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:31.534426 12558 tablet.cc:2406] T 92c6da06f31041f5957cc7f6db119211 P 5287145b6eb24f0585b6cb7b10a6b3b0: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:06:31.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:31.540530 12462 tablet_service.cc:3018] Rejecting scan request for tablet 92c6da06f31041f5957cc7f6db119211: Uninitialized: clean time has not yet been initialized
14:06:31.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:31.541549 12463 tablet_service.cc:3018] Rejecting scan request for tablet 92c6da06f31041f5957cc7f6db119211: Uninitialized: clean time has not yet been initialized
14:06:31.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:31.553426 12465 tablet_service.cc:3018] Rejecting scan request for tablet 92c6da06f31041f5957cc7f6db119211: Uninitialized: clean time has not yet been initialized
14:06:31.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:31.554090 12464 tablet_service.cc:3018] Rejecting scan request for tablet 92c6da06f31041f5957cc7f6db119211: Uninitialized: clean time has not yet been initialized
14:06:31.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:31.555601 12461 tablet_service.cc:3018] Rejecting scan request for tablet 92c6da06f31041f5957cc7f6db119211: Uninitialized: clean time has not yet been initialized
14:06:31.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:31.558082 12466 tablet_service.cc:3018] Rejecting scan request for tablet 92c6da06f31041f5957cc7f6db119211: Uninitialized: clean time has not yet been initialized
14:06:31.571 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location 5287145b6eb24f0585b6cb7b10a6b3b0(127.11.165.194:42737) for tablet 92c6da06f31041f5957cc7f6db119211: clean time has not yet been initialized
14:06:31.577 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location 5287145b6eb24f0585b6cb7b10a6b3b0(127.11.165.194:42737) for tablet 92c6da06f31041f5957cc7f6db119211: clean time has not yet been initialized
14:06:31.578 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location 5287145b6eb24f0585b6cb7b10a6b3b0(127.11.165.194:42737) for tablet 92c6da06f31041f5957cc7f6db119211: clean time has not yet been initialized
14:06:31.579 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location 5287145b6eb24f0585b6cb7b10a6b3b0(127.11.165.194:42737) for tablet 92c6da06f31041f5957cc7f6db119211: clean time has not yet been initialized
14:06:31.580 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location 5287145b6eb24f0585b6cb7b10a6b3b0(127.11.165.194:42737) for tablet 92c6da06f31041f5957cc7f6db119211: clean time has not yet been initialized
14:06:31.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:31.580999 12459 tablet_service.cc:3018] Rejecting scan request for tablet 92c6da06f31041f5957cc7f6db119211: Uninitialized: clean time has not yet been initialized
14:06:31.581 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location 5287145b6eb24f0585b6cb7b10a6b3b0(127.11.165.194:42737) for tablet 92c6da06f31041f5957cc7f6db119211: clean time has not yet been initialized
14:06:31.582 [DEBUG - kudu-nio-3] (RemoteTablet.java:145) tablet 92c6da06f31041f5957cc7f6db119211 already removed ts 5287145b6eb24f0585b6cb7b10a6b3b0, size left is 2
14:06:31.583 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location 5287145b6eb24f0585b6cb7b10a6b3b0(127.11.165.194:42737) for tablet 92c6da06f31041f5957cc7f6db119211: clean time has not yet been initialized
14:06:31.583 [DEBUG - kudu-nio-3] (RemoteTablet.java:145) tablet 92c6da06f31041f5957cc7f6db119211 already removed ts 5287145b6eb24f0585b6cb7b10a6b3b0, size left is 2
14:06:31.584 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location 5287145b6eb24f0585b6cb7b10a6b3b0(127.11.165.194:42737) for tablet 92c6da06f31041f5957cc7f6db119211: clean time has not yet been initialized
14:06:31.584 [DEBUG - kudu-nio-3] (RemoteTablet.java:145) tablet 92c6da06f31041f5957cc7f6db119211 already removed ts 5287145b6eb24f0585b6cb7b10a6b3b0, size left is 2
14:06:31.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:31.587205 12460 tablet_service.cc:3018] Rejecting scan request for tablet 92c6da06f31041f5957cc7f6db119211: Uninitialized: clean time has not yet been initialized
14:06:31.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:31.594187 12463 tablet_service.cc:3018] Rejecting scan request for tablet 92c6da06f31041f5957cc7f6db119211: Uninitialized: clean time has not yet been initialized
14:06:31.594 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location 5287145b6eb24f0585b6cb7b10a6b3b0(127.11.165.194:42737) for tablet 92c6da06f31041f5957cc7f6db119211: clean time has not yet been initialized
14:06:31.594 [DEBUG - kudu-nio-3] (RemoteTablet.java:145) tablet 92c6da06f31041f5957cc7f6db119211 already removed ts 5287145b6eb24f0585b6cb7b10a6b3b0, size left is 2
14:06:31.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:31.602984 12458 tablet_service.cc:3018] Rejecting scan request for tablet 92c6da06f31041f5957cc7f6db119211: Uninitialized: clean time has not yet been initialized
14:06:31.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:31.599674 12461 tablet_service.cc:3018] Rejecting scan request for tablet 92c6da06f31041f5957cc7f6db119211: Uninitialized: clean time has not yet been initialized
14:06:31.612 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location 5287145b6eb24f0585b6cb7b10a6b3b0(127.11.165.194:42737) for tablet 92c6da06f31041f5957cc7f6db119211: clean time has not yet been initialized
14:06:31.613 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location 5287145b6eb24f0585b6cb7b10a6b3b0(127.11.165.194:42737) for tablet 92c6da06f31041f5957cc7f6db119211: clean time has not yet been initialized
14:06:31.613 [DEBUG - kudu-nio-3] (RemoteTablet.java:145) tablet 92c6da06f31041f5957cc7f6db119211 already removed ts 5287145b6eb24f0585b6cb7b10a6b3b0, size left is 2
14:06:31.615 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location 5287145b6eb24f0585b6cb7b10a6b3b0(127.11.165.194:42737) for tablet 92c6da06f31041f5957cc7f6db119211: clean time has not yet been initialized
14:06:31.615 [DEBUG - kudu-nio-3] (RemoteTablet.java:145) tablet 92c6da06f31041f5957cc7f6db119211 already removed ts 5287145b6eb24f0585b6cb7b10a6b3b0, size left is 2
14:06:31.616 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location 5287145b6eb24f0585b6cb7b10a6b3b0(127.11.165.194:42737) for tablet 92c6da06f31041f5957cc7f6db119211: clean time has not yet been initialized
14:06:31.616 [DEBUG - kudu-nio-3] (RemoteTablet.java:145) tablet 92c6da06f31041f5957cc7f6db119211 already removed ts 5287145b6eb24f0585b6cb7b10a6b3b0, size left is 2
14:06:31.616 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location 5287145b6eb24f0585b6cb7b10a6b3b0(127.11.165.194:42737) for tablet 92c6da06f31041f5957cc7f6db119211: clean time has not yet been initialized
14:06:31.616 [DEBUG - kudu-nio-3] (RemoteTablet.java:145) tablet 92c6da06f31041f5957cc7f6db119211 already removed ts 5287145b6eb24f0585b6cb7b10a6b3b0, size left is 2
14:06:31.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:31.605971 12462 tablet_service.cc:3018] Rejecting scan request for tablet 92c6da06f31041f5957cc7f6db119211: Uninitialized: clean time has not yet been initialized
14:06:31.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:31.618695 12465 tablet_service.cc:3018] Rejecting scan request for tablet 92c6da06f31041f5957cc7f6db119211: Uninitialized: clean time has not yet been initialized
14:06:31.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:31.621735 12464 tablet_service.cc:3018] Rejecting scan request for tablet 92c6da06f31041f5957cc7f6db119211: Uninitialized: clean time has not yet been initialized
14:06:31.629 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 92c6da06f31041f5957cc7f6db119211 for table 'TestAuthzTokenCache-table' with partition [<start>, <end>)
14:06:31.629 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=92c6da06f31041f5957cc7f6db119211@[5287145b6eb24f0585b6cb7b10a6b3b0(127.11.165.194:42737)[L],5a1549e96fec4c27b1395ab0e2335e18(127.11.165.193:35709),e27688e4a9ee495cb4427df18f981e82(127.11.165.195:37817)]}]
14:06:31.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:31.629541 12460 tablet_service.cc:3018] Rejecting scan request for tablet 92c6da06f31041f5957cc7f6db119211: Uninitialized: clean time has not yet been initialized
14:06:31.630 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, tablet=92c6da06f31041f5957cc7f6db119211, attempt=3, KuduRpc(method=Scan, tablet=92c6da06f31041f5957cc7f6db119211, attempt=3, TimeoutTracker(timeout=30000, elapsed=196), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.165.252:44325, [34ms] Sub RPC GetTableLocations: received response from server master-127.11.165.252:44325: OK, [36ms] sending RPC to server 5287145b6eb24f0585b6cb7b10a6b3b0, [174ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [174ms] received response from server 5287145b6eb24f0585b6cb7b10a6b3b0: Uninitialized: clean time has not yet been initialized (error 0), [182ms] refreshing cache from master, [182ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.165.252:44325, [189ms] Sub RPC GetTableLocations: received response from server master-127.11.165.252:44325: OK, deferred=Deferred@1199153416(state=PENDING, result=null, callback=wakeup thread pool-6-thread-6 -> (continuation of Deferred@1323937635 after retry RPC@1084518606), errback=wakeup thread pool-6-thread-6 -> (continuation of Deferred@1323937635 after retry RPC@1084518606)))) after lookup
14:06:31.633 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 92c6da06f31041f5957cc7f6db119211 for table 'TestAuthzTokenCache-table' with partition [<start>, <end>)
14:06:31.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:31.632870 12458 tablet_service.cc:3018] Rejecting scan request for tablet 92c6da06f31041f5957cc7f6db119211: Uninitialized: clean time has not yet been initialized
14:06:31.633 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=92c6da06f31041f5957cc7f6db119211@[5287145b6eb24f0585b6cb7b10a6b3b0(127.11.165.194:42737)[L],5a1549e96fec4c27b1395ab0e2335e18(127.11.165.193:35709),e27688e4a9ee495cb4427df18f981e82(127.11.165.195:37817)]}]
14:06:31.634 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, tablet=92c6da06f31041f5957cc7f6db119211, attempt=2, KuduRpc(method=Scan, tablet=92c6da06f31041f5957cc7f6db119211, attempt=2, TimeoutTracker(timeout=30000, elapsed=157), Traces: [0ms] sending RPC to server master-127.11.165.252:44325, [6ms] received response from server master-127.11.165.252:44325: OK, [7ms] Sub RPC Scan: sending RPC to server 5287145b6eb24f0585b6cb7b10a6b3b0, [136ms] Sub RPC Scan: delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [136ms] Sub RPC Scan: received response from server 5287145b6eb24f0585b6cb7b10a6b3b0: Uninitialized: clean time has not yet been initialized (error 0), [144ms] Sub RPC Scan: refreshing cache from master, [144ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.165.252:44325, [156ms] Sub RPC GetTableLocations: received response from server master-127.11.165.252:44325: OK, deferred=Deferred@789557603(state=PENDING, result=null, callback=wakeup thread pool-6-thread-15, errback=wakeup thread pool-6-thread-15))) after lookup
14:06:31.638 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 92c6da06f31041f5957cc7f6db119211 for table 'TestAuthzTokenCache-table' with partition [<start>, <end>)
14:06:31.638 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=92c6da06f31041f5957cc7f6db119211@[5287145b6eb24f0585b6cb7b10a6b3b0(127.11.165.194:42737)[L],5a1549e96fec4c27b1395ab0e2335e18(127.11.165.193:35709),e27688e4a9ee495cb4427df18f981e82(127.11.165.195:37817)]}]
14:06:31.639 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, tablet=92c6da06f31041f5957cc7f6db119211, attempt=2, KuduRpc(method=Scan, tablet=92c6da06f31041f5957cc7f6db119211, attempt=2, TimeoutTracker(timeout=30000, elapsed=153), Traces: [0ms] sending RPC to server master-127.11.165.252:44325, [7ms] received response from server master-127.11.165.252:44325: OK, [7ms] Sub RPC Scan: sending RPC to server 5287145b6eb24f0585b6cb7b10a6b3b0, [130ms] Sub RPC Scan: delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [131ms] Sub RPC Scan: received response from server 5287145b6eb24f0585b6cb7b10a6b3b0: Uninitialized: clean time has not yet been initialized (error 0), [135ms] Sub RPC Scan: refreshing cache from master, [135ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.165.252:44325, [152ms] Sub RPC GetTableLocations: received response from server master-127.11.165.252:44325: OK, deferred=Deferred@1340061195(state=PENDING, result=null, callback=wakeup thread pool-6-thread-16, errback=wakeup thread pool-6-thread-16))) after lookup
14:06:31.641 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 92c6da06f31041f5957cc7f6db119211 for table 'TestAuthzTokenCache-table' with partition [<start>, <end>)
14:06:31.641 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=92c6da06f31041f5957cc7f6db119211@[5287145b6eb24f0585b6cb7b10a6b3b0(127.11.165.194:42737)[L],5a1549e96fec4c27b1395ab0e2335e18(127.11.165.193:35709),e27688e4a9ee495cb4427df18f981e82(127.11.165.195:37817)]}]
14:06:31.641 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, tablet=92c6da06f31041f5957cc7f6db119211, attempt=2, KuduRpc(method=Scan, tablet=92c6da06f31041f5957cc7f6db119211, attempt=2, TimeoutTracker(timeout=30000, elapsed=184), Traces: [0ms] sending RPC to server 5287145b6eb24f0585b6cb7b10a6b3b0, [143ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [143ms] received response from server 5287145b6eb24f0585b6cb7b10a6b3b0: Uninitialized: clean time has not yet been initialized (error 0), [149ms] refreshing cache from master, [149ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.165.252:44325, [168ms] Sub RPC GetTableLocations: received response from server master-127.11.165.252:44325: OK, deferred=Deferred@673379111(state=PENDING, result=null, callback=wakeup thread pool-6-thread-13, errback=wakeup thread pool-6-thread-13))) after lookup
14:06:31.643 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location 5287145b6eb24f0585b6cb7b10a6b3b0(127.11.165.194:42737) for tablet 92c6da06f31041f5957cc7f6db119211: clean time has not yet been initialized
14:06:31.643 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 92c6da06f31041f5957cc7f6db119211 for table 'TestAuthzTokenCache-table' with partition [<start>, <end>)
14:06:31.643 [DEBUG - kudu-nio-3] (RemoteTablet.java:145) tablet 92c6da06f31041f5957cc7f6db119211 already removed ts 5287145b6eb24f0585b6cb7b10a6b3b0, size left is 2
14:06:31.643 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=92c6da06f31041f5957cc7f6db119211@[5287145b6eb24f0585b6cb7b10a6b3b0(127.11.165.194:42737)[L],5a1549e96fec4c27b1395ab0e2335e18(127.11.165.193:35709),e27688e4a9ee495cb4427df18f981e82(127.11.165.195:37817)]}]
14:06:31.644 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, tablet=92c6da06f31041f5957cc7f6db119211, attempt=2, KuduRpc(method=Scan, tablet=92c6da06f31041f5957cc7f6db119211, attempt=2, TimeoutTracker(timeout=30000, elapsed=156), Traces: [0ms] sending RPC to server 5287145b6eb24f0585b6cb7b10a6b3b0, [122ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [122ms] received response from server 5287145b6eb24f0585b6cb7b10a6b3b0: Uninitialized: clean time has not yet been initialized (error 0), [127ms] refreshing cache from master, [127ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.165.252:44325, [148ms] Sub RPC GetTableLocations: received response from server master-127.11.165.252:44325: OK, deferred=Deferred@1110662316(state=PENDING, result=null, callback=wakeup thread pool-6-thread-17, errback=wakeup thread pool-6-thread-17))) after lookup
14:06:31.644 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location 5287145b6eb24f0585b6cb7b10a6b3b0(127.11.165.194:42737) for tablet 92c6da06f31041f5957cc7f6db119211: clean time has not yet been initialized
14:06:31.644 [DEBUG - kudu-nio-3] (RemoteTablet.java:145) tablet 92c6da06f31041f5957cc7f6db119211 already removed ts 5287145b6eb24f0585b6cb7b10a6b3b0, size left is 2
14:06:31.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:31.646716 12461 tablet_service.cc:3018] Rejecting scan request for tablet 92c6da06f31041f5957cc7f6db119211: Uninitialized: clean time has not yet been initialized
14:06:31.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:31.645925 12466 tablet_service.cc:3018] Rejecting scan request for tablet 92c6da06f31041f5957cc7f6db119211: Uninitialized: clean time has not yet been initialized
14:06:31.686 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location 5287145b6eb24f0585b6cb7b10a6b3b0(127.11.165.194:42737) for tablet 92c6da06f31041f5957cc7f6db119211: clean time has not yet been initialized
14:06:31.686 [DEBUG - kudu-nio-3] (RemoteTablet.java:145) tablet 92c6da06f31041f5957cc7f6db119211 already removed ts 5287145b6eb24f0585b6cb7b10a6b3b0, size left is 2
14:06:31.691 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location 5287145b6eb24f0585b6cb7b10a6b3b0(127.11.165.194:42737) for tablet 92c6da06f31041f5957cc7f6db119211: clean time has not yet been initialized
14:06:31.691 [DEBUG - kudu-nio-3] (RemoteTablet.java:145) tablet 92c6da06f31041f5957cc7f6db119211 already removed ts 5287145b6eb24f0585b6cb7b10a6b3b0, size left is 2
14:06:31.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:31.693056 12466 tablet_service.cc:3018] Rejecting scan request for tablet 92c6da06f31041f5957cc7f6db119211: Uninitialized: clean time has not yet been initialized
14:06:31.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:31.708899 12462 tablet_service.cc:3018] Rejecting scan request for tablet 92c6da06f31041f5957cc7f6db119211: Uninitialized: clean time has not yet been initialized
14:06:31.715 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location 5287145b6eb24f0585b6cb7b10a6b3b0(127.11.165.194:42737) for tablet 92c6da06f31041f5957cc7f6db119211: clean time has not yet been initialized
14:06:31.716 [DEBUG - kudu-nio-3] (RemoteTablet.java:145) tablet 92c6da06f31041f5957cc7f6db119211 already removed ts 5287145b6eb24f0585b6cb7b10a6b3b0, size left is 2
14:06:31.717 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location 5287145b6eb24f0585b6cb7b10a6b3b0(127.11.165.194:42737) for tablet 92c6da06f31041f5957cc7f6db119211: clean time has not yet been initialized
14:06:31.717 [DEBUG - kudu-nio-3] (RemoteTablet.java:145) tablet 92c6da06f31041f5957cc7f6db119211 already removed ts 5287145b6eb24f0585b6cb7b10a6b3b0, size left is 2
14:06:31.718 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location 5287145b6eb24f0585b6cb7b10a6b3b0(127.11.165.194:42737) for tablet 92c6da06f31041f5957cc7f6db119211: clean time has not yet been initialized
14:06:31.718 [DEBUG - kudu-nio-3] (RemoteTablet.java:145) tablet 92c6da06f31041f5957cc7f6db119211 already removed ts 5287145b6eb24f0585b6cb7b10a6b3b0, size left is 2
14:06:31.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:31.723431 12460 tablet_service.cc:3018] Rejecting scan request for tablet 92c6da06f31041f5957cc7f6db119211: Uninitialized: clean time has not yet been initialized
14:06:31.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:31.734114 12458 tablet_service.cc:3018] Rejecting scan request for tablet 92c6da06f31041f5957cc7f6db119211: Uninitialized: clean time has not yet been initialized
14:06:31.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:31.739511 12461 tablet_service.cc:3018] Rejecting scan request for tablet 92c6da06f31041f5957cc7f6db119211: Uninitialized: clean time has not yet been initialized
14:06:31.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:31.740433 12465 tablet_service.cc:3018] Rejecting scan request for tablet 92c6da06f31041f5957cc7f6db119211: Uninitialized: clean time has not yet been initialized
14:06:31.754 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location 5287145b6eb24f0585b6cb7b10a6b3b0(127.11.165.194:42737) for tablet 92c6da06f31041f5957cc7f6db119211: clean time has not yet been initialized
14:06:31.754 [DEBUG - kudu-nio-3] (RemoteTablet.java:145) tablet 92c6da06f31041f5957cc7f6db119211 already removed ts 5287145b6eb24f0585b6cb7b10a6b3b0, size left is 2
14:06:31.755 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location 5287145b6eb24f0585b6cb7b10a6b3b0(127.11.165.194:42737) for tablet 92c6da06f31041f5957cc7f6db119211: clean time has not yet been initialized
14:06:31.756 [DEBUG - kudu-nio-3] (RemoteTablet.java:145) tablet 92c6da06f31041f5957cc7f6db119211 already removed ts 5287145b6eb24f0585b6cb7b10a6b3b0, size left is 2
14:06:31.756 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location 5287145b6eb24f0585b6cb7b10a6b3b0(127.11.165.194:42737) for tablet 92c6da06f31041f5957cc7f6db119211: clean time has not yet been initialized
14:06:31.756 [DEBUG - kudu-nio-3] (RemoteTablet.java:145) tablet 92c6da06f31041f5957cc7f6db119211 already removed ts 5287145b6eb24f0585b6cb7b10a6b3b0, size left is 2
14:06:31.757 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location 5287145b6eb24f0585b6cb7b10a6b3b0(127.11.165.194:42737) for tablet 92c6da06f31041f5957cc7f6db119211: clean time has not yet been initialized
14:06:31.757 [DEBUG - kudu-nio-3] (RemoteTablet.java:145) tablet 92c6da06f31041f5957cc7f6db119211 already removed ts 5287145b6eb24f0585b6cb7b10a6b3b0, size left is 2
14:06:31.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:31.743858 12464 tablet_service.cc:3018] Rejecting scan request for tablet 92c6da06f31041f5957cc7f6db119211: Uninitialized: clean time has not yet been initialized
14:06:31.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:31.749933 12459 tablet_service.cc:3018] Rejecting scan request for tablet 92c6da06f31041f5957cc7f6db119211: Uninitialized: clean time has not yet been initialized
14:06:31.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:31.763223 12458 tablet_service.cc:3018] Rejecting scan request for tablet 92c6da06f31041f5957cc7f6db119211: Uninitialized: clean time has not yet been initialized
14:06:31.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:31.775983 12461 tablet_service.cc:3018] Rejecting scan request for tablet 92c6da06f31041f5957cc7f6db119211: Uninitialized: clean time has not yet been initialized
14:06:31.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:31.772261 12466 tablet_service.cc:3018] Rejecting scan request for tablet 92c6da06f31041f5957cc7f6db119211: Uninitialized: clean time has not yet been initialized
14:06:31.780 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location 5287145b6eb24f0585b6cb7b10a6b3b0(127.11.165.194:42737) for tablet 92c6da06f31041f5957cc7f6db119211: clean time has not yet been initialized
14:06:31.780 [DEBUG - kudu-nio-3] (RemoteTablet.java:145) tablet 92c6da06f31041f5957cc7f6db119211 already removed ts 5287145b6eb24f0585b6cb7b10a6b3b0, size left is 2
14:06:31.785 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location 5287145b6eb24f0585b6cb7b10a6b3b0(127.11.165.194:42737) for tablet 92c6da06f31041f5957cc7f6db119211: clean time has not yet been initialized
14:06:31.787 [DEBUG - kudu-nio-3] (RemoteTablet.java:145) tablet 92c6da06f31041f5957cc7f6db119211 already removed ts 5287145b6eb24f0585b6cb7b10a6b3b0, size left is 2
14:06:31.790 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location 5287145b6eb24f0585b6cb7b10a6b3b0(127.11.165.194:42737) for tablet 92c6da06f31041f5957cc7f6db119211: clean time has not yet been initialized
14:06:31.790 [DEBUG - kudu-nio-3] (RemoteTablet.java:145) tablet 92c6da06f31041f5957cc7f6db119211 already removed ts 5287145b6eb24f0585b6cb7b10a6b3b0, size left is 2
14:06:31.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:31.801191 12737 consensus_queue.cc:1048] T 92c6da06f31041f5957cc7f6db119211 P 5287145b6eb24f0585b6cb7b10a6b3b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5a1549e96fec4c27b1395ab0e2335e18" member_type: VOTER last_known_addr { host: "127.11.165.193" port: 35709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
14:06:31.804 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location 5287145b6eb24f0585b6cb7b10a6b3b0(127.11.165.194:42737) for tablet 92c6da06f31041f5957cc7f6db119211: clean time has not yet been initialized
14:06:31.804 [DEBUG - kudu-nio-3] (RemoteTablet.java:145) tablet 92c6da06f31041f5957cc7f6db119211 already removed ts 5287145b6eb24f0585b6cb7b10a6b3b0, size left is 2
14:06:31.812 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location 5287145b6eb24f0585b6cb7b10a6b3b0(127.11.165.194:42737) for tablet 92c6da06f31041f5957cc7f6db119211: clean time has not yet been initialized
14:06:31.813 [DEBUG - kudu-nio-3] (RemoteTablet.java:145) tablet 92c6da06f31041f5957cc7f6db119211 already removed ts 5287145b6eb24f0585b6cb7b10a6b3b0, size left is 2
14:06:31.813 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location 5287145b6eb24f0585b6cb7b10a6b3b0(127.11.165.194:42737) for tablet 92c6da06f31041f5957cc7f6db119211: clean time has not yet been initialized
14:06:31.813 [DEBUG - kudu-nio-3] (RemoteTablet.java:145) tablet 92c6da06f31041f5957cc7f6db119211 already removed ts 5287145b6eb24f0585b6cb7b10a6b3b0, size left is 2
14:06:31.814 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location 5287145b6eb24f0585b6cb7b10a6b3b0(127.11.165.194:42737) for tablet 92c6da06f31041f5957cc7f6db119211: clean time has not yet been initialized
14:06:31.814 [DEBUG - kudu-nio-3] (RemoteTablet.java:145) tablet 92c6da06f31041f5957cc7f6db119211 already removed ts 5287145b6eb24f0585b6cb7b10a6b3b0, size left is 2
14:06:31.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:31.822674 12466 tablet_service.cc:3018] Rejecting scan request for tablet 92c6da06f31041f5957cc7f6db119211: Uninitialized: clean time has not yet been initialized
14:06:31.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:31.826726 12461 tablet_service.cc:3018] Rejecting scan request for tablet 92c6da06f31041f5957cc7f6db119211: Uninitialized: clean time has not yet been initialized
14:06:31.831 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location 5287145b6eb24f0585b6cb7b10a6b3b0(127.11.165.194:42737) for tablet 92c6da06f31041f5957cc7f6db119211: clean time has not yet been initialized
14:06:31.832 [DEBUG - kudu-nio-3] (RemoteTablet.java:145) tablet 92c6da06f31041f5957cc7f6db119211 already removed ts 5287145b6eb24f0585b6cb7b10a6b3b0, size left is 2
14:06:31.834 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location 5287145b6eb24f0585b6cb7b10a6b3b0(127.11.165.194:42737) for tablet 92c6da06f31041f5957cc7f6db119211: clean time has not yet been initialized
14:06:31.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:31.834651 12458 tablet_service.cc:3018] Rejecting scan request for tablet 92c6da06f31041f5957cc7f6db119211: Uninitialized: clean time has not yet been initialized
14:06:31.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:31.837087 12466 tablet_service.cc:3018] Rejecting scan request for tablet 92c6da06f31041f5957cc7f6db119211: Uninitialized: clean time has not yet been initialized
14:06:31.839 [DEBUG - kudu-nio-3] (RemoteTablet.java:145) tablet 92c6da06f31041f5957cc7f6db119211 already removed ts 5287145b6eb24f0585b6cb7b10a6b3b0, size left is 2
14:06:31.840 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location 5287145b6eb24f0585b6cb7b10a6b3b0(127.11.165.194:42737) for tablet 92c6da06f31041f5957cc7f6db119211: clean time has not yet been initialized
14:06:31.840 [DEBUG - kudu-nio-3] (RemoteTablet.java:145) tablet 92c6da06f31041f5957cc7f6db119211 already removed ts 5287145b6eb24f0585b6cb7b10a6b3b0, size left is 2
14:06:31.841 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location 5287145b6eb24f0585b6cb7b10a6b3b0(127.11.165.194:42737) for tablet 92c6da06f31041f5957cc7f6db119211: clean time has not yet been initialized
14:06:31.841 [DEBUG - kudu-nio-3] (RemoteTablet.java:145) tablet 92c6da06f31041f5957cc7f6db119211 already removed ts 5287145b6eb24f0585b6cb7b10a6b3b0, size left is 2
14:06:31.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:31.841141 12458 tablet_service.cc:3018] Rejecting scan request for tablet 92c6da06f31041f5957cc7f6db119211: Uninitialized: clean time has not yet been initialized
14:06:31.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:31.846868 12458 tablet_service.cc:3018] Rejecting scan request for tablet 92c6da06f31041f5957cc7f6db119211: Uninitialized: clean time has not yet been initialized
14:06:31.847 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location 5287145b6eb24f0585b6cb7b10a6b3b0(127.11.165.194:42737) for tablet 92c6da06f31041f5957cc7f6db119211: clean time has not yet been initialized
14:06:31.848 [DEBUG - kudu-nio-3] (RemoteTablet.java:145) tablet 92c6da06f31041f5957cc7f6db119211 already removed ts 5287145b6eb24f0585b6cb7b10a6b3b0, size left is 2
14:06:31.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:31.859233 12466 tablet_service.cc:3018] Rejecting scan request for tablet 92c6da06f31041f5957cc7f6db119211: Uninitialized: clean time has not yet been initialized
14:06:31.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:31.866729 12458 tablet_service.cc:3018] Rejecting scan request for tablet 92c6da06f31041f5957cc7f6db119211: Uninitialized: clean time has not yet been initialized
14:06:31.869 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location 5287145b6eb24f0585b6cb7b10a6b3b0(127.11.165.194:42737) for tablet 92c6da06f31041f5957cc7f6db119211: clean time has not yet been initialized
14:06:31.869 [DEBUG - kudu-nio-3] (RemoteTablet.java:145) tablet 92c6da06f31041f5957cc7f6db119211 already removed ts 5287145b6eb24f0585b6cb7b10a6b3b0, size left is 2
14:06:31.872 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location 5287145b6eb24f0585b6cb7b10a6b3b0(127.11.165.194:42737) for tablet 92c6da06f31041f5957cc7f6db119211: clean time has not yet been initialized
14:06:31.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:31.875454 12738 consensus_queue.cc:1048] T 92c6da06f31041f5957cc7f6db119211 P 5287145b6eb24f0585b6cb7b10a6b3b0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e27688e4a9ee495cb4427df18f981e82" member_type: VOTER last_known_addr { host: "127.11.165.195" port: 37817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:06:31.885 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location 5287145b6eb24f0585b6cb7b10a6b3b0(127.11.165.194:42737) for tablet 92c6da06f31041f5957cc7f6db119211: clean time has not yet been initialized
14:06:31.885 [DEBUG - kudu-nio-3] (RemoteTablet.java:145) tablet 92c6da06f31041f5957cc7f6db119211 already removed ts 5287145b6eb24f0585b6cb7b10a6b3b0, size left is 2
14:06:31.885 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location 5287145b6eb24f0585b6cb7b10a6b3b0(127.11.165.194:42737) for tablet 92c6da06f31041f5957cc7f6db119211: clean time has not yet been initialized
14:06:31.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:31.880416 12466 tablet_service.cc:3018] Rejecting scan request for tablet 92c6da06f31041f5957cc7f6db119211: Uninitialized: clean time has not yet been initialized
14:06:31.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:31.888217 12466 tablet_service.cc:3018] Rejecting scan request for tablet 92c6da06f31041f5957cc7f6db119211: Uninitialized: clean time has not yet been initialized
14:06:31.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:31.894344 12466 tablet_service.cc:3018] Rejecting scan request for tablet 92c6da06f31041f5957cc7f6db119211: Uninitialized: clean time has not yet been initialized
14:06:31.899 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location 5287145b6eb24f0585b6cb7b10a6b3b0(127.11.165.194:42737) for tablet 92c6da06f31041f5957cc7f6db119211: clean time has not yet been initialized
14:06:31.929 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location 5287145b6eb24f0585b6cb7b10a6b3b0(127.11.165.194:42737) for tablet 92c6da06f31041f5957cc7f6db119211: clean time has not yet been initialized
14:06:31.943 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestAuthzTokenCache-table, tablet=92c6da06f31041f5957cc7f6db119211, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:06:31.943 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestAuthzTokenCache-table, tablet=92c6da06f31041f5957cc7f6db119211, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:06:31.947 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestAuthzTokenCache-table, tablet=92c6da06f31041f5957cc7f6db119211, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:06:31.947 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestAuthzTokenCache-table, tablet=92c6da06f31041f5957cc7f6db119211, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:06:31.952 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 92c6da06f31041f5957cc7f6db119211 for table 'TestAuthzTokenCache-table' with partition [<start>, <end>)
14:06:31.952 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=92c6da06f31041f5957cc7f6db119211@[5287145b6eb24f0585b6cb7b10a6b3b0(127.11.165.194:42737)[L],5a1549e96fec4c27b1395ab0e2335e18(127.11.165.193:35709),e27688e4a9ee495cb4427df18f981e82(127.11.165.195:37817)]}]
14:06:31.953 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, tablet=92c6da06f31041f5957cc7f6db119211, attempt=4, KuduRpc(method=Scan, tablet=92c6da06f31041f5957cc7f6db119211, attempt=4, TimeoutTracker(timeout=30000, elapsed=465), Traces: [0ms] sending RPC to server 5287145b6eb24f0585b6cb7b10a6b3b0, [122ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [122ms] received response from server 5287145b6eb24f0585b6cb7b10a6b3b0: Uninitialized: clean time has not yet been initialized (error 0), [127ms] refreshing cache from master, [127ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.165.252:44325, [148ms] Sub RPC GetTableLocations: received response from server master-127.11.165.252:44325: OK, [150ms] sending RPC to server 5287145b6eb24f0585b6cb7b10a6b3b0, [435ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [435ms] received response from server 5287145b6eb24f0585b6cb7b10a6b3b0: Uninitialized: clean time has not yet been initialized (error 0), [447ms] refreshing cache from master, [447ms] Sub RPC GetTableLocations: sending RPC to server master-127.11.165.252:44325, [458ms] Sub RPC GetTableLocations: received response from server master-127.11.165.252:44325: OK, deferred=Deferred@1110662316(state=PENDING, result=null, callback=wakeup thread pool-6-thread-17 -> (continuation of Deferred@554829614 after retry RPC@660636731), errback=wakeup thread pool-6-thread-17 -> (continuation of Deferred@554829614 after retry RPC@660636731)))) after lookup
14:06:31.956 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestAuthzTokenCache-table, tablet=92c6da06f31041f5957cc7f6db119211, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:06:31.956 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestAuthzTokenCache-table, tablet=92c6da06f31041f5957cc7f6db119211, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:06:31.982 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestAuthzTokenCache-table, tablet=92c6da06f31041f5957cc7f6db119211, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:06:31.983 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestAuthzTokenCache-table, tablet=92c6da06f31041f5957cc7f6db119211, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:06:31.984 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestAuthzTokenCache-table, tablet=92c6da06f31041f5957cc7f6db119211, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:06:31.985 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestAuthzTokenCache-table, tablet=92c6da06f31041f5957cc7f6db119211, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:06:31.987 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestAuthzTokenCache-table, tablet=92c6da06f31041f5957cc7f6db119211, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:06:31.995 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestAuthzTokenCache-table, tablet=92c6da06f31041f5957cc7f6db119211, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:06:32.000 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestAuthzTokenCache-table, tablet=92c6da06f31041f5957cc7f6db119211, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:06:32.012 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestAuthzTokenCache-table, tablet=92c6da06f31041f5957cc7f6db119211, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:06:32.015 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestAuthzTokenCache-table, tablet=92c6da06f31041f5957cc7f6db119211, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:06:32.022 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestAuthzTokenCache-table, tablet=92c6da06f31041f5957cc7f6db119211, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:06:32.043 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestAuthzTokenCache-table, tablet=92c6da06f31041f5957cc7f6db119211, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:06:32.045 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestAuthzTokenCache-table, tablet=92c6da06f31041f5957cc7f6db119211, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:06:32.061 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestAuthzTokenCache-table, tablet=92c6da06f31041f5957cc7f6db119211, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:06:32.063 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestAuthzTokenCache-table, tablet=92c6da06f31041f5957cc7f6db119211, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:06:32.071 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestAuthzTokenCache-table, tablet=92c6da06f31041f5957cc7f6db119211, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:06:32.089 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestAuthzTokenCache-table, tablet=92c6da06f31041f5957cc7f6db119211, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:06:32.100 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestAuthzTokenCache-table, tablet=92c6da06f31041f5957cc7f6db119211, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:06:32.123 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestAuthzTokenCache-table, tablet=92c6da06f31041f5957cc7f6db119211, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:06:32.126 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestAuthzTokenCache-table, tablet=92c6da06f31041f5957cc7f6db119211, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:06:32.135 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestAuthzTokenCache-table, tablet=92c6da06f31041f5957cc7f6db119211, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:06:32.165 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestAuthzTokenCache-table, tablet=92c6da06f31041f5957cc7f6db119211, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:06:32.170 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestAuthzTokenCache-table, tablet=92c6da06f31041f5957cc7f6db119211, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:06:32.179 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestAuthzTokenCache-table, tablet=92c6da06f31041f5957cc7f6db119211, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:06:32.182 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestAuthzTokenCache-table, tablet=92c6da06f31041f5957cc7f6db119211, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:06:32.183 [DEBUG - main] (TestAuthzTokenCache.java:150) Sent 7 RPCs for 30 threads
14:06:32.184 [DEBUG - main] (Connection.java:575) [peer master-127.11.165.253:43175(127.11.165.253:43175)] disconnecting while in state READY
14:06:32.184 [DEBUG - main] (Connection.java:575) [peer master-127.11.165.254:38921(127.11.165.254:38921)] disconnecting while in state READY
14:06:32.184 [DEBUG - main] (Connection.java:575) [peer master-127.11.165.252:44325(127.11.165.252:44325)] disconnecting while in state READY
14:06:32.184 [DEBUG - main] (Connection.java:575) [peer 5287145b6eb24f0585b6cb7b10a6b3b0(127.11.165.194:42737)] disconnecting while in state READY
14:06:32.185 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.11.165.254:38921(127.11.165.254:38921)] handling channelInactive
14:06:32.185 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.11.165.254:38921(127.11.165.254:38921)] cleaning up while in state READY due to: connection closed
14:06:32.189 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.11.165.253:43175(127.11.165.253:43175)] handling channelInactive
14:06:32.189 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.11.165.253:43175(127.11.165.253:43175)] cleaning up while in state READY due to: connection closed
14:06:32.191 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.11.165.252:44325(127.11.165.252:44325)] handling channelInactive
14:06:32.191 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.11.165.252:44325(127.11.165.252:44325)] cleaning up while in state READY due to: connection closed
14:06:32.192 [DEBUG - kudu-nio-3] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:06:32.208 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 5287145b6eb24f0585b6cb7b10a6b3b0(127.11.165.194:42737)] handling channelInactive
14:06:32.208 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 5287145b6eb24f0585b6cb7b10a6b3b0(127.11.165.194:42737)] cleaning up while in state READY due to: connection closed
14:06:32.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:32.208177 11927 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskM8Xy4F/build/tsan/bin/kudu with pid 12245
14:06:32.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:32.246271 11927 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskM8Xy4F/build/tsan/bin/kudu with pid 12419
14:06:32.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:32.288177 11927 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskM8Xy4F/build/tsan/bin/kudu with pid 12566
14:06:32.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:32.324432 11927 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskM8Xy4F/build/tsan/bin/kudu with pid 11954
14:06:32.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:32.363211 11927 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskM8Xy4F/build/tsan/bin/kudu with pid 12033
14:06:32.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:32.405130 11927 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskM8Xy4F/build/tsan/bin/kudu with pid 12114
14:06:33.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T14:06:33Z chronyd exiting

Time: 47.776

OK (2 tests)

