JUnit version 4.13.2
.23:08:25.072 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1783465705061
23:08:25.114 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
23:08:25.158 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
23:08:25.168 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskmfN_FM/test-tmp
23:08:25.194 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
23:08:25.196 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskmfN_FM/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
23:08:25.390 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 1
  num_tservers: 3
  enable_kerberos: true
  cluster_root: "/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361"
  extra_master_flags: "--webserver_require_spnego=false"
  extra_master_flags: "--authn_token_validity_seconds=1"
  extra_master_flags: "--rpc_default_keepalive_time_ms=120000"
  extra_tserver_flags: "--webserver_require_spnego=false"
  extra_tserver_flags: "--rpc_default_keepalive_time_ms=120000"
  extra_tserver_flags: "--rpc_inject_invalid_authn_token_ratio=0.5"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

23:08:25.666 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
23:08:25.668 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

23:08:25.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:25.674990 12388 mini_oidc.cc:150] Starting JWKS server
23:08:25.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:25.681320 12388 webserver.cc:534] Webserver started at http://127.0.0.1:40741/ using document root <none> and password file <none>
23:08:25.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:25.681952 12388 mini_oidc.cc:186] Starting OIDC Discovery server
23:08:25.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:25.684441 12388 webserver.cc:534] Webserver started at http://127.0.0.1:37167/ using document root <none> and password file <none>
23:08:25.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Loading random data
23:08:25.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Initializing database '/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/krb5kdc/principal' for realm 'KRBTEST.COM',
23:08:25.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master key name 'K/M@KRBTEST.COM'
23:08:25.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 07 23:08:25 dist-test-slave-3qws krb5kdc[12399](info): setting up network...
23:08:25.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
23:08:25.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 07 23:08:25 dist-test-slave-3qws krb5kdc[12399](info): set up 2 sockets
23:08:25.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 07 23:08:25 dist-test-slave-3qws krb5kdc[12399](info): commencing operation
23:08:25.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) krb5kdc: starting...
23:08:27.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:08:27.761660 12388 mini_kdc.cc:121] Time spent starting KDC: real 2.035s	user 0.008s	sys 0.013s
23:08:27.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
23:08:27.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal slave/admin@KRBTEST.COM with password.
23:08:27.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "test-admin@KRBTEST.COM" created.
23:08:27.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
23:08:27.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal slave/admin@KRBTEST.COM with password.
23:08:27.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "test-user@KRBTEST.COM" created.
23:08:27.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
23:08:27.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal slave/admin@KRBTEST.COM with password.
23:08:27.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "joe-interloper@KRBTEST.COM" created.
23:08:27.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal slave/admin@KRBTEST.COM with password.
23:08:27.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/krb5kdc/test-user.keytab.
23:08:27.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/krb5kdc/test-user.keytab.
23:08:27.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 07 23:08:27 dist-test-slave-3qws krb5kdc[12399](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1783465707, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
23:08:27.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Password for test-admin@KRBTEST.COM: 
23:08:27.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-07T23:08:27Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
23:08:27.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-07T23:08:27Z Disabled control of system clock
23:08:27.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for kudu/127.12.25.62@KRBTEST.COM; defaulting to no policy
23:08:27.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
23:08:27.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "kudu/127.12.25.62@KRBTEST.COM" created.
23:08:27.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
23:08:27.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.12.25.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/krb5kdc/kudu.keytab.
23:08:27.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.12.25.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/krb5kdc/kudu.keytab.
23:08:27.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for HTTP/127.12.25.62@KRBTEST.COM; defaulting to no policy
23:08:27.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
23:08:27.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "HTTP/127.12.25.62@KRBTEST.COM" created.
23:08:27.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
23:08:27.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.12.25.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/krb5kdc/kudu.keytab.
23:08:27.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.12.25.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/krb5kdc/kudu.keytab.
23:08:27.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:27.990144 12388 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskmfN_FM/build/tsan/bin/kudu
23:08:27.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskmfN_FM/build/tsan/bin/kudu
23:08:27.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/master-0/wal
23:08:27.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/master-0/data
23:08:27.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:08:27.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:08:27.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:08:27.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:08:27.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:08:27.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:08:27.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/master-0/logs
23:08:27.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/master-0/data/info.pb
23:08:27.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:08:27.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:08:27.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:08:27.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:08:27.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:08:27.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:08:27.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:08:27.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:08:27.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
23:08:27.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:08:27.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:08:27.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:08:27.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.12.25.62:42107
23:08:27.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.12.25.62
23:08:27.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:08:27.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/krb5kdc/kudu.keytab
23:08:27.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.12.25.62
23:08:27.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
23:08:27.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=test-admin
23:08:27.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=test-user
23:08:27.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=true
23:08:27.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.12.25.20:43009
23:08:27.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:08:27.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:08:27.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:08:27.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:08:27.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.12.25.62:42107
23:08:27.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:08:27.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:40741/jwks.json
23:08:27.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=false
23:08:27.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --authn_token_validity_seconds=1
23:08:27.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_default_keepalive_time_ms=120000 with env {KRB5CCNAME=/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
23:08:28.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:08:28.306998 12415 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:08:28.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:08:28.307713 12415 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:08:28.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:08:28.308681 12415 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:08:28.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:08:28.341212 12415 flags.cc:432] Enabled experimental flag: --authn_token_validity_seconds=1
23:08:28.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:08:28.341495 12415 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
23:08:28.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:08:28.341910 12415 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:08:28.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:08:28.342260 12415 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
23:08:28.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:08:28.342667 12415 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
23:08:28.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:08:28.343036 12415 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
23:08:28.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:08:28.343325 12415 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:40741/jwks.json
23:08:28.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:28.381104 12415 master_runner.cc:387] Master server non-default flags:
23:08:28.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:08:28.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.12.25.20:43009
23:08:28.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:08:28.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:08:28.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/master-0/data
23:08:28.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/master-0/wal
23:08:28.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --authn_token_validity_seconds=1
23:08:28.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
23:08:28.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.12.25.62:42107
23:08:28.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/krb5kdc/kudu.keytab
23:08:28.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.12.25.62
23:08:28.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:08:28.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:08:28.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
23:08:28.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.12.25.62:42107
23:08:28.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
23:08:28.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:08:28.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
23:08:28.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:40741/jwks.json
23:08:28.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
23:08:28.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_default_keepalive_time_ms=120000
23:08:28.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=<redacted>
23:08:28.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=<redacted>
23:08:28.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:08:28.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:08:28.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/master-0/data/info.pb
23:08:28.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.12.25.62
23:08:28.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:08:28.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:08:28.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:08:28.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:08:28.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:08:28.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:08:28.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/master-0/logs
23:08:28.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:08:28.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:08:28.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:08:28.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
23:08:28.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:08:28.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 5090956cd8459f75ecce585332f90a8f50524d7f
23:08:28.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:08:28.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 22:43:31 UTC on e7f111948823
23:08:28.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16829
23:08:28.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
23:08:28.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:28.383872 12415 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:08:28.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:28.385963 12415 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:08:28.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:08:28.402549 12421 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:08:30.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:08:29.806751 12420 debug-util.cc:398] Leaking SignalData structure 0x7b0800034d80 after lost signal to thread 12415
23:08:30.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:08:30.355192 12420 kernel_stack_watchdog.cc:198] Thread 12415 stuck at /home/jenkins-slave/workspace/build_and_test@2/src/kudu/util/thread.cc:642 for 401ms:
23:08:30.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
23:08:30.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
23:08:30.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
23:08:30.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
23:08:30.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:08:28.403571 12422 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:08:30.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:08:30.360881 12415 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.958s	user 0.666s	sys 1.292s
23:08:30.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:08:30.361079 12423 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1952 milliseconds
23:08:30.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:08:30.361294 12415 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.959s	user 0.666s	sys 1.292s
23:08:30.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:08:30.362936 12424 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:08:30.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:30.363052 12415 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
23:08:30.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:30.365211 12415 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:08:30.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:30.369376 12415 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:08:30.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:30.376113 12415 hybrid_clock.cc:648] HybridClock initialized: now 1783465710376014 us; error 99 us; skew 500 ppm
23:08:30.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:30.377969 12415 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:08:30.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 07 23:08:30 dist-test-slave-3qws krb5kdc[12399](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1783465710, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.25.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
23:08:30.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:30.387498 12415 init.cc:377] Logged in from keytab as kudu/127.12.25.62@KRBTEST.COM (short username kudu)
23:08:30.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:30.393042 12415 webserver.cc:534] Webserver started at http://127.12.25.62:45215/ using document root <none> and password file <none>
23:08:30.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:30.394366 12415 fs_manager.cc:362] Metadata directory not provided
23:08:30.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:30.394677 12415 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:08:30.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:30.395457 12415 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:08:30.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:30.400564 12415 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/master-0/data/instance:
23:08:30.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "59d5715f4df44305a208277e4e577db7"
23:08:30.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:08:30 on dist-test-slave-3qws"
23:08:30.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:30.401939 12415 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/master-0/wal/instance:
23:08:30.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "59d5715f4df44305a208277e4e577db7"
23:08:30.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:08:30 on dist-test-slave-3qws"
23:08:30.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:30.411633 12415 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.007s	sys 0.000s
23:08:30.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:30.418612 12432 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:08:30.420 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:30.420337 12415 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.001s	sys 0.002s
23:08:30.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:30.420755 12415 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/master-0/data,/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/master-0/wal
23:08:30.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "59d5715f4df44305a208277e4e577db7"
23:08:30.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:08:30 on dist-test-slave-3qws"
23:08:30.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:30.421283 12415 fs_report.cc:389] FS layout report
23:08:30.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:08:30.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/master-0/wal
23:08:30.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/master-0/wal
23:08:30.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/master-0/data/data
23:08:30.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:08:30.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:08:30.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:08:30.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:08:30.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:08:30.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:08:30.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:08:30.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:08:30.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:08:30.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:08:30.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:08:30.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:30.494846 12415 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:08:30.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:30.505692 12415 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:08:30.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:30.506366 12415 kserver.cc:163] Server-wide thread pool size limit: 3276
23:08:30.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:30.592991 12415 rpc_server.cc:307] RPC server started. Bound to: 127.12.25.62:42107
23:08:30.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:30.593079 12483 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.25.62:42107 every 8 connection(s)
23:08:30.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:30.596736 12415 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/master-0/data/info.pb
23:08:30.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:30.601686 12388 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskmfN_FM/build/tsan/bin/kudu as pid 12415
23:08:30.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:30.602196 12388 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/master-0/wal/instance
23:08:30.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:30.607652 12484 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
23:08:30.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:30.635231 12484 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59d5715f4df44305a208277e4e577db7: Bootstrap starting.
23:08:30.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 07 23:08:30 dist-test-slave-3qws krb5kdc[12399](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1783465707, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.25.62@KRBTEST.COM
23:08:30.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:30.645848 12484 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 59d5715f4df44305a208277e4e577db7: Neither blocks nor log segments found. Creating new log.
23:08:30.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:30.648300 12484 log.cc:826] T 00000000000000000000000000000000 P 59d5715f4df44305a208277e4e577db7: Log is configured to *not* fsync() on all Append() calls
23:08:30.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:30.655623 12484 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 59d5715f4df44305a208277e4e577db7: No bootstrap required, opened a new log
23:08:30.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:30.677924 12484 raft_consensus.cc:359] T 00000000000000000000000000000000 P 59d5715f4df44305a208277e4e577db7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59d5715f4df44305a208277e4e577db7" member_type: VOTER last_known_addr { host: "127.12.25.62" port: 42107 } }
23:08:30.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:30.678617 12484 raft_consensus.cc:385] T 00000000000000000000000000000000 P 59d5715f4df44305a208277e4e577db7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:08:30.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:30.678848 12484 raft_consensus.cc:740] T 00000000000000000000000000000000 P 59d5715f4df44305a208277e4e577db7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59d5715f4df44305a208277e4e577db7, State: Initialized, Role: FOLLOWER
23:08:30.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:30.679939 12484 consensus_queue.cc:260] T 00000000000000000000000000000000 P 59d5715f4df44305a208277e4e577db7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59d5715f4df44305a208277e4e577db7" member_type: VOTER last_known_addr { host: "127.12.25.62" port: 42107 } }
23:08:30.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:30.680485 12484 raft_consensus.cc:399] T 00000000000000000000000000000000 P 59d5715f4df44305a208277e4e577db7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
23:08:30.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:30.680886 12484 raft_consensus.cc:493] T 00000000000000000000000000000000 P 59d5715f4df44305a208277e4e577db7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
23:08:30.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:30.681247 12484 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 59d5715f4df44305a208277e4e577db7 [term 0 FOLLOWER]: Advancing to term 1
23:08:30.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:30.685956 12484 raft_consensus.cc:515] T 00000000000000000000000000000000 P 59d5715f4df44305a208277e4e577db7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59d5715f4df44305a208277e4e577db7" member_type: VOTER last_known_addr { host: "127.12.25.62" port: 42107 } }
23:08:30.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:30.686767 12484 leader_election.cc:304] T 00000000000000000000000000000000 P 59d5715f4df44305a208277e4e577db7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 59d5715f4df44305a208277e4e577db7; no voters: 
23:08:30.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:30.688457 12484 leader_election.cc:290] T 00000000000000000000000000000000 P 59d5715f4df44305a208277e4e577db7 [CANDIDATE]: Term 1 election: Requested vote from peers 
23:08:30.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:30.688799 12489 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 59d5715f4df44305a208277e4e577db7 [term 1 FOLLOWER]: Leader election won for term 1
23:08:30.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:30.692516 12489 raft_consensus.cc:697] T 00000000000000000000000000000000 P 59d5715f4df44305a208277e4e577db7 [term 1 LEADER]: Becoming Leader. State: Replica: 59d5715f4df44305a208277e4e577db7, State: Running, Role: LEADER
23:08:30.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:30.693424 12489 consensus_queue.cc:237] T 00000000000000000000000000000000 P 59d5715f4df44305a208277e4e577db7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59d5715f4df44305a208277e4e577db7" member_type: VOTER last_known_addr { host: "127.12.25.62" port: 42107 } }
23:08:30.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:30.694104 12484 sys_catalog.cc:565] T 00000000000000000000000000000000 P 59d5715f4df44305a208277e4e577db7 [sys.catalog]: configured and running, proceeding with master startup.
23:08:30.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:30.707626 12490 sys_catalog.cc:455] T 00000000000000000000000000000000 P 59d5715f4df44305a208277e4e577db7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 59d5715f4df44305a208277e4e577db7. Latest consensus state: current_term: 1 leader_uuid: "59d5715f4df44305a208277e4e577db7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59d5715f4df44305a208277e4e577db7" member_type: VOTER last_known_addr { host: "127.12.25.62" port: 42107 } } }
23:08:30.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:30.708396 12491 sys_catalog.cc:455] T 00000000000000000000000000000000 P 59d5715f4df44305a208277e4e577db7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "59d5715f4df44305a208277e4e577db7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "59d5715f4df44305a208277e4e577db7" member_type: VOTER last_known_addr { host: "127.12.25.62" port: 42107 } } }
23:08:30.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:30.709100 12491 sys_catalog.cc:458] T 00000000000000000000000000000000 P 59d5715f4df44305a208277e4e577db7 [sys.catalog]: This master's current role is: LEADER
23:08:30.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:30.709100 12490 sys_catalog.cc:458] T 00000000000000000000000000000000 P 59d5715f4df44305a208277e4e577db7 [sys.catalog]: This master's current role is: LEADER
23:08:30.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:30.712858 12498 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
23:08:30.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:30.727221 12498 catalog_manager.cc:1519] Initializing Kudu cluster ID...
23:08:30.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:30.748885 12498 catalog_manager.cc:1382] Generated new cluster ID: 31830691bb164472a0131ecac5966eab
23:08:30.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:30.749171 12498 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
23:08:30.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:30.783864 12498 catalog_manager.cc:1405] Generated new certificate authority record
23:08:30.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:30.785770 12498 catalog_manager.cc:1539] Loading token signing keys...
23:08:30.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:30.802021 12498 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 59d5715f4df44305a208277e4e577db7: Generated new TSK 0
23:08:30.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:30.804490 12498 catalog_manager.cc:1549] Initializing in-progress tserver states...
23:08:30.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for kudu/127.12.25.1@KRBTEST.COM; defaulting to no policy
23:08:30.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
23:08:30.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "kudu/127.12.25.1@KRBTEST.COM" created.
23:08:30.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
23:08:30.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.12.25.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/krb5kdc/kudu.keytab.
23:08:30.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.12.25.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/krb5kdc/kudu.keytab.
23:08:30.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for HTTP/127.12.25.1@KRBTEST.COM; defaulting to no policy
23:08:30.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
23:08:30.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "HTTP/127.12.25.1@KRBTEST.COM" created.
23:08:30.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
23:08:30.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.12.25.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/krb5kdc/kudu.keytab.
23:08:30.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.12.25.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/krb5kdc/kudu.keytab.
23:08:30.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:30.899446 12388 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskmfN_FM/build/tsan/bin/kudu
23:08:30.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskmfN_FM/build/tsan/bin/kudu
23:08:30.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/ts-0/wal
23:08:30.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/ts-0/data
23:08:30.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:08:30.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:08:30.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:08:30.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:08:30.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:08:30.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:08:30.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/ts-0/logs
23:08:30.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/ts-0/data/info.pb
23:08:30.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:08:30.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:08:30.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:08:30.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:08:30.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:08:30.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:08:30.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:08:30.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:08:30.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
23:08:30.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:08:30.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.12.25.1:0
23:08:30.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.12.25.1
23:08:30.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.12.25.1
23:08:30.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:08:30.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.12.25.62:42107
23:08:30.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/krb5kdc/kudu.keytab
23:08:30.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.12.25.1
23:08:30.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
23:08:30.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=test-admin
23:08:30.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=test-user
23:08:30.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=true
23:08:30.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.12.25.20:43009
23:08:30.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:08:30.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:08:30.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:08:30.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=false
23:08:30.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_default_keepalive_time_ms=120000
23:08:30.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_inject_invalid_authn_token_ratio=0.5 with env {KRB5CCNAME=/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
23:08:31.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:08:31.230965 12512 flags.cc:432] Enabled unsafe flag: --rpc_inject_invalid_authn_token_ratio=0.5
23:08:31.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:08:31.231720 12512 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:08:31.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:08:31.232120 12512 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:08:31.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:08:31.233008 12512 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:08:31.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:08:31.267431 12512 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:08:31.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:08:31.268774 12512 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.25.1
23:08:31.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:31.307551 12512 tablet_server_runner.cc:78] Tablet server non-default flags:
23:08:31.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:08:31.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.12.25.20:43009
23:08:31.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:08:31.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:08:31.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/ts-0/data
23:08:31.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/ts-0/wal
23:08:31.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_inject_invalid_authn_token_ratio=0.5
23:08:31.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/krb5kdc/kudu.keytab
23:08:31.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.12.25.1
23:08:31.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:08:31.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:08:31.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.12.25.1:0
23:08:31.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:08:31.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
23:08:31.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_default_keepalive_time_ms=120000
23:08:31.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=<redacted>
23:08:31.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=<redacted>
23:08:31.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:08:31.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:08:31.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/ts-0/data/info.pb
23:08:31.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.12.25.1
23:08:31.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:08:31.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.12.25.62:42107
23:08:31.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:08:31.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:08:31.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:08:31.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:08:31.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:08:31.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.12.25.1
23:08:31.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/ts-0/logs
23:08:31.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:08:31.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:08:31.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:08:31.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
23:08:31.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:08:31.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 5090956cd8459f75ecce585332f90a8f50524d7f
23:08:31.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:08:31.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 22:43:31 UTC on e7f111948823
23:08:31.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16829
23:08:31.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
23:08:31.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:31.309376 12512 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:08:31.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:31.311033 12512 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:08:31.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:08:31.326169 12518 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:08:32.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:08:31.328554 12519 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:08:32.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:08:32.576660 12521 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:08:32.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:08:32.580947 12520 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1244 milliseconds
23:08:32.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:32.581121 12512 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
23:08:32.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:32.582856 12512 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:08:32.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:32.586696 12512 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:08:32.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:32.588402 12512 hybrid_clock.cc:648] HybridClock initialized: now 1783465712588325 us; error 84 us; skew 500 ppm
23:08:32.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:32.589308 12512 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:08:32.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 07 23:08:32 dist-test-slave-3qws krb5kdc[12399](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1783465712, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.25.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
23:08:32.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:32.597218 12512 init.cc:377] Logged in from keytab as kudu/127.12.25.1@KRBTEST.COM (short username kudu)
23:08:32.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:32.606177 12512 webserver.cc:534] Webserver started at http://127.12.25.1:44051/ using document root <none> and password file <none>
23:08:32.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:32.607374 12512 fs_manager.cc:362] Metadata directory not provided
23:08:32.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:32.607636 12512 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:08:32.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:32.612591 12512 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:08:32.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:32.617273 12512 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/ts-0/data/instance:
23:08:32.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "59b4fe0f5202411ca6a2a92bbad90e5a"
23:08:32.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:08:32 on dist-test-slave-3qws"
23:08:32.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:32.618899 12512 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/ts-0/wal/instance:
23:08:32.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "59b4fe0f5202411ca6a2a92bbad90e5a"
23:08:32.619 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:08:32 on dist-test-slave-3qws"
23:08:32.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:32.627341 12512 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.007s	sys 0.001s
23:08:32.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:32.633433 12529 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:08:32.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:32.634845 12512 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.006s	sys 0.000s
23:08:32.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:32.635207 12512 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/ts-0/data,/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/ts-0/wal
23:08:32.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "59b4fe0f5202411ca6a2a92bbad90e5a"
23:08:32.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:08:32 on dist-test-slave-3qws"
23:08:32.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:32.635663 12512 fs_report.cc:389] FS layout report
23:08:32.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:08:32.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/ts-0/wal
23:08:32.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/ts-0/wal
23:08:32.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/ts-0/data/data
23:08:32.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:08:32.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:08:32.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:08:32.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:08:32.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:08:32.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:08:32.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:08:32.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:08:32.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:08:32.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:08:32.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:08:32.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:32.706796 12512 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:08:32.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:32.715337 12512 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:08:32.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:32.716360 12512 kserver.cc:163] Server-wide thread pool size limit: 3276
23:08:32.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:32.720443 12512 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
23:08:32.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:32.725570 12512 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
23:08:32.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:32.725795 12512 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
23:08:32.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:32.726104 12512 ts_tablet_manager.cc:616] Registered 0 tablets
23:08:32.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:32.726336 12512 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
23:08:32.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:32.922928 12512 rpc_server.cc:307] RPC server started. Bound to: 127.12.25.1:45027
23:08:32.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:32.923146 12641 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.25.1:45027 every 8 connection(s)
23:08:32.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:32.926133 12512 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/ts-0/data/info.pb
23:08:32.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:32.931624 12388 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskmfN_FM/build/tsan/bin/kudu as pid 12512
23:08:32.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:32.932119 12388 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/ts-0/wal/instance
23:08:32.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for kudu/127.12.25.2@KRBTEST.COM; defaulting to no policy
23:08:32.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
23:08:32.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "kudu/127.12.25.2@KRBTEST.COM" created.
23:08:32.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 07 23:08:32 dist-test-slave-3qws krb5kdc[12399](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1783465712, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.25.1@KRBTEST.COM for kudu/127.12.25.62@KRBTEST.COM
23:08:32.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:32.984197 12642 heartbeater.cc:344] Connected to a master server at 127.12.25.62:42107
23:08:32.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:32.984710 12642 heartbeater.cc:461] Registering TS with master...
23:08:32.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:32.986169 12642 heartbeater.cc:507] Master 127.12.25.62:42107 requested a full tablet report, sending...
23:08:32.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:32.990587 12449 ts_manager.cc:194] Registered new tserver with Master: 59b4fe0f5202411ca6a2a92bbad90e5a (127.12.25.1:45027)
23:08:32.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
23:08:32.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.12.25.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/krb5kdc/kudu.keytab.
23:08:32.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.12.25.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/krb5kdc/kudu.keytab.
23:08:32.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:32.993665 12449 master_service.cc:502] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.25.1@KRBTEST.COM'} at 127.12.25.1:38747
23:08:33.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for HTTP/127.12.25.2@KRBTEST.COM; defaulting to no policy
23:08:33.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
23:08:33.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "HTTP/127.12.25.2@KRBTEST.COM" created.
23:08:33.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
23:08:33.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.12.25.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/krb5kdc/kudu.keytab.
23:08:33.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.12.25.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/krb5kdc/kudu.keytab.
23:08:33.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:33.035799 12388 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskmfN_FM/build/tsan/bin/kudu
23:08:33.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskmfN_FM/build/tsan/bin/kudu
23:08:33.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/ts-1/wal
23:08:33.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/ts-1/data
23:08:33.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:08:33.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:08:33.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:08:33.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:08:33.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:08:33.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:08:33.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/ts-1/logs
23:08:33.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/ts-1/data/info.pb
23:08:33.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:08:33.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:08:33.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:08:33.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:08:33.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:08:33.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:08:33.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:08:33.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:08:33.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
23:08:33.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:08:33.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.12.25.2:0
23:08:33.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.12.25.2
23:08:33.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.12.25.2
23:08:33.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:08:33.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.12.25.62:42107
23:08:33.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/krb5kdc/kudu.keytab
23:08:33.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.12.25.2
23:08:33.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
23:08:33.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=test-admin
23:08:33.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=test-user
23:08:33.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=true
23:08:33.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.12.25.20:43009
23:08:33.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:08:33.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:08:33.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:08:33.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=false
23:08:33.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_default_keepalive_time_ms=120000
23:08:33.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_inject_invalid_authn_token_ratio=0.5 with env {KRB5CCNAME=/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
23:08:33.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:08:33.368971 12650 flags.cc:432] Enabled unsafe flag: --rpc_inject_invalid_authn_token_ratio=0.5
23:08:33.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:08:33.369747 12650 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:08:33.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:08:33.370132 12650 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:08:33.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:08:33.371116 12650 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:08:33.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:08:33.407274 12650 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:08:33.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:08:33.408638 12650 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.25.2
23:08:33.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:33.448487 12650 tablet_server_runner.cc:78] Tablet server non-default flags:
23:08:33.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:08:33.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.12.25.20:43009
23:08:33.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:08:33.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:08:33.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/ts-1/data
23:08:33.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/ts-1/wal
23:08:33.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_inject_invalid_authn_token_ratio=0.5
23:08:33.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/krb5kdc/kudu.keytab
23:08:33.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.12.25.2
23:08:33.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:08:33.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:08:33.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.12.25.2:0
23:08:33.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:08:33.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
23:08:33.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_default_keepalive_time_ms=120000
23:08:33.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=<redacted>
23:08:33.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=<redacted>
23:08:33.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:08:33.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:08:33.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/ts-1/data/info.pb
23:08:33.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.12.25.2
23:08:33.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:08:33.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.12.25.62:42107
23:08:33.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:08:33.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:08:33.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:08:33.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:08:33.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:08:33.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.12.25.2
23:08:33.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/ts-1/logs
23:08:33.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:08:33.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:08:33.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:08:33.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
23:08:33.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:08:33.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 5090956cd8459f75ecce585332f90a8f50524d7f
23:08:33.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:08:33.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 22:43:31 UTC on e7f111948823
23:08:33.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16829
23:08:33.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
23:08:33.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:33.450320 12650 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:08:33.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:33.451982 12650 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:08:33.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:08:33.466111 12656 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:08:33.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:33.999107 12642 heartbeater.cc:499] Master 127.12.25.62:42107 was elected leader, sending a full tablet report...
23:08:34.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:08:33.472142 12659 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:08:34.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:08:33.468340 12657 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:08:34.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:08:34.666859 12658 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
23:08:34.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:34.667013 12650 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
23:08:34.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:34.672013 12650 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:08:34.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:34.675040 12650 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:08:34.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:34.676587 12650 hybrid_clock.cc:648] HybridClock initialized: now 1783465714676295 us; error 298 us; skew 500 ppm
23:08:34.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:34.677420 12650 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:08:34.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 07 23:08:34 dist-test-slave-3qws krb5kdc[12399](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1783465714, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.25.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
23:08:34.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:34.683897 12650 init.cc:377] Logged in from keytab as kudu/127.12.25.2@KRBTEST.COM (short username kudu)
23:08:34.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:34.689147 12650 webserver.cc:534] Webserver started at http://127.12.25.2:37601/ using document root <none> and password file <none>
23:08:34.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:34.690274 12650 fs_manager.cc:362] Metadata directory not provided
23:08:34.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:34.690541 12650 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:08:34.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:34.691054 12650 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:08:34.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:34.696079 12650 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/ts-1/data/instance:
23:08:34.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "501770cbc1f7431591906d00e5cbdb85"
23:08:34.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:08:34 on dist-test-slave-3qws"
23:08:34.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:34.697223 12650 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/ts-1/wal/instance:
23:08:34.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "501770cbc1f7431591906d00e5cbdb85"
23:08:34.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:08:34 on dist-test-slave-3qws"
23:08:34.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:34.704741 12650 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.004s
23:08:34.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:34.710752 12667 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:08:34.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:34.711822 12650 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.001s	sys 0.002s
23:08:34.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:34.712193 12650 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/ts-1/data,/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/ts-1/wal
23:08:34.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "501770cbc1f7431591906d00e5cbdb85"
23:08:34.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:08:34 on dist-test-slave-3qws"
23:08:34.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:34.712603 12650 fs_report.cc:389] FS layout report
23:08:34.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:08:34.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/ts-1/wal
23:08:34.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/ts-1/wal
23:08:34.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/ts-1/data/data
23:08:34.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:08:34.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:08:34.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:08:34.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:08:34.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:08:34.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:08:34.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:08:34.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:08:34.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:08:34.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:08:34.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:08:34.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:34.764317 12650 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:08:34.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:34.770279 12650 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:08:34.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:34.770855 12650 kserver.cc:163] Server-wide thread pool size limit: 3276
23:08:34.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:34.774005 12650 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
23:08:34.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:34.778316 12650 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
23:08:34.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:34.778571 12650 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
23:08:34.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:34.778890 12650 ts_tablet_manager.cc:616] Registered 0 tablets
23:08:34.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:34.779141 12650 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
23:08:34.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:34.933458 12650 rpc_server.cc:307] RPC server started. Bound to: 127.12.25.2:40317
23:08:34.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:34.933614 12779 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.25.2:40317 every 8 connection(s)
23:08:34.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:34.936255 12650 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/ts-1/data/info.pb
23:08:34.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:34.945755 12388 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskmfN_FM/build/tsan/bin/kudu as pid 12650
23:08:34.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:34.946272 12388 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/ts-1/wal/instance
23:08:34.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 07 23:08:34 dist-test-slave-3qws krb5kdc[12399](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1783465714, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.25.2@KRBTEST.COM for kudu/127.12.25.62@KRBTEST.COM
23:08:34.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for kudu/127.12.25.3@KRBTEST.COM; defaulting to no policy
23:08:34.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
23:08:34.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "kudu/127.12.25.3@KRBTEST.COM" created.
23:08:34.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:34.976024 12780 heartbeater.cc:344] Connected to a master server at 127.12.25.62:42107
23:08:34.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:34.976617 12780 heartbeater.cc:461] Registering TS with master...
23:08:34.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:34.978284 12780 heartbeater.cc:507] Master 127.12.25.62:42107 requested a full tablet report, sending...
23:08:34.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:34.981057 12449 ts_manager.cc:194] Registered new tserver with Master: 501770cbc1f7431591906d00e5cbdb85 (127.12.25.2:40317)
23:08:34.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:34.982424 12449 master_service.cc:502] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.25.2@KRBTEST.COM'} at 127.12.25.2:33767
23:08:34.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
23:08:34.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.12.25.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/krb5kdc/kudu.keytab.
23:08:34.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.12.25.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/krb5kdc/kudu.keytab.
23:08:35.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for HTTP/127.12.25.3@KRBTEST.COM; defaulting to no policy
23:08:35.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
23:08:35.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "HTTP/127.12.25.3@KRBTEST.COM" created.
23:08:35.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
23:08:35.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.12.25.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/krb5kdc/kudu.keytab.
23:08:35.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.12.25.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/krb5kdc/kudu.keytab.
23:08:35.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:35.037314 12388 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskmfN_FM/build/tsan/bin/kudu
23:08:35.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskmfN_FM/build/tsan/bin/kudu
23:08:35.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/ts-2/wal
23:08:35.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/ts-2/data
23:08:35.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
23:08:35.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
23:08:35.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
23:08:35.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:08:35.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:08:35.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:08:35.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/ts-2/logs
23:08:35.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/ts-2/data/info.pb
23:08:35.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:08:35.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
23:08:35.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
23:08:35.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
23:08:35.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
23:08:35.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:08:35.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:08:35.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:08:35.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
23:08:35.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
23:08:35.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.12.25.3:0
23:08:35.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.12.25.3
23:08:35.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.12.25.3
23:08:35.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:08:35.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.12.25.62:42107
23:08:35.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/krb5kdc/kudu.keytab
23:08:35.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.12.25.3
23:08:35.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
23:08:35.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=test-admin
23:08:35.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=test-user
23:08:35.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=true
23:08:35.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.12.25.20:43009
23:08:35.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:08:35.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:08:35.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:08:35.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=false
23:08:35.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_default_keepalive_time_ms=120000
23:08:35.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_inject_invalid_authn_token_ratio=0.5 with env {KRB5CCNAME=/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
23:08:35.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:08:35.373728 12788 flags.cc:432] Enabled unsafe flag: --rpc_inject_invalid_authn_token_ratio=0.5
23:08:35.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:08:35.374380 12788 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
23:08:35.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:08:35.374687 12788 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
23:08:35.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:08:35.375255 12788 flags.cc:432] Enabled unsafe flag: --never_fsync=true
23:08:35.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:08:35.408846 12788 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
23:08:35.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:08:35.409821 12788 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.25.3
23:08:35.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:35.448626 12788 tablet_server_runner.cc:78] Tablet server non-default flags:
23:08:35.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
23:08:35.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.12.25.20:43009
23:08:35.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
23:08:35.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
23:08:35.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/ts-2/data
23:08:35.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/ts-2/wal
23:08:35.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_inject_invalid_authn_token_ratio=0.5
23:08:35.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/krb5kdc/kudu.keytab
23:08:35.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.12.25.3
23:08:35.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
23:08:35.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
23:08:35.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.12.25.3:0
23:08:35.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
23:08:35.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
23:08:35.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_default_keepalive_time_ms=120000
23:08:35.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=<redacted>
23:08:35.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=<redacted>
23:08:35.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
23:08:35.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
23:08:35.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/ts-2/data/info.pb
23:08:35.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.12.25.3
23:08:35.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
23:08:35.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.12.25.62:42107
23:08:35.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
23:08:35.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
23:08:35.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
23:08:35.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
23:08:35.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
23:08:35.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.12.25.3
23:08:35.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/ts-2/logs
23:08:35.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
23:08:35.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
23:08:35.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
23:08:35.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
23:08:35.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
23:08:35.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 5090956cd8459f75ecce585332f90a8f50524d7f
23:08:35.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
23:08:35.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 07 Jul 2026 22:43:31 UTC on e7f111948823
23:08:35.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 16829
23:08:35.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
23:08:35.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:35.449981 12788 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
23:08:35.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:35.451263 12788 file_cache.cc:492] Constructed file cache file cache with capacity 419430
23:08:35.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:08:35.463186 12794 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:08:35.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:35.986784 12780 heartbeater.cc:499] Master 127.12.25.62:42107 was elected leader, sending a full tablet report...
23:08:36.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:08:35.465386 12795 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:08:36.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:08:36.744467 12797 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
23:08:36.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:08:36.747350 12796 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1277 milliseconds
23:08:36.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:36.747496 12788 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
23:08:36.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:36.748806 12788 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
23:08:36.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:36.751091 12788 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
23:08:36.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:36.752494 12788 hybrid_clock.cc:648] HybridClock initialized: now 1783465716752453 us; error 40 us; skew 500 ppm
23:08:36.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:36.753403 12788 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
23:08:36.758 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 07 23:08:36 dist-test-slave-3qws krb5kdc[12399](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1783465716, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.25.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
23:08:36.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:36.759652 12788 init.cc:377] Logged in from keytab as kudu/127.12.25.3@KRBTEST.COM (short username kudu)
23:08:36.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:36.765292 12788 webserver.cc:534] Webserver started at http://127.12.25.3:34939/ using document root <none> and password file <none>
23:08:36.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:36.766227 12788 fs_manager.cc:362] Metadata directory not provided
23:08:36.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:36.766422 12788 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
23:08:36.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:36.766921 12788 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
23:08:36.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:36.771252 12788 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/ts-2/data/instance:
23:08:36.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "88585f88ba884a7696202abadfa18998"
23:08:36.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:08:36 on dist-test-slave-3qws"
23:08:36.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:36.772424 12788 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/ts-2/wal/instance:
23:08:36.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "88585f88ba884a7696202abadfa18998"
23:08:36.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:08:36 on dist-test-slave-3qws"
23:08:36.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:36.780107 12788 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.004s
23:08:36.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:36.785475 12806 log_block_manager.cc:4031] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
23:08:36.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:36.786808 12788 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
23:08:36.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:36.787097 12788 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/ts-2/data,/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/ts-2/wal
23:08:36.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "88585f88ba884a7696202abadfa18998"
23:08:36.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-07 23:08:36 on dist-test-slave-3qws"
23:08:36.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:36.787398 12788 fs_report.cc:389] FS layout report
23:08:36.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
23:08:36.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/ts-2/wal
23:08:36.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/ts-2/wal
23:08:36.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/ts-2/data/data
23:08:36.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
23:08:36.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
23:08:36.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
23:08:36.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
23:08:36.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
23:08:36.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
23:08:36.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
23:08:36.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
23:08:36.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
23:08:36.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
23:08:36.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
23:08:36.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:36.852811 12788 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
23:08:36.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:36.866818 12788 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
23:08:36.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:36.867274 12788 kserver.cc:163] Server-wide thread pool size limit: 3276
23:08:36.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:36.869889 12788 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
23:08:36.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:36.874238 12788 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
23:08:36.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:36.874439 12788 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
23:08:36.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:36.874745 12788 ts_tablet_manager.cc:616] Registered 0 tablets
23:08:36.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:36.874910 12788 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
23:08:37.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:37.032703 12788 rpc_server.cc:307] RPC server started. Bound to: 127.12.25.3:39375
23:08:37.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:37.032832 12918 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.12.25.3:39375 every 8 connection(s)
23:08:37.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:37.035269 12788 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/ts-2/data/info.pb
23:08:37.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:37.038798 12388 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskmfN_FM/build/tsan/bin/kudu as pid 12788
23:08:37.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:37.039548 12388 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/ts-2/wal/instance
23:08:37.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 07 23:08:37 dist-test-slave-3qws krb5kdc[12399](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1783465716, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.25.3@KRBTEST.COM for kudu/127.12.25.62@KRBTEST.COM
23:08:37.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:37.070660 12919 heartbeater.cc:344] Connected to a master server at 127.12.25.62:42107
23:08:37.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:37.071110 12919 heartbeater.cc:461] Registering TS with master...
23:08:37.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:37.072204 12919 heartbeater.cc:507] Master 127.12.25.62:42107 requested a full tablet report, sending...
23:08:37.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:37.074919 12449 ts_manager.cc:194] Registered new tserver with Master: 88585f88ba884a7696202abadfa18998 (127.12.25.3:39375)
23:08:37.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:37.076418 12449 master_service.cc:502] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.25.3@KRBTEST.COM'} at 127.12.25.3:44987
23:08:37.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:37.077190 12388 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
23:08:37.090 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
23:08:37.091 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_kdc_env_vars {
}

23:08:37.101 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_kdc_env_vars {
  env_vars {
    key: "KRB5CCNAME"
    value: "/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/krb5kdc/krb5cc"
  }
  env_vars {
    key: "KRB5_CONFIG"
    value: "/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/krb5kdc/krb5.conf"
  }
  env_vars {
    key: "KRB5_KDC_PROFILE"
    value: "/tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/krb5kdc/kdc.conf"
  }
  env_vars {
    key: "KUDU_ENABLE_KRB5_REALM_FIX"
    value: "yes"
  }
}

23:08:37.102 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

23:08:37.110 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.12.25.62"
      port: 42107
    }
    bound_http_address {
      host: "127.12.25.62"
      port: 45215
    }
  }
}

23:08:37.113 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

23:08:37.116 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.12.25.1"
      port: 45027
    }
    bound_http_address {
      host: "127.12.25.1"
      port: 44051
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.12.25.2"
      port: 40317
    }
    bound_http_address {
      host: "127.12.25.2"
      port: 37601
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.12.25.3"
      port: 39375
    }
    bound_http_address {
      host: "127.12.25.3"
      port: 34939
    }
  }
}

23:08:37.116 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
23:08:37.459 [DEBUG - main] (CompositeStrategy.java:59) Unable to load modern Subject methods, relying only on legacy methods
java.lang.NoSuchMethodException: javax.security.auth.Subject.current()
	at java.base/java.lang.Class.getDeclaredMethod(Class.java:2677)
	at org.apache.kudu.client.internals.ModernStrategy.<init>(ModernStrategy.java:51)
	at org.apache.kudu.client.internals.CompositeStrategy.<init>(CompositeStrategy.java:52)
	at org.apache.kudu.client.internals.CompositeStrategy.<clinit>(CompositeStrategy.java:41)
	at org.apache.kudu.client.internals.SecurityManagerCompatibility.get(SecurityManagerCompatibility.java:43)
	at org.apache.kudu.client.SecurityContext.setupSubject(SecurityContext.java:155)
	at org.apache.kudu.client.SecurityContext.<init>(SecurityContext.java:138)
	at org.apache.kudu.client.AsyncKuduClient.<init>(AsyncKuduClient.java:431)
	at org.apache.kudu.client.AsyncKuduClient$AsyncKuduClientBuilder.build(AsyncKuduClient.java:3109)
	at org.apache.kudu.test.KuduTestHarness.before(KuduTestHarness.java:161)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:50)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.doOneAttempt(RetryRule.java:225)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.evaluate(RetryRule.java:246)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runners.Suite.runChild(Suite.java:128)
	at org.junit.runners.Suite.runChild(Suite.java:27)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
	at org.junit.runner.JUnitCore.runMain(JUnitCore.java:77)
	at org.junit.runner.JUnitCore.main(JUnitCore.java:36)
23:08:37.544 [DEBUG - main] (SecurityUtil.java:105) Using ticketCache: /tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/krb5kdc/krb5cc
23:08:37.606 [DEBUG - main] (SecurityUtil.java:119) Logged in as subject: test-admin@KRBTEST.COM
23:08:37.743 [DEBUG - main] (Connection.java:748) [peer master-127.12.25.62:42107(127.12.25.62:42107)] connecting to peer
23:08:37.812 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.12.25.62:42107(127.12.25.62:42107)] Successfully connected to peer
23:08:37.905 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism GSSAPI chosen for peer 127.12.25.62
23:08:38.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:38.079982 12919 heartbeater.cc:499] Master 127.12.25.62:42107 was elected leader, sending a full tablet report...
23:08:38.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Jul 07 23:08:38 dist-test-slave-3qws krb5kdc[12399](info): TGS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1783465707, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.25.62@KRBTEST.COM
23:08:38.231 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xaa880cba, L:/127.0.0.1:42940 - R:/127.12.25.62:42107] using SASL/GSSAPI
23:08:38.269 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:08:38.270 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=ListTabletServers, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=576), Traces: [0ms] refreshing cache from master, [32ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.25.62:42107, [548ms] Sub RPC ConnectToMaster: received response from server master-127.12.25.62:42107: OK, deferred=null) after lookup
23:08:38.290 [DEBUG - main] (Connection.java:575) [peer master-127.12.25.62:42107(127.12.25.62:42107)] disconnecting while in state READY
23:08:38.297 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.12.25.62:42107(127.12.25.62:42107)] handling channelInactive
23:08:38.298 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.12.25.62:42107(127.12.25.62:42107)] cleaning up while in state READY due to: connection closed
23:08:38.298 [INFO - kudu-nio-0] (AsyncKuduClient.java:2355) Invalidating location master-127.12.25.62:42107(127.12.25.62:42107) for tablet Kudu Master: connection closed
23:08:38.318 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.12.25.62:42107(127.12.25.62:42107)] connecting to peer
23:08:38.320 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.12.25.62:42107(127.12.25.62:42107)] Successfully connected to peer
23:08:38.384 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xd9b400b5, L:/127.0.0.1:42954 - R:/127.12.25.62:42107] using TOKEN/null
23:08:38.389 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
23:08:38.389 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=ListTables, tablet=Kudu Master, attempt=2, TimeoutTracker(timeout=50000, elapsed=97), Traces: [0ms] sending RPC to server master-127.12.25.62:42107, [7ms] received response from server master-127.12.25.62:42107: Network error: connection closed, [7ms] delaying RPC due to: Network error: connection closed, [26ms] refreshing cache from master, [26ms] Sub RPC ConnectToMaster: sending RPC to server master-127.12.25.62:42107, [97ms] Sub RPC ConnectToMaster: received response from server master-127.12.25.62:42107: OK, deferred=Deferred@1862599194(state=PENDING, result=null, callback=wakeup thread main, errback=wakeup thread main)) after lookup
23:08:38.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:38.452350 12449 catalog_manager.cc:2282] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:42954:
23:08:38.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "TestAuthnTokenReacquireOpen-table"
23:08:38.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
23:08:38.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:08:38.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key"
23:08:38.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
23:08:38.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
23:08:38.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:08:38.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:08:38.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:08:38.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:08:38.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:08:38.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:08:38.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column1_i"
23:08:38.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
23:08:38.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
23:08:38.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:08:38.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:08:38.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:08:38.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:08:38.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:08:38.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:08:38.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column2_i"
23:08:38.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
23:08:38.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
23:08:38.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:08:38.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:08:38.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:08:38.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:08:38.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:08:38.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:08:38.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column3_s"
23:08:38.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
23:08:38.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
23:08:38.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: true
23:08:38.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: DICT_ENCODING
23:08:38.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: LZ4
23:08:38.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 4096
23:08:38.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:08:38.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:08:38.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:08:38.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
23:08:38.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column4_b"
23:08:38.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BOOL
23:08:38.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
23:08:38.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
23:08:38.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
23:08:38.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
23:08:38.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
23:08:38.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:08:38.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
23:08:38.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
23:08:38.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
23:08:38.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
23:08:38.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key"
23:08:38.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
23:08:38.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
23:08:38.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
23:08:38.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:08:38.479647 12449 catalog_manager.cc:7076] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table TestAuthnTokenReacquireOpen-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
23:08:38.557 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 606416c84bd34441810ff61d6ad6a68f
23:08:38.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:38.563345 12854 tablet_service.cc:1511] Processing CreateTablet for tablet 0ecddae4658c4e4db7207100673b695e (DEFAULT_TABLE table=TestAuthnTokenReacquireOpen-table [id=606416c84bd34441810ff61d6ad6a68f]), partition=RANGE (key) PARTITION UNBOUNDED
23:08:38.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:38.566068 12854 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ecddae4658c4e4db7207100673b695e. 1 dirs total, 0 dirs full, 0 dirs failed
23:08:38.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:38.568432 12715 tablet_service.cc:1511] Processing CreateTablet for tablet 0ecddae4658c4e4db7207100673b695e (DEFAULT_TABLE table=TestAuthnTokenReacquireOpen-table [id=606416c84bd34441810ff61d6ad6a68f]), partition=RANGE (key) PARTITION UNBOUNDED
23:08:38.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:38.570848 12715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ecddae4658c4e4db7207100673b695e. 1 dirs total, 0 dirs full, 0 dirs failed
23:08:38.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:38.576186 12577 tablet_service.cc:1511] Processing CreateTablet for tablet 0ecddae4658c4e4db7207100673b695e (DEFAULT_TABLE table=TestAuthnTokenReacquireOpen-table [id=606416c84bd34441810ff61d6ad6a68f]), partition=RANGE (key) PARTITION UNBOUNDED
23:08:38.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:38.578204 12577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ecddae4658c4e4db7207100673b695e. 1 dirs total, 0 dirs full, 0 dirs failed
23:08:38.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:38.620205 12940 tablet_bootstrap.cc:492] T 0ecddae4658c4e4db7207100673b695e P 59b4fe0f5202411ca6a2a92bbad90e5a: Bootstrap starting.
23:08:38.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:38.631111 12940 tablet_bootstrap.cc:654] T 0ecddae4658c4e4db7207100673b695e P 59b4fe0f5202411ca6a2a92bbad90e5a: Neither blocks nor log segments found. Creating new log.
23:08:38.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:38.634884 12940 log.cc:826] T 0ecddae4658c4e4db7207100673b695e P 59b4fe0f5202411ca6a2a92bbad90e5a: Log is configured to *not* fsync() on all Append() calls
23:08:38.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:38.647125 12942 tablet_bootstrap.cc:492] T 0ecddae4658c4e4db7207100673b695e P 501770cbc1f7431591906d00e5cbdb85: Bootstrap starting.
23:08:38.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:38.644840 12939 tablet_bootstrap.cc:492] T 0ecddae4658c4e4db7207100673b695e P 88585f88ba884a7696202abadfa18998: Bootstrap starting.
23:08:38.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:38.657006 12942 tablet_bootstrap.cc:654] T 0ecddae4658c4e4db7207100673b695e P 501770cbc1f7431591906d00e5cbdb85: Neither blocks nor log segments found. Creating new log.
23:08:38.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:38.659993 12942 log.cc:826] T 0ecddae4658c4e4db7207100673b695e P 501770cbc1f7431591906d00e5cbdb85: Log is configured to *not* fsync() on all Append() calls
23:08:38.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:38.665949 12939 tablet_bootstrap.cc:654] T 0ecddae4658c4e4db7207100673b695e P 88585f88ba884a7696202abadfa18998: Neither blocks nor log segments found. Creating new log.
23:08:38.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:38.667191 12940 tablet_bootstrap.cc:492] T 0ecddae4658c4e4db7207100673b695e P 59b4fe0f5202411ca6a2a92bbad90e5a: No bootstrap required, opened a new log
23:08:38.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:38.668052 12940 ts_tablet_manager.cc:1403] T 0ecddae4658c4e4db7207100673b695e P 59b4fe0f5202411ca6a2a92bbad90e5a: Time spent bootstrapping tablet: real 0.048s	user 0.020s	sys 0.013s
23:08:38.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:38.673907 12939 log.cc:826] T 0ecddae4658c4e4db7207100673b695e P 88585f88ba884a7696202abadfa18998: Log is configured to *not* fsync() on all Append() calls
23:08:38.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:38.690968 12942 tablet_bootstrap.cc:492] T 0ecddae4658c4e4db7207100673b695e P 501770cbc1f7431591906d00e5cbdb85: No bootstrap required, opened a new log
23:08:38.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:38.691500 12939 tablet_bootstrap.cc:492] T 0ecddae4658c4e4db7207100673b695e P 88585f88ba884a7696202abadfa18998: No bootstrap required, opened a new log
23:08:38.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:38.691936 12942 ts_tablet_manager.cc:1403] T 0ecddae4658c4e4db7207100673b695e P 501770cbc1f7431591906d00e5cbdb85: Time spent bootstrapping tablet: real 0.046s	user 0.013s	sys 0.008s
23:08:38.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:38.692323 12939 ts_tablet_manager.cc:1403] T 0ecddae4658c4e4db7207100673b695e P 88585f88ba884a7696202abadfa18998: Time spent bootstrapping tablet: real 0.048s	user 0.015s	sys 0.008s
23:08:38.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:38.728443 12939 raft_consensus.cc:359] T 0ecddae4658c4e4db7207100673b695e P 88585f88ba884a7696202abadfa18998 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88585f88ba884a7696202abadfa18998" member_type: VOTER last_known_addr { host: "127.12.25.3" port: 39375 } } peers { permanent_uuid: "501770cbc1f7431591906d00e5cbdb85" member_type: VOTER last_known_addr { host: "127.12.25.2" port: 40317 } } peers { permanent_uuid: "59b4fe0f5202411ca6a2a92bbad90e5a" member_type: VOTER last_known_addr { host: "127.12.25.1" port: 45027 } }
23:08:38.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:38.729938 12939 raft_consensus.cc:385] T 0ecddae4658c4e4db7207100673b695e P 88585f88ba884a7696202abadfa18998 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:08:38.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:38.729694 12940 raft_consensus.cc:359] T 0ecddae4658c4e4db7207100673b695e P 59b4fe0f5202411ca6a2a92bbad90e5a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88585f88ba884a7696202abadfa18998" member_type: VOTER last_known_addr { host: "127.12.25.3" port: 39375 } } peers { permanent_uuid: "501770cbc1f7431591906d00e5cbdb85" member_type: VOTER last_known_addr { host: "127.12.25.2" port: 40317 } } peers { permanent_uuid: "59b4fe0f5202411ca6a2a92bbad90e5a" member_type: VOTER last_known_addr { host: "127.12.25.1" port: 45027 } }
23:08:38.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:38.730552 12939 raft_consensus.cc:740] T 0ecddae4658c4e4db7207100673b695e P 88585f88ba884a7696202abadfa18998 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 88585f88ba884a7696202abadfa18998, State: Initialized, Role: FOLLOWER
23:08:38.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:38.730964 12940 raft_consensus.cc:385] T 0ecddae4658c4e4db7207100673b695e P 59b4fe0f5202411ca6a2a92bbad90e5a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:08:38.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:38.731494 12940 raft_consensus.cc:740] T 0ecddae4658c4e4db7207100673b695e P 59b4fe0f5202411ca6a2a92bbad90e5a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59b4fe0f5202411ca6a2a92bbad90e5a, State: Initialized, Role: FOLLOWER
23:08:38.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:38.731993 12939 consensus_queue.cc:260] T 0ecddae4658c4e4db7207100673b695e P 88585f88ba884a7696202abadfa18998 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88585f88ba884a7696202abadfa18998" member_type: VOTER last_known_addr { host: "127.12.25.3" port: 39375 } } peers { permanent_uuid: "501770cbc1f7431591906d00e5cbdb85" member_type: VOTER last_known_addr { host: "127.12.25.2" port: 40317 } } peers { permanent_uuid: "59b4fe0f5202411ca6a2a92bbad90e5a" member_type: VOTER last_known_addr { host: "127.12.25.1" port: 45027 } }
23:08:38.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:38.733184 12940 consensus_queue.cc:260] T 0ecddae4658c4e4db7207100673b695e P 59b4fe0f5202411ca6a2a92bbad90e5a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88585f88ba884a7696202abadfa18998" member_type: VOTER last_known_addr { host: "127.12.25.3" port: 39375 } } peers { permanent_uuid: "501770cbc1f7431591906d00e5cbdb85" member_type: VOTER last_known_addr { host: "127.12.25.2" port: 40317 } } peers { permanent_uuid: "59b4fe0f5202411ca6a2a92bbad90e5a" member_type: VOTER last_known_addr { host: "127.12.25.1" port: 45027 } }
23:08:38.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:38.739459 12942 raft_consensus.cc:359] T 0ecddae4658c4e4db7207100673b695e P 501770cbc1f7431591906d00e5cbdb85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88585f88ba884a7696202abadfa18998" member_type: VOTER last_known_addr { host: "127.12.25.3" port: 39375 } } peers { permanent_uuid: "501770cbc1f7431591906d00e5cbdb85" member_type: VOTER last_known_addr { host: "127.12.25.2" port: 40317 } } peers { permanent_uuid: "59b4fe0f5202411ca6a2a92bbad90e5a" member_type: VOTER last_known_addr { host: "127.12.25.1" port: 45027 } }
23:08:38.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:38.741106 12942 raft_consensus.cc:385] T 0ecddae4658c4e4db7207100673b695e P 501770cbc1f7431591906d00e5cbdb85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
23:08:38.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:38.741803 12942 raft_consensus.cc:740] T 0ecddae4658c4e4db7207100673b695e P 501770cbc1f7431591906d00e5cbdb85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 501770cbc1f7431591906d00e5cbdb85, State: Initialized, Role: FOLLOWER
23:08:38.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:38.743225 12939 ts_tablet_manager.cc:1434] T 0ecddae4658c4e4db7207100673b695e P 88585f88ba884a7696202abadfa18998: Time spent starting tablet: real 0.050s	user 0.028s	sys 0.011s
23:08:38.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:38.744342 12942 consensus_queue.cc:260] T 0ecddae4658c4e4db7207100673b695e P 501770cbc1f7431591906d00e5cbdb85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88585f88ba884a7696202abadfa18998" member_type: VOTER last_known_addr { host: "127.12.25.3" port: 39375 } } peers { permanent_uuid: "501770cbc1f7431591906d00e5cbdb85" member_type: VOTER last_known_addr { host: "127.12.25.2" port: 40317 } } peers { permanent_uuid: "59b4fe0f5202411ca6a2a92bbad90e5a" member_type: VOTER last_known_addr { host: "127.12.25.1" port: 45027 } }
23:08:38.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:38.765643 12940 ts_tablet_manager.cc:1434] T 0ecddae4658c4e4db7207100673b695e P 59b4fe0f5202411ca6a2a92bbad90e5a: Time spent starting tablet: real 0.097s	user 0.037s	sys 0.026s
23:08:38.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:38.768925 12942 ts_tablet_manager.cc:1434] T 0ecddae4658c4e4db7207100673b695e P 501770cbc1f7431591906d00e5cbdb85: Time spent starting tablet: real 0.076s	user 0.034s	sys 0.015s
23:08:38.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:08:38.795674 12920 tablet.cc:2406] T 0ecddae4658c4e4db7207100673b695e P 88585f88ba884a7696202abadfa18998: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:08:38.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:38.805866 12945 raft_consensus.cc:493] T 0ecddae4658c4e4db7207100673b695e P 88585f88ba884a7696202abadfa18998 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
23:08:38.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:38.806447 12945 raft_consensus.cc:515] T 0ecddae4658c4e4db7207100673b695e P 88585f88ba884a7696202abadfa18998 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88585f88ba884a7696202abadfa18998" member_type: VOTER last_known_addr { host: "127.12.25.3" port: 39375 } } peers { permanent_uuid: "501770cbc1f7431591906d00e5cbdb85" member_type: VOTER last_known_addr { host: "127.12.25.2" port: 40317 } } peers { permanent_uuid: "59b4fe0f5202411ca6a2a92bbad90e5a" member_type: VOTER last_known_addr { host: "127.12.25.1" port: 45027 } }
23:08:38.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:38.810079 12945 leader_election.cc:290] T 0ecddae4658c4e4db7207100673b695e P 88585f88ba884a7696202abadfa18998 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 501770cbc1f7431591906d00e5cbdb85 (127.12.25.2:40317), 59b4fe0f5202411ca6a2a92bbad90e5a (127.12.25.1:45027)
23:08:38.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:38.824420 12735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecddae4658c4e4db7207100673b695e" candidate_uuid: "88585f88ba884a7696202abadfa18998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501770cbc1f7431591906d00e5cbdb85" is_pre_election: true
23:08:38.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:38.825476 12735 raft_consensus.cc:2468] T 0ecddae4658c4e4db7207100673b695e P 501770cbc1f7431591906d00e5cbdb85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88585f88ba884a7696202abadfa18998 in term 0.
23:08:38.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:38.825652 12597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecddae4658c4e4db7207100673b695e" candidate_uuid: "88585f88ba884a7696202abadfa18998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59b4fe0f5202411ca6a2a92bbad90e5a" is_pre_election: true
23:08:38.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:38.826633 12597 raft_consensus.cc:2468] T 0ecddae4658c4e4db7207100673b695e P 59b4fe0f5202411ca6a2a92bbad90e5a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 88585f88ba884a7696202abadfa18998 in term 0.
23:08:38.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:38.826931 12810 leader_election.cc:304] T 0ecddae4658c4e4db7207100673b695e P 88585f88ba884a7696202abadfa18998 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 501770cbc1f7431591906d00e5cbdb85, 88585f88ba884a7696202abadfa18998; no voters: 
23:08:38.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:38.827872 12945 raft_consensus.cc:2804] T 0ecddae4658c4e4db7207100673b695e P 88585f88ba884a7696202abadfa18998 [term 0 FOLLOWER]: Leader pre-election won for term 1
23:08:38.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:38.828230 12945 raft_consensus.cc:493] T 0ecddae4658c4e4db7207100673b695e P 88585f88ba884a7696202abadfa18998 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
23:08:38.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:38.828542 12945 raft_consensus.cc:3060] T 0ecddae4658c4e4db7207100673b695e P 88585f88ba884a7696202abadfa18998 [term 0 FOLLOWER]: Advancing to term 1
23:08:38.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:38.833130 12945 raft_consensus.cc:515] T 0ecddae4658c4e4db7207100673b695e P 88585f88ba884a7696202abadfa18998 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88585f88ba884a7696202abadfa18998" member_type: VOTER last_known_addr { host: "127.12.25.3" port: 39375 } } peers { permanent_uuid: "501770cbc1f7431591906d00e5cbdb85" member_type: VOTER last_known_addr { host: "127.12.25.2" port: 40317 } } peers { permanent_uuid: "59b4fe0f5202411ca6a2a92bbad90e5a" member_type: VOTER last_known_addr { host: "127.12.25.1" port: 45027 } }
23:08:38.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:38.834823 12945 leader_election.cc:290] T 0ecddae4658c4e4db7207100673b695e P 88585f88ba884a7696202abadfa18998 [CANDIDATE]: Term 1 election: Requested vote from peers 501770cbc1f7431591906d00e5cbdb85 (127.12.25.2:40317), 59b4fe0f5202411ca6a2a92bbad90e5a (127.12.25.1:45027)
23:08:38.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:38.835605 12735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecddae4658c4e4db7207100673b695e" candidate_uuid: "88585f88ba884a7696202abadfa18998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "501770cbc1f7431591906d00e5cbdb85"
23:08:38.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:38.835897 12597 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ecddae4658c4e4db7207100673b695e" candidate_uuid: "88585f88ba884a7696202abadfa18998" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59b4fe0f5202411ca6a2a92bbad90e5a"
23:08:38.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:38.836167 12735 raft_consensus.cc:3060] T 0ecddae4658c4e4db7207100673b695e P 501770cbc1f7431591906d00e5cbdb85 [term 0 FOLLOWER]: Advancing to term 1
23:08:38.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:38.836506 12597 raft_consensus.cc:3060] T 0ecddae4658c4e4db7207100673b695e P 59b4fe0f5202411ca6a2a92bbad90e5a [term 0 FOLLOWER]: Advancing to term 1
23:08:38.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:38.841379 12597 raft_consensus.cc:2468] T 0ecddae4658c4e4db7207100673b695e P 59b4fe0f5202411ca6a2a92bbad90e5a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88585f88ba884a7696202abadfa18998 in term 1.
23:08:38.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:38.842401 12810 leader_election.cc:304] T 0ecddae4658c4e4db7207100673b695e P 88585f88ba884a7696202abadfa18998 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59b4fe0f5202411ca6a2a92bbad90e5a, 88585f88ba884a7696202abadfa18998; no voters: 
23:08:38.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:38.843206 12945 raft_consensus.cc:2804] T 0ecddae4658c4e4db7207100673b695e P 88585f88ba884a7696202abadfa18998 [term 1 FOLLOWER]: Leader election won for term 1
23:08:38.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:38.843338 12735 raft_consensus.cc:2468] T 0ecddae4658c4e4db7207100673b695e P 501770cbc1f7431591906d00e5cbdb85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 88585f88ba884a7696202abadfa18998 in term 1.
23:08:38.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:38.845506 12945 raft_consensus.cc:697] T 0ecddae4658c4e4db7207100673b695e P 88585f88ba884a7696202abadfa18998 [term 1 LEADER]: Becoming Leader. State: Replica: 88585f88ba884a7696202abadfa18998, State: Running, Role: LEADER
23:08:38.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:38.846704 12945 consensus_queue.cc:237] T 0ecddae4658c4e4db7207100673b695e P 88585f88ba884a7696202abadfa18998 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88585f88ba884a7696202abadfa18998" member_type: VOTER last_known_addr { host: "127.12.25.3" port: 39375 } } peers { permanent_uuid: "501770cbc1f7431591906d00e5cbdb85" member_type: VOTER last_known_addr { host: "127.12.25.2" port: 40317 } } peers { permanent_uuid: "59b4fe0f5202411ca6a2a92bbad90e5a" member_type: VOTER last_known_addr { host: "127.12.25.1" port: 45027 } }
23:08:38.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:38.861689 12448 catalog_manager.cc:5696] T 0ecddae4658c4e4db7207100673b695e P 88585f88ba884a7696202abadfa18998 reported cstate change: term changed from 0 to 1, leader changed from <none> to 88585f88ba884a7696202abadfa18998 (127.12.25.3). New cstate: current_term: 1 leader_uuid: "88585f88ba884a7696202abadfa18998" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "88585f88ba884a7696202abadfa18998" member_type: VOTER last_known_addr { host: "127.12.25.3" port: 39375 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "501770cbc1f7431591906d00e5cbdb85" member_type: VOTER last_known_addr { host: "127.12.25.2" port: 40317 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59b4fe0f5202411ca6a2a92bbad90e5a" member_type: VOTER last_known_addr { host: "127.12.25.1" port: 45027 } health_report { overall_health: UNKNOWN } } }
23:08:38.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:08:38.946771 12781 tablet.cc:2406] T 0ecddae4658c4e4db7207100673b695e P 501770cbc1f7431591906d00e5cbdb85: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:08:38.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:08:38.952860 12643 tablet.cc:2406] T 0ecddae4658c4e4db7207100673b695e P 59b4fe0f5202411ca6a2a92bbad90e5a: Can't schedule compaction. Clean time has not been advanced past its initial value.
23:08:39.087 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 606416c84bd34441810ff61d6ad6a68f
23:08:39.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:39.274111 12945 consensus_queue.cc:1048] T 0ecddae4658c4e4db7207100673b695e P 88585f88ba884a7696202abadfa18998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "501770cbc1f7431591906d00e5cbdb85" member_type: VOTER last_known_addr { host: "127.12.25.2" port: 40317 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:08:39.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:39.299556 12956 consensus_queue.cc:1048] T 0ecddae4658c4e4db7207100673b695e P 88585f88ba884a7696202abadfa18998 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59b4fe0f5202411ca6a2a92bbad90e5a" member_type: VOTER last_known_addr { host: "127.12.25.1" port: 45027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
23:08:40.093 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 606416c84bd34441810ff61d6ad6a68f
23:08:40.118 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 0ecddae4658c4e4db7207100673b695e for table 'TestAuthnTokenReacquireOpen-table' with partition [<start>, <end>)
23:08:40.124 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299994, tablet=0ecddae4658c4e4db7207100673b695e@[501770cbc1f7431591906d00e5cbdb85(127.12.25.2:40317),59b4fe0f5202411ca6a2a92bbad90e5a(127.12.25.1:45027),88585f88ba884a7696202abadfa18998(127.12.25.3:39375)[L]]}]
23:08:40.133 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=60000, elapsed=18), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.12.25.62:42107, [10ms] Sub RPC GetTableLocations: received response from server master-127.12.25.62:42107: OK, deferred=null)) after lookup
23:08:40.144 [DEBUG - kudu-nio-1] (Connection.java:748) [peer 88585f88ba884a7696202abadfa18998(127.12.25.3:39375)] connecting to peer
23:08:40.147 [DEBUG - kudu-nio-2] (Connection.java:757) [peer 88585f88ba884a7696202abadfa18998(127.12.25.3:39375)] Successfully connected to peer
23:08:40.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:08:40.198904 12961 negotiation.cc:343] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:34220: token expired
23:08:40.203 [DEBUG - kudu-nio-2] (Negotiator.java:352) peer /127.12.25.3:39375 sent connection negotiation error: Not authorized: token expired
23:08:40.205 [DEBUG - kudu-nio-2] (Connection.java:239) [peer 88585f88ba884a7696202abadfa18998(127.12.25.3:39375)] handling channelInactive
23:08:40.206 [DEBUG - kudu-nio-2] (Connection.java:709) [peer 88585f88ba884a7696202abadfa18998(127.12.25.3:39375)] cleaning up while in state NEGOTIATION_FAILED due to: connection closed
23:08:40.208 [DEBUG - kudu-nio-2] (Connection.java:748) [peer master-127.12.25.62:42107(127.12.25.62:42107)] connecting to peer
23:08:40.210 [DEBUG - kudu-nio-3] (Connection.java:757) [peer master-127.12.25.62:42107(127.12.25.62:42107)] Successfully connected to peer
23:08:40.219 [DEBUG - kudu-nio-3] (Negotiator.java:529) SASL mechanism GSSAPI chosen for peer 127.12.25.62
23:08:40.263 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x8f9c8c53, L:/127.0.0.1:42968 - R:/127.12.25.62:42107] using SASL/GSSAPI
23:08:40.267 [INFO - kudu-nio-3] (AsyncKuduClient.java:516) connect to master: received a new authn token
23:08:40.268 [DEBUG - kudu-nio-3] (Connection.java:748) [peer 88585f88ba884a7696202abadfa18998(127.12.25.3:39375)] connecting to peer
23:08:40.270 [DEBUG - kudu-nio-4] (Connection.java:757) [peer 88585f88ba884a7696202abadfa18998(127.12.25.3:39375)] Successfully connected to peer
23:08:40.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:08:40.297122 12961 fault_injection.cc:43] FAULT INJECTION ENABLED!
23:08:40.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:08:40.297406 12961 fault_injection.cc:44] THIS SERVER MAY CRASH!
23:08:40.299 [DEBUG - kudu-nio-4] (Negotiator.java:919) Authenticated connection [id: 0x647c1d9c, L:/127.0.0.1:34230 - R:/127.12.25.3:39375] using TOKEN/null
23:08:40.340 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestAuthnTokenReacquireOpen-table, tablet=0ecddae4658c4e4db7207100673b695e, scannerId=null, scanRequestTimeout=60000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
23:08:40.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:40.352814 12449 catalog_manager.cc:2532] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:42954:
23:08:40.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "TestAuthnTokenReacquireOpen-table" }
23:08:40.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:40.353534 12449 catalog_manager.cc:2780] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:42954:
23:08:40.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "TestAuthnTokenReacquireOpen-table" }
23:08:40.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:40.368723 12449 catalog_manager.cc:5983] T 00000000000000000000000000000000 P 59d5715f4df44305a208277e4e577db7: Sending DeleteTablet for 3 replicas of tablet 0ecddae4658c4e4db7207100673b695e
23:08:40.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:40.371253 12854 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ecddae4658c4e4db7207100673b695e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-07-07 23:08:40 UTC) from {username='kudu', principal='kudu/127.12.25.62@KRBTEST.COM'} at 127.0.0.1:34216
23:08:40.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:40.371598 12715 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ecddae4658c4e4db7207100673b695e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-07-07 23:08:40 UTC) from {username='kudu', principal='kudu/127.12.25.62@KRBTEST.COM'} at 127.0.0.1:54836
23:08:40.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:40.373847 12577 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ecddae4658c4e4db7207100673b695e with delete_type TABLET_DATA_DELETED (Table deleted at 2026-07-07 23:08:40 UTC) from {username='kudu', principal='kudu/127.12.25.62@KRBTEST.COM'} at 127.0.0.1:51692
23:08:40.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:40.375442 12972 tablet_replica.cc:333] T 0ecddae4658c4e4db7207100673b695e P 501770cbc1f7431591906d00e5cbdb85: stopping tablet replica
23:08:40.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:40.376304 12972 raft_consensus.cc:2243] T 0ecddae4658c4e4db7207100673b695e P 501770cbc1f7431591906d00e5cbdb85 [term 1 FOLLOWER]: Raft consensus shutting down.
23:08:40.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:40.376935 12972 raft_consensus.cc:2272] T 0ecddae4658c4e4db7207100673b695e P 501770cbc1f7431591906d00e5cbdb85 [term 1 FOLLOWER]: Raft consensus is shut down!
23:08:40.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:40.379909 12972 ts_tablet_manager.cc:1916] T 0ecddae4658c4e4db7207100673b695e P 501770cbc1f7431591906d00e5cbdb85: Deleting tablet data with delete state TABLET_DATA_DELETED
23:08:40.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:40.381909 12971 tablet_replica.cc:333] T 0ecddae4658c4e4db7207100673b695e P 88585f88ba884a7696202abadfa18998: stopping tablet replica
23:08:40.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:40.383050 12971 raft_consensus.cc:2243] T 0ecddae4658c4e4db7207100673b695e P 88585f88ba884a7696202abadfa18998 [term 1 LEADER]: Raft consensus shutting down.
23:08:40.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:40.384577 12971 raft_consensus.cc:2272] T 0ecddae4658c4e4db7207100673b695e P 88585f88ba884a7696202abadfa18998 [term 1 FOLLOWER]: Raft consensus is shut down!
23:08:40.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:40.387636 12971 ts_tablet_manager.cc:1916] T 0ecddae4658c4e4db7207100673b695e P 88585f88ba884a7696202abadfa18998: Deleting tablet data with delete state TABLET_DATA_DELETED
23:08:40.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:40.394654 12973 tablet_replica.cc:333] T 0ecddae4658c4e4db7207100673b695e P 59b4fe0f5202411ca6a2a92bbad90e5a: stopping tablet replica
23:08:40.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:40.396059 12973 raft_consensus.cc:2243] T 0ecddae4658c4e4db7207100673b695e P 59b4fe0f5202411ca6a2a92bbad90e5a [term 1 FOLLOWER]: Raft consensus shutting down.
23:08:40.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:40.397003 12973 raft_consensus.cc:2272] T 0ecddae4658c4e4db7207100673b695e P 59b4fe0f5202411ca6a2a92bbad90e5a [term 1 FOLLOWER]: Raft consensus is shut down!
23:08:40.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:40.398248 12972 ts_tablet_manager.cc:1929] T 0ecddae4658c4e4db7207100673b695e P 501770cbc1f7431591906d00e5cbdb85: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
23:08:40.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:40.398926 12972 log.cc:1199] T 0ecddae4658c4e4db7207100673b695e P 501770cbc1f7431591906d00e5cbdb85: Deleting WAL directory at /tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/ts-1/wal/wals/0ecddae4658c4e4db7207100673b695e
23:08:40.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:40.399981 12972 ts_tablet_manager.cc:1950] T 0ecddae4658c4e4db7207100673b695e P 501770cbc1f7431591906d00e5cbdb85: Deleting consensus metadata
23:08:40.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:40.400000 12973 ts_tablet_manager.cc:1916] T 0ecddae4658c4e4db7207100673b695e P 59b4fe0f5202411ca6a2a92bbad90e5a: Deleting tablet data with delete state TABLET_DATA_DELETED
23:08:40.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:40.403986 12436 catalog_manager.cc:5027] TS 501770cbc1f7431591906d00e5cbdb85 (127.12.25.2:40317): tablet 0ecddae4658c4e4db7207100673b695e (table TestAuthnTokenReacquireOpen-table [id=606416c84bd34441810ff61d6ad6a68f]) successfully deleted
23:08:40.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:40.404899 12971 ts_tablet_manager.cc:1929] T 0ecddae4658c4e4db7207100673b695e P 88585f88ba884a7696202abadfa18998: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.1
23:08:40.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:40.405493 12971 log.cc:1199] T 0ecddae4658c4e4db7207100673b695e P 88585f88ba884a7696202abadfa18998: Deleting WAL directory at /tmp/dist-test-taskmfN_FM/test-tmp/mini-kudu-cluster6132439189113836361/ts-2/wal/wals/0ecddae4658c4e4db7207100673b695e
23:08:40.406 [DEBUG - main] (Connection.java:575) [peer master-127.12.25.62:42107(127.12.25.62:42107)] disconnecting while in state READY
23:08:40.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:40.406494 12971 ts_tablet_manager.cc:1950] T 0ecddae4658c4e4db7207100673b695e P 88585f88ba884a7696202abadfa18998: Deleting consensus metadata
23:08:40.407 [DEBUG - main] (Connection.java:575) [peer master-127.12.25.62:42107(127.12.25.62:42107)] disconnecting while in state READY
23:08:40.407 [DEBUG - main] (Connection.java:575) [peer 88585f88ba884a7696202abadfa18998(127.12.25.3:39375)] disconnecting while in state READY
23:08:40.408 [DEBUG - kudu-nio-3] (Connection.java:239) [peer master-127.12.25.62:42107(127.12.25.62:42107)] handling channelInactive
23:08:40.408 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.12.25.62:42107(127.12.25.62:42107)] cleaning up while in state READY due to: connection closed
23:08:40.408 [DEBUG - kudu-nio-4] (Connection.java:239) [peer 88585f88ba884a7696202abadfa18998(127.12.25.3:39375)] handling channelInactive
23:08:40.408 [DEBUG - kudu-nio-4] (Connection.java:709) [peer 88585f88ba884a7696202abadfa18998(127.12.25.3:39375)] cleaning up while in state READY due to: connection closed
23:08:40.409 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
23:08:40.414 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.12.25.62:42107(127.12.25.62:42107)] handling channelInactive
23:08:40.414 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.12.25.62:42107(127.12.25.62:42107)] cleaning up while in state READY due to: connection closed
23:08:40.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:40.414407 12433 catalog_manager.cc:5027] TS 88585f88ba884a7696202abadfa18998 (127.12.25.3:39375): tablet 0ecddae4658c4e4db7207100673b695e (table TestAuthnTokenReacquireOpen-table [id=606416c84bd34441810ff61d6ad6a68f]) successfully deleted
23:08:40.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:40.415674 12388 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskmfN_FM/build/tsan/bin/kudu with pid 12512
23:08:40.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:08:40.441322 12436 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.25.1:45027 (error 108)
23:08:40.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:40.442960 12388 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskmfN_FM/build/tsan/bin/kudu with pid 12650
23:08:40.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260707 23:08:40.453754 12436 catalog_manager.cc:4754] TS 59b4fe0f5202411ca6a2a92bbad90e5a (127.12.25.1:45027): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 0ecddae4658c4e4db7207100673b695e: Network error: Client connection negotiation failed: client connection to 127.12.25.1:45027: connect: Connection refused (error 111)
23:08:40.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:40.482234 12388 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskmfN_FM/build/tsan/bin/kudu with pid 12788
23:08:40.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260707 23:08:40.505761 12388 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskmfN_FM/build/tsan/bin/kudu with pid 12415
23:08:41.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-07T23:08:41Z chronyd exiting

Time: 17.685

OK (1 test)

