JUnit version 4.13.2
.02:03:49.350 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1779069829342
02:03:49.387 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
02:03:49.451 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
02:03:49.464 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-task2tB5Xy/test-tmp
02:03:49.470 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
02:03:49.473 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-task2tB5Xy/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
02:03:49.675 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: true
  cluster_root: "/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879"
  extra_master_flags: "--webserver_require_spnego=false"
  extra_tserver_flags: "--webserver_require_spnego=false"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

02:03:49.854 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
02:03:49.856 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

02:03:49.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:49.859735 15486 mini_oidc.cc:150] Starting JWKS server
02:03:49.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:49.863124 15486 webserver.cc:533] Webserver started at http://127.0.0.1:34739/ using document root <none> and password file <none>
02:03:49.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:49.863548 15486 mini_oidc.cc:186] Starting OIDC Discovery server
02:03:49.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:49.865288 15486 webserver.cc:533] Webserver started at http://127.0.0.1:40651/ using document root <none> and password file <none>
02:03:49.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Loading random data
02:03:49.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Initializing database '/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/krb5kdc/principal' for realm 'KRBTEST.COM',
02:03:49.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master key name 'K/M@KRBTEST.COM'
02:03:49.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 18 02:03:49 dist-test-slave-q2wt krb5kdc[15497](info): setting up network...
02:03:49.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
02:03:49.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 18 02:03:49 dist-test-slave-q2wt krb5kdc[15497](info): set up 2 sockets
02:03:49.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 18 02:03:49 dist-test-slave-q2wt krb5kdc[15497](info): commencing operation
02:03:49.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) krb5kdc: starting...
02:03:51.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:51.983412 15486 mini_kdc.cc:121] Time spent starting KDC: real 2.080s	user 0.006s	sys 0.013s
02:03:51.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
02:03:52.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal slave/admin@KRBTEST.COM with password.
02:03:52.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "test-admin@KRBTEST.COM" created.
02:03:52.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
02:03:52.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal slave/admin@KRBTEST.COM with password.
02:03:52.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "test-user@KRBTEST.COM" created.
02:03:52.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
02:03:52.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal slave/admin@KRBTEST.COM with password.
02:03:52.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "joe-interloper@KRBTEST.COM" created.
02:03:52.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal slave/admin@KRBTEST.COM with password.
02:03:52.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/krb5kdc/test-user.keytab.
02:03:52.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/krb5kdc/test-user.keytab.
02:03:52.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 18 02:03:52 dist-test-slave-q2wt krb5kdc[15497](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1779069832, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
02:03:52.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Password for test-admin@KRBTEST.COM: 
02:03:52.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T02:03:52Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
02:03:52.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T02:03:52Z Disabled control of system clock
02:03:52.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for kudu/127.15.31.190@KRBTEST.COM; defaulting to no policy
02:03:52.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
02:03:52.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "kudu/127.15.31.190@KRBTEST.COM" created.
02:03:52.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
02:03:52.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.15.31.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/krb5kdc/kudu.keytab.
02:03:52.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.15.31.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/krb5kdc/kudu.keytab.
02:03:52.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for HTTP/127.15.31.190@KRBTEST.COM; defaulting to no policy
02:03:52.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
02:03:52.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "HTTP/127.15.31.190@KRBTEST.COM" created.
02:03:52.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
02:03:52.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.15.31.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/krb5kdc/kudu.keytab.
02:03:52.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.15.31.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/krb5kdc/kudu.keytab.
02:03:52.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.222445 15486 external_mini_cluster.cc:1366] Running /tmp/dist-test-task2tB5Xy/build/tsan/bin/kudu
02:03:52.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-task2tB5Xy/build/tsan/bin/kudu
02:03:52.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/master-0/wal
02:03:52.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/master-0/data
02:03:52.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:03:52.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:03:52.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:03:52.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:03:52.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:03:52.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:03:52.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/master-0/logs
02:03:52.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/master-0/data/info.pb
02:03:52.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:03:52.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:03:52.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:03:52.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:03:52.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:03:52.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:03:52.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:03:52.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:03:52.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
02:03:52.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:03:52.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:03:52.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:03:52.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.31.190:35787
02:03:52.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.31.190
02:03:52.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:03:52.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/krb5kdc/kudu.keytab
02:03:52.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.15.31.190
02:03:52.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
02:03:52.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=test-admin
02:03:52.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=test-user
02:03:52.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=true
02:03:52.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.31.148:42341
02:03:52.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:03:52.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:03:52.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:03:52.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:03:52.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.15.31.190:35787,127.15.31.189:43497,127.15.31.188:42765
02:03:52.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:03:52.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34739/jwks.json
02:03:52.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=false with env {KRB5CCNAME=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
02:03:52.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:52.526557 15513 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:03:52.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:52.527117 15513 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:03:52.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:52.527841 15513 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:03:52.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:52.563207 15513 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
02:03:52.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:52.563580 15513 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:03:52.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:52.563773 15513 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
02:03:52.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:52.563957 15513 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
02:03:52.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:52.564267 15513 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
02:03:52.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:52.564538 15513 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:34739/jwks.json
02:03:52.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.604377 15513 master_runner.cc:387] Master server non-default flags:
02:03:52.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:03:52.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.31.148:42341
02:03:52.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:03:52.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:03:52.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/master-0/data
02:03:52.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/master-0/wal
02:03:52.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:03:52.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.15.31.190:35787,127.15.31.189:43497,127.15.31.188:42765
02:03:52.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/krb5kdc/kudu.keytab
02:03:52.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.15.31.190
02:03:52.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:03:52.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:03:52.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:03:52.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.31.190:35787
02:03:52.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:03:52.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:03:52.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:03:52.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34739/jwks.json
02:03:52.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
02:03:52.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=<redacted>
02:03:52.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=<redacted>
02:03:52.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:03:52.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:03:52.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/master-0/data/info.pb
02:03:52.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.31.190
02:03:52.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:03:52.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:03:52.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:03:52.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:03:52.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:03:52.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:03:52.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/master-0/logs
02:03:52.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:03:52.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:03:52.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:03:52.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
02:03:52.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:03:52.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
02:03:52.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:03:52.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 01:43:23 UTC on e7f111948823
02:03:52.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11951
02:03:52.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:03:52.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.605845 15513 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:03:52.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:52.607254 15513 file_cache.cc:492] Constructed file cache file cache with capacity 419430
02:03:52.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:52.622510 15520 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:03:53.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:52.623517 15519 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:03:53.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:53.839813 15521 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
02:03:53.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:53.841859 15522 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:03:53.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:53.842018 15513 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
02:03:53.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:53.845794 15513 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:03:53.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:53.848958 15513 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:03:53.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:53.850389 15513 hybrid_clock.cc:648] HybridClock initialized: now 1779069833850339 us; error 60 us; skew 500 ppm
02:03:53.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:53.851215 15513 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:03:53.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 18 02:03:53 dist-test-slave-q2wt krb5kdc[15497](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1779069833, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.31.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
02:03:53.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:53.857465 15513 init.cc:377] Logged in from keytab as kudu/127.15.31.190@KRBTEST.COM (short username kudu)
02:03:53.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:53.862713 15513 webserver.cc:533] Webserver started at http://127.15.31.190:45901/ using document root <none> and password file <none>
02:03:53.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:53.863782 15513 fs_manager.cc:362] Metadata directory not provided
02:03:53.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:53.863976 15513 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:03:53.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:53.864441 15513 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:03:53.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:53.869441 15513 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/master-0/data/instance:
02:03:53.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "8f81d717a94d4cd4a38c5260d6cf77c2"
02:03:53.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:03:53 on dist-test-slave-q2wt"
02:03:53.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:53.870512 15513 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/master-0/wal/instance:
02:03:53.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "8f81d717a94d4cd4a38c5260d6cf77c2"
02:03:53.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:03:53 on dist-test-slave-q2wt"
02:03:53.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:53.878131 15513 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.004s	sys 0.004s
02:03:53.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:53.883971 15530 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:03:53.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:53.885481 15513 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
02:03:53.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:53.885906 15513 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/master-0/data,/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/master-0/wal
02:03:53.886 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "8f81d717a94d4cd4a38c5260d6cf77c2"
02:03:53.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:03:53 on dist-test-slave-q2wt"
02:03:53.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:53.886500 15513 fs_report.cc:389] FS layout report
02:03:53.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:03:53.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/master-0/wal
02:03:53.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/master-0/wal
02:03:53.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/master-0/data/data
02:03:53.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:03:53.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:03:53.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:03:53.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:03:53.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:03:53.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:03:53.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:03:53.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:03:53.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:03:53.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:03:53.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:03:53.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:53.964205 15513 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:03:53.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:53.970925 15513 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:03:53.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:53.971540 15513 kserver.cc:163] Server-wide thread pool size limit: 3276
02:03:54.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:54.050405 15513 rpc_server.cc:307] RPC server started. Bound to: 127.15.31.190:35787
02:03:54.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:54.050482 15581 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.31.190:35787 every 8 connection(s)
02:03:54.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:54.054044 15513 server_base.cc:1193] Dumped server information to /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/master-0/data/info.pb
02:03:54.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:54.055575 15486 external_mini_cluster.cc:1428] Started /tmp/dist-test-task2tB5Xy/build/tsan/bin/kudu as pid 15513
02:03:54.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:54.056114 15486 external_mini_cluster.cc:1442] Reading /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/master-0/wal/instance
02:03:54.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:54.064749 15582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
02:03:54.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for kudu/127.15.31.189@KRBTEST.COM; defaulting to no policy
02:03:54.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:54.077878 15582 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.31.190" port: 35787 } has no permanent_uuid. Determining permanent_uuid...
02:03:54.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
02:03:54.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "kudu/127.15.31.189@KRBTEST.COM" created.
02:03:54.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 18 02:03:54 dist-test-slave-q2wt krb5kdc[15497](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1779069833, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.31.190@KRBTEST.COM for kudu/127.15.31.190@KRBTEST.COM
02:03:54.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
02:03:54.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.15.31.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/krb5kdc/kudu.keytab.
02:03:54.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.15.31.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/krb5kdc/kudu.keytab.
02:03:54.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:54.120972 15582 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.31.189" port: 43497 } has no permanent_uuid. Determining permanent_uuid...
02:03:54.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:54.123628 15533 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.31.189:43497: connect: Connection refused (error 111)
02:03:54.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for HTTP/127.15.31.189@KRBTEST.COM; defaulting to no policy
02:03:54.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
02:03:54.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "HTTP/127.15.31.189@KRBTEST.COM" created.
02:03:54.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:54.127954 15582 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.31.189:43497: Network error: Client connection negotiation failed: client connection to 127.15.31.189:43497: connect: Connection refused (error 111)
02:03:54.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
02:03:54.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.15.31.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/krb5kdc/kudu.keytab.
02:03:54.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.15.31.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/krb5kdc/kudu.keytab.
02:03:54.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:54.152820 15486 external_mini_cluster.cc:1366] Running /tmp/dist-test-task2tB5Xy/build/tsan/bin/kudu
02:03:54.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-task2tB5Xy/build/tsan/bin/kudu
02:03:54.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/master-1/wal
02:03:54.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/master-1/data
02:03:54.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:03:54.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:03:54.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:03:54.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:03:54.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:03:54.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:03:54.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/master-1/logs
02:03:54.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/master-1/data/info.pb
02:03:54.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:03:54.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:03:54.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:03:54.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:03:54.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:03:54.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:03:54.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:03:54.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:03:54.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
02:03:54.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:03:54.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:03:54.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:03:54.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.31.189:43497
02:03:54.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.31.189
02:03:54.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:03:54.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/krb5kdc/kudu.keytab
02:03:54.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.15.31.189
02:03:54.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
02:03:54.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=test-admin
02:03:54.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=test-user
02:03:54.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=true
02:03:54.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.31.148:42341
02:03:54.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:03:54.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:03:54.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:03:54.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:03:54.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.15.31.190:35787,127.15.31.189:43497,127.15.31.188:42765
02:03:54.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:03:54.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34739/jwks.json
02:03:54.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=false with env {KRB5CCNAME=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
02:03:54.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:54.177515 15582 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.31.189" port: 43497 } attempt: 1
02:03:54.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:54.181373 15582 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.31.189:43497: Network error: Client connection negotiation failed: client connection to 127.15.31.189:43497: connect: Connection refused (error 111)
02:03:54.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:54.249868 15582 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.31.189" port: 43497 } attempt: 2
02:03:54.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:54.253978 15582 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.31.189:43497: Network error: Client connection negotiation failed: client connection to 127.15.31.189:43497: connect: Connection refused (error 111)
02:03:54.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:54.345479 15582 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.31.189" port: 43497 } attempt: 3
02:03:54.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:54.349822 15582 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.31.189:43497: Network error: Client connection negotiation failed: client connection to 127.15.31.189:43497: connect: Connection refused (error 111)
02:03:54.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:54.472558 15591 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:03:54.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:54.473124 15591 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:03:54.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:54.473694 15591 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:03:54.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:54.493314 15582 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.31.189" port: 43497 } attempt: 4
02:03:54.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:54.497817 15582 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.31.189:43497: Network error: Client connection negotiation failed: client connection to 127.15.31.189:43497: connect: Connection refused (error 111)
02:03:54.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:54.510049 15591 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
02:03:54.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:54.510589 15591 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:03:54.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:54.510936 15591 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
02:03:54.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:54.511252 15591 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
02:03:54.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:54.511590 15591 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
02:03:54.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:54.511873 15591 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:34739/jwks.json
02:03:54.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:54.552608 15591 master_runner.cc:387] Master server non-default flags:
02:03:54.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:03:54.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.31.148:42341
02:03:54.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:03:54.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:03:54.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/master-1/data
02:03:54.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/master-1/wal
02:03:54.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:03:54.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.15.31.190:35787,127.15.31.189:43497,127.15.31.188:42765
02:03:54.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/krb5kdc/kudu.keytab
02:03:54.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.15.31.189
02:03:54.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:03:54.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:03:54.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:03:54.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.31.189:43497
02:03:54.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:03:54.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:03:54.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:03:54.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34739/jwks.json
02:03:54.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
02:03:54.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=<redacted>
02:03:54.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=<redacted>
02:03:54.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:03:54.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:03:54.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/master-1/data/info.pb
02:03:54.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.31.189
02:03:54.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:03:54.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:03:54.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:03:54.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:03:54.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:03:54.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:03:54.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/master-1/logs
02:03:54.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:03:54.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:03:54.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:03:54.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
02:03:54.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:03:54.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
02:03:54.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:03:54.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 01:43:23 UTC on e7f111948823
02:03:54.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11951
02:03:54.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:03:54.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:54.554582 15591 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:03:54.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:54.556221 15591 file_cache.cc:492] Constructed file cache file cache with capacity 419430
02:03:54.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:54.570494 15597 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:03:54.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:54.797253 15582 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.31.189" port: 43497 } attempt: 5
02:03:54.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:54.805727 15582 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.31.189:43497: Network error: Client connection negotiation failed: client connection to 127.15.31.189:43497: connect: Connection refused (error 111)
02:03:55.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:55.353277 15582 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.31.189" port: 43497 } attempt: 6
02:03:55.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:55.392608 15582 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.31.189:43497: Network error: Client connection negotiation failed: client connection to 127.15.31.189:43497: connect: Connection refused (error 111)
02:03:56.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:55.973531 15596 debug-util.cc:398] Leaking SignalData structure 0x7b08000377a0 after lost signal to thread 15591
02:03:56.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:56.052215 15591 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.481s	user 0.518s	sys 0.952s
02:03:56.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:54.571310 15598 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:03:56.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:56.053791 15591 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.483s	user 0.518s	sys 0.953s
02:03:56.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:56.054639 15599 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1480 milliseconds
02:03:56.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:56.054816 15600 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:03:56.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:56.055124 15591 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
02:03:56.060 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:56.059806 15591 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:03:56.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:56.064685 15591 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:03:56.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:56.066654 15591 hybrid_clock.cc:648] HybridClock initialized: now 1779069836066607 us; error 48 us; skew 500 ppm
02:03:56.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:56.067756 15591 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:03:56.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 18 02:03:56 dist-test-slave-q2wt krb5kdc[15497](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1779069836, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.31.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
02:03:56.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:56.074016 15591 init.cc:377] Logged in from keytab as kudu/127.15.31.189@KRBTEST.COM (short username kudu)
02:03:56.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:56.079180 15591 webserver.cc:533] Webserver started at http://127.15.31.189:37257/ using document root <none> and password file <none>
02:03:56.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:56.080026 15591 fs_manager.cc:362] Metadata directory not provided
02:03:56.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:56.080205 15591 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:03:56.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:56.080667 15591 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:03:56.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:56.085124 15591 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/master-1/data/instance:
02:03:56.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "0c4706bb87ca4229b8be684b6ca5f54b"
02:03:56.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:03:56 on dist-test-slave-q2wt"
02:03:56.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:56.086206 15591 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/master-1/wal/instance:
02:03:56.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "0c4706bb87ca4229b8be684b6ca5f54b"
02:03:56.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:03:56 on dist-test-slave-q2wt"
02:03:56.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:56.094231 15591 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.004s	sys 0.004s
02:03:56.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:56.100005 15610 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:03:56.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:56.101256 15591 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.001s
02:03:56.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:56.101619 15591 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/master-1/data,/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/master-1/wal
02:03:56.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "0c4706bb87ca4229b8be684b6ca5f54b"
02:03:56.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:03:56 on dist-test-slave-q2wt"
02:03:56.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:56.102046 15591 fs_report.cc:389] FS layout report
02:03:56.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:03:56.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/master-1/wal
02:03:56.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/master-1/wal
02:03:56.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/master-1/data/data
02:03:56.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:03:56.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:03:56.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:03:56.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:03:56.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:03:56.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:03:56.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:03:56.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:03:56.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:03:56.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:03:56.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:03:56.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:56.153888 15591 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:03:56.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:56.162923 15591 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:03:56.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:56.163501 15591 kserver.cc:163] Server-wide thread pool size limit: 3276
02:03:56.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:56.238554 15591 rpc_server.cc:307] RPC server started. Bound to: 127.15.31.189:43497
02:03:56.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:56.238660 15661 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.31.189:43497 every 8 connection(s)
02:03:56.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:56.241755 15591 server_base.cc:1193] Dumped server information to /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/master-1/data/info.pb
02:03:56.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:56.246845 15486 external_mini_cluster.cc:1428] Started /tmp/dist-test-task2tB5Xy/build/tsan/bin/kudu as pid 15591
02:03:56.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:56.247188 15486 external_mini_cluster.cc:1442] Reading /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/master-1/wal/instance
02:03:56.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:56.249107 15662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
02:03:56.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for kudu/127.15.31.188@KRBTEST.COM; defaulting to no policy
02:03:56.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:56.265869 15662 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.31.190" port: 35787 } has no permanent_uuid. Determining permanent_uuid...
02:03:56.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
02:03:56.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "kudu/127.15.31.188@KRBTEST.COM" created.
02:03:56.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 18 02:03:56 dist-test-slave-q2wt krb5kdc[15497](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1779069836, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.31.189@KRBTEST.COM for kudu/127.15.31.190@KRBTEST.COM
02:03:56.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
02:03:56.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.15.31.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/krb5kdc/kudu.keytab.
02:03:56.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.15.31.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/krb5kdc/kudu.keytab.
02:03:56.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:56.311116 15662 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.31.189" port: 43497 } has no permanent_uuid. Determining permanent_uuid...
02:03:56.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for HTTP/127.15.31.188@KRBTEST.COM; defaulting to no policy
02:03:56.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
02:03:56.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "HTTP/127.15.31.188@KRBTEST.COM" created.
02:03:56.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 18 02:03:56 dist-test-slave-q2wt krb5kdc[15497](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1779069836, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.31.189@KRBTEST.COM for kudu/127.15.31.189@KRBTEST.COM
02:03:56.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:56.340850 15662 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.31.188" port: 42765 } has no permanent_uuid. Determining permanent_uuid...
02:03:56.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
02:03:56.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.15.31.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/krb5kdc/kudu.keytab.
02:03:56.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.15.31.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/krb5kdc/kudu.keytab.
02:03:56.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:56.343717 15613 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.31.188:42765: connect: Connection refused (error 111)
02:03:56.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:56.345292 15486 external_mini_cluster.cc:1366] Running /tmp/dist-test-task2tB5Xy/build/tsan/bin/kudu
02:03:56.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-task2tB5Xy/build/tsan/bin/kudu
02:03:56.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/master-2/wal
02:03:56.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/master-2/data
02:03:56.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:03:56.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:03:56.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:03:56.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:03:56.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:03:56.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:03:56.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/master-2/logs
02:03:56.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/master-2/data/info.pb
02:03:56.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:03:56.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:03:56.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:03:56.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:03:56.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:03:56.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:03:56.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:03:56.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:03:56.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
02:03:56.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:03:56.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:03:56.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:03:56.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.31.188:42765
02:03:56.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.31.188
02:03:56.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:03:56.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/krb5kdc/kudu.keytab
02:03:56.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.15.31.188
02:03:56.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
02:03:56.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=test-admin
02:03:56.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=test-user
02:03:56.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=true
02:03:56.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.31.148:42341
02:03:56.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:03:56.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:03:56.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:03:56.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:03:56.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.15.31.190:35787,127.15.31.189:43497,127.15.31.188:42765
02:03:56.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:03:56.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34739/jwks.json
02:03:56.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=false with env {KRB5CCNAME=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
02:03:56.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:56.348469 15662 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.31.188:42765: Network error: Client connection negotiation failed: client connection to 127.15.31.188:42765: connect: Connection refused (error 111)
02:03:56.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:56.398087 15662 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.31.188" port: 42765 } attempt: 1
02:03:56.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:56.402797 15662 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.31.188:42765: Network error: Client connection negotiation failed: client connection to 127.15.31.188:42765: connect: Connection refused (error 111)
02:03:56.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:56.453183 15582 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.31.189" port: 43497 } attempt: 7
02:03:56.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 18 02:03:56 dist-test-slave-q2wt krb5kdc[15497](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1779069833, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.31.190@KRBTEST.COM for kudu/127.15.31.189@KRBTEST.COM
02:03:56.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:56.471196 15662 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.31.188" port: 42765 } attempt: 2
02:03:56.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:56.476224 15662 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.31.188:42765: Network error: Client connection negotiation failed: client connection to 127.15.31.188:42765: connect: Connection refused (error 111)
02:03:56.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:56.477627 15582 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.31.188" port: 42765 } has no permanent_uuid. Determining permanent_uuid...
02:03:56.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:56.483000 15582 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.31.188:42765: Network error: Client connection negotiation failed: client connection to 127.15.31.188:42765: connect: Connection refused (error 111)
02:03:56.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:56.541378 15582 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.31.188" port: 42765 } attempt: 1
02:03:56.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:56.545661 15582 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.31.188:42765: Network error: Client connection negotiation failed: client connection to 127.15.31.188:42765: connect: Connection refused (error 111)
02:03:56.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:56.567759 15662 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.31.188" port: 42765 } attempt: 3
02:03:56.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:56.572324 15662 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.31.188:42765: Network error: Client connection negotiation failed: client connection to 127.15.31.188:42765: connect: Connection refused (error 111)
02:03:56.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:56.627103 15582 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.31.188" port: 42765 } attempt: 2
02:03:56.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:56.631335 15582 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.31.188:42765: Network error: Client connection negotiation failed: client connection to 127.15.31.188:42765: connect: Connection refused (error 111)
02:03:56.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:56.672374 15672 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:03:56.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:56.673028 15672 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:03:56.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:56.673583 15672 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:03:56.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:56.706687 15672 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
02:03:56.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:56.707064 15672 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:03:56.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:56.707269 15672 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
02:03:56.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:56.707544 15672 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
02:03:56.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:56.707749 15672 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
02:03:56.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:56.707887 15672 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:34739/jwks.json
02:03:56.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:56.715847 15662 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.31.188" port: 42765 } attempt: 4
02:03:56.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:56.716784 15582 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.31.188" port: 42765 } attempt: 3
02:03:56.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:56.720605 15662 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.31.188:42765: Network error: Client connection negotiation failed: client connection to 127.15.31.188:42765: connect: Connection refused (error 111)
02:03:56.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:56.721197 15582 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.31.188:42765: Network error: Client connection negotiation failed: client connection to 127.15.31.188:42765: connect: Connection refused (error 111)
02:03:56.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:56.750109 15672 master_runner.cc:387] Master server non-default flags:
02:03:56.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:03:56.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.31.148:42341
02:03:56.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:03:56.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:03:56.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/master-2/data
02:03:56.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/master-2/wal
02:03:56.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:03:56.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.15.31.190:35787,127.15.31.189:43497,127.15.31.188:42765
02:03:56.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/krb5kdc/kudu.keytab
02:03:56.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.15.31.188
02:03:56.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:03:56.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:03:56.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:03:56.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.31.188:42765
02:03:56.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:03:56.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:03:56.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:03:56.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:34739/jwks.json
02:03:56.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
02:03:56.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=<redacted>
02:03:56.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=<redacted>
02:03:56.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:03:56.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:03:56.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/master-2/data/info.pb
02:03:56.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.31.188
02:03:56.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:03:56.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:03:56.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:03:56.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:03:56.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:03:56.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:03:56.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/master-2/logs
02:03:56.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:03:56.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:03:56.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:03:56.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
02:03:56.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:03:56.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
02:03:56.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:03:56.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 01:43:23 UTC on e7f111948823
02:03:56.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11951
02:03:56.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:03:56.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:56.751904 15672 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:03:56.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:56.753507 15672 file_cache.cc:492] Constructed file cache file cache with capacity 419430
02:03:56.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:56.766687 15680 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:03:56.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:56.861639 15582 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.31.188" port: 42765 } attempt: 4
02:03:56.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:56.869858 15582 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.31.188:42765: Network error: Client connection negotiation failed: client connection to 127.15.31.188:42765: connect: Connection refused (error 111)
02:03:57.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:57.020102 15662 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.31.188" port: 42765 } attempt: 5
02:03:57.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:57.029120 15662 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.31.188:42765: Network error: Client connection negotiation failed: client connection to 127.15.31.188:42765: connect: Connection refused (error 111)
02:03:57.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:57.153417 15582 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.31.188" port: 42765 } attempt: 5
02:03:57.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:57.162231 15582 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.31.188:42765: Network error: Client connection negotiation failed: client connection to 127.15.31.188:42765: connect: Connection refused (error 111)
02:03:57.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:57.576740 15662 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.31.188" port: 42765 } attempt: 6
02:03:57.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:57.608690 15662 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.31.188:42765: Network error: Client connection negotiation failed: client connection to 127.15.31.188:42765: connect: Connection refused (error 111)
02:03:57.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:57.714882 15582 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.31.188" port: 42765 } attempt: 6
02:03:57.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:57.749677 15582 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.31.188:42765: Network error: Client connection negotiation failed: client connection to 127.15.31.188:42765: connect: Connection refused (error 111)
02:03:58.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:56.767692 15681 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:03:58.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:58.107374 15683 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:03:58.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:58.111883 15682 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1343 milliseconds
02:03:58.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:58.112638 15672 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.346s	user 0.456s	sys 0.877s
02:03:58.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:58.112880 15672 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.347s	user 0.456s	sys 0.877s
02:03:58.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.113055 15672 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
02:03:58.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.114099 15672 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:03:58.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.117300 15672 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:03:58.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.118746 15672 hybrid_clock.cc:648] HybridClock initialized: now 1779069838118698 us; error 68 us; skew 500 ppm
02:03:58.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.119697 15672 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:03:58.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 18 02:03:58 dist-test-slave-q2wt krb5kdc[15497](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1779069838, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.31.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
02:03:58.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.127084 15672 init.cc:377] Logged in from keytab as kudu/127.15.31.188@KRBTEST.COM (short username kudu)
02:03:58.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.133142 15672 webserver.cc:533] Webserver started at http://127.15.31.188:44089/ using document root <none> and password file <none>
02:03:58.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.134101 15672 fs_manager.cc:362] Metadata directory not provided
02:03:58.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.134302 15672 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:03:58.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.134739 15672 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:03:58.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.139304 15672 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/master-2/data/instance:
02:03:58.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d073da54822548048c97505b8a53b278"
02:03:58.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:03:58 on dist-test-slave-q2wt"
02:03:58.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.140722 15672 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/master-2/wal/instance:
02:03:58.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d073da54822548048c97505b8a53b278"
02:03:58.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:03:58 on dist-test-slave-q2wt"
02:03:58.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.149413 15672 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.002s	sys 0.005s
02:03:58.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.155524 15695 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:03:58.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.156836 15672 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.001s	sys 0.001s
02:03:58.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.157217 15672 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/master-2/data,/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/master-2/wal
02:03:58.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d073da54822548048c97505b8a53b278"
02:03:58.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:03:58 on dist-test-slave-q2wt"
02:03:58.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.157666 15672 fs_report.cc:389] FS layout report
02:03:58.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:03:58.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/master-2/wal
02:03:58.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/master-2/wal
02:03:58.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/master-2/data/data
02:03:58.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:03:58.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:03:58.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:03:58.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:03:58.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:03:58.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:03:58.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:03:58.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:03:58.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:03:58.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:03:58.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:03:58.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.232990 15672 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:03:58.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.238920 15672 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:03:58.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.239472 15672 kserver.cc:163] Server-wide thread pool size limit: 3276
02:03:58.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.317162 15672 rpc_server.cc:307] RPC server started. Bound to: 127.15.31.188:42765
02:03:58.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.317226 15746 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.31.188:42765 every 8 connection(s)
02:03:58.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.320148 15672 server_base.cc:1193] Dumped server information to /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/master-2/data/info.pb
02:03:58.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.323904 15486 external_mini_cluster.cc:1428] Started /tmp/dist-test-task2tB5Xy/build/tsan/bin/kudu as pid 15672
02:03:58.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.324455 15486 external_mini_cluster.cc:1442] Reading /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/master-2/wal/instance
02:03:58.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.327777 15747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
02:03:58.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.346393 15747 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.31.190" port: 35787 } has no permanent_uuid. Determining permanent_uuid...
02:03:58.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 18 02:03:58 dist-test-slave-q2wt krb5kdc[15497](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1779069832, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.31.190@KRBTEST.COM
02:03:58.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 18 02:03:58 dist-test-slave-q2wt krb5kdc[15497](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1779069838, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.31.188@KRBTEST.COM for kudu/127.15.31.190@KRBTEST.COM
02:03:58.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 18 02:03:58 dist-test-slave-q2wt krb5kdc[15497](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1779069832, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.31.189@KRBTEST.COM
02:03:58.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.386945 15747 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.31.189" port: 43497 } has no permanent_uuid. Determining permanent_uuid...
02:03:58.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 18 02:03:58 dist-test-slave-q2wt krb5kdc[15497](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1779069838, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.31.188@KRBTEST.COM for kudu/127.15.31.189@KRBTEST.COM
02:03:58.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 18 02:03:58 dist-test-slave-q2wt krb5kdc[15497](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1779069832, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.31.188@KRBTEST.COM
02:03:58.412 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.412322 15747 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.31.188" port: 42765 } has no permanent_uuid. Determining permanent_uuid...
02:03:58.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 18 02:03:58 dist-test-slave-q2wt krb5kdc[15497](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1779069838, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.31.188@KRBTEST.COM for kudu/127.15.31.188@KRBTEST.COM
02:03:58.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.444583 15747 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d073da54822548048c97505b8a53b278: Bootstrap starting.
02:03:58.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.450865 15747 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d073da54822548048c97505b8a53b278: Neither blocks nor log segments found. Creating new log.
02:03:58.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.453606 15747 log.cc:826] T 00000000000000000000000000000000 P d073da54822548048c97505b8a53b278: Log is configured to *not* fsync() on all Append() calls
02:03:58.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.458575 15747 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d073da54822548048c97505b8a53b278: No bootstrap required, opened a new log
02:03:58.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.479988 15747 raft_consensus.cc:359] T 00000000000000000000000000000000 P d073da54822548048c97505b8a53b278 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f81d717a94d4cd4a38c5260d6cf77c2" member_type: VOTER last_known_addr { host: "127.15.31.190" port: 35787 } } peers { permanent_uuid: "0c4706bb87ca4229b8be684b6ca5f54b" member_type: VOTER last_known_addr { host: "127.15.31.189" port: 43497 } } peers { permanent_uuid: "d073da54822548048c97505b8a53b278" member_type: VOTER last_known_addr { host: "127.15.31.188" port: 42765 } }
02:03:58.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.480830 15747 raft_consensus.cc:385] T 00000000000000000000000000000000 P d073da54822548048c97505b8a53b278 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:03:58.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.481065 15747 raft_consensus.cc:740] T 00000000000000000000000000000000 P d073da54822548048c97505b8a53b278 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d073da54822548048c97505b8a53b278, State: Initialized, Role: FOLLOWER
02:03:58.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.481761 15747 consensus_queue.cc:260] T 00000000000000000000000000000000 P d073da54822548048c97505b8a53b278 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f81d717a94d4cd4a38c5260d6cf77c2" member_type: VOTER last_known_addr { host: "127.15.31.190" port: 35787 } } peers { permanent_uuid: "0c4706bb87ca4229b8be684b6ca5f54b" member_type: VOTER last_known_addr { host: "127.15.31.189" port: 43497 } } peers { permanent_uuid: "d073da54822548048c97505b8a53b278" member_type: VOTER last_known_addr { host: "127.15.31.188" port: 42765 } }
02:03:58.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.485072 15758 sys_catalog.cc:455] T 00000000000000000000000000000000 P d073da54822548048c97505b8a53b278 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f81d717a94d4cd4a38c5260d6cf77c2" member_type: VOTER last_known_addr { host: "127.15.31.190" port: 35787 } } peers { permanent_uuid: "0c4706bb87ca4229b8be684b6ca5f54b" member_type: VOTER last_known_addr { host: "127.15.31.189" port: 43497 } } peers { permanent_uuid: "d073da54822548048c97505b8a53b278" member_type: VOTER last_known_addr { host: "127.15.31.188" port: 42765 } } }
02:03:58.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.485968 15758 sys_catalog.cc:458] T 00000000000000000000000000000000 P d073da54822548048c97505b8a53b278 [sys.catalog]: This master's current role is: FOLLOWER
02:03:58.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.487007 15747 sys_catalog.cc:565] T 00000000000000000000000000000000 P d073da54822548048c97505b8a53b278 [sys.catalog]: configured and running, proceeding with master startup.
02:03:58.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:58.495589 15701 tablet.cc:2404] T 00000000000000000000000000000000 P d073da54822548048c97505b8a53b278: Can't schedule compaction. Clean time has not been advanced past its initial value.
02:03:58.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:58.516471 15769 catalog_manager.cc:1593] T 00000000000000000000000000000000 P d073da54822548048c97505b8a53b278: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
02:03:58.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:58.517350 15769 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
02:03:58.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.511695 15672 master_runner.cc:187] Error getting master registration for 127.15.31.190:35787: OK, instance_id { permanent_uuid: "8f81d717a94d4cd4a38c5260d6cf77c2" instance_seqno: 1779069834028937 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
02:03:58.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.532766 15672 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
02:03:58.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.669293 15662 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.31.188" port: 42765 } attempt: 7
02:03:58.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 18 02:03:58 dist-test-slave-q2wt krb5kdc[15497](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1779069836, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.31.189@KRBTEST.COM for kudu/127.15.31.188@KRBTEST.COM
02:03:58.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.698547 15758 raft_consensus.cc:493] T 00000000000000000000000000000000 P d073da54822548048c97505b8a53b278 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
02:03:58.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.699137 15758 raft_consensus.cc:515] T 00000000000000000000000000000000 P d073da54822548048c97505b8a53b278 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f81d717a94d4cd4a38c5260d6cf77c2" member_type: VOTER last_known_addr { host: "127.15.31.190" port: 35787 } } peers { permanent_uuid: "0c4706bb87ca4229b8be684b6ca5f54b" member_type: VOTER last_known_addr { host: "127.15.31.189" port: 43497 } } peers { permanent_uuid: "d073da54822548048c97505b8a53b278" member_type: VOTER last_known_addr { host: "127.15.31.188" port: 42765 } }
02:03:58.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.703306 15662 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c4706bb87ca4229b8be684b6ca5f54b: Bootstrap starting.
02:03:58.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.704155 15758 leader_election.cc:290] T 00000000000000000000000000000000 P d073da54822548048c97505b8a53b278 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8f81d717a94d4cd4a38c5260d6cf77c2 (127.15.31.190:35787), 0c4706bb87ca4229b8be684b6ca5f54b (127.15.31.189:43497)
02:03:58.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.711519 15662 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0c4706bb87ca4229b8be684b6ca5f54b: Neither blocks nor log segments found. Creating new log.
02:03:58.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.713886 15662 log.cc:826] T 00000000000000000000000000000000 P 0c4706bb87ca4229b8be684b6ca5f54b: Log is configured to *not* fsync() on all Append() calls
02:03:58.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.719265 15662 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0c4706bb87ca4229b8be684b6ca5f54b: No bootstrap required, opened a new log
02:03:58.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.748633 15662 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0c4706bb87ca4229b8be684b6ca5f54b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f81d717a94d4cd4a38c5260d6cf77c2" member_type: VOTER last_known_addr { host: "127.15.31.190" port: 35787 } } peers { permanent_uuid: "0c4706bb87ca4229b8be684b6ca5f54b" member_type: VOTER last_known_addr { host: "127.15.31.189" port: 43497 } } peers { permanent_uuid: "d073da54822548048c97505b8a53b278" member_type: VOTER last_known_addr { host: "127.15.31.188" port: 42765 } }
02:03:58.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.749557 15662 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0c4706bb87ca4229b8be684b6ca5f54b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:03:58.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.750821 15662 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0c4706bb87ca4229b8be684b6ca5f54b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0c4706bb87ca4229b8be684b6ca5f54b, State: Initialized, Role: FOLLOWER
02:03:58.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.751793 15662 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0c4706bb87ca4229b8be684b6ca5f54b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f81d717a94d4cd4a38c5260d6cf77c2" member_type: VOTER last_known_addr { host: "127.15.31.190" port: 35787 } } peers { permanent_uuid: "0c4706bb87ca4229b8be684b6ca5f54b" member_type: VOTER last_known_addr { host: "127.15.31.189" port: 43497 } } peers { permanent_uuid: "d073da54822548048c97505b8a53b278" member_type: VOTER last_known_addr { host: "127.15.31.188" port: 42765 } }
02:03:58.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.757038 15662 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0c4706bb87ca4229b8be684b6ca5f54b [sys.catalog]: configured and running, proceeding with master startup.
02:03:58.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.758611 15637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d073da54822548048c97505b8a53b278" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c4706bb87ca4229b8be684b6ca5f54b" is_pre_election: true
02:03:58.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.760342 15637 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 0c4706bb87ca4229b8be684b6ca5f54b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d073da54822548048c97505b8a53b278 in term 0.
02:03:58.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.762836 15698 leader_election.cc:304] T 00000000000000000000000000000000 P d073da54822548048c97505b8a53b278 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c4706bb87ca4229b8be684b6ca5f54b, d073da54822548048c97505b8a53b278; no voters: 
02:03:58.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.764039 15758 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d073da54822548048c97505b8a53b278 [term 0 FOLLOWER]: Leader pre-election won for term 1
02:03:58.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.764397 15758 raft_consensus.cc:493] T 00000000000000000000000000000000 P d073da54822548048c97505b8a53b278 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
02:03:58.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.764734 15758 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d073da54822548048c97505b8a53b278 [term 0 FOLLOWER]: Advancing to term 1
02:03:58.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.771983 15758 raft_consensus.cc:515] T 00000000000000000000000000000000 P d073da54822548048c97505b8a53b278 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f81d717a94d4cd4a38c5260d6cf77c2" member_type: VOTER last_known_addr { host: "127.15.31.190" port: 35787 } } peers { permanent_uuid: "0c4706bb87ca4229b8be684b6ca5f54b" member_type: VOTER last_known_addr { host: "127.15.31.189" port: 43497 } } peers { permanent_uuid: "d073da54822548048c97505b8a53b278" member_type: VOTER last_known_addr { host: "127.15.31.188" port: 42765 } }
02:03:58.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.755465 15773 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c4706bb87ca4229b8be684b6ca5f54b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f81d717a94d4cd4a38c5260d6cf77c2" member_type: VOTER last_known_addr { host: "127.15.31.190" port: 35787 } } peers { permanent_uuid: "0c4706bb87ca4229b8be684b6ca5f54b" member_type: VOTER last_known_addr { host: "127.15.31.189" port: 43497 } } peers { permanent_uuid: "d073da54822548048c97505b8a53b278" member_type: VOTER last_known_addr { host: "127.15.31.188" port: 42765 } } }
02:03:58.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.777006 15773 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c4706bb87ca4229b8be684b6ca5f54b [sys.catalog]: This master's current role is: FOLLOWER
02:03:58.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.777575 15758 leader_election.cc:290] T 00000000000000000000000000000000 P d073da54822548048c97505b8a53b278 [CANDIDATE]: Term 1 election: Requested vote from peers 8f81d717a94d4cd4a38c5260d6cf77c2 (127.15.31.190:35787), 0c4706bb87ca4229b8be684b6ca5f54b (127.15.31.189:43497)
02:03:58.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.777077 15637 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d073da54822548048c97505b8a53b278" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0c4706bb87ca4229b8be684b6ca5f54b"
02:03:58.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.778244 15637 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0c4706bb87ca4229b8be684b6ca5f54b [term 0 FOLLOWER]: Advancing to term 1
02:03:58.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.783259 15582 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.31.188" port: 42765 } attempt: 7
02:03:58.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.789921 15637 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 0c4706bb87ca4229b8be684b6ca5f54b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d073da54822548048c97505b8a53b278 in term 1.
02:03:58.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.791348 15698 leader_election.cc:304] T 00000000000000000000000000000000 P d073da54822548048c97505b8a53b278 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0c4706bb87ca4229b8be684b6ca5f54b, d073da54822548048c97505b8a53b278; no voters: 
02:03:58.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.794728 15758 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d073da54822548048c97505b8a53b278 [term 1 FOLLOWER]: Leader election won for term 1
02:03:58.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.804972 15758 raft_consensus.cc:697] T 00000000000000000000000000000000 P d073da54822548048c97505b8a53b278 [term 1 LEADER]: Becoming Leader. State: Replica: d073da54822548048c97505b8a53b278, State: Running, Role: LEADER
02:03:58.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.806375 15758 consensus_queue.cc:237] T 00000000000000000000000000000000 P d073da54822548048c97505b8a53b278 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f81d717a94d4cd4a38c5260d6cf77c2" member_type: VOTER last_known_addr { host: "127.15.31.190" port: 35787 } } peers { permanent_uuid: "0c4706bb87ca4229b8be684b6ca5f54b" member_type: VOTER last_known_addr { host: "127.15.31.189" port: 43497 } } peers { permanent_uuid: "d073da54822548048c97505b8a53b278" member_type: VOTER last_known_addr { host: "127.15.31.188" port: 42765 } }
02:03:58.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.822063 15781 sys_catalog.cc:455] T 00000000000000000000000000000000 P d073da54822548048c97505b8a53b278 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d073da54822548048c97505b8a53b278. Latest consensus state: current_term: 1 leader_uuid: "d073da54822548048c97505b8a53b278" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f81d717a94d4cd4a38c5260d6cf77c2" member_type: VOTER last_known_addr { host: "127.15.31.190" port: 35787 } } peers { permanent_uuid: "0c4706bb87ca4229b8be684b6ca5f54b" member_type: VOTER last_known_addr { host: "127.15.31.189" port: 43497 } } peers { permanent_uuid: "d073da54822548048c97505b8a53b278" member_type: VOTER last_known_addr { host: "127.15.31.188" port: 42765 } } }
02:03:58.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.822667 15781 sys_catalog.cc:458] T 00000000000000000000000000000000 P d073da54822548048c97505b8a53b278 [sys.catalog]: This master's current role is: LEADER
02:03:58.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 18 02:03:58 dist-test-slave-q2wt krb5kdc[15497](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1779069833, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.31.190@KRBTEST.COM for kudu/127.15.31.188@KRBTEST.COM
02:03:58.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.831735 15788 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
02:03:58.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.839275 15787 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
02:03:58.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.847265 15787 catalog_manager.cc:1519] Initializing Kudu cluster ID...
02:03:58.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.873653 15582 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8f81d717a94d4cd4a38c5260d6cf77c2: Bootstrap starting.
02:03:58.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.875953 15637 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 0c4706bb87ca4229b8be684b6ca5f54b [term 1 FOLLOWER]: Refusing update from remote peer d073da54822548048c97505b8a53b278: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
02:03:58.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.877665 15758 consensus_queue.cc:1048] T 00000000000000000000000000000000 P d073da54822548048c97505b8a53b278 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0c4706bb87ca4229b8be684b6ca5f54b" member_type: VOTER last_known_addr { host: "127.15.31.189" port: 43497 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
02:03:58.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.836702 15591 master_runner.cc:187] Error getting master registration for 127.15.31.190:35787: OK, instance_id { permanent_uuid: "8f81d717a94d4cd4a38c5260d6cf77c2" instance_seqno: 1779069834028937 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
02:03:58.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.883531 15591 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
02:03:58.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.889775 15582 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8f81d717a94d4cd4a38c5260d6cf77c2: Neither blocks nor log segments found. Creating new log.
02:03:58.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.892544 15582 log.cc:826] T 00000000000000000000000000000000 P 8f81d717a94d4cd4a38c5260d6cf77c2: Log is configured to *not* fsync() on all Append() calls
02:03:58.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.904325 15789 mvcc.cc:204] Tried to move back new op lower bound from 7287070060017197056 to 7287070059764916224. Current Snapshot: MvccSnapshot[applied={T|T < 7287070060017197056}]
02:03:58.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.906654 15773 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c4706bb87ca4229b8be684b6ca5f54b [sys.catalog]: SysCatalogTable state changed. Reason: New leader d073da54822548048c97505b8a53b278. Latest consensus state: current_term: 1 leader_uuid: "d073da54822548048c97505b8a53b278" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f81d717a94d4cd4a38c5260d6cf77c2" member_type: VOTER last_known_addr { host: "127.15.31.190" port: 35787 } } peers { permanent_uuid: "0c4706bb87ca4229b8be684b6ca5f54b" member_type: VOTER last_known_addr { host: "127.15.31.189" port: 43497 } } peers { permanent_uuid: "d073da54822548048c97505b8a53b278" member_type: VOTER last_known_addr { host: "127.15.31.188" port: 42765 } } }
02:03:58.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.907449 15773 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c4706bb87ca4229b8be684b6ca5f54b [sys.catalog]: This master's current role is: FOLLOWER
02:03:58.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.927134 15781 sys_catalog.cc:455] T 00000000000000000000000000000000 P d073da54822548048c97505b8a53b278 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d073da54822548048c97505b8a53b278" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f81d717a94d4cd4a38c5260d6cf77c2" member_type: VOTER last_known_addr { host: "127.15.31.190" port: 35787 } } peers { permanent_uuid: "0c4706bb87ca4229b8be684b6ca5f54b" member_type: VOTER last_known_addr { host: "127.15.31.189" port: 43497 } } peers { permanent_uuid: "d073da54822548048c97505b8a53b278" member_type: VOTER last_known_addr { host: "127.15.31.188" port: 42765 } } }
02:03:58.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.927919 15781 sys_catalog.cc:458] T 00000000000000000000000000000000 P d073da54822548048c97505b8a53b278 [sys.catalog]: This master's current role is: LEADER
02:03:58.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.937078 15773 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0c4706bb87ca4229b8be684b6ca5f54b [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d073da54822548048c97505b8a53b278" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f81d717a94d4cd4a38c5260d6cf77c2" member_type: VOTER last_known_addr { host: "127.15.31.190" port: 35787 } } peers { permanent_uuid: "0c4706bb87ca4229b8be684b6ca5f54b" member_type: VOTER last_known_addr { host: "127.15.31.189" port: 43497 } } peers { permanent_uuid: "d073da54822548048c97505b8a53b278" member_type: VOTER last_known_addr { host: "127.15.31.188" port: 42765 } } }
02:03:58.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.937732 15773 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0c4706bb87ca4229b8be684b6ca5f54b [sys.catalog]: This master's current role is: FOLLOWER
02:03:58.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.940212 15787 catalog_manager.cc:1382] Generated new cluster ID: 3ba788b377f243e697f4833272574cdc
02:03:58.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.940538 15787 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
02:03:58.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.944938 15582 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8f81d717a94d4cd4a38c5260d6cf77c2: No bootstrap required, opened a new log
02:03:58.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.982932 15582 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8f81d717a94d4cd4a38c5260d6cf77c2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f81d717a94d4cd4a38c5260d6cf77c2" member_type: VOTER last_known_addr { host: "127.15.31.190" port: 35787 } } peers { permanent_uuid: "0c4706bb87ca4229b8be684b6ca5f54b" member_type: VOTER last_known_addr { host: "127.15.31.189" port: 43497 } } peers { permanent_uuid: "d073da54822548048c97505b8a53b278" member_type: VOTER last_known_addr { host: "127.15.31.188" port: 42765 } }
02:03:58.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.984319 15582 raft_consensus.cc:385] T 00000000000000000000000000000000 P 8f81d717a94d4cd4a38c5260d6cf77c2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:03:58.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.984737 15582 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8f81d717a94d4cd4a38c5260d6cf77c2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f81d717a94d4cd4a38c5260d6cf77c2, State: Initialized, Role: FOLLOWER
02:03:58.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.987792 15787 catalog_manager.cc:1405] Generated new certificate authority record
02:03:58.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.987788 15582 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8f81d717a94d4cd4a38c5260d6cf77c2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f81d717a94d4cd4a38c5260d6cf77c2" member_type: VOTER last_known_addr { host: "127.15.31.190" port: 35787 } } peers { permanent_uuid: "0c4706bb87ca4229b8be684b6ca5f54b" member_type: VOTER last_known_addr { host: "127.15.31.189" port: 43497 } } peers { permanent_uuid: "d073da54822548048c97505b8a53b278" member_type: VOTER last_known_addr { host: "127.15.31.188" port: 42765 } }
02:03:58.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.992231 15796 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8f81d717a94d4cd4a38c5260d6cf77c2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f81d717a94d4cd4a38c5260d6cf77c2" member_type: VOTER last_known_addr { host: "127.15.31.190" port: 35787 } } peers { permanent_uuid: "0c4706bb87ca4229b8be684b6ca5f54b" member_type: VOTER last_known_addr { host: "127.15.31.189" port: 43497 } } peers { permanent_uuid: "d073da54822548048c97505b8a53b278" member_type: VOTER last_known_addr { host: "127.15.31.188" port: 42765 } } }
02:03:58.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.993099 15796 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8f81d717a94d4cd4a38c5260d6cf77c2 [sys.catalog]: This master's current role is: FOLLOWER
02:03:58.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.994208 15582 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8f81d717a94d4cd4a38c5260d6cf77c2 [sys.catalog]: configured and running, proceeding with master startup.
02:03:58.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.994457 15556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d073da54822548048c97505b8a53b278" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f81d717a94d4cd4a38c5260d6cf77c2"
02:03:58.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.994803 15787 catalog_manager.cc:1539] Loading token signing keys...
02:03:58.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.995210 15556 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8f81d717a94d4cd4a38c5260d6cf77c2 [term 0 FOLLOWER]: Advancing to term 1
02:03:58.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:58.996953 15557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "d073da54822548048c97505b8a53b278" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8f81d717a94d4cd4a38c5260d6cf77c2" is_pre_election: true
02:03:59.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:59.011565 15556 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 8f81d717a94d4cd4a38c5260d6cf77c2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d073da54822548048c97505b8a53b278 in term 1.
02:03:59.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:59.013348 15555 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 8f81d717a94d4cd4a38c5260d6cf77c2 [term 1 FOLLOWER]: Refusing update from remote peer d073da54822548048c97505b8a53b278: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
02:03:59.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:59.024261 15781 consensus_queue.cc:1048] T 00000000000000000000000000000000 P d073da54822548048c97505b8a53b278 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8f81d717a94d4cd4a38c5260d6cf77c2" member_type: VOTER last_known_addr { host: "127.15.31.190" port: 35787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
02:03:59.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:59.034932 15787 catalog_manager.cc:6069] T 00000000000000000000000000000000 P d073da54822548048c97505b8a53b278: Generated new TSK 0
02:03:59.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:59.036832 15787 catalog_manager.cc:1549] Initializing in-progress tserver states...
02:03:59.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for kudu/127.15.31.129@KRBTEST.COM; defaulting to no policy
02:03:59.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:59.111195 15809 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8f81d717a94d4cd4a38c5260d6cf77c2 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "d073da54822548048c97505b8a53b278" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f81d717a94d4cd4a38c5260d6cf77c2" member_type: VOTER last_known_addr { host: "127.15.31.190" port: 35787 } } peers { permanent_uuid: "0c4706bb87ca4229b8be684b6ca5f54b" member_type: VOTER last_known_addr { host: "127.15.31.189" port: 43497 } } peers { permanent_uuid: "d073da54822548048c97505b8a53b278" member_type: VOTER last_known_addr { host: "127.15.31.188" port: 42765 } } }
02:03:59.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:59.112731 15809 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8f81d717a94d4cd4a38c5260d6cf77c2 [sys.catalog]: This master's current role is: FOLLOWER
02:03:59.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:59.112689 15796 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8f81d717a94d4cd4a38c5260d6cf77c2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d073da54822548048c97505b8a53b278. Latest consensus state: current_term: 1 leader_uuid: "d073da54822548048c97505b8a53b278" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f81d717a94d4cd4a38c5260d6cf77c2" member_type: VOTER last_known_addr { host: "127.15.31.190" port: 35787 } } peers { permanent_uuid: "0c4706bb87ca4229b8be684b6ca5f54b" member_type: VOTER last_known_addr { host: "127.15.31.189" port: 43497 } } peers { permanent_uuid: "d073da54822548048c97505b8a53b278" member_type: VOTER last_known_addr { host: "127.15.31.188" port: 42765 } } }
02:03:59.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:59.113420 15796 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8f81d717a94d4cd4a38c5260d6cf77c2 [sys.catalog]: This master's current role is: FOLLOWER
02:03:59.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:59.117230 15813 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
02:03:59.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:59.120218 15781 sys_catalog.cc:455] T 00000000000000000000000000000000 P d073da54822548048c97505b8a53b278 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "d073da54822548048c97505b8a53b278" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8f81d717a94d4cd4a38c5260d6cf77c2" member_type: VOTER last_known_addr { host: "127.15.31.190" port: 35787 } } peers { permanent_uuid: "0c4706bb87ca4229b8be684b6ca5f54b" member_type: VOTER last_known_addr { host: "127.15.31.189" port: 43497 } } peers { permanent_uuid: "d073da54822548048c97505b8a53b278" member_type: VOTER last_known_addr { host: "127.15.31.188" port: 42765 } } }
02:03:59.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:59.123389 15781 sys_catalog.cc:458] T 00000000000000000000000000000000 P d073da54822548048c97505b8a53b278 [sys.catalog]: This master's current role is: LEADER
02:03:59.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
02:03:59.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "kudu/127.15.31.129@KRBTEST.COM" created.
02:03:59.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
02:03:59.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.15.31.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/krb5kdc/kudu.keytab.
02:03:59.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.15.31.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/krb5kdc/kudu.keytab.
02:03:59.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for HTTP/127.15.31.129@KRBTEST.COM; defaulting to no policy
02:03:59.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
02:03:59.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "HTTP/127.15.31.129@KRBTEST.COM" created.
02:03:59.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
02:03:59.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.15.31.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/krb5kdc/kudu.keytab.
02:03:59.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.15.31.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/krb5kdc/kudu.keytab.
02:03:59.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:59.207194 15486 external_mini_cluster.cc:1366] Running /tmp/dist-test-task2tB5Xy/build/tsan/bin/kudu
02:03:59.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-task2tB5Xy/build/tsan/bin/kudu
02:03:59.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/ts-0/wal
02:03:59.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/ts-0/data
02:03:59.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:03:59.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:03:59.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:03:59.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:03:59.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:03:59.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:03:59.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/ts-0/logs
02:03:59.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/ts-0/data/info.pb
02:03:59.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:03:59.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:03:59.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:03:59.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:03:59.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:03:59.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:03:59.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:03:59.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:03:59.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
02:03:59.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:03:59.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.31.129:0
02:03:59.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.15.31.129
02:03:59.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.31.129
02:03:59.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:03:59.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.15.31.190:35787,127.15.31.189:43497,127.15.31.188:42765
02:03:59.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/krb5kdc/kudu.keytab
02:03:59.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.15.31.129
02:03:59.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
02:03:59.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=test-admin
02:03:59.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=test-user
02:03:59.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=true
02:03:59.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.31.148:42341
02:03:59.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:03:59.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:03:59.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:03:59.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=false with env {KRB5CCNAME=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
02:03:59.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:59.570250 15818 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:03:59.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:59.570839 15818 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:03:59.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:59.571600 15818 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:03:59.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:59.609000 15818 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:03:59.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:59.610165 15818 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.31.129
02:03:59.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:59.653133 15818 tablet_server_runner.cc:78] Tablet server non-default flags:
02:03:59.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:03:59.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.31.148:42341
02:03:59.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:03:59.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:03:59.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/ts-0/data
02:03:59.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/ts-0/wal
02:03:59.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/krb5kdc/kudu.keytab
02:03:59.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.15.31.129
02:03:59.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:03:59.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:03:59.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.31.129:0
02:03:59.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:03:59.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
02:03:59.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=<redacted>
02:03:59.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=<redacted>
02:03:59.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:03:59.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:03:59.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/ts-0/data/info.pb
02:03:59.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.31.129
02:03:59.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:03:59.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.15.31.190:35787,127.15.31.189:43497,127.15.31.188:42765
02:03:59.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:03:59.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:03:59.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:03:59.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:03:59.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:03:59.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.15.31.129
02:03:59.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/ts-0/logs
02:03:59.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:03:59.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:03:59.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:03:59.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
02:03:59.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:03:59.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
02:03:59.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:03:59.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 01:43:23 UTC on e7f111948823
02:03:59.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11951
02:03:59.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:03:59.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:59.654970 15818 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:03:59.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:59.656565 15818 file_cache.cc:492] Constructed file cache file cache with capacity 419430
02:03:59.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:59.672981 15824 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:03:59.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:59.871160 15788 catalog_manager.cc:1294] Loaded cluster ID: 3ba788b377f243e697f4833272574cdc
02:03:59.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:59.871765 15788 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 0c4706bb87ca4229b8be684b6ca5f54b: loading cluster ID for follower catalog manager: success
02:03:59.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:59.907742 15788 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 0c4706bb87ca4229b8be684b6ca5f54b: acquiring CA information for follower catalog manager: success
02:03:59.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:03:59.941329 15788 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 0c4706bb87ca4229b8be684b6ca5f54b: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
02:04:00.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:00.151468 15813 catalog_manager.cc:1294] Loaded cluster ID: 3ba788b377f243e697f4833272574cdc
02:04:00.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:00.168617 15813 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 8f81d717a94d4cd4a38c5260d6cf77c2: loading cluster ID for follower catalog manager: success
02:04:00.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:00.204594 15813 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 8f81d717a94d4cd4a38c5260d6cf77c2: acquiring CA information for follower catalog manager: success
02:04:00.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:00.243744 15813 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 8f81d717a94d4cd4a38c5260d6cf77c2: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
02:04:02.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:01.073589 15823 debug-util.cc:398] Leaking SignalData structure 0x7b0800037780 after lost signal to thread 15818
02:04:02.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:02.088516 15823 kernel_stack_watchdog.cc:198] Thread 15818 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 395ms:
02:04:02.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
02:04:02.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
02:04:02.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
02:04:02.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
02:04:02.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:03:59.677597 15825 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:02.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:02.098996 15818 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 2.422s	user 0.003s	sys 0.005s
02:04:02.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:02.099852 15818 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 2.423s	user 0.003s	sys 0.005s
02:04:02.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:02.096284 15826 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection timed out after 2420 milliseconds
02:04:02.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:02.102039 15818 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
02:04:02.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:02.102768 15828 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:02.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:02.104650 15818 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:04:02.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:02.121376 15818 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:04:02.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:02.123194 15818 hybrid_clock.cc:648] HybridClock initialized: now 1779069842123117 us; error 92 us; skew 500 ppm
02:04:02.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:02.124329 15818 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:04:02.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 18 02:04:02 dist-test-slave-q2wt krb5kdc[15497](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1779069842, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.31.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
02:04:02.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:02.133155 15818 init.cc:377] Logged in from keytab as kudu/127.15.31.129@KRBTEST.COM (short username kudu)
02:04:02.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:02.162796 15818 webserver.cc:533] Webserver started at http://127.15.31.129:42611/ using document root <none> and password file <none>
02:04:02.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:02.164508 15818 fs_manager.cc:362] Metadata directory not provided
02:04:02.165 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:02.165064 15818 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:04:02.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:02.165807 15818 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:04:02.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:02.173727 15818 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/ts-0/data/instance:
02:04:02.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "7adc3eaead8e48cea35dc848edeb3339"
02:04:02.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:04:02 on dist-test-slave-q2wt"
02:04:02.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:02.175912 15818 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/ts-0/wal/instance:
02:04:02.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "7adc3eaead8e48cea35dc848edeb3339"
02:04:02.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:04:02 on dist-test-slave-q2wt"
02:04:02.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:02.192095 15818 fs_manager.cc:696] Time spent creating directory manager: real 0.015s	user 0.009s	sys 0.004s
02:04:02.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:02.205936 15838 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:04:02.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:02.207809 15818 fs_manager.cc:730] Time spent opening block manager: real 0.011s	user 0.001s	sys 0.007s
02:04:02.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:02.208604 15818 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/ts-0/data,/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/ts-0/wal
02:04:02.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "7adc3eaead8e48cea35dc848edeb3339"
02:04:02.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:04:02 on dist-test-slave-q2wt"
02:04:02.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:02.209360 15818 fs_report.cc:389] FS layout report
02:04:02.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:04:02.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/ts-0/wal
02:04:02.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/ts-0/wal
02:04:02.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/ts-0/data/data
02:04:02.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:04:02.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:04:02.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:04:02.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:04:02.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:04:02.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:04:02.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:04:02.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:04:02.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:04:02.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:04:02.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:04:02.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:02.320152 15818 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:04:02.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:02.332217 15818 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:04:02.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:02.332729 15818 kserver.cc:163] Server-wide thread pool size limit: 3276
02:04:02.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:02.336486 15818 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
02:04:02.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:02.342935 15818 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
02:04:02.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:02.343247 15818 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
02:04:02.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:02.343559 15818 ts_tablet_manager.cc:616] Registered 0 tablets
02:04:02.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:02.343778 15818 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
02:04:02.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:02.558720 15818 rpc_server.cc:307] RPC server started. Bound to: 127.15.31.129:44335
02:04:02.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:02.558929 15951 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.31.129:44335 every 8 connection(s)
02:04:02.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:02.562698 15818 server_base.cc:1193] Dumped server information to /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/ts-0/data/info.pb
02:04:02.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:02.564185 15486 external_mini_cluster.cc:1428] Started /tmp/dist-test-task2tB5Xy/build/tsan/bin/kudu as pid 15818
02:04:02.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:02.564898 15486 external_mini_cluster.cc:1442] Reading /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/ts-0/wal/instance
02:04:02.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 18 02:04:02 dist-test-slave-q2wt krb5kdc[15497](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1779069842, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.31.129@KRBTEST.COM for kudu/127.15.31.188@KRBTEST.COM
02:04:02.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for kudu/127.15.31.130@KRBTEST.COM; defaulting to no policy
02:04:02.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 18 02:04:02 dist-test-slave-q2wt krb5kdc[15497](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1779069842, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.31.129@KRBTEST.COM for kudu/127.15.31.189@KRBTEST.COM
02:04:02.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:02.651118 15952 heartbeater.cc:344] Connected to a master server at 127.15.31.188:42765
02:04:02.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:02.651576 15952 heartbeater.cc:461] Registering TS with master...
02:04:02.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:02.652906 15952 heartbeater.cc:507] Master 127.15.31.188:42765 requested a full tablet report, sending...
02:04:02.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:02.656924 15712 ts_manager.cc:194] Registered new tserver with Master: 7adc3eaead8e48cea35dc848edeb3339 (127.15.31.129:44335)
02:04:02.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:02.659673 15712 master_service.cc:502] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.31.129@KRBTEST.COM'} at 127.15.31.129:33005
02:04:02.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 18 02:04:02 dist-test-slave-q2wt krb5kdc[15497](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1779069842, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.31.129@KRBTEST.COM for kudu/127.15.31.190@KRBTEST.COM
02:04:02.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
02:04:02.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "kudu/127.15.31.130@KRBTEST.COM" created.
02:04:02.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:02.680696 15954 heartbeater.cc:344] Connected to a master server at 127.15.31.189:43497
02:04:02.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:02.681115 15954 heartbeater.cc:461] Registering TS with master...
02:04:02.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:02.681927 15954 heartbeater.cc:507] Master 127.15.31.189:43497 requested a full tablet report, sending...
02:04:02.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:02.689899 15627 ts_manager.cc:194] Registered new tserver with Master: 7adc3eaead8e48cea35dc848edeb3339 (127.15.31.129:44335)
02:04:02.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:02.693449 15957 heartbeater.cc:344] Connected to a master server at 127.15.31.190:35787
02:04:02.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:02.693888 15957 heartbeater.cc:461] Registering TS with master...
02:04:02.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:02.694664 15957 heartbeater.cc:507] Master 127.15.31.190:35787 requested a full tablet report, sending...
02:04:02.699 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:02.698941 15547 ts_manager.cc:194] Registered new tserver with Master: 7adc3eaead8e48cea35dc848edeb3339 (127.15.31.129:44335)
02:04:02.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
02:04:02.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.15.31.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/krb5kdc/kudu.keytab.
02:04:02.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.15.31.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/krb5kdc/kudu.keytab.
02:04:02.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:02.708281 15486 mini_kdc.cc:268] Time spent creating service keytab for kudu/127.15.31.130: real 0.132s	user 0.006s	sys 0.008s
02:04:02.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for HTTP/127.15.31.130@KRBTEST.COM; defaulting to no policy
02:04:02.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
02:04:02.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "HTTP/127.15.31.130@KRBTEST.COM" created.
02:04:02.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
02:04:02.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.15.31.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/krb5kdc/kudu.keytab.
02:04:02.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.15.31.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/krb5kdc/kudu.keytab.
02:04:02.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:02.753552 15486 external_mini_cluster.cc:1366] Running /tmp/dist-test-task2tB5Xy/build/tsan/bin/kudu
02:04:02.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-task2tB5Xy/build/tsan/bin/kudu
02:04:02.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/ts-1/wal
02:04:02.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/ts-1/data
02:04:02.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:04:02.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:04:02.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:04:02.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:04:02.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:04:02.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:04:02.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/ts-1/logs
02:04:02.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/ts-1/data/info.pb
02:04:02.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:04:02.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:04:02.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:04:02.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:04:02.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:04:02.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:04:02.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:04:02.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:04:02.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
02:04:02.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:04:02.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.31.130:0
02:04:02.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.15.31.130
02:04:02.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.31.130
02:04:02.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:04:02.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.15.31.190:35787,127.15.31.189:43497,127.15.31.188:42765
02:04:02.756 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/krb5kdc/kudu.keytab
02:04:02.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.15.31.130
02:04:02.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
02:04:02.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=test-admin
02:04:02.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=test-user
02:04:02.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=true
02:04:02.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.31.148:42341
02:04:02.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:04:02.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:04:02.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:04:02.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=false with env {KRB5CCNAME=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
02:04:03.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:03.276064 15966 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:04:03.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:03.277220 15966 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:04:03.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:03.278432 15966 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:04:03.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:03.341480 15966 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:04:03.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:03.343397 15966 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.31.130
02:04:03.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.413081 15966 tablet_server_runner.cc:78] Tablet server non-default flags:
02:04:03.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:04:03.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.31.148:42341
02:04:03.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:04:03.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:04:03.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/ts-1/data
02:04:03.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/ts-1/wal
02:04:03.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/krb5kdc/kudu.keytab
02:04:03.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.15.31.130
02:04:03.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:04:03.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:04:03.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.31.130:0
02:04:03.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:04:03.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
02:04:03.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=<redacted>
02:04:03.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=<redacted>
02:04:03.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:04:03.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:04:03.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/ts-1/data/info.pb
02:04:03.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.31.130
02:04:03.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:04:03.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.15.31.190:35787,127.15.31.189:43497,127.15.31.188:42765
02:04:03.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:04:03.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:04:03.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:04:03.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:04:03.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:04:03.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.15.31.130
02:04:03.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/ts-1/logs
02:04:03.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:04:03.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:04:03.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:04:03.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
02:04:03.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:04:03.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
02:04:03.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:04:03.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 01:43:23 UTC on e7f111948823
02:04:03.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11951
02:04:03.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:04:03.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.415056 15966 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:04:03.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.416597 15966 file_cache.cc:492] Constructed file cache file cache with capacity 419430
02:04:03.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:03.434623 15972 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:03.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:03.664867 15952 heartbeater.cc:499] Master 127.15.31.188:42765 was elected leader, sending a full tablet report...
02:04:04.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:03.436414 15973 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:04.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:04.834740 15971 debug-util.cc:398] Leaking SignalData structure 0x7b0800037780 after lost signal to thread 15966
02:04:04.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:04.845896 15966 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 1.412s	user 0.000s	sys 0.002s
02:04:04.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:04.846233 15966 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 1.413s	user 0.000s	sys 0.002s
02:04:04.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:04.855355 15966 server_base.cc:1061] running on GCE node
02:04:04.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:04.855468 15978 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:04.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:04.856686 15966 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:04:04.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:04.858767 15966 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:04:04.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:04.860170 15966 hybrid_clock.cc:648] HybridClock initialized: now 1779069844860064 us; error 121 us; skew 500 ppm
02:04:04.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:04.861111 15966 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:04:04.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 18 02:04:04 dist-test-slave-q2wt krb5kdc[15497](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1779069844, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.31.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
02:04:04.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:04.868116 15966 init.cc:377] Logged in from keytab as kudu/127.15.31.130@KRBTEST.COM (short username kudu)
02:04:04.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:04.873898 15966 webserver.cc:533] Webserver started at http://127.15.31.130:39925/ using document root <none> and password file <none>
02:04:04.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:04.875026 15966 fs_manager.cc:362] Metadata directory not provided
02:04:04.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:04.875303 15966 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:04:04.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:04.875834 15966 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:04:04.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:04.880369 15966 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/ts-1/data/instance:
02:04:04.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e0e38f40a5194ad5a2af48abfcd61929"
02:04:04.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:04:04 on dist-test-slave-q2wt"
02:04:04.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:04.881748 15966 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/ts-1/wal/instance:
02:04:04.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e0e38f40a5194ad5a2af48abfcd61929"
02:04:04.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:04:04 on dist-test-slave-q2wt"
02:04:04.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:04.889256 15966 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.003s	sys 0.005s
02:04:04.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:04.895179 15984 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:04:04.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:04.897388 15966 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.007s	sys 0.000s
02:04:04.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:04.897925 15966 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/ts-1/data,/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/ts-1/wal
02:04:04.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "e0e38f40a5194ad5a2af48abfcd61929"
02:04:04.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:04:04 on dist-test-slave-q2wt"
02:04:04.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:04.898412 15966 fs_report.cc:389] FS layout report
02:04:04.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:04:04.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/ts-1/wal
02:04:04.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/ts-1/wal
02:04:04.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/ts-1/data/data
02:04:04.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:04:04.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:04:04.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:04:04.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:04:04.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:04:04.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:04:04.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:04:04.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:04:04.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:04:04.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:04:04.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:04:04.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:04.961983 15966 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:04:04.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:04.968204 15966 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:04:04.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:04.968756 15966 kserver.cc:163] Server-wide thread pool size limit: 3276
02:04:04.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:04.971468 15966 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
02:04:04.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:04.975975 15966 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
02:04:04.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:04.976174 15966 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
02:04:04.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:04.976374 15966 ts_tablet_manager.cc:616] Registered 0 tablets
02:04:04.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:04.976584 15966 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
02:04:05.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:05.143347 15966 rpc_server.cc:307] RPC server started. Bound to: 127.15.31.130:34651
02:04:05.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:05.143533 16096 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.31.130:34651 every 8 connection(s)
02:04:05.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:05.146143 15966 server_base.cc:1193] Dumped server information to /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/ts-1/data/info.pb
02:04:05.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:05.157977 15486 external_mini_cluster.cc:1428] Started /tmp/dist-test-task2tB5Xy/build/tsan/bin/kudu as pid 15966
02:04:05.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:05.158649 15486 external_mini_cluster.cc:1442] Reading /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/ts-1/wal/instance
02:04:05.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 18 02:04:05 dist-test-slave-q2wt krb5kdc[15497](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1779069844, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.31.130@KRBTEST.COM for kudu/127.15.31.188@KRBTEST.COM
02:04:05.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 18 02:04:05 dist-test-slave-q2wt krb5kdc[15497](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1779069844, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.31.130@KRBTEST.COM for kudu/127.15.31.189@KRBTEST.COM
02:04:05.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 18 02:04:05 dist-test-slave-q2wt krb5kdc[15497](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1779069844, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.31.130@KRBTEST.COM for kudu/127.15.31.190@KRBTEST.COM
02:04:05.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for kudu/127.15.31.131@KRBTEST.COM; defaulting to no policy
02:04:05.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:05.195982 16097 heartbeater.cc:344] Connected to a master server at 127.15.31.188:42765
02:04:05.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:05.196707 16097 heartbeater.cc:461] Registering TS with master...
02:04:05.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:05.198503 16097 heartbeater.cc:507] Master 127.15.31.188:42765 requested a full tablet report, sending...
02:04:05.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:05.199671 16098 heartbeater.cc:344] Connected to a master server at 127.15.31.189:43497
02:04:05.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:05.200042 16098 heartbeater.cc:461] Registering TS with master...
02:04:05.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
02:04:05.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "kudu/127.15.31.131@KRBTEST.COM" created.
02:04:05.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:05.201092 16098 heartbeater.cc:507] Master 127.15.31.189:43497 requested a full tablet report, sending...
02:04:05.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:05.201409 15712 ts_manager.cc:194] Registered new tserver with Master: e0e38f40a5194ad5a2af48abfcd61929 (127.15.31.130:34651)
02:04:05.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:05.202955 15712 master_service.cc:502] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.31.130@KRBTEST.COM'} at 127.15.31.130:42399
02:04:05.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:05.205651 15627 ts_manager.cc:194] Registered new tserver with Master: e0e38f40a5194ad5a2af48abfcd61929 (127.15.31.130:34651)
02:04:05.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:05.209254 16099 heartbeater.cc:344] Connected to a master server at 127.15.31.190:35787
02:04:05.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:05.209671 16099 heartbeater.cc:461] Registering TS with master...
02:04:05.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:05.210413 16099 heartbeater.cc:507] Master 127.15.31.190:35787 requested a full tablet report, sending...
02:04:05.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:05.213258 15547 ts_manager.cc:194] Registered new tserver with Master: e0e38f40a5194ad5a2af48abfcd61929 (127.15.31.130:34651)
02:04:05.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
02:04:05.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.15.31.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/krb5kdc/kudu.keytab.
02:04:05.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.15.31.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/krb5kdc/kudu.keytab.
02:04:05.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for HTTP/127.15.31.131@KRBTEST.COM; defaulting to no policy
02:04:05.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
02:04:05.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "HTTP/127.15.31.131@KRBTEST.COM" created.
02:04:05.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
02:04:05.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.15.31.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/krb5kdc/kudu.keytab.
02:04:05.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.15.31.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/krb5kdc/kudu.keytab.
02:04:05.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:05.273852 15486 external_mini_cluster.cc:1366] Running /tmp/dist-test-task2tB5Xy/build/tsan/bin/kudu
02:04:05.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-task2tB5Xy/build/tsan/bin/kudu
02:04:05.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/ts-2/wal
02:04:05.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/ts-2/data
02:04:05.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:04:05.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:04:05.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:04:05.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:04:05.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:04:05.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:04:05.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/ts-2/logs
02:04:05.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/ts-2/data/info.pb
02:04:05.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:04:05.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:04:05.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:04:05.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:04:05.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:04:05.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:04:05.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:04:05.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:04:05.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
02:04:05.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:04:05.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.31.131:0
02:04:05.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.15.31.131
02:04:05.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.31.131
02:04:05.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:04:05.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.15.31.190:35787,127.15.31.189:43497,127.15.31.188:42765
02:04:05.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/krb5kdc/kudu.keytab
02:04:05.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.15.31.131
02:04:05.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
02:04:05.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=test-admin
02:04:05.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=test-user
02:04:05.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=true
02:04:05.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.31.148:42341
02:04:05.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:04:05.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:04:05.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:04:05.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=false with env {KRB5CCNAME=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
02:04:05.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:05.596396 16111 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:04:05.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:05.596990 16111 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:04:05.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:05.597806 16111 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:04:05.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:05.633498 16111 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:04:05.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:05.634538 16111 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.31.131
02:04:05.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:05.673602 16111 tablet_server_runner.cc:78] Tablet server non-default flags:
02:04:05.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:04:05.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.31.148:42341
02:04:05.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:04:05.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:04:05.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/ts-2/data
02:04:05.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/ts-2/wal
02:04:05.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/krb5kdc/kudu.keytab
02:04:05.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.15.31.131
02:04:05.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:04:05.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:04:05.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.31.131:0
02:04:05.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:04:05.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
02:04:05.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=<redacted>
02:04:05.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=<redacted>
02:04:05.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:04:05.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:04:05.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/ts-2/data/info.pb
02:04:05.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.31.131
02:04:05.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:04:05.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.15.31.190:35787,127.15.31.189:43497,127.15.31.188:42765
02:04:05.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:04:05.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:04:05.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:04:05.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:04:05.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:04:05.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.15.31.131
02:04:05.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/ts-2/logs
02:04:05.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:04:05.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:04:05.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:04:05.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
02:04:05.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:04:05.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
02:04:05.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:04:05.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 01:43:23 UTC on e7f111948823
02:04:05.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11951
02:04:05.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:04:05.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:05.675340 16111 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:04:05.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:05.676923 16111 file_cache.cc:492] Constructed file cache file cache with capacity 419430
02:04:05.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:05.691536 16117 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:06.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:06.207321 16097 heartbeater.cc:499] Master 127.15.31.188:42765 was elected leader, sending a full tablet report...
02:04:07.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:05.693295 16118 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:07.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:07.053210 16120 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:07.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:07.053319 16119 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1354 milliseconds
02:04:07.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:07.053232 16111 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.360s	user 0.514s	sys 0.835s
02:04:07.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:07.056830 16111 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.364s	user 0.515s	sys 0.835s
02:04:07.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:07.057147 16111 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
02:04:07.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:07.058322 16111 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:04:07.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:07.061076 16111 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:04:07.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:07.062733 16111 hybrid_clock.cc:648] HybridClock initialized: now 1779069847062651 us; error 91 us; skew 500 ppm
02:04:07.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:07.063609 16111 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:04:07.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 18 02:04:07 dist-test-slave-q2wt krb5kdc[15497](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1779069847, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.31.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
02:04:07.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:07.071323 16111 init.cc:377] Logged in from keytab as kudu/127.15.31.131@KRBTEST.COM (short username kudu)
02:04:07.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:07.078008 16111 webserver.cc:533] Webserver started at http://127.15.31.131:44077/ using document root <none> and password file <none>
02:04:07.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:07.079056 16111 fs_manager.cc:362] Metadata directory not provided
02:04:07.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:07.079349 16111 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:04:07.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:07.079900 16111 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:04:07.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:07.084525 16111 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/ts-2/data/instance:
02:04:07.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3fdf46482bfb4d7f8b77b5cad38608bb"
02:04:07.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:04:07 on dist-test-slave-q2wt"
02:04:07.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:07.085891 16111 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/ts-2/wal/instance:
02:04:07.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3fdf46482bfb4d7f8b77b5cad38608bb"
02:04:07.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:04:07 on dist-test-slave-q2wt"
02:04:07.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:07.094642 16111 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.004s	sys 0.004s
02:04:07.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:07.101150 16129 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:04:07.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:07.102922 16111 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.000s	sys 0.004s
02:04:07.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:07.103348 16111 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/ts-2/data,/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/ts-2/wal
02:04:07.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3fdf46482bfb4d7f8b77b5cad38608bb"
02:04:07.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:04:07 on dist-test-slave-q2wt"
02:04:07.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:07.103850 16111 fs_report.cc:389] FS layout report
02:04:07.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:04:07.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/ts-2/wal
02:04:07.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/ts-2/wal
02:04:07.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/ts-2/data/data
02:04:07.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:04:07.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:04:07.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:04:07.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:04:07.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:04:07.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:04:07.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:04:07.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:04:07.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:04:07.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:04:07.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:04:07.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:07.209506 16111 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:04:07.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:07.215672 16111 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:04:07.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:07.216087 16111 kserver.cc:163] Server-wide thread pool size limit: 3276
02:04:07.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:07.218869 16111 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
02:04:07.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:07.223986 16111 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
02:04:07.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:07.224277 16111 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
02:04:07.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:07.224721 16111 ts_tablet_manager.cc:616] Registered 0 tablets
02:04:07.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:07.225020 16111 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
02:04:07.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:07.388162 16111 rpc_server.cc:307] RPC server started. Bound to: 127.15.31.131:39969
02:04:07.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:07.388271 16241 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.31.131:39969 every 8 connection(s)
02:04:07.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:07.391145 16111 server_base.cc:1193] Dumped server information to /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/ts-2/data/info.pb
02:04:07.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:07.398844 15486 external_mini_cluster.cc:1428] Started /tmp/dist-test-task2tB5Xy/build/tsan/bin/kudu as pid 16111
02:04:07.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:07.399326 15486 external_mini_cluster.cc:1442] Reading /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/ts-2/wal/instance
02:04:07.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 18 02:04:07 dist-test-slave-q2wt krb5kdc[15497](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1779069847, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.31.131@KRBTEST.COM for kudu/127.15.31.188@KRBTEST.COM
02:04:07.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 18 02:04:07 dist-test-slave-q2wt krb5kdc[15497](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1779069847, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.31.131@KRBTEST.COM for kudu/127.15.31.189@KRBTEST.COM
02:04:07.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:07.450340 16242 heartbeater.cc:344] Connected to a master server at 127.15.31.188:42765
02:04:07.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:07.450889 16242 heartbeater.cc:461] Registering TS with master...
02:04:07.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 18 02:04:07 dist-test-slave-q2wt krb5kdc[15497](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1779069847, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.31.131@KRBTEST.COM for kudu/127.15.31.190@KRBTEST.COM
02:04:07.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:07.453047 16242 heartbeater.cc:507] Master 127.15.31.188:42765 requested a full tablet report, sending...
02:04:07.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:07.456122 16243 heartbeater.cc:344] Connected to a master server at 127.15.31.189:43497
02:04:07.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:07.456569 16243 heartbeater.cc:461] Registering TS with master...
02:04:07.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:07.456709 15712 ts_manager.cc:194] Registered new tserver with Master: 3fdf46482bfb4d7f8b77b5cad38608bb (127.15.31.131:39969)
02:04:07.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:07.457638 16243 heartbeater.cc:507] Master 127.15.31.189:43497 requested a full tablet report, sending...
02:04:07.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:07.458528 15712 master_service.cc:502] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.31.131@KRBTEST.COM'} at 127.15.31.131:55429
02:04:07.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:07.461089 15627 ts_manager.cc:194] Registered new tserver with Master: 3fdf46482bfb4d7f8b77b5cad38608bb (127.15.31.131:39969)
02:04:07.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:07.467289 16244 heartbeater.cc:344] Connected to a master server at 127.15.31.190:35787
02:04:07.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:07.467612 16244 heartbeater.cc:461] Registering TS with master...
02:04:07.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:07.468245 16244 heartbeater.cc:507] Master 127.15.31.190:35787 requested a full tablet report, sending...
02:04:07.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:07.470665 15547 ts_manager.cc:194] Registered new tserver with Master: 3fdf46482bfb4d7f8b77b5cad38608bb (127.15.31.131:39969)
02:04:07.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:07.472069 15486 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
02:04:07.483 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
02:04:07.485 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_kdc_env_vars {
}

02:04:07.494 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_kdc_env_vars {
  env_vars {
    key: "KRB5CCNAME"
    value: "/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/krb5kdc/krb5cc"
  }
  env_vars {
    key: "KRB5_CONFIG"
    value: "/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/krb5kdc/krb5.conf"
  }
  env_vars {
    key: "KRB5_KDC_PROFILE"
    value: "/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/krb5kdc/kdc.conf"
  }
  env_vars {
    key: "KUDU_ENABLE_KRB5_REALM_FIX"
    value: "yes"
  }
}

02:04:07.495 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

02:04:07.507 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.15.31.190"
      port: 35787
    }
    bound_http_address {
      host: "127.15.31.190"
      port: 45901
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.15.31.189"
      port: 43497
    }
    bound_http_address {
      host: "127.15.31.189"
      port: 37257
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.15.31.188"
      port: 42765
    }
    bound_http_address {
      host: "127.15.31.188"
      port: 44089
    }
  }
}

02:04:07.511 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

02:04:07.514 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.15.31.129"
      port: 44335
    }
    bound_http_address {
      host: "127.15.31.129"
      port: 42611
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.15.31.130"
      port: 34651
    }
    bound_http_address {
      host: "127.15.31.130"
      port: 39925
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.15.31.131"
      port: 39969
    }
    bound_http_address {
      host: "127.15.31.131"
      port: 44077
    }
  }
}

02:04:07.515 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
02:04:07.733 [DEBUG - main] (CompositeStrategy.java:59) Unable to load modern Subject methods, relying only on legacy methods
java.lang.NoSuchMethodException: javax.security.auth.Subject.current()
	at java.base/java.lang.Class.getDeclaredMethod(Class.java:2677)
	at org.apache.kudu.client.internals.ModernStrategy.<init>(ModernStrategy.java:51)
	at org.apache.kudu.client.internals.CompositeStrategy.<init>(CompositeStrategy.java:52)
	at org.apache.kudu.client.internals.CompositeStrategy.<clinit>(CompositeStrategy.java:41)
	at org.apache.kudu.client.internals.SecurityManagerCompatibility.get(SecurityManagerCompatibility.java:43)
	at org.apache.kudu.client.SecurityContext.setupSubject(SecurityContext.java:155)
	at org.apache.kudu.client.SecurityContext.<init>(SecurityContext.java:138)
	at org.apache.kudu.client.AsyncKuduClient.<init>(AsyncKuduClient.java:431)
	at org.apache.kudu.client.AsyncKuduClient$AsyncKuduClientBuilder.build(AsyncKuduClient.java:3109)
	at org.apache.kudu.test.KuduTestHarness.before(KuduTestHarness.java:161)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:50)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.doOneAttemptAndReport(RetryRule.java:184)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.evaluate(RetryRule.java:244)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runners.Suite.runChild(Suite.java:128)
	at org.junit.runners.Suite.runChild(Suite.java:27)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
	at org.junit.runner.JUnitCore.runMain(JUnitCore.java:77)
	at org.junit.runner.JUnitCore.main(JUnitCore.java:36)
02:04:07.755 [DEBUG - main] (SecurityUtil.java:105) Using ticketCache: /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster8751238063314096879/krb5kdc/krb5cc
02:04:07.804 [DEBUG - main] (SecurityUtil.java:119) Logged in as subject: test-admin@KRBTEST.COM
02:04:07.939 [DEBUG - main] (Connection.java:748) [peer master-127.15.31.190:35787(127.15.31.190:35787)] connecting to peer
02:04:08.000 [DEBUG - main] (Connection.java:748) [peer master-127.15.31.189:43497(127.15.31.189:43497)] connecting to peer
02:04:08.001 [DEBUG - main] (Connection.java:748) [peer master-127.15.31.188:42765(127.15.31.188:42765)] connecting to peer
02:04:08.019 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.15.31.188:42765(127.15.31.188:42765)] Successfully connected to peer
02:04:08.023 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.15.31.190:35787(127.15.31.190:35787)] Successfully connected to peer
02:04:08.019 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.15.31.189:43497(127.15.31.189:43497)] Successfully connected to peer
02:04:08.145 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism GSSAPI chosen for peer 127.15.31.188
02:04:08.145 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism GSSAPI chosen for peer 127.15.31.190
02:04:08.146 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism GSSAPI chosen for peer 127.15.31.189
02:04:08.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:08.464388 16242 heartbeater.cc:499] Master 127.15.31.188:42765 was elected leader, sending a full tablet report...
02:04:08.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 18 02:04:08 dist-test-slave-q2wt krb5kdc[15497](info): TGS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1779069832, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.31.190@KRBTEST.COM
02:04:08.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 18 02:04:08 dist-test-slave-q2wt krb5kdc[15497](info): TGS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1779069832, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.31.188@KRBTEST.COM
02:04:08.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 18 02:04:08 dist-test-slave-q2wt krb5kdc[15497](info): TGS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1779069832, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.31.189@KRBTEST.COM
02:04:08.538 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x8d35f196, L:/127.0.0.1:37640 - R:/127.15.31.188:42765] using SASL/GSSAPI
02:04:08.538 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xdc85b0d6, L:/127.0.0.1:48590 - R:/127.15.31.190:35787] using SASL/GSSAPI
02:04:08.543 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xb18de8f5, L:/127.0.0.1:60394 - R:/127.15.31.189:43497] using SASL/GSSAPI
02:04:08.585 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
02:04:08.586 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=686), Traces: [0ms] refreshing cache from master, [22ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.31.190:35787, [97ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.31.189:43497, [98ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.31.188:42765, [654ms] Sub RPC ConnectToMaster: received response from server master-127.15.31.188:42765: OK, [656ms] Sub RPC ConnectToMaster: received response from server master-127.15.31.189:43497: OK, [656ms] Sub RPC ConnectToMaster: received response from server master-127.15.31.190:35787: OK, deferred=null) after lookup
02:04:08.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:08.647154 15712 catalog_manager.cc:2282] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:37640:
02:04:08.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "TestAuthzTokenCache-table"
02:04:08.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
02:04:08.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
02:04:08.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key"
02:04:08.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
02:04:08.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
02:04:08.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
02:04:08.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
02:04:08.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
02:04:08.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
02:04:08.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:04:08.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
02:04:08.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column1_i"
02:04:08.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
02:04:08.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
02:04:08.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
02:04:08.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
02:04:08.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
02:04:08.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
02:04:08.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:04:08.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
02:04:08.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column2_i"
02:04:08.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
02:04:08.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
02:04:08.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
02:04:08.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
02:04:08.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
02:04:08.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
02:04:08.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:04:08.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
02:04:08.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column3_s"
02:04:08.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
02:04:08.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
02:04:08.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: true
02:04:08.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: DICT_ENCODING
02:04:08.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: LZ4
02:04:08.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 4096
02:04:08.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
02:04:08.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
02:04:08.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:04:08.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
02:04:08.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column4_b"
02:04:08.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BOOL
02:04:08.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
02:04:08.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
02:04:08.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
02:04:08.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
02:04:08.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
02:04:08.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:04:08.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
02:04:08.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
02:04:08.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
02:04:08.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
02:04:08.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key"
02:04:08.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
02:04:08.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:04:08.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
02:04:08.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:08.651634 15712 catalog_manager.cc:7058] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table TestAuthzTokenCache-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
02:04:08.722 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 7f2559dd3f4d4743826d1f6490468f9a
02:04:08.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:08.759826 16032 tablet_service.cc:1511] Processing CreateTablet for tablet 64d60f7ee3d246a0b42864db2d601a43 (DEFAULT_TABLE table=TestAuthzTokenCache-table [id=7f2559dd3f4d4743826d1f6490468f9a]), partition=RANGE (key) PARTITION UNBOUNDED
02:04:08.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:08.766251 16032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64d60f7ee3d246a0b42864db2d601a43. 1 dirs total, 0 dirs full, 0 dirs failed
02:04:08.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:08.768225 15886 tablet_service.cc:1511] Processing CreateTablet for tablet 64d60f7ee3d246a0b42864db2d601a43 (DEFAULT_TABLE table=TestAuthzTokenCache-table [id=7f2559dd3f4d4743826d1f6490468f9a]), partition=RANGE (key) PARTITION UNBOUNDED
02:04:08.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:08.770057 15886 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64d60f7ee3d246a0b42864db2d601a43. 1 dirs total, 0 dirs full, 0 dirs failed
02:04:08.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:08.781675 16177 tablet_service.cc:1511] Processing CreateTablet for tablet 64d60f7ee3d246a0b42864db2d601a43 (DEFAULT_TABLE table=TestAuthzTokenCache-table [id=7f2559dd3f4d4743826d1f6490468f9a]), partition=RANGE (key) PARTITION UNBOUNDED
02:04:08.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:08.783578 16177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64d60f7ee3d246a0b42864db2d601a43. 1 dirs total, 0 dirs full, 0 dirs failed
02:04:08.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:08.794957 16276 tablet_bootstrap.cc:492] T 64d60f7ee3d246a0b42864db2d601a43 P e0e38f40a5194ad5a2af48abfcd61929: Bootstrap starting.
02:04:08.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:08.801218 16277 tablet_bootstrap.cc:492] T 64d60f7ee3d246a0b42864db2d601a43 P 7adc3eaead8e48cea35dc848edeb3339: Bootstrap starting.
02:04:08.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:08.802459 16276 tablet_bootstrap.cc:654] T 64d60f7ee3d246a0b42864db2d601a43 P e0e38f40a5194ad5a2af48abfcd61929: Neither blocks nor log segments found. Creating new log.
02:04:08.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:08.805225 16276 log.cc:826] T 64d60f7ee3d246a0b42864db2d601a43 P e0e38f40a5194ad5a2af48abfcd61929: Log is configured to *not* fsync() on all Append() calls
02:04:08.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:08.811012 16276 tablet_bootstrap.cc:492] T 64d60f7ee3d246a0b42864db2d601a43 P e0e38f40a5194ad5a2af48abfcd61929: No bootstrap required, opened a new log
02:04:08.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:08.811304 16277 tablet_bootstrap.cc:654] T 64d60f7ee3d246a0b42864db2d601a43 P 7adc3eaead8e48cea35dc848edeb3339: Neither blocks nor log segments found. Creating new log.
02:04:08.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:08.811583 16276 ts_tablet_manager.cc:1403] T 64d60f7ee3d246a0b42864db2d601a43 P e0e38f40a5194ad5a2af48abfcd61929: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.000s
02:04:08.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:08.813393 16279 tablet_bootstrap.cc:492] T 64d60f7ee3d246a0b42864db2d601a43 P 3fdf46482bfb4d7f8b77b5cad38608bb: Bootstrap starting.
02:04:08.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:08.814365 16277 log.cc:826] T 64d60f7ee3d246a0b42864db2d601a43 P 7adc3eaead8e48cea35dc848edeb3339: Log is configured to *not* fsync() on all Append() calls
02:04:08.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:08.821352 16277 tablet_bootstrap.cc:492] T 64d60f7ee3d246a0b42864db2d601a43 P 7adc3eaead8e48cea35dc848edeb3339: No bootstrap required, opened a new log
02:04:08.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:08.821887 16277 ts_tablet_manager.cc:1403] T 64d60f7ee3d246a0b42864db2d601a43 P 7adc3eaead8e48cea35dc848edeb3339: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.004s
02:04:08.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:08.827069 16279 tablet_bootstrap.cc:654] T 64d60f7ee3d246a0b42864db2d601a43 P 3fdf46482bfb4d7f8b77b5cad38608bb: Neither blocks nor log segments found. Creating new log.
02:04:08.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:08.829461 16279 log.cc:826] T 64d60f7ee3d246a0b42864db2d601a43 P 3fdf46482bfb4d7f8b77b5cad38608bb: Log is configured to *not* fsync() on all Append() calls
02:04:08.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:08.835038 16279 tablet_bootstrap.cc:492] T 64d60f7ee3d246a0b42864db2d601a43 P 3fdf46482bfb4d7f8b77b5cad38608bb: No bootstrap required, opened a new log
02:04:08.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:08.835577 16279 ts_tablet_manager.cc:1403] T 64d60f7ee3d246a0b42864db2d601a43 P 3fdf46482bfb4d7f8b77b5cad38608bb: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.003s
02:04:08.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:08.836645 16276 raft_consensus.cc:359] T 64d60f7ee3d246a0b42864db2d601a43 P e0e38f40a5194ad5a2af48abfcd61929 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0e38f40a5194ad5a2af48abfcd61929" member_type: VOTER last_known_addr { host: "127.15.31.130" port: 34651 } } peers { permanent_uuid: "7adc3eaead8e48cea35dc848edeb3339" member_type: VOTER last_known_addr { host: "127.15.31.129" port: 44335 } } peers { permanent_uuid: "3fdf46482bfb4d7f8b77b5cad38608bb" member_type: VOTER last_known_addr { host: "127.15.31.131" port: 39969 } }
02:04:08.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:08.837395 16276 raft_consensus.cc:385] T 64d60f7ee3d246a0b42864db2d601a43 P e0e38f40a5194ad5a2af48abfcd61929 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:04:08.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:08.837847 16276 raft_consensus.cc:740] T 64d60f7ee3d246a0b42864db2d601a43 P e0e38f40a5194ad5a2af48abfcd61929 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e0e38f40a5194ad5a2af48abfcd61929, State: Initialized, Role: FOLLOWER
02:04:08.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:08.838795 16276 consensus_queue.cc:260] T 64d60f7ee3d246a0b42864db2d601a43 P e0e38f40a5194ad5a2af48abfcd61929 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0e38f40a5194ad5a2af48abfcd61929" member_type: VOTER last_known_addr { host: "127.15.31.130" port: 34651 } } peers { permanent_uuid: "7adc3eaead8e48cea35dc848edeb3339" member_type: VOTER last_known_addr { host: "127.15.31.129" port: 44335 } } peers { permanent_uuid: "3fdf46482bfb4d7f8b77b5cad38608bb" member_type: VOTER last_known_addr { host: "127.15.31.131" port: 39969 } }
02:04:08.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:08.842566 16276 ts_tablet_manager.cc:1434] T 64d60f7ee3d246a0b42864db2d601a43 P e0e38f40a5194ad5a2af48abfcd61929: Time spent starting tablet: real 0.031s	user 0.029s	sys 0.003s
02:04:08.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:08.850428 16277 raft_consensus.cc:359] T 64d60f7ee3d246a0b42864db2d601a43 P 7adc3eaead8e48cea35dc848edeb3339 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0e38f40a5194ad5a2af48abfcd61929" member_type: VOTER last_known_addr { host: "127.15.31.130" port: 34651 } } peers { permanent_uuid: "7adc3eaead8e48cea35dc848edeb3339" member_type: VOTER last_known_addr { host: "127.15.31.129" port: 44335 } } peers { permanent_uuid: "3fdf46482bfb4d7f8b77b5cad38608bb" member_type: VOTER last_known_addr { host: "127.15.31.131" port: 39969 } }
02:04:08.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:08.851336 16277 raft_consensus.cc:385] T 64d60f7ee3d246a0b42864db2d601a43 P 7adc3eaead8e48cea35dc848edeb3339 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:04:08.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:08.851675 16277 raft_consensus.cc:740] T 64d60f7ee3d246a0b42864db2d601a43 P 7adc3eaead8e48cea35dc848edeb3339 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7adc3eaead8e48cea35dc848edeb3339, State: Initialized, Role: FOLLOWER
02:04:08.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:08.852815 16277 consensus_queue.cc:260] T 64d60f7ee3d246a0b42864db2d601a43 P 7adc3eaead8e48cea35dc848edeb3339 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0e38f40a5194ad5a2af48abfcd61929" member_type: VOTER last_known_addr { host: "127.15.31.130" port: 34651 } } peers { permanent_uuid: "7adc3eaead8e48cea35dc848edeb3339" member_type: VOTER last_known_addr { host: "127.15.31.129" port: 44335 } } peers { permanent_uuid: "3fdf46482bfb4d7f8b77b5cad38608bb" member_type: VOTER last_known_addr { host: "127.15.31.131" port: 39969 } }
02:04:08.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:08.856642 16277 ts_tablet_manager.cc:1434] T 64d60f7ee3d246a0b42864db2d601a43 P 7adc3eaead8e48cea35dc848edeb3339: Time spent starting tablet: real 0.034s	user 0.035s	sys 0.001s
02:04:08.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:08.869674 16279 raft_consensus.cc:359] T 64d60f7ee3d246a0b42864db2d601a43 P 3fdf46482bfb4d7f8b77b5cad38608bb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0e38f40a5194ad5a2af48abfcd61929" member_type: VOTER last_known_addr { host: "127.15.31.130" port: 34651 } } peers { permanent_uuid: "7adc3eaead8e48cea35dc848edeb3339" member_type: VOTER last_known_addr { host: "127.15.31.129" port: 44335 } } peers { permanent_uuid: "3fdf46482bfb4d7f8b77b5cad38608bb" member_type: VOTER last_known_addr { host: "127.15.31.131" port: 39969 } }
02:04:08.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:08.870666 16279 raft_consensus.cc:385] T 64d60f7ee3d246a0b42864db2d601a43 P 3fdf46482bfb4d7f8b77b5cad38608bb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:04:08.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:08.870983 16279 raft_consensus.cc:740] T 64d60f7ee3d246a0b42864db2d601a43 P 3fdf46482bfb4d7f8b77b5cad38608bb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3fdf46482bfb4d7f8b77b5cad38608bb, State: Initialized, Role: FOLLOWER
02:04:08.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:08.872059 16279 consensus_queue.cc:260] T 64d60f7ee3d246a0b42864db2d601a43 P 3fdf46482bfb4d7f8b77b5cad38608bb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0e38f40a5194ad5a2af48abfcd61929" member_type: VOTER last_known_addr { host: "127.15.31.130" port: 34651 } } peers { permanent_uuid: "7adc3eaead8e48cea35dc848edeb3339" member_type: VOTER last_known_addr { host: "127.15.31.129" port: 44335 } } peers { permanent_uuid: "3fdf46482bfb4d7f8b77b5cad38608bb" member_type: VOTER last_known_addr { host: "127.15.31.131" port: 39969 } }
02:04:08.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:08.875715 16279 ts_tablet_manager.cc:1434] T 64d60f7ee3d246a0b42864db2d601a43 P 3fdf46482bfb4d7f8b77b5cad38608bb: Time spent starting tablet: real 0.040s	user 0.032s	sys 0.005s
02:04:08.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:08.878739 15960 tablet.cc:2404] T 64d60f7ee3d246a0b42864db2d601a43 P 7adc3eaead8e48cea35dc848edeb3339: Can't schedule compaction. Clean time has not been advanced past its initial value.
02:04:08.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:08.887818 16283 raft_consensus.cc:493] T 64d60f7ee3d246a0b42864db2d601a43 P 7adc3eaead8e48cea35dc848edeb3339 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
02:04:08.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:08.888392 16283 raft_consensus.cc:515] T 64d60f7ee3d246a0b42864db2d601a43 P 7adc3eaead8e48cea35dc848edeb3339 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0e38f40a5194ad5a2af48abfcd61929" member_type: VOTER last_known_addr { host: "127.15.31.130" port: 34651 } } peers { permanent_uuid: "7adc3eaead8e48cea35dc848edeb3339" member_type: VOTER last_known_addr { host: "127.15.31.129" port: 44335 } } peers { permanent_uuid: "3fdf46482bfb4d7f8b77b5cad38608bb" member_type: VOTER last_known_addr { host: "127.15.31.131" port: 39969 } }
02:04:08.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:08.890803 16283 leader_election.cc:290] T 64d60f7ee3d246a0b42864db2d601a43 P 7adc3eaead8e48cea35dc848edeb3339 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e0e38f40a5194ad5a2af48abfcd61929 (127.15.31.130:34651), 3fdf46482bfb4d7f8b77b5cad38608bb (127.15.31.131:39969)
02:04:08.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:08.904112 16052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64d60f7ee3d246a0b42864db2d601a43" candidate_uuid: "7adc3eaead8e48cea35dc848edeb3339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0e38f40a5194ad5a2af48abfcd61929" is_pre_election: true
02:04:08.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:08.904194 16197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64d60f7ee3d246a0b42864db2d601a43" candidate_uuid: "7adc3eaead8e48cea35dc848edeb3339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fdf46482bfb4d7f8b77b5cad38608bb" is_pre_election: true
02:04:08.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:08.905014 16197 raft_consensus.cc:2468] T 64d60f7ee3d246a0b42864db2d601a43 P 3fdf46482bfb4d7f8b77b5cad38608bb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7adc3eaead8e48cea35dc848edeb3339 in term 0.
02:04:08.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:08.905035 16052 raft_consensus.cc:2468] T 64d60f7ee3d246a0b42864db2d601a43 P e0e38f40a5194ad5a2af48abfcd61929 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7adc3eaead8e48cea35dc848edeb3339 in term 0.
02:04:08.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:08.906214 15841 leader_election.cc:304] T 64d60f7ee3d246a0b42864db2d601a43 P 7adc3eaead8e48cea35dc848edeb3339 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fdf46482bfb4d7f8b77b5cad38608bb, 7adc3eaead8e48cea35dc848edeb3339; no voters: 
02:04:08.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:08.906985 16283 raft_consensus.cc:2804] T 64d60f7ee3d246a0b42864db2d601a43 P 7adc3eaead8e48cea35dc848edeb3339 [term 0 FOLLOWER]: Leader pre-election won for term 1
02:04:08.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:08.907269 16283 raft_consensus.cc:493] T 64d60f7ee3d246a0b42864db2d601a43 P 7adc3eaead8e48cea35dc848edeb3339 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
02:04:08.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:08.907513 16283 raft_consensus.cc:3060] T 64d60f7ee3d246a0b42864db2d601a43 P 7adc3eaead8e48cea35dc848edeb3339 [term 0 FOLLOWER]: Advancing to term 1
02:04:08.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:08.912529 16283 raft_consensus.cc:515] T 64d60f7ee3d246a0b42864db2d601a43 P 7adc3eaead8e48cea35dc848edeb3339 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0e38f40a5194ad5a2af48abfcd61929" member_type: VOTER last_known_addr { host: "127.15.31.130" port: 34651 } } peers { permanent_uuid: "7adc3eaead8e48cea35dc848edeb3339" member_type: VOTER last_known_addr { host: "127.15.31.129" port: 44335 } } peers { permanent_uuid: "3fdf46482bfb4d7f8b77b5cad38608bb" member_type: VOTER last_known_addr { host: "127.15.31.131" port: 39969 } }
02:04:08.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:08.914060 16283 leader_election.cc:290] T 64d60f7ee3d246a0b42864db2d601a43 P 7adc3eaead8e48cea35dc848edeb3339 [CANDIDATE]: Term 1 election: Requested vote from peers e0e38f40a5194ad5a2af48abfcd61929 (127.15.31.130:34651), 3fdf46482bfb4d7f8b77b5cad38608bb (127.15.31.131:39969)
02:04:08.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:08.915087 16052 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64d60f7ee3d246a0b42864db2d601a43" candidate_uuid: "7adc3eaead8e48cea35dc848edeb3339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e0e38f40a5194ad5a2af48abfcd61929"
02:04:08.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:08.915373 16197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64d60f7ee3d246a0b42864db2d601a43" candidate_uuid: "7adc3eaead8e48cea35dc848edeb3339" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3fdf46482bfb4d7f8b77b5cad38608bb"
02:04:08.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:08.915747 16052 raft_consensus.cc:3060] T 64d60f7ee3d246a0b42864db2d601a43 P e0e38f40a5194ad5a2af48abfcd61929 [term 0 FOLLOWER]: Advancing to term 1
02:04:08.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:08.915967 16197 raft_consensus.cc:3060] T 64d60f7ee3d246a0b42864db2d601a43 P 3fdf46482bfb4d7f8b77b5cad38608bb [term 0 FOLLOWER]: Advancing to term 1
02:04:08.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:08.916673 16102 tablet.cc:2404] T 64d60f7ee3d246a0b42864db2d601a43 P e0e38f40a5194ad5a2af48abfcd61929: Can't schedule compaction. Clean time has not been advanced past its initial value.
02:04:08.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:08.921607 16197 raft_consensus.cc:2468] T 64d60f7ee3d246a0b42864db2d601a43 P 3fdf46482bfb4d7f8b77b5cad38608bb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7adc3eaead8e48cea35dc848edeb3339 in term 1.
02:04:08.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:08.921895 16052 raft_consensus.cc:2468] T 64d60f7ee3d246a0b42864db2d601a43 P e0e38f40a5194ad5a2af48abfcd61929 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7adc3eaead8e48cea35dc848edeb3339 in term 1.
02:04:08.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:08.922750 15841 leader_election.cc:304] T 64d60f7ee3d246a0b42864db2d601a43 P 7adc3eaead8e48cea35dc848edeb3339 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3fdf46482bfb4d7f8b77b5cad38608bb, 7adc3eaead8e48cea35dc848edeb3339; no voters: 
02:04:08.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:08.923589 16283 raft_consensus.cc:2804] T 64d60f7ee3d246a0b42864db2d601a43 P 7adc3eaead8e48cea35dc848edeb3339 [term 1 FOLLOWER]: Leader election won for term 1
02:04:08.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:08.926395 16283 raft_consensus.cc:697] T 64d60f7ee3d246a0b42864db2d601a43 P 7adc3eaead8e48cea35dc848edeb3339 [term 1 LEADER]: Becoming Leader. State: Replica: 7adc3eaead8e48cea35dc848edeb3339, State: Running, Role: LEADER
02:04:08.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:08.927832 16283 consensus_queue.cc:237] T 64d60f7ee3d246a0b42864db2d601a43 P 7adc3eaead8e48cea35dc848edeb3339 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0e38f40a5194ad5a2af48abfcd61929" member_type: VOTER last_known_addr { host: "127.15.31.130" port: 34651 } } peers { permanent_uuid: "7adc3eaead8e48cea35dc848edeb3339" member_type: VOTER last_known_addr { host: "127.15.31.129" port: 44335 } } peers { permanent_uuid: "3fdf46482bfb4d7f8b77b5cad38608bb" member_type: VOTER last_known_addr { host: "127.15.31.131" port: 39969 } }
02:04:08.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:08.940901 15712 catalog_manager.cc:5696] T 64d60f7ee3d246a0b42864db2d601a43 P 7adc3eaead8e48cea35dc848edeb3339 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7adc3eaead8e48cea35dc848edeb3339 (127.15.31.129). New cstate: current_term: 1 leader_uuid: "7adc3eaead8e48cea35dc848edeb3339" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e0e38f40a5194ad5a2af48abfcd61929" member_type: VOTER last_known_addr { host: "127.15.31.130" port: 34651 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7adc3eaead8e48cea35dc848edeb3339" member_type: VOTER last_known_addr { host: "127.15.31.129" port: 44335 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3fdf46482bfb4d7f8b77b5cad38608bb" member_type: VOTER last_known_addr { host: "127.15.31.131" port: 39969 } health_report { overall_health: UNKNOWN } } }
02:04:08.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:08.942502 16249 tablet.cc:2404] T 64d60f7ee3d246a0b42864db2d601a43 P 3fdf46482bfb4d7f8b77b5cad38608bb: Can't schedule compaction. Clean time has not been advanced past its initial value.
02:04:09.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:09.516654 16289 consensus_queue.cc:1048] T 64d60f7ee3d246a0b42864db2d601a43 P 7adc3eaead8e48cea35dc848edeb3339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3fdf46482bfb4d7f8b77b5cad38608bb" member_type: VOTER last_known_addr { host: "127.15.31.131" port: 39969 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
02:04:09.538 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:09.537813 16289 consensus_queue.cc:1048] T 64d60f7ee3d246a0b42864db2d601a43 P 7adc3eaead8e48cea35dc848edeb3339 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e0e38f40a5194ad5a2af48abfcd61929" member_type: VOTER last_known_addr { host: "127.15.31.130" port: 34651 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
02:04:10.170 [DEBUG - main] (AuthzTokenCache.java:153) sending RPC to retrieve token for table ID 7f2559dd3f4d4743826d1f6490468f9a
02:04:10.175 [DEBUG - kudu-nio-2] (AuthzTokenCache.java:193) retrieved authz token for 7f2559dd3f4d4743826d1f6490468f9a
02:04:10.183 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 64d60f7ee3d246a0b42864db2d601a43 for table 'TestAuthzTokenCache-table' with partition [<start>, <end>)
02:04:10.189 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299995, tablet=64d60f7ee3d246a0b42864db2d601a43@[3fdf46482bfb4d7f8b77b5cad38608bb(127.15.31.131:39969),7adc3eaead8e48cea35dc848edeb3339(127.15.31.129:44335)[L],e0e38f40a5194ad5a2af48abfcd61929(127.15.31.130:34651)]}]
02:04:10.198 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=22), Traces: [0ms] sending RPC to server master-127.15.31.188:42765, [5ms] received response from server master-127.15.31.188:42765: OK, [5ms] Sub RPC Scan: refreshing cache from master, [6ms] Sub RPC GetTableLocations: sending RPC to server master-127.15.31.188:42765, [13ms] Sub RPC GetTableLocations: received response from server master-127.15.31.188:42765: OK, deferred=Deferred@1635589202(state=PENDING, result=null, callback=wakeup thread main, errback=wakeup thread main))) after lookup
02:04:10.209 [DEBUG - kudu-nio-2] (Connection.java:748) [peer 7adc3eaead8e48cea35dc848edeb3339(127.15.31.129:44335)] connecting to peer
02:04:10.213 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 7adc3eaead8e48cea35dc848edeb3339(127.15.31.129:44335)] Successfully connected to peer
02:04:10.275 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0xa652dfe7, L:/127.0.0.1:37000 - R:/127.15.31.129:44335] using TOKEN/null
02:04:10.307 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestAuthzTokenCache-table, tablet=64d60f7ee3d246a0b42864db2d601a43, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
02:04:10.310 [DEBUG - main] (Connection.java:575) [peer master-127.15.31.190:35787(127.15.31.190:35787)] disconnecting while in state READY
02:04:10.310 [DEBUG - main] (Connection.java:575) [peer master-127.15.31.188:42765(127.15.31.188:42765)] disconnecting while in state READY
02:04:10.311 [DEBUG - main] (Connection.java:575) [peer master-127.15.31.189:43497(127.15.31.189:43497)] disconnecting while in state READY
02:04:10.311 [DEBUG - main] (Connection.java:575) [peer 7adc3eaead8e48cea35dc848edeb3339(127.15.31.129:44335)] disconnecting while in state READY
02:04:10.317 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
02:04:10.319 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.15.31.189:43497(127.15.31.189:43497)] handling channelInactive
02:04:10.319 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.31.189:43497(127.15.31.189:43497)] cleaning up while in state READY due to: connection closed
02:04:10.319 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.15.31.188:42765(127.15.31.188:42765)] handling channelInactive
02:04:10.320 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.31.188:42765(127.15.31.188:42765)] cleaning up while in state READY due to: connection closed
02:04:10.328 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 7adc3eaead8e48cea35dc848edeb3339(127.15.31.129:44335)] handling channelInactive
02:04:10.329 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 7adc3eaead8e48cea35dc848edeb3339(127.15.31.129:44335)] cleaning up while in state READY due to: connection closed
02:04:10.332 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.15.31.190:35787(127.15.31.190:35787)] handling channelInactive
02:04:10.333 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.31.190:35787(127.15.31.190:35787)] cleaning up while in state READY due to: connection closed
02:04:10.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:10.333877 15486 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task2tB5Xy/build/tsan/bin/kudu with pid 15818
02:04:10.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:10.369905 15486 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task2tB5Xy/build/tsan/bin/kudu with pid 15966
02:04:10.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:10.401225 15486 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task2tB5Xy/build/tsan/bin/kudu with pid 16111
02:04:10.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:10.431092 15486 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task2tB5Xy/build/tsan/bin/kudu with pid 15513
02:04:10.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:10.460063 15698 connection.cc:582] client connection to 127.15.31.190:35787 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
02:04:10.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:10.460844 15486 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task2tB5Xy/build/tsan/bin/kudu with pid 15591
02:04:10.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:10.460875 15698 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
02:04:10.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:10.465734 15698 consensus_peers.cc:597] T 00000000000000000000000000000000 P d073da54822548048c97505b8a53b278 -> Peer 8f81d717a94d4cd4a38c5260d6cf77c2 (127.15.31.190:35787): Couldn't send request to peer 8f81d717a94d4cd4a38c5260d6cf77c2. Status: Network error: Client connection negotiation failed: client connection to 127.15.31.190:35787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
02:04:10.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:10.490278 15486 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task2tB5Xy/build/tsan/bin/kudu with pid 15672
02:04:11.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T02:04:11Z chronyd exiting
.02:04:12.936 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1779069852936
02:04:12.939 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
02:04:12.940 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
02:04:12.940 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-task2tB5Xy/test-tmp
02:04:12.941 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
02:04:12.941 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-task2tB5Xy/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
02:04:12.944 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: true
  cluster_root: "/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962"
  extra_master_flags: "--webserver_require_spnego=false"
  extra_tserver_flags: "--webserver_require_spnego=false"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

02:04:13.302 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
02:04:13.303 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

02:04:13.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.306577 16316 mini_oidc.cc:150] Starting JWKS server
02:04:13.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.309990 16316 webserver.cc:533] Webserver started at http://127.0.0.1:46085/ using document root <none> and password file <none>
02:04:13.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.310413 16316 mini_oidc.cc:186] Starting OIDC Discovery server
02:04:13.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:13.312104 16316 webserver.cc:533] Webserver started at http://127.0.0.1:33545/ using document root <none> and password file <none>
02:04:13.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Loading random data
02:04:13.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Initializing database '/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/krb5kdc/principal' for realm 'KRBTEST.COM',
02:04:13.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master key name 'K/M@KRBTEST.COM'
02:04:13.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 18 02:04:13 dist-test-slave-q2wt krb5kdc[16327](info): setting up network...
02:04:13.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
02:04:13.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 18 02:04:13 dist-test-slave-q2wt krb5kdc[16327](info): set up 2 sockets
02:04:13.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 18 02:04:13 dist-test-slave-q2wt krb5kdc[16327](info): commencing operation
02:04:13.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) krb5kdc: starting...
02:04:15.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:15.399163 16316 mini_kdc.cc:121] Time spent starting KDC: real 2.050s	user 0.001s	sys 0.020s
02:04:15.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
02:04:15.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal slave/admin@KRBTEST.COM with password.
02:04:15.427 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "test-admin@KRBTEST.COM" created.
02:04:15.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
02:04:15.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal slave/admin@KRBTEST.COM with password.
02:04:15.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "test-user@KRBTEST.COM" created.
02:04:15.477 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
02:04:15.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal slave/admin@KRBTEST.COM with password.
02:04:15.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "joe-interloper@KRBTEST.COM" created.
02:04:15.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal slave/admin@KRBTEST.COM with password.
02:04:15.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/krb5kdc/test-user.keytab.
02:04:15.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/krb5kdc/test-user.keytab.
02:04:15.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 18 02:04:15 dist-test-slave-q2wt krb5kdc[16327](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1779069855, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
02:04:15.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Password for test-admin@KRBTEST.COM: 
02:04:15.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T02:04:15Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
02:04:15.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T02:04:15Z Disabled control of system clock
02:04:15.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for kudu/127.15.239.62@KRBTEST.COM; defaulting to no policy
02:04:15.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
02:04:15.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "kudu/127.15.239.62@KRBTEST.COM" created.
02:04:15.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
02:04:15.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.15.239.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/krb5kdc/kudu.keytab.
02:04:15.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.15.239.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/krb5kdc/kudu.keytab.
02:04:15.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for HTTP/127.15.239.62@KRBTEST.COM; defaulting to no policy
02:04:15.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
02:04:15.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "HTTP/127.15.239.62@KRBTEST.COM" created.
02:04:15.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
02:04:15.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.15.239.62 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/krb5kdc/kudu.keytab.
02:04:15.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.15.239.62 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/krb5kdc/kudu.keytab.
02:04:15.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:15.660899 16316 external_mini_cluster.cc:1366] Running /tmp/dist-test-task2tB5Xy/build/tsan/bin/kudu
02:04:15.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-task2tB5Xy/build/tsan/bin/kudu
02:04:15.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/master-0/wal
02:04:15.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/master-0/data
02:04:15.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:04:15.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:04:15.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:04:15.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:04:15.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:04:15.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:04:15.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/master-0/logs
02:04:15.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/master-0/data/info.pb
02:04:15.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:04:15.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:04:15.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:04:15.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:04:15.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:04:15.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:04:15.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:04:15.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:04:15.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
02:04:15.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:04:15.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:04:15.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:04:15.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.239.62:36255
02:04:15.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.239.62
02:04:15.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:04:15.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/krb5kdc/kudu.keytab
02:04:15.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.15.239.62
02:04:15.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
02:04:15.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=test-admin
02:04:15.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=test-user
02:04:15.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=true
02:04:15.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.239.20:44727
02:04:15.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:04:15.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:04:15.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:04:15.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:04:15.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.15.239.62:36255,127.15.239.61:39633,127.15.239.60:35113
02:04:15.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:04:15.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:46085/jwks.json
02:04:15.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=false with env {KRB5CCNAME=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
02:04:15.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:15.974846 16343 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:04:15.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:15.975402 16343 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:04:15.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:15.975960 16343 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:04:16.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:16.009716 16343 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
02:04:16.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:16.010088 16343 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:04:16.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:16.010278 16343 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
02:04:16.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:16.010475 16343 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
02:04:16.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:16.010656 16343 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
02:04:16.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:16.010811 16343 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:46085/jwks.json
02:04:16.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:16.051683 16343 master_runner.cc:387] Master server non-default flags:
02:04:16.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:04:16.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.239.20:44727
02:04:16.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:04:16.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:04:16.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/master-0/data
02:04:16.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/master-0/wal
02:04:16.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:04:16.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.15.239.62:36255,127.15.239.61:39633,127.15.239.60:35113
02:04:16.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/krb5kdc/kudu.keytab
02:04:16.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.15.239.62
02:04:16.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:04:16.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:04:16.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:04:16.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.239.62:36255
02:04:16.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:04:16.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:04:16.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:04:16.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:46085/jwks.json
02:04:16.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
02:04:16.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=<redacted>
02:04:16.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=<redacted>
02:04:16.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:04:16.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:04:16.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/master-0/data/info.pb
02:04:16.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.239.62
02:04:16.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:04:16.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:04:16.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:04:16.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:04:16.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:04:16.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:04:16.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/master-0/logs
02:04:16.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:04:16.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:04:16.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:04:16.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
02:04:16.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:04:16.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
02:04:16.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:04:16.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 01:43:23 UTC on e7f111948823
02:04:16.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11951
02:04:16.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:04:16.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:16.053227 16343 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:04:16.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:16.054670 16343 file_cache.cc:492] Constructed file cache file cache with capacity 419430
02:04:16.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:16.069041 16350 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:17.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:16.070163 16351 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:17.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:17.296155 16353 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:17.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:17.299690 16352 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1225 milliseconds
02:04:17.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:17.299815 16343 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
02:04:17.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:17.301338 16343 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:04:17.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:17.304836 16343 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:04:17.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:17.306420 16343 hybrid_clock.cc:648] HybridClock initialized: now 1779069857306368 us; error 86 us; skew 500 ppm
02:04:17.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:17.307262 16343 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:04:17.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 18 02:04:17 dist-test-slave-q2wt krb5kdc[16327](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1779069857, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.62@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
02:04:17.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:17.313905 16343 init.cc:377] Logged in from keytab as kudu/127.15.239.62@KRBTEST.COM (short username kudu)
02:04:17.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:17.320401 16343 webserver.cc:533] Webserver started at http://127.15.239.62:37095/ using document root <none> and password file <none>
02:04:17.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:17.321578 16343 fs_manager.cc:362] Metadata directory not provided
02:04:17.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:17.321797 16343 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:04:17.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:17.322522 16343 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:04:17.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:17.327924 16343 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/master-0/data/instance:
02:04:17.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ba29378713734b10bd07d3268dbe0c31"
02:04:17.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:04:17 on dist-test-slave-q2wt"
02:04:17.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:17.329283 16343 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/master-0/wal/instance:
02:04:17.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ba29378713734b10bd07d3268dbe0c31"
02:04:17.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:04:17 on dist-test-slave-q2wt"
02:04:17.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:17.337078 16343 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.001s
02:04:17.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:17.343024 16361 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:04:17.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:17.344218 16343 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.001s	sys 0.004s
02:04:17.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:17.344650 16343 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/master-0/data,/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/master-0/wal
02:04:17.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ba29378713734b10bd07d3268dbe0c31"
02:04:17.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:04:17 on dist-test-slave-q2wt"
02:04:17.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:17.345019 16343 fs_report.cc:389] FS layout report
02:04:17.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:04:17.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/master-0/wal
02:04:17.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/master-0/wal
02:04:17.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/master-0/data/data
02:04:17.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:04:17.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:04:17.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:04:17.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:04:17.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:04:17.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:04:17.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:04:17.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:04:17.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:04:17.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:04:17.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:04:17.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:17.401747 16343 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:04:17.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:17.407835 16343 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:04:17.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:17.408396 16343 kserver.cc:163] Server-wide thread pool size limit: 3276
02:04:17.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:17.481958 16343 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.62:36255
02:04:17.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:17.482071 16412 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.239.62:36255 every 8 connection(s)
02:04:17.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:17.484874 16343 server_base.cc:1193] Dumped server information to /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/master-0/data/info.pb
02:04:17.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:17.485886 16316 external_mini_cluster.cc:1428] Started /tmp/dist-test-task2tB5Xy/build/tsan/bin/kudu as pid 16343
02:04:17.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:17.486500 16316 external_mini_cluster.cc:1442] Reading /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/master-0/wal/instance
02:04:17.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:17.491501 16413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
02:04:17.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for kudu/127.15.239.61@KRBTEST.COM; defaulting to no policy
02:04:17.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:17.505960 16413 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.239.62" port: 36255 } has no permanent_uuid. Determining permanent_uuid...
02:04:17.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
02:04:17.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "kudu/127.15.239.61@KRBTEST.COM" created.
02:04:17.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 18 02:04:17 dist-test-slave-q2wt krb5kdc[16327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1779069857, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.62@KRBTEST.COM for kudu/127.15.239.62@KRBTEST.COM
02:04:17.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
02:04:17.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.15.239.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/krb5kdc/kudu.keytab.
02:04:17.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.15.239.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/krb5kdc/kudu.keytab.
02:04:17.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:17.552088 16413 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.239.61" port: 39633 } has no permanent_uuid. Determining permanent_uuid...
02:04:17.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:17.554626 16364 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.239.61:39633: connect: Connection refused (error 111)
02:04:17.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for HTTP/127.15.239.61@KRBTEST.COM; defaulting to no policy
02:04:17.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:17.558836 16413 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.239.61:39633: Network error: Client connection negotiation failed: client connection to 127.15.239.61:39633: connect: Connection refused (error 111)
02:04:17.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
02:04:17.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "HTTP/127.15.239.61@KRBTEST.COM" created.
02:04:17.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
02:04:17.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.15.239.61 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/krb5kdc/kudu.keytab.
02:04:17.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.15.239.61 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/krb5kdc/kudu.keytab.
02:04:17.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:17.586138 16316 external_mini_cluster.cc:1366] Running /tmp/dist-test-task2tB5Xy/build/tsan/bin/kudu
02:04:17.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-task2tB5Xy/build/tsan/bin/kudu
02:04:17.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/master-1/wal
02:04:17.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/master-1/data
02:04:17.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:04:17.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:04:17.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:04:17.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:04:17.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:04:17.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:04:17.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/master-1/logs
02:04:17.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/master-1/data/info.pb
02:04:17.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:04:17.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:04:17.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:04:17.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:04:17.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:04:17.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:04:17.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:04:17.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:04:17.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
02:04:17.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:04:17.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:04:17.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:04:17.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.239.61:39633
02:04:17.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.239.61
02:04:17.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:04:17.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/krb5kdc/kudu.keytab
02:04:17.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.15.239.61
02:04:17.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
02:04:17.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=test-admin
02:04:17.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=test-user
02:04:17.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=true
02:04:17.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.239.20:44727
02:04:17.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:04:17.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:04:17.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:04:17.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:04:17.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.15.239.62:36255,127.15.239.61:39633,127.15.239.60:35113
02:04:17.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:04:17.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:46085/jwks.json
02:04:17.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=false with env {KRB5CCNAME=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
02:04:17.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:17.608367 16413 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.239.61" port: 39633 } attempt: 1
02:04:17.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:17.612833 16413 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.239.61:39633: Network error: Client connection negotiation failed: client connection to 127.15.239.61:39633: connect: Connection refused (error 111)
02:04:17.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:17.681298 16413 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.239.61" port: 39633 } attempt: 2
02:04:17.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:17.685397 16413 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.239.61:39633: Network error: Client connection negotiation failed: client connection to 127.15.239.61:39633: connect: Connection refused (error 111)
02:04:17.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:17.776896 16413 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.239.61" port: 39633 } attempt: 3
02:04:17.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:17.781728 16413 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.239.61:39633: Network error: Client connection negotiation failed: client connection to 127.15.239.61:39633: connect: Connection refused (error 111)
02:04:17.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:17.901165 16422 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:04:17.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:17.901770 16422 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:04:17.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:17.902370 16422 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:04:17.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:17.925207 16413 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.239.61" port: 39633 } attempt: 4
02:04:17.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:17.929468 16413 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.239.61:39633: Network error: Client connection negotiation failed: client connection to 127.15.239.61:39633: connect: Connection refused (error 111)
02:04:17.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:17.937068 16422 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
02:04:17.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:17.937438 16422 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:04:17.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:17.937696 16422 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
02:04:17.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:17.937964 16422 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
02:04:17.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:17.938154 16422 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
02:04:17.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:17.938310 16422 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:46085/jwks.json
02:04:17.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:17.978246 16422 master_runner.cc:387] Master server non-default flags:
02:04:17.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:04:17.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.239.20:44727
02:04:17.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:04:17.978 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:04:17.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/master-1/data
02:04:17.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/master-1/wal
02:04:17.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:04:17.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.15.239.62:36255,127.15.239.61:39633,127.15.239.60:35113
02:04:17.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/krb5kdc/kudu.keytab
02:04:17.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.15.239.61
02:04:17.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:04:17.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:04:17.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:04:17.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.239.61:39633
02:04:17.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:04:17.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:04:17.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:04:17.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:46085/jwks.json
02:04:17.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
02:04:17.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=<redacted>
02:04:17.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=<redacted>
02:04:17.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:04:17.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:04:17.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/master-1/data/info.pb
02:04:17.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.239.61
02:04:17.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:04:17.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:04:17.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:04:17.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:04:17.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:04:17.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:04:17.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/master-1/logs
02:04:17.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:04:17.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:04:17.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:04:17.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
02:04:17.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:04:17.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
02:04:17.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:04:17.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 01:43:23 UTC on e7f111948823
02:04:17.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11951
02:04:17.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:04:17.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:17.979787 16422 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:04:17.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:17.980943 16422 file_cache.cc:492] Constructed file cache file cache with capacity 419430
02:04:17.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:17.991518 16428 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:18.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:18.229050 16413 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.239.61" port: 39633 } attempt: 5
02:04:18.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:18.235968 16413 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.239.61:39633: Network error: Client connection negotiation failed: client connection to 127.15.239.61:39633: connect: Connection refused (error 111)
02:04:18.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:18.783669 16413 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.239.61" port: 39633 } attempt: 6
02:04:18.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:18.797062 16413 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.239.61:39633: Network error: Client connection negotiation failed: client connection to 127.15.239.61:39633: connect: Connection refused (error 111)
02:04:19.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:17.993468 16429 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:19.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:17.997448 16431 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:19.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:19.244184 16430 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1247 milliseconds
02:04:19.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:19.244326 16422 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
02:04:19.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:19.245793 16422 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:04:19.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:19.249078 16422 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:04:19.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:19.250550 16422 hybrid_clock.cc:648] HybridClock initialized: now 1779069859250486 us; error 79 us; skew 500 ppm
02:04:19.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:19.251364 16422 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:04:19.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 18 02:04:19 dist-test-slave-q2wt krb5kdc[16327](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1779069859, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.61@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
02:04:19.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:19.258107 16422 init.cc:377] Logged in from keytab as kudu/127.15.239.61@KRBTEST.COM (short username kudu)
02:04:19.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:19.264151 16422 webserver.cc:533] Webserver started at http://127.15.239.61:33125/ using document root <none> and password file <none>
02:04:19.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:19.265249 16422 fs_manager.cc:362] Metadata directory not provided
02:04:19.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:19.265451 16422 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:04:19.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:19.265914 16422 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:04:19.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:19.270648 16422 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/master-1/data/instance:
02:04:19.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "25b31746aa834ff79c611972881e58fc"
02:04:19.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:04:19 on dist-test-slave-q2wt"
02:04:19.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:19.271845 16422 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/master-1/wal/instance:
02:04:19.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "25b31746aa834ff79c611972881e58fc"
02:04:19.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:04:19 on dist-test-slave-q2wt"
02:04:19.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:19.280005 16422 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.005s	sys 0.004s
02:04:19.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:19.286345 16441 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:04:19.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:19.287789 16422 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
02:04:19.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:19.288148 16422 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/master-1/data,/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/master-1/wal
02:04:19.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "25b31746aa834ff79c611972881e58fc"
02:04:19.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:04:19 on dist-test-slave-q2wt"
02:04:19.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:19.288568 16422 fs_report.cc:389] FS layout report
02:04:19.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:04:19.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/master-1/wal
02:04:19.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/master-1/wal
02:04:19.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/master-1/data/data
02:04:19.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:04:19.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:04:19.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:04:19.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:04:19.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:04:19.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:04:19.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:04:19.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:04:19.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:04:19.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:04:19.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:04:19.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:19.348143 16422 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:04:19.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:19.360340 16422 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:04:19.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:19.360968 16422 kserver.cc:163] Server-wide thread pool size limit: 3276
02:04:19.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:19.436566 16422 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.61:39633
02:04:19.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:19.436607 16492 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.239.61:39633 every 8 connection(s)
02:04:19.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:19.439711 16422 server_base.cc:1193] Dumped server information to /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/master-1/data/info.pb
02:04:19.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:19.446115 16493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
02:04:19.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:19.448328 16316 external_mini_cluster.cc:1428] Started /tmp/dist-test-task2tB5Xy/build/tsan/bin/kudu as pid 16422
02:04:19.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:19.448755 16316 external_mini_cluster.cc:1442] Reading /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/master-1/wal/instance
02:04:19.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:19.457636 16493 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.239.62" port: 36255 } has no permanent_uuid. Determining permanent_uuid...
02:04:19.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for kudu/127.15.239.60@KRBTEST.COM; defaulting to no policy
02:04:19.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
02:04:19.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "kudu/127.15.239.60@KRBTEST.COM" created.
02:04:19.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 18 02:04:19 dist-test-slave-q2wt krb5kdc[16327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1779069859, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.61@KRBTEST.COM for kudu/127.15.239.62@KRBTEST.COM
02:04:19.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:19.492405 16493 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.239.61" port: 39633 } has no permanent_uuid. Determining permanent_uuid...
02:04:19.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
02:04:19.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.15.239.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/krb5kdc/kudu.keytab.
02:04:19.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.15.239.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/krb5kdc/kudu.keytab.
02:04:19.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 18 02:04:19 dist-test-slave-q2wt krb5kdc[16327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1779069859, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.61@KRBTEST.COM for kudu/127.15.239.61@KRBTEST.COM
02:04:19.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for HTTP/127.15.239.60@KRBTEST.COM; defaulting to no policy
02:04:19.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:19.521292 16493 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.239.60" port: 35113 } has no permanent_uuid. Determining permanent_uuid...
02:04:19.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
02:04:19.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "HTTP/127.15.239.60@KRBTEST.COM" created.
02:04:19.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:19.523967 16445 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.15.239.60:35113: connect: Connection refused (error 111)
02:04:19.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:19.528339 16493 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.239.60:35113: Network error: Client connection negotiation failed: client connection to 127.15.239.60:35113: connect: Connection refused (error 111)
02:04:19.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
02:04:19.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.15.239.60 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/krb5kdc/kudu.keytab.
02:04:19.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.15.239.60 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/krb5kdc/kudu.keytab.
02:04:19.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:19.550369 16316 external_mini_cluster.cc:1366] Running /tmp/dist-test-task2tB5Xy/build/tsan/bin/kudu
02:04:19.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-task2tB5Xy/build/tsan/bin/kudu
02:04:19.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/master-2/wal
02:04:19.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/master-2/data
02:04:19.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:04:19.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:04:19.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:04:19.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:04:19.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:04:19.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:04:19.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/master-2/logs
02:04:19.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/master-2/data/info.pb
02:04:19.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:04:19.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:04:19.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:04:19.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:04:19.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:04:19.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:04:19.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:04:19.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:04:19.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
02:04:19.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:04:19.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:04:19.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:04:19.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.239.60:35113
02:04:19.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.239.60
02:04:19.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:04:19.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/krb5kdc/kudu.keytab
02:04:19.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.15.239.60
02:04:19.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
02:04:19.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=test-admin
02:04:19.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=test-user
02:04:19.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=true
02:04:19.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.239.20:44727
02:04:19.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:04:19.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:04:19.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:04:19.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:04:19.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.15.239.62:36255,127.15.239.61:39633,127.15.239.60:35113
02:04:19.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:04:19.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:46085/jwks.json
02:04:19.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=false with env {KRB5CCNAME=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
02:04:19.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:19.577994 16493 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.239.60" port: 35113 } attempt: 1
02:04:19.582 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:19.582214 16493 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.239.60:35113: Network error: Client connection negotiation failed: client connection to 127.15.239.60:35113: connect: Connection refused (error 111)
02:04:19.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:19.650676 16493 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.239.60" port: 35113 } attempt: 2
02:04:19.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:19.655798 16493 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.239.60:35113: Network error: Client connection negotiation failed: client connection to 127.15.239.60:35113: connect: Connection refused (error 111)
02:04:19.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:19.747284 16493 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.239.60" port: 35113 } attempt: 3
02:04:19.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:19.751487 16493 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.239.60:35113: Network error: Client connection negotiation failed: client connection to 127.15.239.60:35113: connect: Connection refused (error 111)
02:04:19.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:19.857789 16413 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.239.61" port: 39633 } attempt: 7
02:04:19.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 18 02:04:19 dist-test-slave-q2wt krb5kdc[16327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1779069857, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.62@KRBTEST.COM for kudu/127.15.239.61@KRBTEST.COM
02:04:19.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:19.881465 16413 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.239.60" port: 35113 } has no permanent_uuid. Determining permanent_uuid...
02:04:19.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:19.887431 16413 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.239.60:35113: Network error: Client connection negotiation failed: client connection to 127.15.239.60:35113: connect: Connection refused (error 111)
02:04:19.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:19.892782 16503 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:04:19.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:19.893304 16503 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:04:19.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:19.893863 16503 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:04:19.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:19.894977 16493 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.239.60" port: 35113 } attempt: 4
02:04:19.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:19.898883 16493 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.239.60:35113: Network error: Client connection negotiation failed: client connection to 127.15.239.60:35113: connect: Connection refused (error 111)
02:04:19.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:19.928120 16503 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
02:04:19.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:19.928493 16503 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:04:19.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:19.928699 16503 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
02:04:19.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:19.928896 16503 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
02:04:19.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:19.929078 16503 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
02:04:19.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:19.929214 16503 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:46085/jwks.json
02:04:19.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:19.945920 16413 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.239.60" port: 35113 } attempt: 1
02:04:19.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:19.950032 16413 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.239.60:35113: Network error: Client connection negotiation failed: client connection to 127.15.239.60:35113: connect: Connection refused (error 111)
02:04:19.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:19.970770 16503 master_runner.cc:387] Master server non-default flags:
02:04:19.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:04:19.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.239.20:44727
02:04:19.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:04:19.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:04:19.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/master-2/data
02:04:19.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/master-2/wal
02:04:19.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
02:04:19.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.15.239.62:36255,127.15.239.61:39633,127.15.239.60:35113
02:04:19.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/krb5kdc/kudu.keytab
02:04:19.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.15.239.60
02:04:19.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:04:19.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:04:19.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
02:04:19.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.239.60:35113
02:04:19.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
02:04:19.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:04:19.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
02:04:19.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:46085/jwks.json
02:04:19.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
02:04:19.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=<redacted>
02:04:19.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=<redacted>
02:04:19.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:04:19.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:04:19.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/master-2/data/info.pb
02:04:19.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.239.60
02:04:19.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:04:19.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:04:19.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:04:19.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:04:19.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:04:19.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:04:19.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/master-2/logs
02:04:19.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:04:19.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:04:19.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:04:19.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
02:04:19.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:04:19.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
02:04:19.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:04:19.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 01:43:23 UTC on e7f111948823
02:04:19.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11951
02:04:19.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:04:19.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:19.972282 16503 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:04:19.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:19.973522 16503 file_cache.cc:492] Constructed file cache file cache with capacity 419430
02:04:19.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:19.985986 16511 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:20.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:20.031535 16413 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.239.60" port: 35113 } attempt: 2
02:04:20.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:20.036249 16413 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.239.60:35113: Network error: Client connection negotiation failed: client connection to 127.15.239.60:35113: connect: Connection refused (error 111)
02:04:20.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:20.121999 16413 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.239.60" port: 35113 } attempt: 3
02:04:20.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:20.126560 16413 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.239.60:35113: Network error: Client connection negotiation failed: client connection to 127.15.239.60:35113: connect: Connection refused (error 111)
02:04:20.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:20.198330 16493 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.239.60" port: 35113 } attempt: 5
02:04:20.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:20.203634 16493 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.239.60:35113: Network error: Client connection negotiation failed: client connection to 127.15.239.60:35113: connect: Connection refused (error 111)
02:04:20.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:20.267241 16413 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.239.60" port: 35113 } attempt: 4
02:04:20.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:20.271653 16413 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.239.60:35113: Network error: Client connection negotiation failed: client connection to 127.15.239.60:35113: connect: Connection refused (error 111)
02:04:20.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:20.555336 16413 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.239.60" port: 35113 } attempt: 5
02:04:20.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:20.560120 16413 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.239.60:35113: Network error: Client connection negotiation failed: client connection to 127.15.239.60:35113: connect: Connection refused (error 111)
02:04:20.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:20.751117 16493 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.239.60" port: 35113 } attempt: 6
02:04:20.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:20.759680 16493 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.239.60:35113: Network error: Client connection negotiation failed: client connection to 127.15.239.60:35113: connect: Connection refused (error 111)
02:04:21.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.112560 16413 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.239.60" port: 35113 } attempt: 6
02:04:21.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:21.119765 16413 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.15.239.60:35113: Network error: Client connection negotiation failed: client connection to 127.15.239.60:35113: connect: Connection refused (error 111)
02:04:21.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:19.986720 16512 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:21.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:19.993347 16514 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:21.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:21.218082 16513 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
02:04:21.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.218180 16503 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
02:04:21.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.222491 16503 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:04:21.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.225143 16503 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:04:21.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.226512 16503 hybrid_clock.cc:648] HybridClock initialized: now 1779069861226490 us; error 63 us; skew 500 ppm
02:04:21.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.227325 16503 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:04:21.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 18 02:04:21 dist-test-slave-q2wt krb5kdc[16327](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1779069861, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.60@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
02:04:21.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.233609 16503 init.cc:377] Logged in from keytab as kudu/127.15.239.60@KRBTEST.COM (short username kudu)
02:04:21.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.238778 16503 webserver.cc:533] Webserver started at http://127.15.239.60:34169/ using document root <none> and password file <none>
02:04:21.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.239665 16503 fs_manager.cc:362] Metadata directory not provided
02:04:21.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.239850 16503 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:04:21.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.240239 16503 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:04:21.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.245204 16503 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/master-2/data/instance:
02:04:21.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "0460bdae3eea449f84e6832c04b40e8e"
02:04:21.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:04:21 on dist-test-slave-q2wt"
02:04:21.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.246336 16503 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/master-2/wal/instance:
02:04:21.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "0460bdae3eea449f84e6832c04b40e8e"
02:04:21.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:04:21 on dist-test-slave-q2wt"
02:04:21.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.254032 16503 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.008s	sys 0.000s
02:04:21.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.259956 16526 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:04:21.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.261152 16503 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
02:04:21.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.261555 16503 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/master-2/data,/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/master-2/wal
02:04:21.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "0460bdae3eea449f84e6832c04b40e8e"
02:04:21.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:04:21 on dist-test-slave-q2wt"
02:04:21.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.261973 16503 fs_report.cc:389] FS layout report
02:04:21.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:04:21.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/master-2/wal
02:04:21.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/master-2/wal
02:04:21.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/master-2/data/data
02:04:21.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:04:21.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:04:21.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:04:21.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:04:21.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:04:21.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:04:21.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:04:21.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:04:21.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:04:21.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:04:21.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:04:21.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.315351 16503 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:04:21.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.320998 16503 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:04:21.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.321398 16503 kserver.cc:163] Server-wide thread pool size limit: 3276
02:04:21.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.397727 16503 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.60:35113
02:04:21.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.397852 16577 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.239.60:35113 every 8 connection(s)
02:04:21.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.400476 16503 server_base.cc:1193] Dumped server information to /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/master-2/data/info.pb
02:04:21.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.404181 16316 external_mini_cluster.cc:1428] Started /tmp/dist-test-task2tB5Xy/build/tsan/bin/kudu as pid 16503
02:04:21.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.404711 16316 external_mini_cluster.cc:1442] Reading /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/master-2/wal/instance
02:04:21.408 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.407763 16578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
02:04:21.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.425305 16578 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.239.62" port: 36255 } has no permanent_uuid. Determining permanent_uuid...
02:04:21.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 18 02:04:21 dist-test-slave-q2wt krb5kdc[16327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1779069855, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.239.62@KRBTEST.COM
02:04:21.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 18 02:04:21 dist-test-slave-q2wt krb5kdc[16327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1779069861, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.60@KRBTEST.COM for kudu/127.15.239.62@KRBTEST.COM
02:04:21.461 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 18 02:04:21 dist-test-slave-q2wt krb5kdc[16327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1779069855, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.239.61@KRBTEST.COM
02:04:21.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.466279 16578 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.239.61" port: 39633 } has no permanent_uuid. Determining permanent_uuid...
02:04:21.478 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 18 02:04:21 dist-test-slave-q2wt krb5kdc[16327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1779069861, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.60@KRBTEST.COM for kudu/127.15.239.61@KRBTEST.COM
02:04:21.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 18 02:04:21 dist-test-slave-q2wt krb5kdc[16327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1779069855, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.239.60@KRBTEST.COM
02:04:21.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.491703 16578 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.15.239.60" port: 35113 } has no permanent_uuid. Determining permanent_uuid...
02:04:21.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 18 02:04:21 dist-test-slave-q2wt krb5kdc[16327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1779069861, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.60@KRBTEST.COM for kudu/127.15.239.60@KRBTEST.COM
02:04:21.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.526407 16578 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0460bdae3eea449f84e6832c04b40e8e: Bootstrap starting.
02:04:21.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.533586 16578 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0460bdae3eea449f84e6832c04b40e8e: Neither blocks nor log segments found. Creating new log.
02:04:21.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.535343 16578 log.cc:826] T 00000000000000000000000000000000 P 0460bdae3eea449f84e6832c04b40e8e: Log is configured to *not* fsync() on all Append() calls
02:04:21.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.540726 16578 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0460bdae3eea449f84e6832c04b40e8e: No bootstrap required, opened a new log
02:04:21.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.560523 16578 raft_consensus.cc:359] T 00000000000000000000000000000000 P 0460bdae3eea449f84e6832c04b40e8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba29378713734b10bd07d3268dbe0c31" member_type: VOTER last_known_addr { host: "127.15.239.62" port: 36255 } } peers { permanent_uuid: "25b31746aa834ff79c611972881e58fc" member_type: VOTER last_known_addr { host: "127.15.239.61" port: 39633 } } peers { permanent_uuid: "0460bdae3eea449f84e6832c04b40e8e" member_type: VOTER last_known_addr { host: "127.15.239.60" port: 35113 } }
02:04:21.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.561486 16578 raft_consensus.cc:385] T 00000000000000000000000000000000 P 0460bdae3eea449f84e6832c04b40e8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:04:21.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.561730 16578 raft_consensus.cc:740] T 00000000000000000000000000000000 P 0460bdae3eea449f84e6832c04b40e8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0460bdae3eea449f84e6832c04b40e8e, State: Initialized, Role: FOLLOWER
02:04:21.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.562458 16578 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0460bdae3eea449f84e6832c04b40e8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba29378713734b10bd07d3268dbe0c31" member_type: VOTER last_known_addr { host: "127.15.239.62" port: 36255 } } peers { permanent_uuid: "25b31746aa834ff79c611972881e58fc" member_type: VOTER last_known_addr { host: "127.15.239.61" port: 39633 } } peers { permanent_uuid: "0460bdae3eea449f84e6832c04b40e8e" member_type: VOTER last_known_addr { host: "127.15.239.60" port: 35113 } }
02:04:21.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.565148 16589 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0460bdae3eea449f84e6832c04b40e8e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba29378713734b10bd07d3268dbe0c31" member_type: VOTER last_known_addr { host: "127.15.239.62" port: 36255 } } peers { permanent_uuid: "25b31746aa834ff79c611972881e58fc" member_type: VOTER last_known_addr { host: "127.15.239.61" port: 39633 } } peers { permanent_uuid: "0460bdae3eea449f84e6832c04b40e8e" member_type: VOTER last_known_addr { host: "127.15.239.60" port: 35113 } } }
02:04:21.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.566535 16589 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0460bdae3eea449f84e6832c04b40e8e [sys.catalog]: This master's current role is: FOLLOWER
02:04:21.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.567137 16578 sys_catalog.cc:565] T 00000000000000000000000000000000 P 0460bdae3eea449f84e6832c04b40e8e [sys.catalog]: configured and running, proceeding with master startup.
02:04:21.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.572933 16589 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0460bdae3eea449f84e6832c04b40e8e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
02:04:21.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.573549 16589 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0460bdae3eea449f84e6832c04b40e8e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba29378713734b10bd07d3268dbe0c31" member_type: VOTER last_known_addr { host: "127.15.239.62" port: 36255 } } peers { permanent_uuid: "25b31746aa834ff79c611972881e58fc" member_type: VOTER last_known_addr { host: "127.15.239.61" port: 39633 } } peers { permanent_uuid: "0460bdae3eea449f84e6832c04b40e8e" member_type: VOTER last_known_addr { host: "127.15.239.60" port: 35113 } }
02:04:21.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.576756 16589 leader_election.cc:290] T 00000000000000000000000000000000 P 0460bdae3eea449f84e6832c04b40e8e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ba29378713734b10bd07d3268dbe0c31 (127.15.239.62:36255), 25b31746aa834ff79c611972881e58fc (127.15.239.61:39633)
02:04:21.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:21.577865 16532 tablet.cc:2404] T 00000000000000000000000000000000 P 0460bdae3eea449f84e6832c04b40e8e: Can't schedule compaction. Clean time has not been advanced past its initial value.
02:04:21.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:21.607230 16600 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 0460bdae3eea449f84e6832c04b40e8e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
02:04:21.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:21.607600 16600 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
02:04:21.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.601648 16503 master_runner.cc:187] Error getting master registration for 127.15.239.62:36255: OK, instance_id { permanent_uuid: "ba29378713734b10bd07d3268dbe0c31" instance_seqno: 1779069857462008 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
02:04:21.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.632592 16503 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
02:04:21.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.820137 16493 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.239.60" port: 35113 } attempt: 7
02:04:21.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 18 02:04:21 dist-test-slave-q2wt krb5kdc[16327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1779069859, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.61@KRBTEST.COM for kudu/127.15.239.60@KRBTEST.COM
02:04:21.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.860193 16493 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25b31746aa834ff79c611972881e58fc: Bootstrap starting.
02:04:21.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.868851 16493 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 25b31746aa834ff79c611972881e58fc: Neither blocks nor log segments found. Creating new log.
02:04:21.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.871548 16493 log.cc:826] T 00000000000000000000000000000000 P 25b31746aa834ff79c611972881e58fc: Log is configured to *not* fsync() on all Append() calls
02:04:21.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.876399 16493 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25b31746aa834ff79c611972881e58fc: No bootstrap required, opened a new log
02:04:21.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.898608 16493 raft_consensus.cc:359] T 00000000000000000000000000000000 P 25b31746aa834ff79c611972881e58fc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba29378713734b10bd07d3268dbe0c31" member_type: VOTER last_known_addr { host: "127.15.239.62" port: 36255 } } peers { permanent_uuid: "25b31746aa834ff79c611972881e58fc" member_type: VOTER last_known_addr { host: "127.15.239.61" port: 39633 } } peers { permanent_uuid: "0460bdae3eea449f84e6832c04b40e8e" member_type: VOTER last_known_addr { host: "127.15.239.60" port: 35113 } }
02:04:21.900 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.900040 16493 raft_consensus.cc:385] T 00000000000000000000000000000000 P 25b31746aa834ff79c611972881e58fc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:04:21.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.900650 16493 raft_consensus.cc:740] T 00000000000000000000000000000000 P 25b31746aa834ff79c611972881e58fc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25b31746aa834ff79c611972881e58fc, State: Initialized, Role: FOLLOWER
02:04:21.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.901985 16493 consensus_queue.cc:260] T 00000000000000000000000000000000 P 25b31746aa834ff79c611972881e58fc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba29378713734b10bd07d3268dbe0c31" member_type: VOTER last_known_addr { host: "127.15.239.62" port: 36255 } } peers { permanent_uuid: "25b31746aa834ff79c611972881e58fc" member_type: VOTER last_known_addr { host: "127.15.239.61" port: 39633 } } peers { permanent_uuid: "0460bdae3eea449f84e6832c04b40e8e" member_type: VOTER last_known_addr { host: "127.15.239.60" port: 35113 } }
02:04:21.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.905151 16604 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25b31746aa834ff79c611972881e58fc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba29378713734b10bd07d3268dbe0c31" member_type: VOTER last_known_addr { host: "127.15.239.62" port: 36255 } } peers { permanent_uuid: "25b31746aa834ff79c611972881e58fc" member_type: VOTER last_known_addr { host: "127.15.239.61" port: 39633 } } peers { permanent_uuid: "0460bdae3eea449f84e6832c04b40e8e" member_type: VOTER last_known_addr { host: "127.15.239.60" port: 35113 } } }
02:04:21.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.906145 16604 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25b31746aa834ff79c611972881e58fc [sys.catalog]: This master's current role is: FOLLOWER
02:04:21.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.907080 16493 sys_catalog.cc:565] T 00000000000000000000000000000000 P 25b31746aa834ff79c611972881e58fc [sys.catalog]: configured and running, proceeding with master startup.
02:04:21.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.907301 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0460bdae3eea449f84e6832c04b40e8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b31746aa834ff79c611972881e58fc" is_pre_election: true
02:04:21.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.909425 16468 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 25b31746aa834ff79c611972881e58fc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0460bdae3eea449f84e6832c04b40e8e in term 0.
02:04:21.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.910940 16529 leader_election.cc:304] T 00000000000000000000000000000000 P 0460bdae3eea449f84e6832c04b40e8e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0460bdae3eea449f84e6832c04b40e8e, 25b31746aa834ff79c611972881e58fc; no voters: 
02:04:21.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.912122 16589 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0460bdae3eea449f84e6832c04b40e8e [term 0 FOLLOWER]: Leader pre-election won for term 1
02:04:21.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.912511 16589 raft_consensus.cc:493] T 00000000000000000000000000000000 P 0460bdae3eea449f84e6832c04b40e8e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
02:04:21.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.912827 16589 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 0460bdae3eea449f84e6832c04b40e8e [term 0 FOLLOWER]: Advancing to term 1
02:04:21.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.920122 16589 raft_consensus.cc:515] T 00000000000000000000000000000000 P 0460bdae3eea449f84e6832c04b40e8e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba29378713734b10bd07d3268dbe0c31" member_type: VOTER last_known_addr { host: "127.15.239.62" port: 36255 } } peers { permanent_uuid: "25b31746aa834ff79c611972881e58fc" member_type: VOTER last_known_addr { host: "127.15.239.61" port: 39633 } } peers { permanent_uuid: "0460bdae3eea449f84e6832c04b40e8e" member_type: VOTER last_known_addr { host: "127.15.239.60" port: 35113 } }
02:04:21.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.923319 16468 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0460bdae3eea449f84e6832c04b40e8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25b31746aa834ff79c611972881e58fc"
02:04:21.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.924372 16468 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 25b31746aa834ff79c611972881e58fc [term 0 FOLLOWER]: Advancing to term 1
02:04:21.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.924855 16589 leader_election.cc:290] T 00000000000000000000000000000000 P 0460bdae3eea449f84e6832c04b40e8e [CANDIDATE]: Term 1 election: Requested vote from peers ba29378713734b10bd07d3268dbe0c31 (127.15.239.62:36255), 25b31746aa834ff79c611972881e58fc (127.15.239.61:39633)
02:04:21.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.933385 16468 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 25b31746aa834ff79c611972881e58fc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0460bdae3eea449f84e6832c04b40e8e in term 1.
02:04:21.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.934823 16529 leader_election.cc:304] T 00000000000000000000000000000000 P 0460bdae3eea449f84e6832c04b40e8e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0460bdae3eea449f84e6832c04b40e8e, 25b31746aa834ff79c611972881e58fc; no voters: 
02:04:21.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.935870 16589 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 0460bdae3eea449f84e6832c04b40e8e [term 1 FOLLOWER]: Leader election won for term 1
02:04:21.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.938385 16589 raft_consensus.cc:697] T 00000000000000000000000000000000 P 0460bdae3eea449f84e6832c04b40e8e [term 1 LEADER]: Becoming Leader. State: Replica: 0460bdae3eea449f84e6832c04b40e8e, State: Running, Role: LEADER
02:04:21.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.940414 16589 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0460bdae3eea449f84e6832c04b40e8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba29378713734b10bd07d3268dbe0c31" member_type: VOTER last_known_addr { host: "127.15.239.62" port: 36255 } } peers { permanent_uuid: "25b31746aa834ff79c611972881e58fc" member_type: VOTER last_known_addr { host: "127.15.239.61" port: 39633 } } peers { permanent_uuid: "0460bdae3eea449f84e6832c04b40e8e" member_type: VOTER last_known_addr { host: "127.15.239.60" port: 35113 } }
02:04:21.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.960806 16608 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0460bdae3eea449f84e6832c04b40e8e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0460bdae3eea449f84e6832c04b40e8e. Latest consensus state: current_term: 1 leader_uuid: "0460bdae3eea449f84e6832c04b40e8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba29378713734b10bd07d3268dbe0c31" member_type: VOTER last_known_addr { host: "127.15.239.62" port: 36255 } } peers { permanent_uuid: "25b31746aa834ff79c611972881e58fc" member_type: VOTER last_known_addr { host: "127.15.239.61" port: 39633 } } peers { permanent_uuid: "0460bdae3eea449f84e6832c04b40e8e" member_type: VOTER last_known_addr { host: "127.15.239.60" port: 35113 } } }
02:04:21.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.964818 16608 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0460bdae3eea449f84e6832c04b40e8e [sys.catalog]: This master's current role is: LEADER
02:04:21.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.974807 16616 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
02:04:21.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.983523 16616 catalog_manager.cc:1519] Initializing Kudu cluster ID...
02:04:22.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:22.008677 16468 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 25b31746aa834ff79c611972881e58fc [term 1 FOLLOWER]: Refusing update from remote peer 0460bdae3eea449f84e6832c04b40e8e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
02:04:22.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:22.012315 16608 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 0460bdae3eea449f84e6832c04b40e8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "25b31746aa834ff79c611972881e58fc" member_type: VOTER last_known_addr { host: "127.15.239.61" port: 39633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
02:04:22.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:22.020071 16618 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 25b31746aa834ff79c611972881e58fc: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
02:04:22.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:22.020455 16618 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
02:04:22.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:21.982048 16422 master_runner.cc:187] Error getting master registration for 127.15.239.62:36255: OK, instance_id { permanent_uuid: "ba29378713734b10bd07d3268dbe0c31" instance_seqno: 1779069857462008 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
02:04:22.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:22.043387 16422 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
02:04:22.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:22.057674 16604 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25b31746aa834ff79c611972881e58fc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0460bdae3eea449f84e6832c04b40e8e. Latest consensus state: current_term: 1 leader_uuid: "0460bdae3eea449f84e6832c04b40e8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba29378713734b10bd07d3268dbe0c31" member_type: VOTER last_known_addr { host: "127.15.239.62" port: 36255 } } peers { permanent_uuid: "25b31746aa834ff79c611972881e58fc" member_type: VOTER last_known_addr { host: "127.15.239.61" port: 39633 } } peers { permanent_uuid: "0460bdae3eea449f84e6832c04b40e8e" member_type: VOTER last_known_addr { host: "127.15.239.60" port: 35113 } } }
02:04:22.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:22.062237 16604 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25b31746aa834ff79c611972881e58fc [sys.catalog]: This master's current role is: FOLLOWER
02:04:22.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:22.070328 16620 mvcc.cc:204] Tried to move back new op lower bound from 7287070154760974336 to 7287070154520965120. Current Snapshot: MvccSnapshot[applied={T|T < 7287070154760974336}]
02:04:22.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:22.073200 16589 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0460bdae3eea449f84e6832c04b40e8e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0460bdae3eea449f84e6832c04b40e8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba29378713734b10bd07d3268dbe0c31" member_type: VOTER last_known_addr { host: "127.15.239.62" port: 36255 } } peers { permanent_uuid: "25b31746aa834ff79c611972881e58fc" member_type: VOTER last_known_addr { host: "127.15.239.61" port: 39633 } } peers { permanent_uuid: "0460bdae3eea449f84e6832c04b40e8e" member_type: VOTER last_known_addr { host: "127.15.239.60" port: 35113 } } }
02:04:22.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:22.073916 16589 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0460bdae3eea449f84e6832c04b40e8e [sys.catalog]: This master's current role is: LEADER
02:04:22.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:22.076445 16616 catalog_manager.cc:1382] Generated new cluster ID: ec7b251cc6224ff680f2adbe0a3d57d8
02:04:22.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:22.076718 16616 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
02:04:22.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:22.095081 16604 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25b31746aa834ff79c611972881e58fc [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0460bdae3eea449f84e6832c04b40e8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba29378713734b10bd07d3268dbe0c31" member_type: VOTER last_known_addr { host: "127.15.239.62" port: 36255 } } peers { permanent_uuid: "25b31746aa834ff79c611972881e58fc" member_type: VOTER last_known_addr { host: "127.15.239.61" port: 39633 } } peers { permanent_uuid: "0460bdae3eea449f84e6832c04b40e8e" member_type: VOTER last_known_addr { host: "127.15.239.60" port: 35113 } } }
02:04:22.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:22.098901 16604 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25b31746aa834ff79c611972881e58fc [sys.catalog]: This master's current role is: FOLLOWER
02:04:22.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:22.117141 16616 catalog_manager.cc:1405] Generated new certificate authority record
02:04:22.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:22.121079 16616 catalog_manager.cc:1539] Loading token signing keys...
02:04:22.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:22.147535 16616 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 0460bdae3eea449f84e6832c04b40e8e: Generated new TSK 0
02:04:22.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:22.150924 16616 catalog_manager.cc:1549] Initializing in-progress tserver states...
02:04:22.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:22.153153 16413 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.15.239.60" port: 35113 } attempt: 7
02:04:22.180 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 18 02:04:22 dist-test-slave-q2wt krb5kdc[16327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1779069857, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.62@KRBTEST.COM for kudu/127.15.239.60@KRBTEST.COM
02:04:22.198 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for kudu/127.15.239.1@KRBTEST.COM; defaulting to no policy
02:04:22.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
02:04:22.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "kudu/127.15.239.1@KRBTEST.COM" created.
02:04:22.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:22.207170 16413 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba29378713734b10bd07d3268dbe0c31: Bootstrap starting.
02:04:22.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:22.217562 16413 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ba29378713734b10bd07d3268dbe0c31: Neither blocks nor log segments found. Creating new log.
02:04:22.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:22.220507 16413 log.cc:826] T 00000000000000000000000000000000 P ba29378713734b10bd07d3268dbe0c31: Log is configured to *not* fsync() on all Append() calls
02:04:22.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:22.250321 16413 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba29378713734b10bd07d3268dbe0c31: No bootstrap required, opened a new log
02:04:22.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
02:04:22.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.15.239.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/krb5kdc/kudu.keytab.
02:04:22.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.15.239.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/krb5kdc/kudu.keytab.
02:04:22.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:22.291254 16413 raft_consensus.cc:359] T 00000000000000000000000000000000 P ba29378713734b10bd07d3268dbe0c31 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba29378713734b10bd07d3268dbe0c31" member_type: VOTER last_known_addr { host: "127.15.239.62" port: 36255 } } peers { permanent_uuid: "25b31746aa834ff79c611972881e58fc" member_type: VOTER last_known_addr { host: "127.15.239.61" port: 39633 } } peers { permanent_uuid: "0460bdae3eea449f84e6832c04b40e8e" member_type: VOTER last_known_addr { host: "127.15.239.60" port: 35113 } }
02:04:22.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:22.292865 16413 raft_consensus.cc:385] T 00000000000000000000000000000000 P ba29378713734b10bd07d3268dbe0c31 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:04:22.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:22.293467 16413 raft_consensus.cc:740] T 00000000000000000000000000000000 P ba29378713734b10bd07d3268dbe0c31 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba29378713734b10bd07d3268dbe0c31, State: Initialized, Role: FOLLOWER
02:04:22.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:22.294651 16413 consensus_queue.cc:260] T 00000000000000000000000000000000 P ba29378713734b10bd07d3268dbe0c31 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba29378713734b10bd07d3268dbe0c31" member_type: VOTER last_known_addr { host: "127.15.239.62" port: 36255 } } peers { permanent_uuid: "25b31746aa834ff79c611972881e58fc" member_type: VOTER last_known_addr { host: "127.15.239.61" port: 39633 } } peers { permanent_uuid: "0460bdae3eea449f84e6832c04b40e8e" member_type: VOTER last_known_addr { host: "127.15.239.60" port: 35113 } }
02:04:22.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:22.303290 16630 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba29378713734b10bd07d3268dbe0c31 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba29378713734b10bd07d3268dbe0c31" member_type: VOTER last_known_addr { host: "127.15.239.62" port: 36255 } } peers { permanent_uuid: "25b31746aa834ff79c611972881e58fc" member_type: VOTER last_known_addr { host: "127.15.239.61" port: 39633 } } peers { permanent_uuid: "0460bdae3eea449f84e6832c04b40e8e" member_type: VOTER last_known_addr { host: "127.15.239.60" port: 35113 } } }
02:04:22.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:22.307866 16630 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba29378713734b10bd07d3268dbe0c31 [sys.catalog]: This master's current role is: FOLLOWER
02:04:22.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:22.307473 16413 sys_catalog.cc:565] T 00000000000000000000000000000000 P ba29378713734b10bd07d3268dbe0c31 [sys.catalog]: configured and running, proceeding with master startup.
02:04:22.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:22.308487 16388 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0460bdae3eea449f84e6832c04b40e8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba29378713734b10bd07d3268dbe0c31" is_pre_election: true
02:04:22.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:22.309425 16388 raft_consensus.cc:2468] T 00000000000000000000000000000000 P ba29378713734b10bd07d3268dbe0c31 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0460bdae3eea449f84e6832c04b40e8e in term 0.
02:04:22.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:22.311442 16387 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "0460bdae3eea449f84e6832c04b40e8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ba29378713734b10bd07d3268dbe0c31"
02:04:22.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:22.312213 16387 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ba29378713734b10bd07d3268dbe0c31 [term 0 FOLLOWER]: Advancing to term 1
02:04:22.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for HTTP/127.15.239.1@KRBTEST.COM; defaulting to no policy
02:04:22.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:22.323197 16387 raft_consensus.cc:2468] T 00000000000000000000000000000000 P ba29378713734b10bd07d3268dbe0c31 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0460bdae3eea449f84e6832c04b40e8e in term 1.
02:04:22.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:22.332501 16386 raft_consensus.cc:1275] T 00000000000000000000000000000000 P ba29378713734b10bd07d3268dbe0c31 [term 1 FOLLOWER]: Refusing update from remote peer 0460bdae3eea449f84e6832c04b40e8e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
02:04:22.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:22.342675 16608 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 0460bdae3eea449f84e6832c04b40e8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ba29378713734b10bd07d3268dbe0c31" member_type: VOTER last_known_addr { host: "127.15.239.62" port: 36255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
02:04:22.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
02:04:22.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "HTTP/127.15.239.1@KRBTEST.COM" created.
02:04:22.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
02:04:22.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.15.239.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/krb5kdc/kudu.keytab.
02:04:22.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.15.239.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/krb5kdc/kudu.keytab.
02:04:22.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:22.428875 16316 mini_kdc.cc:268] Time spent creating service keytab for HTTP/127.15.239.1: real 0.151s	user 0.000s	sys 0.016s
02:04:22.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:22.431335 16316 external_mini_cluster.cc:1366] Running /tmp/dist-test-task2tB5Xy/build/tsan/bin/kudu
02:04:22.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-task2tB5Xy/build/tsan/bin/kudu
02:04:22.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/ts-0/wal
02:04:22.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/ts-0/data
02:04:22.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:04:22.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:04:22.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:04:22.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:04:22.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:04:22.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:04:22.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/ts-0/logs
02:04:22.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/ts-0/data/info.pb
02:04:22.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:04:22.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:04:22.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:04:22.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:04:22.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:04:22.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:04:22.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:04:22.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:04:22.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
02:04:22.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:04:22.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.239.1:0
02:04:22.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.15.239.1
02:04:22.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.239.1
02:04:22.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:04:22.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.15.239.62:36255,127.15.239.61:39633,127.15.239.60:35113
02:04:22.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/krb5kdc/kudu.keytab
02:04:22.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.15.239.1
02:04:22.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
02:04:22.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=test-admin
02:04:22.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=test-user
02:04:22.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=true
02:04:22.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.239.20:44727
02:04:22.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:04:22.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:04:22.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:04:22.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=false with env {KRB5CCNAME=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
02:04:22.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:22.444159 16630 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba29378713734b10bd07d3268dbe0c31 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0460bdae3eea449f84e6832c04b40e8e. Latest consensus state: current_term: 1 leader_uuid: "0460bdae3eea449f84e6832c04b40e8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba29378713734b10bd07d3268dbe0c31" member_type: VOTER last_known_addr { host: "127.15.239.62" port: 36255 } } peers { permanent_uuid: "25b31746aa834ff79c611972881e58fc" member_type: VOTER last_known_addr { host: "127.15.239.61" port: 39633 } } peers { permanent_uuid: "0460bdae3eea449f84e6832c04b40e8e" member_type: VOTER last_known_addr { host: "127.15.239.60" port: 35113 } } }
02:04:22.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:22.444918 16630 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba29378713734b10bd07d3268dbe0c31 [sys.catalog]: This master's current role is: FOLLOWER
02:04:22.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:22.445995 16642 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba29378713734b10bd07d3268dbe0c31 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "0460bdae3eea449f84e6832c04b40e8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba29378713734b10bd07d3268dbe0c31" member_type: VOTER last_known_addr { host: "127.15.239.62" port: 36255 } } peers { permanent_uuid: "25b31746aa834ff79c611972881e58fc" member_type: VOTER last_known_addr { host: "127.15.239.61" port: 39633 } } peers { permanent_uuid: "0460bdae3eea449f84e6832c04b40e8e" member_type: VOTER last_known_addr { host: "127.15.239.60" port: 35113 } } }
02:04:22.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:22.446987 16642 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba29378713734b10bd07d3268dbe0c31 [sys.catalog]: This master's current role is: FOLLOWER
02:04:22.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:22.465509 16649 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
02:04:22.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:22.948911 16648 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:04:22.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:22.949584 16648 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:04:22.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:22.950481 16648 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:04:22.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:22.969893 16608 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0460bdae3eea449f84e6832c04b40e8e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "0460bdae3eea449f84e6832c04b40e8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ba29378713734b10bd07d3268dbe0c31" member_type: VOTER last_known_addr { host: "127.15.239.62" port: 36255 } } peers { permanent_uuid: "25b31746aa834ff79c611972881e58fc" member_type: VOTER last_known_addr { host: "127.15.239.61" port: 39633 } } peers { permanent_uuid: "0460bdae3eea449f84e6832c04b40e8e" member_type: VOTER last_known_addr { host: "127.15.239.60" port: 35113 } } }
02:04:22.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:22.971062 16608 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0460bdae3eea449f84e6832c04b40e8e [sys.catalog]: This master's current role is: LEADER
02:04:23.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:23.014041 16648 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:04:23.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:23.015570 16648 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.1
02:04:23.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:23.026849 16618 catalog_manager.cc:1294] Loaded cluster ID: ec7b251cc6224ff680f2adbe0a3d57d8
02:04:23.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:23.027448 16618 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 25b31746aa834ff79c611972881e58fc: loading cluster ID for follower catalog manager: success
02:04:23.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:23.035279 16618 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 25b31746aa834ff79c611972881e58fc: acquiring CA information for follower catalog manager: success
02:04:23.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:23.041831 16618 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 25b31746aa834ff79c611972881e58fc: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
02:04:23.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:23.086345 16648 tablet_server_runner.cc:78] Tablet server non-default flags:
02:04:23.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:04:23.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.239.20:44727
02:04:23.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:04:23.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:04:23.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/ts-0/data
02:04:23.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/ts-0/wal
02:04:23.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/krb5kdc/kudu.keytab
02:04:23.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.15.239.1
02:04:23.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:04:23.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:04:23.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.239.1:0
02:04:23.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:04:23.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
02:04:23.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=<redacted>
02:04:23.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=<redacted>
02:04:23.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:04:23.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:04:23.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/ts-0/data/info.pb
02:04:23.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.239.1
02:04:23.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:04:23.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.15.239.62:36255,127.15.239.61:39633,127.15.239.60:35113
02:04:23.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:04:23.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:04:23.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:04:23.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:04:23.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:04:23.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.15.239.1
02:04:23.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/ts-0/logs
02:04:23.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:04:23.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:04:23.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:04:23.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
02:04:23.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:04:23.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
02:04:23.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:04:23.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 01:43:23 UTC on e7f111948823
02:04:23.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11951
02:04:23.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:04:23.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:23.088027 16648 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:04:23.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:23.089429 16648 file_cache.cc:492] Constructed file cache file cache with capacity 419430
02:04:23.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:23.106110 16657 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:23.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:23.514838 16649 catalog_manager.cc:1294] Loaded cluster ID: ec7b251cc6224ff680f2adbe0a3d57d8
02:04:23.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:23.528057 16649 catalog_manager.cc:1587] T 00000000000000000000000000000000 P ba29378713734b10bd07d3268dbe0c31: loading cluster ID for follower catalog manager: success
02:04:23.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:23.536105 16649 catalog_manager.cc:1609] T 00000000000000000000000000000000 P ba29378713734b10bd07d3268dbe0c31: acquiring CA information for follower catalog manager: success
02:04:23.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:23.583122 16649 catalog_manager.cc:1637] T 00000000000000000000000000000000 P ba29378713734b10bd07d3268dbe0c31: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
02:04:24.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:24.510378 16656 debug-util.cc:398] Leaking SignalData structure 0x7b0800037780 after lost signal to thread 16648
02:04:24.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:24.941255 16660 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:24.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:24.939189 16648 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.831s	user 0.546s	sys 1.082s
02:04:24.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:24.941672 16648 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.834s	user 0.546s	sys 1.082s
02:04:24.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:23.107918 16658 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:24.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:24.946486 16659 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1833 milliseconds
02:04:24.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:24.946579 16648 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
02:04:24.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:24.948190 16648 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:04:24.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:24.958868 16648 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:04:24.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:24.960512 16648 hybrid_clock.cc:648] HybridClock initialized: now 1779069864960457 us; error 63 us; skew 500 ppm
02:04:24.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:24.961680 16648 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:04:24.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 18 02:04:24 dist-test-slave-q2wt krb5kdc[16327](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1779069864, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
02:04:24.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:24.969975 16648 init.cc:377] Logged in from keytab as kudu/127.15.239.1@KRBTEST.COM (short username kudu)
02:04:25.005 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:25.005362 16648 webserver.cc:533] Webserver started at http://127.15.239.1:38877/ using document root <none> and password file <none>
02:04:25.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:25.007160 16648 fs_manager.cc:362] Metadata directory not provided
02:04:25.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:25.007815 16648 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:04:25.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:25.008633 16648 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:04:25.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:25.015493 16648 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/ts-0/data/instance:
02:04:25.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "76eeaaee714844158f4db95d1c6f1b1d"
02:04:25.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:04:25 on dist-test-slave-q2wt"
02:04:25.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:25.017486 16648 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/ts-0/wal/instance:
02:04:25.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "76eeaaee714844158f4db95d1c6f1b1d"
02:04:25.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:04:25 on dist-test-slave-q2wt"
02:04:25.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:25.033779 16648 fs_manager.cc:696] Time spent creating directory manager: real 0.015s	user 0.013s	sys 0.001s
02:04:25.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:25.047821 16670 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:04:25.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:25.049793 16648 fs_manager.cc:730] Time spent opening block manager: real 0.011s	user 0.003s	sys 0.008s
02:04:25.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:25.050446 16648 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/ts-0/data,/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/ts-0/wal
02:04:25.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "76eeaaee714844158f4db95d1c6f1b1d"
02:04:25.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:04:25 on dist-test-slave-q2wt"
02:04:25.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:25.051165 16648 fs_report.cc:389] FS layout report
02:04:25.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:04:25.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/ts-0/wal
02:04:25.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/ts-0/wal
02:04:25.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/ts-0/data/data
02:04:25.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:04:25.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:04:25.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:04:25.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:04:25.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:04:25.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:04:25.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:04:25.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:04:25.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:04:25.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:04:25.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:04:25.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:25.171295 16648 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:04:25.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:25.184082 16648 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:04:25.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:25.185068 16648 kserver.cc:163] Server-wide thread pool size limit: 3276
02:04:25.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:25.194909 16648 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
02:04:25.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:25.207599 16648 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
02:04:25.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:25.208230 16648 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s	user 0.000s	sys 0.001s
02:04:25.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:25.208786 16648 ts_tablet_manager.cc:616] Registered 0 tablets
02:04:25.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:25.209522 16648 ts_tablet_manager.cc:595] Time spent register tablets: real 0.001s	user 0.000s	sys 0.000s
02:04:25.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:25.803396 16648 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.1:41753
02:04:25.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:25.803490 16782 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.239.1:41753 every 8 connection(s)
02:04:25.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:25.807791 16648 server_base.cc:1193] Dumped server information to /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/ts-0/data/info.pb
02:04:25.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:25.813750 16316 external_mini_cluster.cc:1428] Started /tmp/dist-test-task2tB5Xy/build/tsan/bin/kudu as pid 16648
02:04:25.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:25.814620 16316 external_mini_cluster.cc:1442] Reading /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/ts-0/wal/instance
02:04:25.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 18 02:04:25 dist-test-slave-q2wt krb5kdc[16327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1779069864, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.1@KRBTEST.COM for kudu/127.15.239.60@KRBTEST.COM
02:04:25.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:25.909325 16783 heartbeater.cc:344] Connected to a master server at 127.15.239.60:35113
02:04:25.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:25.909891 16783 heartbeater.cc:461] Registering TS with master...
02:04:25.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:25.911949 16783 heartbeater.cc:507] Master 127.15.239.60:35113 requested a full tablet report, sending...
02:04:25.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 18 02:04:25 dist-test-slave-q2wt krb5kdc[16327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1779069864, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.1@KRBTEST.COM for kudu/127.15.239.61@KRBTEST.COM
02:04:25.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:25.915422 16543 ts_manager.cc:194] Registered new tserver with Master: 76eeaaee714844158f4db95d1c6f1b1d (127.15.239.1:41753)
02:04:25.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:25.918228 16543 master_service.cc:502] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.239.1@KRBTEST.COM'} at 127.15.239.1:44181
02:04:25.923 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for kudu/127.15.239.2@KRBTEST.COM; defaulting to no policy
02:04:25.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
02:04:25.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "kudu/127.15.239.2@KRBTEST.COM" created.
02:04:25.927 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 18 02:04:25 dist-test-slave-q2wt krb5kdc[16327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1779069864, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.1@KRBTEST.COM for kudu/127.15.239.62@KRBTEST.COM
02:04:25.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:25.930284 16784 heartbeater.cc:344] Connected to a master server at 127.15.239.61:39633
02:04:25.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:25.930691 16784 heartbeater.cc:461] Registering TS with master...
02:04:25.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:25.931409 16784 heartbeater.cc:507] Master 127.15.239.61:39633 requested a full tablet report, sending...
02:04:25.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:25.936892 16458 ts_manager.cc:194] Registered new tserver with Master: 76eeaaee714844158f4db95d1c6f1b1d (127.15.239.1:41753)
02:04:25.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
02:04:25.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.15.239.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/krb5kdc/kudu.keytab.
02:04:25.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.15.239.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/krb5kdc/kudu.keytab.
02:04:25.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:25.960858 16316 mini_kdc.cc:268] Time spent creating service keytab for kudu/127.15.239.2: real 0.113s	user 0.009s	sys 0.006s
02:04:25.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:25.974190 16787 heartbeater.cc:344] Connected to a master server at 127.15.239.62:36255
02:04:25.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:25.974653 16787 heartbeater.cc:461] Registering TS with master...
02:04:25.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:25.975417 16787 heartbeater.cc:507] Master 127.15.239.62:36255 requested a full tablet report, sending...
02:04:25.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:25.980206 16378 ts_manager.cc:194] Registered new tserver with Master: 76eeaaee714844158f4db95d1c6f1b1d (127.15.239.1:41753)
02:04:25.984 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for HTTP/127.15.239.2@KRBTEST.COM; defaulting to no policy
02:04:25.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
02:04:25.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "HTTP/127.15.239.2@KRBTEST.COM" created.
02:04:26.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
02:04:26.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.15.239.2 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/krb5kdc/kudu.keytab.
02:04:26.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.15.239.2 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/krb5kdc/kudu.keytab.
02:04:26.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:26.018646 16316 external_mini_cluster.cc:1366] Running /tmp/dist-test-task2tB5Xy/build/tsan/bin/kudu
02:04:26.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-task2tB5Xy/build/tsan/bin/kudu
02:04:26.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/ts-1/wal
02:04:26.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/ts-1/data
02:04:26.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:04:26.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:04:26.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:04:26.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:04:26.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:04:26.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:04:26.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/ts-1/logs
02:04:26.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/ts-1/data/info.pb
02:04:26.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:04:26.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:04:26.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:04:26.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:04:26.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:04:26.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:04:26.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:04:26.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:04:26.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
02:04:26.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:04:26.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.239.2:0
02:04:26.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.15.239.2
02:04:26.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.239.2
02:04:26.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:04:26.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.15.239.62:36255,127.15.239.61:39633,127.15.239.60:35113
02:04:26.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/krb5kdc/kudu.keytab
02:04:26.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.15.239.2
02:04:26.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
02:04:26.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=test-admin
02:04:26.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=test-user
02:04:26.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=true
02:04:26.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.239.20:44727
02:04:26.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:04:26.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:04:26.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:04:26.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=false with env {KRB5CCNAME=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
02:04:26.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:26.349712 16798 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:04:26.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:26.350277 16798 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:04:26.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:26.350986 16798 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:04:26.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:26.386876 16798 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:04:26.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:26.387966 16798 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.2
02:04:26.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:26.432524 16798 tablet_server_runner.cc:78] Tablet server non-default flags:
02:04:26.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:04:26.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.239.20:44727
02:04:26.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:04:26.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:04:26.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/ts-1/data
02:04:26.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/ts-1/wal
02:04:26.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/krb5kdc/kudu.keytab
02:04:26.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.15.239.2
02:04:26.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:04:26.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:04:26.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.239.2:0
02:04:26.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:04:26.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
02:04:26.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=<redacted>
02:04:26.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=<redacted>
02:04:26.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:04:26.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:04:26.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/ts-1/data/info.pb
02:04:26.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.239.2
02:04:26.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:04:26.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.15.239.62:36255,127.15.239.61:39633,127.15.239.60:35113
02:04:26.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:04:26.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:04:26.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:04:26.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:04:26.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:04:26.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.15.239.2
02:04:26.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/ts-1/logs
02:04:26.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:04:26.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:04:26.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:04:26.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
02:04:26.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:04:26.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
02:04:26.434 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:04:26.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 01:43:23 UTC on e7f111948823
02:04:26.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11951
02:04:26.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:04:26.435 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:26.434322 16798 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:04:26.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:26.435775 16798 file_cache.cc:492] Constructed file cache file cache with capacity 419430
02:04:26.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:26.452135 16804 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:26.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:26.923390 16783 heartbeater.cc:499] Master 127.15.239.60:35113 was elected leader, sending a full tablet report...
02:04:28.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:27.855640 16803 debug-util.cc:398] Leaking SignalData structure 0x7b0800037780 after lost signal to thread 16798
02:04:28.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:28.107992 16803 kernel_stack_watchdog.cc:198] Thread 16798 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 399ms:
02:04:28.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
02:04:28.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
02:04:28.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
02:04:28.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
02:04:28.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:26.456499 16805 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:28.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:28.114813 16798 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.660s	user 0.001s	sys 0.006s
02:04:28.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:28.115113 16798 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.661s	user 0.001s	sys 0.006s
02:04:28.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:28.115218 16806 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1652 milliseconds
02:04:28.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:28.117513 16807 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:28.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:28.117515 16798 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
02:04:28.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:28.118904 16798 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:04:28.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:28.120970 16798 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:04:28.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:28.122413 16798 hybrid_clock.cc:648] HybridClock initialized: now 1779069868122380 us; error 35 us; skew 500 ppm
02:04:28.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:28.123361 16798 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:04:28.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 18 02:04:28 dist-test-slave-q2wt krb5kdc[16327](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1779069868, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.2@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
02:04:28.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:28.129863 16798 init.cc:377] Logged in from keytab as kudu/127.15.239.2@KRBTEST.COM (short username kudu)
02:04:28.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:28.134620 16798 webserver.cc:533] Webserver started at http://127.15.239.2:33753/ using document root <none> and password file <none>
02:04:28.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:28.135596 16798 fs_manager.cc:362] Metadata directory not provided
02:04:28.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:28.135846 16798 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:04:28.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:28.136380 16798 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:04:28.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:28.140852 16798 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/ts-1/data/instance:
02:04:28.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b412c1a03a43464e97bb7beac4c05b89"
02:04:28.141 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:04:28 on dist-test-slave-q2wt"
02:04:28.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:28.142071 16798 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/ts-1/wal/instance:
02:04:28.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b412c1a03a43464e97bb7beac4c05b89"
02:04:28.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:04:28 on dist-test-slave-q2wt"
02:04:28.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:28.149674 16798 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.007s	sys 0.001s
02:04:28.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:28.155632 16816 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:04:28.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:28.157177 16798 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.001s
02:04:28.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:28.157488 16798 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/ts-1/data,/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/ts-1/wal
02:04:28.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "b412c1a03a43464e97bb7beac4c05b89"
02:04:28.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:04:28 on dist-test-slave-q2wt"
02:04:28.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:28.157793 16798 fs_report.cc:389] FS layout report
02:04:28.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:04:28.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/ts-1/wal
02:04:28.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/ts-1/wal
02:04:28.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/ts-1/data/data
02:04:28.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:04:28.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:04:28.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:04:28.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:04:28.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:04:28.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:04:28.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:04:28.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:04:28.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:04:28.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:04:28.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:04:28.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:28.211817 16798 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:04:28.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:28.218112 16798 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:04:28.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:28.218535 16798 kserver.cc:163] Server-wide thread pool size limit: 3276
02:04:28.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:28.221225 16798 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
02:04:28.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:28.225553 16798 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
02:04:28.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:28.225757 16798 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
02:04:28.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:28.225955 16798 ts_tablet_manager.cc:616] Registered 0 tablets
02:04:28.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:28.226099 16798 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
02:04:28.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:28.369207 16798 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.2:43249
02:04:28.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:28.369333 16928 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.239.2:43249 every 8 connection(s)
02:04:28.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:28.372167 16798 server_base.cc:1193] Dumped server information to /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/ts-1/data/info.pb
02:04:28.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:28.373430 16316 external_mini_cluster.cc:1428] Started /tmp/dist-test-task2tB5Xy/build/tsan/bin/kudu as pid 16798
02:04:28.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:28.373883 16316 external_mini_cluster.cc:1442] Reading /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/ts-1/wal/instance
02:04:28.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for kudu/127.15.239.3@KRBTEST.COM; defaulting to no policy
02:04:28.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 18 02:04:28 dist-test-slave-q2wt krb5kdc[16327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1779069868, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.2@KRBTEST.COM for kudu/127.15.239.60@KRBTEST.COM
02:04:28.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 18 02:04:28 dist-test-slave-q2wt krb5kdc[16327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1779069868, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.2@KRBTEST.COM for kudu/127.15.239.61@KRBTEST.COM
02:04:28.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
02:04:28.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "kudu/127.15.239.3@KRBTEST.COM" created.
02:04:28.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 18 02:04:28 dist-test-slave-q2wt krb5kdc[16327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1779069868, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.2@KRBTEST.COM for kudu/127.15.239.62@KRBTEST.COM
02:04:28.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:28.459285 16930 heartbeater.cc:344] Connected to a master server at 127.15.239.61:39633
02:04:28.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:28.459888 16930 heartbeater.cc:461] Registering TS with master...
02:04:28.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:28.461447 16930 heartbeater.cc:507] Master 127.15.239.61:39633 requested a full tablet report, sending...
02:04:28.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:28.463316 16929 heartbeater.cc:344] Connected to a master server at 127.15.239.60:35113
02:04:28.464 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:28.463670 16929 heartbeater.cc:461] Registering TS with master...
02:04:28.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:28.464668 16929 heartbeater.cc:507] Master 127.15.239.60:35113 requested a full tablet report, sending...
02:04:28.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:28.464888 16458 ts_manager.cc:194] Registered new tserver with Master: b412c1a03a43464e97bb7beac4c05b89 (127.15.239.2:43249)
02:04:28.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:28.467147 16543 ts_manager.cc:194] Registered new tserver with Master: b412c1a03a43464e97bb7beac4c05b89 (127.15.239.2:43249)
02:04:28.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:28.468963 16543 master_service.cc:502] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.239.2@KRBTEST.COM'} at 127.15.239.2:58015
02:04:28.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:28.472059 16931 heartbeater.cc:344] Connected to a master server at 127.15.239.62:36255
02:04:28.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:28.472411 16931 heartbeater.cc:461] Registering TS with master...
02:04:28.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:28.473132 16931 heartbeater.cc:507] Master 127.15.239.62:36255 requested a full tablet report, sending...
02:04:28.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:28.475706 16378 ts_manager.cc:194] Registered new tserver with Master: b412c1a03a43464e97bb7beac4c05b89 (127.15.239.2:43249)
02:04:28.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
02:04:28.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.15.239.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/krb5kdc/kudu.keytab.
02:04:28.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal kudu/127.15.239.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/krb5kdc/kudu.keytab.
02:04:28.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) WARNING: no policy specified for HTTP/127.15.239.3@KRBTEST.COM; defaulting to no policy
02:04:28.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
02:04:28.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Principal "HTTP/127.15.239.3@KRBTEST.COM" created.
02:04:28.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Authenticating as principal test-admin/admin@KRBTEST.COM with password.
02:04:28.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.15.239.3 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/krb5kdc/kudu.keytab.
02:04:28.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Entry for principal HTTP/127.15.239.3 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/krb5kdc/kudu.keytab.
02:04:28.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:28.529850 16316 external_mini_cluster.cc:1366] Running /tmp/dist-test-task2tB5Xy/build/tsan/bin/kudu
02:04:28.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-task2tB5Xy/build/tsan/bin/kudu
02:04:28.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/ts-2/wal
02:04:28.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/ts-2/data
02:04:28.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
02:04:28.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
02:04:28.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
02:04:28.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:04:28.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:04:28.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:04:28.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/ts-2/logs
02:04:28.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/ts-2/data/info.pb
02:04:28.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:04:28.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
02:04:28.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
02:04:28.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
02:04:28.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
02:04:28.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:04:28.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:04:28.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:04:28.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
02:04:28.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
02:04:28.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.239.3:0
02:04:28.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.15.239.3
02:04:28.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.239.3
02:04:28.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:04:28.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.15.239.62:36255,127.15.239.61:39633,127.15.239.60:35113
02:04:28.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/krb5kdc/kudu.keytab
02:04:28.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.15.239.3
02:04:28.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
02:04:28.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=test-admin
02:04:28.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=test-user
02:04:28.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=true
02:04:28.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.239.20:44727
02:04:28.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:04:28.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:04:28.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:04:28.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_require_spnego=false with env {KRB5CCNAME=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
02:04:28.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:28.859269 16943 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
02:04:28.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:28.859736 16943 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
02:04:28.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:28.860247 16943 flags.cc:432] Enabled unsafe flag: --never_fsync=true
02:04:28.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:28.894865 16943 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
02:04:28.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:28.895747 16943 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.15.239.3
02:04:28.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:28.933683 16943 tablet_server_runner.cc:78] Tablet server non-default flags:
02:04:28.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
02:04:28.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.15.239.20:44727
02:04:28.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
02:04:28.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
02:04:28.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/ts-2/data
02:04:28.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/ts-2/wal
02:04:28.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --keytab_file=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/krb5kdc/kudu.keytab
02:04:28.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --principal=kudu/127.15.239.3
02:04:28.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
02:04:28.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
02:04:28.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.15.239.3:0
02:04:28.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
02:04:28.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_authentication=required
02:04:28.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --superuser_acl=<redacted>
02:04:28.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --user_acl=<redacted>
02:04:28.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
02:04:28.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
02:04:28.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/ts-2/data/info.pb
02:04:28.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.15.239.3
02:04:28.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
02:04:28.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.15.239.62:36255,127.15.239.61:39633,127.15.239.60:35113
02:04:28.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
02:04:28.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
02:04:28.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
02:04:28.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
02:04:28.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
02:04:28.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.15.239.3
02:04:28.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/ts-2/logs
02:04:28.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
02:04:28.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
02:04:28.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
02:04:28.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
02:04:28.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
02:04:28.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
02:04:28.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
02:04:28.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 01:43:23 UTC on e7f111948823
02:04:28.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11951
02:04:28.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
02:04:28.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:28.934953 16943 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
02:04:28.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:28.936201 16943 file_cache.cc:492] Constructed file cache file cache with capacity 419430
02:04:28.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:28.949869 16949 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:29.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:29.472970 16929 heartbeater.cc:499] Master 127.15.239.60:35113 was elected leader, sending a full tablet report...
02:04:30.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:30.353204 16948 debug-util.cc:398] Leaking SignalData structure 0x7b0800037780 after lost signal to thread 16943
02:04:30.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:30.685427 16948 kernel_stack_watchdog.cc:198] Thread 16943 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 401ms:
02:04:30.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
02:04:30.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
02:04:30.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
02:04:30.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
02:04:30.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:28.950249 16950 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:30.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:30.686501 16943 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.737s	user 0.582s	sys 1.112s
02:04:30.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:30.686786 16951 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1736 milliseconds
02:04:30.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:30.686879 16943 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.738s	user 0.582s	sys 1.112s
02:04:30.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:30.688702 16943 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
02:04:30.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:30.688745 16952 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
02:04:30.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:30.692284 16943 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
02:04:30.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:30.694542 16943 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
02:04:30.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:30.695987 16943 hybrid_clock.cc:648] HybridClock initialized: now 1779069870695953 us; error 39 us; skew 500 ppm
02:04:30.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:30.696975 16943 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
02:04:30.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 18 02:04:30 dist-test-slave-q2wt krb5kdc[16327](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1779069870, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.3@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
02:04:30.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:30.703766 16943 init.cc:377] Logged in from keytab as kudu/127.15.239.3@KRBTEST.COM (short username kudu)
02:04:30.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:30.710749 16943 webserver.cc:533] Webserver started at http://127.15.239.3:40767/ using document root <none> and password file <none>
02:04:30.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:30.712209 16943 fs_manager.cc:362] Metadata directory not provided
02:04:30.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:30.712519 16943 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
02:04:30.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:30.713135 16943 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
02:04:30.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:30.717742 16943 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/ts-2/data/instance:
02:04:30.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "194ec164ee1c424a91b9d008d099fdd1"
02:04:30.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:04:30 on dist-test-slave-q2wt"
02:04:30.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:30.719010 16943 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/ts-2/wal/instance:
02:04:30.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "194ec164ee1c424a91b9d008d099fdd1"
02:04:30.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:04:30 on dist-test-slave-q2wt"
02:04:30.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:30.726639 16943 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.000s	sys 0.009s
02:04:30.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:30.732723 16963 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
02:04:30.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:30.734071 16943 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.001s
02:04:30.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:30.734480 16943 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/ts-2/data,/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/ts-2/wal
02:04:30.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "194ec164ee1c424a91b9d008d099fdd1"
02:04:30.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 02:04:30 on dist-test-slave-q2wt"
02:04:30.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:30.734884 16943 fs_report.cc:389] FS layout report
02:04:30.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
02:04:30.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/ts-2/wal
02:04:30.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/ts-2/wal
02:04:30.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/ts-2/data/data
02:04:30.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
02:04:30.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
02:04:30.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
02:04:30.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
02:04:30.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
02:04:30.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
02:04:30.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
02:04:30.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
02:04:30.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
02:04:30.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
02:04:30.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
02:04:30.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:30.790437 16943 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
02:04:30.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:30.800367 16943 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
02:04:30.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:30.801005 16943 kserver.cc:163] Server-wide thread pool size limit: 3276
02:04:30.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:30.804636 16943 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
02:04:30.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:30.809329 16943 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
02:04:30.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:30.809584 16943 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
02:04:30.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:30.809895 16943 ts_tablet_manager.cc:616] Registered 0 tablets
02:04:30.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:30.810117 16943 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
02:04:30.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:30.961155 16943 rpc_server.cc:307] RPC server started. Bound to: 127.15.239.3:43333
02:04:30.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:30.961268 17075 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.15.239.3:43333 every 8 connection(s)
02:04:30.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:30.963951 16943 server_base.cc:1193] Dumped server information to /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/ts-2/data/info.pb
02:04:30.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:30.970891 16316 external_mini_cluster.cc:1428] Started /tmp/dist-test-task2tB5Xy/build/tsan/bin/kudu as pid 16943
02:04:30.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:30.971490 16316 external_mini_cluster.cc:1442] Reading /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/ts-2/wal/instance
02:04:31.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 18 02:04:31 dist-test-slave-q2wt krb5kdc[16327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1779069870, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.3@KRBTEST.COM for kudu/127.15.239.61@KRBTEST.COM
02:04:31.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 18 02:04:31 dist-test-slave-q2wt krb5kdc[16327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1779069870, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.3@KRBTEST.COM for kudu/127.15.239.60@KRBTEST.COM
02:04:31.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 18 02:04:31 dist-test-slave-q2wt krb5kdc[16327](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1779069870, etypes {rep=17 tkt=17 ses=17}, kudu/127.15.239.3@KRBTEST.COM for kudu/127.15.239.62@KRBTEST.COM
02:04:31.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.032083 17077 heartbeater.cc:344] Connected to a master server at 127.15.239.61:39633
02:04:31.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.032701 17077 heartbeater.cc:461] Registering TS with master...
02:04:31.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.034430 17077 heartbeater.cc:507] Master 127.15.239.61:39633 requested a full tablet report, sending...
02:04:31.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.036638 17076 heartbeater.cc:344] Connected to a master server at 127.15.239.60:35113
02:04:31.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.037019 17076 heartbeater.cc:461] Registering TS with master...
02:04:31.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.038295 17076 heartbeater.cc:507] Master 127.15.239.60:35113 requested a full tablet report, sending...
02:04:31.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.041184 16542 ts_manager.cc:194] Registered new tserver with Master: 194ec164ee1c424a91b9d008d099fdd1 (127.15.239.3:43333)
02:04:31.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.041755 16458 ts_manager.cc:194] Registered new tserver with Master: 194ec164ee1c424a91b9d008d099fdd1 (127.15.239.3:43333)
02:04:31.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.043385 16542 master_service.cc:502] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.15.239.3@KRBTEST.COM'} at 127.15.239.3:60299
02:04:31.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.046569 17078 heartbeater.cc:344] Connected to a master server at 127.15.239.62:36255
02:04:31.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.047021 17078 heartbeater.cc:461] Registering TS with master...
02:04:31.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.047765 17078 heartbeater.cc:507] Master 127.15.239.62:36255 requested a full tablet report, sending...
02:04:31.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.050184 16378 ts_manager.cc:194] Registered new tserver with Master: 194ec164ee1c424a91b9d008d099fdd1 (127.15.239.3:43333)
02:04:31.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.063555 16316 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
02:04:31.076 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
02:04:31.077 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_kdc_env_vars {
}

02:04:31.078 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_kdc_env_vars {
  env_vars {
    key: "KRB5CCNAME"
    value: "/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/krb5kdc/krb5cc"
  }
  env_vars {
    key: "KRB5_CONFIG"
    value: "/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/krb5kdc/krb5.conf"
  }
  env_vars {
    key: "KRB5_KDC_PROFILE"
    value: "/tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/krb5kdc/kdc.conf"
  }
  env_vars {
    key: "KUDU_ENABLE_KRB5_REALM_FIX"
    value: "yes"
  }
}

02:04:31.078 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

02:04:31.082 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.15.239.62"
      port: 36255
    }
    bound_http_address {
      host: "127.15.239.62"
      port: 37095
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.15.239.61"
      port: 39633
    }
    bound_http_address {
      host: "127.15.239.61"
      port: 33125
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.15.239.60"
      port: 35113
    }
    bound_http_address {
      host: "127.15.239.60"
      port: 34169
    }
  }
}

02:04:31.082 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

02:04:31.085 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.15.239.1"
      port: 41753
    }
    bound_http_address {
      host: "127.15.239.1"
      port: 38877
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.15.239.2"
      port: 43249
    }
    bound_http_address {
      host: "127.15.239.2"
      port: 33753
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.15.239.3"
      port: 43333
    }
    bound_http_address {
      host: "127.15.239.3"
      port: 40767
    }
  }
}

02:04:31.085 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
02:04:31.087 [DEBUG - main] (SecurityUtil.java:105) Using ticketCache: /tmp/dist-test-task2tB5Xy/test-tmp/mini-kudu-cluster4721961075132620962/krb5kdc/krb5cc
02:04:31.089 [DEBUG - main] (SecurityUtil.java:119) Logged in as subject: test-admin@KRBTEST.COM
02:04:31.091 [DEBUG - main] (Connection.java:748) [peer master-127.15.239.60:35113(127.15.239.60:35113)] connecting to peer
02:04:31.093 [DEBUG - main] (Connection.java:748) [peer master-127.15.239.61:39633(127.15.239.61:39633)] connecting to peer
02:04:31.094 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.15.239.60:35113(127.15.239.60:35113)] Successfully connected to peer
02:04:31.095 [DEBUG - main] (Connection.java:748) [peer master-127.15.239.62:36255(127.15.239.62:36255)] connecting to peer
02:04:31.097 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.15.239.62:36255(127.15.239.62:36255)] Successfully connected to peer
02:04:31.100 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism GSSAPI chosen for peer 127.15.239.60
02:04:31.102 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.15.239.61:39633(127.15.239.61:39633)] Successfully connected to peer
02:04:31.108 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism GSSAPI chosen for peer 127.15.239.62
02:04:31.110 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism GSSAPI chosen for peer 127.15.239.61
02:04:31.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 18 02:04:31 dist-test-slave-q2wt krb5kdc[16327](info): TGS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1779069855, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.239.60@KRBTEST.COM
02:04:31.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 18 02:04:31 dist-test-slave-q2wt krb5kdc[16327](info): TGS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1779069855, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.239.62@KRBTEST.COM
02:04:31.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) May 18 02:04:31 dist-test-slave-q2wt krb5kdc[16327](info): TGS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1779069855, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.15.239.61@KRBTEST.COM
02:04:31.148 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x7c205928, L:/127.0.0.1:42764 - R:/127.15.239.62:36255] using SASL/GSSAPI
02:04:31.158 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x00123e11, L:/127.0.0.1:33802 - R:/127.15.239.60:35113] using SASL/GSSAPI
02:04:31.163 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
02:04:31.164 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=73), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.239.60:35113, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.239.61:39633, [4ms] Sub RPC ConnectToMaster: sending RPC to server master-127.15.239.62:36255, [61ms] Sub RPC ConnectToMaster: received response from server master-127.15.239.62:36255: OK, [71ms] Sub RPC ConnectToMaster: received response from server master-127.15.239.60:35113: OK, deferred=null) after lookup
02:04:31.165 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xf0c00dc4, L:/127.0.0.1:46310 - R:/127.15.239.61:39633] using SASL/GSSAPI
02:04:31.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.167183 16542 catalog_manager.cc:2282] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:33802:
02:04:31.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "TestAuthzTokenCache-table"
02:04:31.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
02:04:31.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
02:04:31.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key"
02:04:31.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
02:04:31.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
02:04:31.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
02:04:31.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
02:04:31.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
02:04:31.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
02:04:31.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:04:31.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
02:04:31.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column1_i"
02:04:31.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
02:04:31.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
02:04:31.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
02:04:31.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
02:04:31.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
02:04:31.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
02:04:31.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:04:31.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
02:04:31.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column2_i"
02:04:31.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
02:04:31.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
02:04:31.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
02:04:31.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
02:04:31.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
02:04:31.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
02:04:31.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:04:31.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
02:04:31.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column3_s"
02:04:31.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
02:04:31.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
02:04:31.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: true
02:04:31.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: DICT_ENCODING
02:04:31.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: LZ4
02:04:31.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 4096
02:04:31.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
02:04:31.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
02:04:31.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:04:31.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
02:04:31.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column4_b"
02:04:31.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BOOL
02:04:31.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
02:04:31.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
02:04:31.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
02:04:31.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
02:04:31.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
02:04:31.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:04:31.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
02:04:31.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
02:04:31.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
02:04:31.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
02:04:31.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key"
02:04:31.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
02:04:31.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
02:04:31.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
02:04:31.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:31.171765 16542 catalog_manager.cc:7058] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table TestAuthzTokenCache-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
02:04:31.208 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 7532f5f2fdbb4795a7999b0f8a16037b
02:04:31.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.244665 16718 tablet_service.cc:1511] Processing CreateTablet for tablet d511a1f5f1c340fb807f8f4bcc88aca0 (DEFAULT_TABLE table=TestAuthzTokenCache-table [id=7532f5f2fdbb4795a7999b0f8a16037b]), partition=RANGE (key) PARTITION UNBOUNDED
02:04:31.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.246248 16718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d511a1f5f1c340fb807f8f4bcc88aca0. 1 dirs total, 0 dirs full, 0 dirs failed
02:04:31.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.280722 17107 tablet_bootstrap.cc:492] T d511a1f5f1c340fb807f8f4bcc88aca0 P 76eeaaee714844158f4db95d1c6f1b1d: Bootstrap starting.
02:04:31.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.288928 17107 tablet_bootstrap.cc:654] T d511a1f5f1c340fb807f8f4bcc88aca0 P 76eeaaee714844158f4db95d1c6f1b1d: Neither blocks nor log segments found. Creating new log.
02:04:31.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.291536 17107 log.cc:826] T d511a1f5f1c340fb807f8f4bcc88aca0 P 76eeaaee714844158f4db95d1c6f1b1d: Log is configured to *not* fsync() on all Append() calls
02:04:31.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.292229 17011 tablet_service.cc:1511] Processing CreateTablet for tablet d511a1f5f1c340fb807f8f4bcc88aca0 (DEFAULT_TABLE table=TestAuthzTokenCache-table [id=7532f5f2fdbb4795a7999b0f8a16037b]), partition=RANGE (key) PARTITION UNBOUNDED
02:04:31.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.294520 17011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d511a1f5f1c340fb807f8f4bcc88aca0. 1 dirs total, 0 dirs full, 0 dirs failed
02:04:31.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.294121 16864 tablet_service.cc:1511] Processing CreateTablet for tablet d511a1f5f1c340fb807f8f4bcc88aca0 (DEFAULT_TABLE table=TestAuthzTokenCache-table [id=7532f5f2fdbb4795a7999b0f8a16037b]), partition=RANGE (key) PARTITION UNBOUNDED
02:04:31.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.297135 16864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d511a1f5f1c340fb807f8f4bcc88aca0. 1 dirs total, 0 dirs full, 0 dirs failed
02:04:31.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.299278 17107 tablet_bootstrap.cc:492] T d511a1f5f1c340fb807f8f4bcc88aca0 P 76eeaaee714844158f4db95d1c6f1b1d: No bootstrap required, opened a new log
02:04:31.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.299842 17107 ts_tablet_manager.cc:1403] T d511a1f5f1c340fb807f8f4bcc88aca0 P 76eeaaee714844158f4db95d1c6f1b1d: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.004s
02:04:31.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.327148 17107 raft_consensus.cc:359] T d511a1f5f1c340fb807f8f4bcc88aca0 P 76eeaaee714844158f4db95d1c6f1b1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76eeaaee714844158f4db95d1c6f1b1d" member_type: VOTER last_known_addr { host: "127.15.239.1" port: 41753 } } peers { permanent_uuid: "194ec164ee1c424a91b9d008d099fdd1" member_type: VOTER last_known_addr { host: "127.15.239.3" port: 43333 } } peers { permanent_uuid: "b412c1a03a43464e97bb7beac4c05b89" member_type: VOTER last_known_addr { host: "127.15.239.2" port: 43249 } }
02:04:31.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.328101 17107 raft_consensus.cc:385] T d511a1f5f1c340fb807f8f4bcc88aca0 P 76eeaaee714844158f4db95d1c6f1b1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:04:31.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.328410 17107 raft_consensus.cc:740] T d511a1f5f1c340fb807f8f4bcc88aca0 P 76eeaaee714844158f4db95d1c6f1b1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 76eeaaee714844158f4db95d1c6f1b1d, State: Initialized, Role: FOLLOWER
02:04:31.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.329399 17107 consensus_queue.cc:260] T d511a1f5f1c340fb807f8f4bcc88aca0 P 76eeaaee714844158f4db95d1c6f1b1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76eeaaee714844158f4db95d1c6f1b1d" member_type: VOTER last_known_addr { host: "127.15.239.1" port: 41753 } } peers { permanent_uuid: "194ec164ee1c424a91b9d008d099fdd1" member_type: VOTER last_known_addr { host: "127.15.239.3" port: 43333 } } peers { permanent_uuid: "b412c1a03a43464e97bb7beac4c05b89" member_type: VOTER last_known_addr { host: "127.15.239.2" port: 43249 } }
02:04:31.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.331073 17109 tablet_bootstrap.cc:492] T d511a1f5f1c340fb807f8f4bcc88aca0 P 194ec164ee1c424a91b9d008d099fdd1: Bootstrap starting.
02:04:31.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.342219 17107 ts_tablet_manager.cc:1434] T d511a1f5f1c340fb807f8f4bcc88aca0 P 76eeaaee714844158f4db95d1c6f1b1d: Time spent starting tablet: real 0.042s	user 0.026s	sys 0.010s
02:04:31.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.344762 17110 tablet_bootstrap.cc:492] T d511a1f5f1c340fb807f8f4bcc88aca0 P b412c1a03a43464e97bb7beac4c05b89: Bootstrap starting.
02:04:31.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.352555 17110 tablet_bootstrap.cc:654] T d511a1f5f1c340fb807f8f4bcc88aca0 P b412c1a03a43464e97bb7beac4c05b89: Neither blocks nor log segments found. Creating new log.
02:04:31.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.356086 17110 log.cc:826] T d511a1f5f1c340fb807f8f4bcc88aca0 P b412c1a03a43464e97bb7beac4c05b89: Log is configured to *not* fsync() on all Append() calls
02:04:31.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.356849 17109 tablet_bootstrap.cc:654] T d511a1f5f1c340fb807f8f4bcc88aca0 P 194ec164ee1c424a91b9d008d099fdd1: Neither blocks nor log segments found. Creating new log.
02:04:31.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.359721 17109 log.cc:826] T d511a1f5f1c340fb807f8f4bcc88aca0 P 194ec164ee1c424a91b9d008d099fdd1: Log is configured to *not* fsync() on all Append() calls
02:04:31.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.374131 17110 tablet_bootstrap.cc:492] T d511a1f5f1c340fb807f8f4bcc88aca0 P b412c1a03a43464e97bb7beac4c05b89: No bootstrap required, opened a new log
02:04:31.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.374248 17109 tablet_bootstrap.cc:492] T d511a1f5f1c340fb807f8f4bcc88aca0 P 194ec164ee1c424a91b9d008d099fdd1: No bootstrap required, opened a new log
02:04:31.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.374720 17109 ts_tablet_manager.cc:1403] T d511a1f5f1c340fb807f8f4bcc88aca0 P 194ec164ee1c424a91b9d008d099fdd1: Time spent bootstrapping tablet: real 0.044s	user 0.012s	sys 0.011s
02:04:31.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.374720 17110 ts_tablet_manager.cc:1403] T d511a1f5f1c340fb807f8f4bcc88aca0 P b412c1a03a43464e97bb7beac4c05b89: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.012s
02:04:31.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:31.394989 16791 tablet.cc:2404] T d511a1f5f1c340fb807f8f4bcc88aca0 P 76eeaaee714844158f4db95d1c6f1b1d: Can't schedule compaction. Clean time has not been advanced past its initial value.
02:04:31.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.404187 17109 raft_consensus.cc:359] T d511a1f5f1c340fb807f8f4bcc88aca0 P 194ec164ee1c424a91b9d008d099fdd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76eeaaee714844158f4db95d1c6f1b1d" member_type: VOTER last_known_addr { host: "127.15.239.1" port: 41753 } } peers { permanent_uuid: "194ec164ee1c424a91b9d008d099fdd1" member_type: VOTER last_known_addr { host: "127.15.239.3" port: 43333 } } peers { permanent_uuid: "b412c1a03a43464e97bb7beac4c05b89" member_type: VOTER last_known_addr { host: "127.15.239.2" port: 43249 } }
02:04:31.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.405261 17109 raft_consensus.cc:385] T d511a1f5f1c340fb807f8f4bcc88aca0 P 194ec164ee1c424a91b9d008d099fdd1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:04:31.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.405596 17109 raft_consensus.cc:740] T d511a1f5f1c340fb807f8f4bcc88aca0 P 194ec164ee1c424a91b9d008d099fdd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 194ec164ee1c424a91b9d008d099fdd1, State: Initialized, Role: FOLLOWER
02:04:31.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.406176 17110 raft_consensus.cc:359] T d511a1f5f1c340fb807f8f4bcc88aca0 P b412c1a03a43464e97bb7beac4c05b89 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76eeaaee714844158f4db95d1c6f1b1d" member_type: VOTER last_known_addr { host: "127.15.239.1" port: 41753 } } peers { permanent_uuid: "194ec164ee1c424a91b9d008d099fdd1" member_type: VOTER last_known_addr { host: "127.15.239.3" port: 43333 } } peers { permanent_uuid: "b412c1a03a43464e97bb7beac4c05b89" member_type: VOTER last_known_addr { host: "127.15.239.2" port: 43249 } }
02:04:31.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.407089 17110 raft_consensus.cc:385] T d511a1f5f1c340fb807f8f4bcc88aca0 P b412c1a03a43464e97bb7beac4c05b89 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
02:04:31.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.406661 17109 consensus_queue.cc:260] T d511a1f5f1c340fb807f8f4bcc88aca0 P 194ec164ee1c424a91b9d008d099fdd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76eeaaee714844158f4db95d1c6f1b1d" member_type: VOTER last_known_addr { host: "127.15.239.1" port: 41753 } } peers { permanent_uuid: "194ec164ee1c424a91b9d008d099fdd1" member_type: VOTER last_known_addr { host: "127.15.239.3" port: 43333 } } peers { permanent_uuid: "b412c1a03a43464e97bb7beac4c05b89" member_type: VOTER last_known_addr { host: "127.15.239.2" port: 43249 } }
02:04:31.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.407403 17110 raft_consensus.cc:740] T d511a1f5f1c340fb807f8f4bcc88aca0 P b412c1a03a43464e97bb7beac4c05b89 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b412c1a03a43464e97bb7beac4c05b89, State: Initialized, Role: FOLLOWER
02:04:31.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.408720 17110 consensus_queue.cc:260] T d511a1f5f1c340fb807f8f4bcc88aca0 P b412c1a03a43464e97bb7beac4c05b89 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76eeaaee714844158f4db95d1c6f1b1d" member_type: VOTER last_known_addr { host: "127.15.239.1" port: 41753 } } peers { permanent_uuid: "194ec164ee1c424a91b9d008d099fdd1" member_type: VOTER last_known_addr { host: "127.15.239.3" port: 43333 } } peers { permanent_uuid: "b412c1a03a43464e97bb7beac4c05b89" member_type: VOTER last_known_addr { host: "127.15.239.2" port: 43249 } }
02:04:31.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.410348 17076 heartbeater.cc:499] Master 127.15.239.60:35113 was elected leader, sending a full tablet report...
02:04:31.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.411093 17109 ts_tablet_manager.cc:1434] T d511a1f5f1c340fb807f8f4bcc88aca0 P 194ec164ee1c424a91b9d008d099fdd1: Time spent starting tablet: real 0.036s	user 0.028s	sys 0.007s
02:04:31.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.414587 17110 ts_tablet_manager.cc:1434] T d511a1f5f1c340fb807f8f4bcc88aca0 P b412c1a03a43464e97bb7beac4c05b89: Time spent starting tablet: real 0.040s	user 0.031s	sys 0.005s
02:04:31.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:31.495164 17083 tablet.cc:2404] T d511a1f5f1c340fb807f8f4bcc88aca0 P 194ec164ee1c424a91b9d008d099fdd1: Can't schedule compaction. Clean time has not been advanced past its initial value.
02:04:31.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.568215 17115 raft_consensus.cc:493] T d511a1f5f1c340fb807f8f4bcc88aca0 P b412c1a03a43464e97bb7beac4c05b89 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
02:04:31.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.568909 17115 raft_consensus.cc:515] T d511a1f5f1c340fb807f8f4bcc88aca0 P b412c1a03a43464e97bb7beac4c05b89 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76eeaaee714844158f4db95d1c6f1b1d" member_type: VOTER last_known_addr { host: "127.15.239.1" port: 41753 } } peers { permanent_uuid: "194ec164ee1c424a91b9d008d099fdd1" member_type: VOTER last_known_addr { host: "127.15.239.3" port: 43333 } } peers { permanent_uuid: "b412c1a03a43464e97bb7beac4c05b89" member_type: VOTER last_known_addr { host: "127.15.239.2" port: 43249 } }
02:04:31.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.571389 17115 leader_election.cc:290] T d511a1f5f1c340fb807f8f4bcc88aca0 P b412c1a03a43464e97bb7beac4c05b89 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 76eeaaee714844158f4db95d1c6f1b1d (127.15.239.1:41753), 194ec164ee1c424a91b9d008d099fdd1 (127.15.239.3:43333)
02:04:31.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.584563 17031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d511a1f5f1c340fb807f8f4bcc88aca0" candidate_uuid: "b412c1a03a43464e97bb7beac4c05b89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "194ec164ee1c424a91b9d008d099fdd1" is_pre_election: true
02:04:31.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.585085 16738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d511a1f5f1c340fb807f8f4bcc88aca0" candidate_uuid: "b412c1a03a43464e97bb7beac4c05b89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76eeaaee714844158f4db95d1c6f1b1d" is_pre_election: true
02:04:31.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.585501 17031 raft_consensus.cc:2468] T d511a1f5f1c340fb807f8f4bcc88aca0 P 194ec164ee1c424a91b9d008d099fdd1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b412c1a03a43464e97bb7beac4c05b89 in term 0.
02:04:31.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.585983 16738 raft_consensus.cc:2468] T d511a1f5f1c340fb807f8f4bcc88aca0 P 76eeaaee714844158f4db95d1c6f1b1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b412c1a03a43464e97bb7beac4c05b89 in term 0.
02:04:31.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.587110 16820 leader_election.cc:304] T d511a1f5f1c340fb807f8f4bcc88aca0 P b412c1a03a43464e97bb7beac4c05b89 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 194ec164ee1c424a91b9d008d099fdd1, b412c1a03a43464e97bb7beac4c05b89; no voters: 
02:04:31.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.588006 17115 raft_consensus.cc:2804] T d511a1f5f1c340fb807f8f4bcc88aca0 P b412c1a03a43464e97bb7beac4c05b89 [term 0 FOLLOWER]: Leader pre-election won for term 1
02:04:31.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.588346 17115 raft_consensus.cc:493] T d511a1f5f1c340fb807f8f4bcc88aca0 P b412c1a03a43464e97bb7beac4c05b89 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
02:04:31.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.588721 17115 raft_consensus.cc:3060] T d511a1f5f1c340fb807f8f4bcc88aca0 P b412c1a03a43464e97bb7beac4c05b89 [term 0 FOLLOWER]: Advancing to term 1
02:04:31.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.593490 17115 raft_consensus.cc:515] T d511a1f5f1c340fb807f8f4bcc88aca0 P b412c1a03a43464e97bb7beac4c05b89 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76eeaaee714844158f4db95d1c6f1b1d" member_type: VOTER last_known_addr { host: "127.15.239.1" port: 41753 } } peers { permanent_uuid: "194ec164ee1c424a91b9d008d099fdd1" member_type: VOTER last_known_addr { host: "127.15.239.3" port: 43333 } } peers { permanent_uuid: "b412c1a03a43464e97bb7beac4c05b89" member_type: VOTER last_known_addr { host: "127.15.239.2" port: 43249 } }
02:04:31.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.595031 17115 leader_election.cc:290] T d511a1f5f1c340fb807f8f4bcc88aca0 P b412c1a03a43464e97bb7beac4c05b89 [CANDIDATE]: Term 1 election: Requested vote from peers 76eeaaee714844158f4db95d1c6f1b1d (127.15.239.1:41753), 194ec164ee1c424a91b9d008d099fdd1 (127.15.239.3:43333)
02:04:31.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.596205 17031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d511a1f5f1c340fb807f8f4bcc88aca0" candidate_uuid: "b412c1a03a43464e97bb7beac4c05b89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "194ec164ee1c424a91b9d008d099fdd1"
02:04:31.596 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.596206 16738 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d511a1f5f1c340fb807f8f4bcc88aca0" candidate_uuid: "b412c1a03a43464e97bb7beac4c05b89" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "76eeaaee714844158f4db95d1c6f1b1d"
02:04:31.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.596830 16738 raft_consensus.cc:3060] T d511a1f5f1c340fb807f8f4bcc88aca0 P 76eeaaee714844158f4db95d1c6f1b1d [term 0 FOLLOWER]: Advancing to term 1
02:04:31.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.596801 17031 raft_consensus.cc:3060] T d511a1f5f1c340fb807f8f4bcc88aca0 P 194ec164ee1c424a91b9d008d099fdd1 [term 0 FOLLOWER]: Advancing to term 1
02:04:31.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.604300 17031 raft_consensus.cc:2468] T d511a1f5f1c340fb807f8f4bcc88aca0 P 194ec164ee1c424a91b9d008d099fdd1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b412c1a03a43464e97bb7beac4c05b89 in term 1.
02:04:31.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.604300 16738 raft_consensus.cc:2468] T d511a1f5f1c340fb807f8f4bcc88aca0 P 76eeaaee714844158f4db95d1c6f1b1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b412c1a03a43464e97bb7beac4c05b89 in term 1.
02:04:31.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.605614 16818 leader_election.cc:304] T d511a1f5f1c340fb807f8f4bcc88aca0 P b412c1a03a43464e97bb7beac4c05b89 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 76eeaaee714844158f4db95d1c6f1b1d, b412c1a03a43464e97bb7beac4c05b89; no voters: 
02:04:31.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.606413 17115 raft_consensus.cc:2804] T d511a1f5f1c340fb807f8f4bcc88aca0 P b412c1a03a43464e97bb7beac4c05b89 [term 1 FOLLOWER]: Leader election won for term 1
02:04:31.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.608180 17115 raft_consensus.cc:697] T d511a1f5f1c340fb807f8f4bcc88aca0 P b412c1a03a43464e97bb7beac4c05b89 [term 1 LEADER]: Becoming Leader. State: Replica: b412c1a03a43464e97bb7beac4c05b89, State: Running, Role: LEADER
02:04:31.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.609161 17115 consensus_queue.cc:237] T d511a1f5f1c340fb807f8f4bcc88aca0 P b412c1a03a43464e97bb7beac4c05b89 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76eeaaee714844158f4db95d1c6f1b1d" member_type: VOTER last_known_addr { host: "127.15.239.1" port: 41753 } } peers { permanent_uuid: "194ec164ee1c424a91b9d008d099fdd1" member_type: VOTER last_known_addr { host: "127.15.239.3" port: 43333 } } peers { permanent_uuid: "b412c1a03a43464e97bb7beac4c05b89" member_type: VOTER last_known_addr { host: "127.15.239.2" port: 43249 } }
02:04:31.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:31.623869 16543 catalog_manager.cc:5696] T d511a1f5f1c340fb807f8f4bcc88aca0 P b412c1a03a43464e97bb7beac4c05b89 reported cstate change: term changed from 0 to 1, leader changed from <none> to b412c1a03a43464e97bb7beac4c05b89 (127.15.239.2). New cstate: current_term: 1 leader_uuid: "b412c1a03a43464e97bb7beac4c05b89" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "76eeaaee714844158f4db95d1c6f1b1d" member_type: VOTER last_known_addr { host: "127.15.239.1" port: 41753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "194ec164ee1c424a91b9d008d099fdd1" member_type: VOTER last_known_addr { host: "127.15.239.3" port: 43333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b412c1a03a43464e97bb7beac4c05b89" member_type: VOTER last_known_addr { host: "127.15.239.2" port: 43249 } health_report { overall_health: HEALTHY } } }
02:04:31.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:31.647264 16935 tablet.cc:2404] T d511a1f5f1c340fb807f8f4bcc88aca0 P b412c1a03a43464e97bb7beac4c05b89: Can't schedule compaction. Clean time has not been advanced past its initial value.
02:04:31.917 [DEBUG - pool-6-thread-1] (AuthzTokenCache.java:153) sending RPC to retrieve token for table ID 7532f5f2fdbb4795a7999b0f8a16037b
02:04:31.922 [DEBUG - kudu-nio-0] (AuthzTokenCache.java:193) retrieved authz token for 7532f5f2fdbb4795a7999b0f8a16037b
02:04:31.924 [DEBUG - pool-6-thread-13] (AuthzTokenCache.java:153) sending RPC to retrieve token for table ID 7532f5f2fdbb4795a7999b0f8a16037b
02:04:31.933 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet d511a1f5f1c340fb807f8f4bcc88aca0 for table 'TestAuthzTokenCache-table' with partition [<start>, <end>)
02:04:31.933 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=d511a1f5f1c340fb807f8f4bcc88aca0@[194ec164ee1c424a91b9d008d099fdd1(127.15.239.3:43333),76eeaaee714844158f4db95d1c6f1b1d(127.15.239.1:41753),b412c1a03a43464e97bb7beac4c05b89(127.15.239.2:43249)[L]]}]
02:04:31.934 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=17), Traces: [0ms] sending RPC to server master-127.15.239.60:35113, [5ms] received response from server master-127.15.239.60:35113: OK, [5ms] Sub RPC Scan: refreshing cache from master, [6ms] Sub RPC GetTableLocations: sending RPC to server master-127.15.239.60:35113, [16ms] Sub RPC GetTableLocations: received response from server master-127.15.239.60:35113: OK, deferred=Deferred@1499775140(state=PENDING, result=null, callback=wakeup thread pool-6-thread-1, errback=wakeup thread pool-6-thread-1))) after lookup
02:04:31.935 [DEBUG - kudu-nio-0] (Connection.java:748) [peer b412c1a03a43464e97bb7beac4c05b89(127.15.239.2:43249)] connecting to peer
02:04:31.942 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet d511a1f5f1c340fb807f8f4bcc88aca0 for table 'TestAuthzTokenCache-table' with partition [<start>, <end>)
02:04:31.942 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=d511a1f5f1c340fb807f8f4bcc88aca0@[194ec164ee1c424a91b9d008d099fdd1(127.15.239.3:43333),76eeaaee714844158f4db95d1c6f1b1d(127.15.239.1:41753),b412c1a03a43464e97bb7beac4c05b89(127.15.239.2:43249)[L]]}]
02:04:31.943 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=26), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC GetTableLocations: sending RPC to server master-127.15.239.60:35113, [18ms] Sub RPC GetTableLocations: received response from server master-127.15.239.60:35113: OK, deferred=Deferred@1113623717(state=PENDING, result=null, callback=wakeup thread pool-6-thread-3, errback=wakeup thread pool-6-thread-3))) after lookup
02:04:31.945 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet d511a1f5f1c340fb807f8f4bcc88aca0 for table 'TestAuthzTokenCache-table' with partition [<start>, <end>)
02:04:31.945 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=d511a1f5f1c340fb807f8f4bcc88aca0@[194ec164ee1c424a91b9d008d099fdd1(127.15.239.3:43333),76eeaaee714844158f4db95d1c6f1b1d(127.15.239.1:41753),b412c1a03a43464e97bb7beac4c05b89(127.15.239.2:43249)[L]]}]
02:04:31.945 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=27), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.15.239.60:35113, [19ms] Sub RPC GetTableLocations: received response from server master-127.15.239.60:35113: OK, deferred=Deferred@2145079455(state=PENDING, result=null, callback=wakeup thread pool-6-thread-6, errback=wakeup thread pool-6-thread-6))) after lookup
02:04:31.947 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet d511a1f5f1c340fb807f8f4bcc88aca0 for table 'TestAuthzTokenCache-table' with partition [<start>, <end>)
02:04:31.947 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=d511a1f5f1c340fb807f8f4bcc88aca0@[194ec164ee1c424a91b9d008d099fdd1(127.15.239.3:43333),76eeaaee714844158f4db95d1c6f1b1d(127.15.239.1:41753),b412c1a03a43464e97bb7beac4c05b89(127.15.239.2:43249)[L]]}]
02:04:31.947 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=28), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.15.239.60:35113, [20ms] Sub RPC GetTableLocations: received response from server master-127.15.239.60:35113: OK, deferred=Deferred@1954135702(state=PENDING, result=null, callback=wakeup thread pool-6-thread-7, errback=wakeup thread pool-6-thread-7))) after lookup
02:04:31.949 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet d511a1f5f1c340fb807f8f4bcc88aca0 for table 'TestAuthzTokenCache-table' with partition [<start>, <end>)
02:04:31.949 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=d511a1f5f1c340fb807f8f4bcc88aca0@[194ec164ee1c424a91b9d008d099fdd1(127.15.239.3:43333),76eeaaee714844158f4db95d1c6f1b1d(127.15.239.1:41753),b412c1a03a43464e97bb7beac4c05b89(127.15.239.2:43249)[L]]}]
02:04:31.949 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=30), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.15.239.60:35113, [22ms] Sub RPC GetTableLocations: received response from server master-127.15.239.60:35113: OK, deferred=Deferred@183692611(state=PENDING, result=null, callback=wakeup thread pool-6-thread-8, errback=wakeup thread pool-6-thread-8))) after lookup
02:04:31.950 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet d511a1f5f1c340fb807f8f4bcc88aca0 for table 'TestAuthzTokenCache-table' with partition [<start>, <end>)
02:04:31.950 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=d511a1f5f1c340fb807f8f4bcc88aca0@[194ec164ee1c424a91b9d008d099fdd1(127.15.239.3:43333),76eeaaee714844158f4db95d1c6f1b1d(127.15.239.1:41753),b412c1a03a43464e97bb7beac4c05b89(127.15.239.2:43249)[L]]}]
02:04:31.951 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=32), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.15.239.60:35113, [23ms] Sub RPC GetTableLocations: received response from server master-127.15.239.60:35113: OK, deferred=Deferred@1364238144(state=PENDING, result=null, callback=wakeup thread pool-6-thread-5, errback=wakeup thread pool-6-thread-5))) after lookup
02:04:31.952 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet d511a1f5f1c340fb807f8f4bcc88aca0 for table 'TestAuthzTokenCache-table' with partition [<start>, <end>)
02:04:31.952 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=d511a1f5f1c340fb807f8f4bcc88aca0@[194ec164ee1c424a91b9d008d099fdd1(127.15.239.3:43333),76eeaaee714844158f4db95d1c6f1b1d(127.15.239.1:41753),b412c1a03a43464e97bb7beac4c05b89(127.15.239.2:43249)[L]]}]
02:04:31.952 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=34), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.15.239.60:35113, [23ms] Sub RPC GetTableLocations: received response from server master-127.15.239.60:35113: OK, deferred=Deferred@600718391(state=PENDING, result=null, callback=wakeup thread pool-6-thread-4, errback=wakeup thread pool-6-thread-4))) after lookup
02:04:31.953 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet d511a1f5f1c340fb807f8f4bcc88aca0 for table 'TestAuthzTokenCache-table' with partition [<start>, <end>)
02:04:31.953 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=d511a1f5f1c340fb807f8f4bcc88aca0@[194ec164ee1c424a91b9d008d099fdd1(127.15.239.3:43333),76eeaaee714844158f4db95d1c6f1b1d(127.15.239.1:41753),b412c1a03a43464e97bb7beac4c05b89(127.15.239.2:43249)[L]]}]
02:04:31.953 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=34), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.15.239.60:35113, [25ms] Sub RPC GetTableLocations: received response from server master-127.15.239.60:35113: OK, deferred=Deferred@1049844633(state=PENDING, result=null, callback=wakeup thread pool-6-thread-9, errback=wakeup thread pool-6-thread-9))) after lookup
02:04:31.954 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet d511a1f5f1c340fb807f8f4bcc88aca0 for table 'TestAuthzTokenCache-table' with partition [<start>, <end>)
02:04:31.955 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=d511a1f5f1c340fb807f8f4bcc88aca0@[194ec164ee1c424a91b9d008d099fdd1(127.15.239.3:43333),76eeaaee714844158f4db95d1c6f1b1d(127.15.239.1:41753),b412c1a03a43464e97bb7beac4c05b89(127.15.239.2:43249)[L]]}]
02:04:31.955 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=37), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.15.239.60:35113, [25ms] Sub RPC GetTableLocations: received response from server master-127.15.239.60:35113: OK, deferred=Deferred@141759335(state=PENDING, result=null, callback=wakeup thread pool-6-thread-2, errback=wakeup thread pool-6-thread-2))) after lookup
02:04:31.955 [DEBUG - kudu-nio-3] (Connection.java:757) [peer b412c1a03a43464e97bb7beac4c05b89(127.15.239.2:43249)] Successfully connected to peer
02:04:31.956 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet d511a1f5f1c340fb807f8f4bcc88aca0 for table 'TestAuthzTokenCache-table' with partition [<start>, <end>)
02:04:31.957 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=d511a1f5f1c340fb807f8f4bcc88aca0@[194ec164ee1c424a91b9d008d099fdd1(127.15.239.3:43333),76eeaaee714844158f4db95d1c6f1b1d(127.15.239.1:41753),b412c1a03a43464e97bb7beac4c05b89(127.15.239.2:43249)[L]]}]
02:04:31.957 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=37), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC GetTableLocations: sending RPC to server master-127.15.239.60:35113, [27ms] Sub RPC GetTableLocations: received response from server master-127.15.239.60:35113: OK, deferred=Deferred@610599010(state=PENDING, result=null, callback=wakeup thread pool-6-thread-11, errback=wakeup thread pool-6-thread-11))) after lookup
02:04:31.958 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet d511a1f5f1c340fb807f8f4bcc88aca0 for table 'TestAuthzTokenCache-table' with partition [<start>, <end>)
02:04:31.958 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=d511a1f5f1c340fb807f8f4bcc88aca0@[194ec164ee1c424a91b9d008d099fdd1(127.15.239.3:43333),76eeaaee714844158f4db95d1c6f1b1d(127.15.239.1:41753),b412c1a03a43464e97bb7beac4c05b89(127.15.239.2:43249)[L]]}]
02:04:31.958 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=37), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.15.239.60:35113, [28ms] Sub RPC GetTableLocations: received response from server master-127.15.239.60:35113: OK, deferred=Deferred@455135175(state=PENDING, result=null, callback=wakeup thread pool-6-thread-12, errback=wakeup thread pool-6-thread-12))) after lookup
02:04:31.959 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet d511a1f5f1c340fb807f8f4bcc88aca0 for table 'TestAuthzTokenCache-table' with partition [<start>, <end>)
02:04:31.960 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=d511a1f5f1c340fb807f8f4bcc88aca0@[194ec164ee1c424a91b9d008d099fdd1(127.15.239.3:43333),76eeaaee714844158f4db95d1c6f1b1d(127.15.239.1:41753),b412c1a03a43464e97bb7beac4c05b89(127.15.239.2:43249)[L]]}]
02:04:31.960 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, attempt=1, KuduRpc(method=Scan, tablet=null, attempt=1, TimeoutTracker(timeout=30000, elapsed=38), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.15.239.60:35113, [28ms] Sub RPC GetTableLocations: received response from server master-127.15.239.60:35113: OK, deferred=Deferred@1632718475(state=PENDING, result=null, callback=wakeup thread pool-6-thread-10, errback=wakeup thread pool-6-thread-10))) after lookup
02:04:31.961 [DEBUG - kudu-nio-0] (AuthzTokenCache.java:193) retrieved authz token for 7532f5f2fdbb4795a7999b0f8a16037b
02:04:32.014 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0xd4709db0, L:/127.0.0.1:37458 - R:/127.15.239.2:43249] using TOKEN/null
02:04:32.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:32.018834 16844 tablet_service.cc:3018] Rejecting scan request for tablet d511a1f5f1c340fb807f8f4bcc88aca0: Uninitialized: clean time has not yet been initialized
02:04:32.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:32.019145 16843 tablet_service.cc:3018] Rejecting scan request for tablet d511a1f5f1c340fb807f8f4bcc88aca0: Uninitialized: clean time has not yet been initialized
02:04:32.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:32.025795 16843 tablet_service.cc:3018] Rejecting scan request for tablet d511a1f5f1c340fb807f8f4bcc88aca0: Uninitialized: clean time has not yet been initialized
02:04:32.043 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location b412c1a03a43464e97bb7beac4c05b89(127.15.239.2:43249) for tablet d511a1f5f1c340fb807f8f4bcc88aca0: clean time has not yet been initialized
02:04:32.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:32.030231 16842 tablet_service.cc:3018] Rejecting scan request for tablet d511a1f5f1c340fb807f8f4bcc88aca0: Uninitialized: clean time has not yet been initialized
02:04:32.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:32.032572 16841 tablet_service.cc:3018] Rejecting scan request for tablet d511a1f5f1c340fb807f8f4bcc88aca0: Uninitialized: clean time has not yet been initialized
02:04:32.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:32.034888 16840 tablet_service.cc:3018] Rejecting scan request for tablet d511a1f5f1c340fb807f8f4bcc88aca0: Uninitialized: clean time has not yet been initialized
02:04:32.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:32.030270 16839 tablet_service.cc:3018] Rejecting scan request for tablet d511a1f5f1c340fb807f8f4bcc88aca0: Uninitialized: clean time has not yet been initialized
02:04:32.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:32.038108 16838 tablet_service.cc:3018] Rejecting scan request for tablet d511a1f5f1c340fb807f8f4bcc88aca0: Uninitialized: clean time has not yet been initialized
02:04:32.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:32.039630 16836 tablet_service.cc:3018] Rejecting scan request for tablet d511a1f5f1c340fb807f8f4bcc88aca0: Uninitialized: clean time has not yet been initialized
02:04:32.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:32.040727 16837 tablet_service.cc:3018] Rejecting scan request for tablet d511a1f5f1c340fb807f8f4bcc88aca0: Uninitialized: clean time has not yet been initialized
02:04:32.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:32.043679 16844 tablet_service.cc:3018] Rejecting scan request for tablet d511a1f5f1c340fb807f8f4bcc88aca0: Uninitialized: clean time has not yet been initialized
02:04:32.048 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location b412c1a03a43464e97bb7beac4c05b89(127.15.239.2:43249) for tablet d511a1f5f1c340fb807f8f4bcc88aca0: clean time has not yet been initialized
02:04:32.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:32.043622 16835 tablet_service.cc:3018] Rejecting scan request for tablet d511a1f5f1c340fb807f8f4bcc88aca0: Uninitialized: clean time has not yet been initialized
02:04:32.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:32.050843 16834 tablet_service.cc:3018] Rejecting scan request for tablet d511a1f5f1c340fb807f8f4bcc88aca0: Uninitialized: clean time has not yet been initialized
02:04:32.055 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location b412c1a03a43464e97bb7beac4c05b89(127.15.239.2:43249) for tablet d511a1f5f1c340fb807f8f4bcc88aca0: clean time has not yet been initialized
02:04:32.074 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location b412c1a03a43464e97bb7beac4c05b89(127.15.239.2:43249) for tablet d511a1f5f1c340fb807f8f4bcc88aca0: clean time has not yet been initialized
02:04:32.082 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location b412c1a03a43464e97bb7beac4c05b89(127.15.239.2:43249) for tablet d511a1f5f1c340fb807f8f4bcc88aca0: clean time has not yet been initialized
02:04:32.084 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location b412c1a03a43464e97bb7beac4c05b89(127.15.239.2:43249) for tablet d511a1f5f1c340fb807f8f4bcc88aca0: clean time has not yet been initialized
02:04:32.084 [DEBUG - kudu-nio-3] (RemoteTablet.java:144) tablet d511a1f5f1c340fb807f8f4bcc88aca0 already removed ts b412c1a03a43464e97bb7beac4c05b89, size left is 2
02:04:32.087 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location b412c1a03a43464e97bb7beac4c05b89(127.15.239.2:43249) for tablet d511a1f5f1c340fb807f8f4bcc88aca0: clean time has not yet been initialized
02:04:32.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:32.088724 16837 tablet_service.cc:3018] Rejecting scan request for tablet d511a1f5f1c340fb807f8f4bcc88aca0: Uninitialized: clean time has not yet been initialized
02:04:32.090 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location b412c1a03a43464e97bb7beac4c05b89(127.15.239.2:43249) for tablet d511a1f5f1c340fb807f8f4bcc88aca0: clean time has not yet been initialized
02:04:32.091 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location b412c1a03a43464e97bb7beac4c05b89(127.15.239.2:43249) for tablet d511a1f5f1c340fb807f8f4bcc88aca0: clean time has not yet been initialized
02:04:32.091 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location b412c1a03a43464e97bb7beac4c05b89(127.15.239.2:43249) for tablet d511a1f5f1c340fb807f8f4bcc88aca0: clean time has not yet been initialized
02:04:32.092 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location b412c1a03a43464e97bb7beac4c05b89(127.15.239.2:43249) for tablet d511a1f5f1c340fb807f8f4bcc88aca0: clean time has not yet been initialized
02:04:32.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:32.091029 16840 tablet_service.cc:3018] Rejecting scan request for tablet d511a1f5f1c340fb807f8f4bcc88aca0: Uninitialized: clean time has not yet been initialized
02:04:32.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:32.094781 16844 tablet_service.cc:3018] Rejecting scan request for tablet d511a1f5f1c340fb807f8f4bcc88aca0: Uninitialized: clean time has not yet been initialized
02:04:32.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:32.097851 17115 consensus_queue.cc:1048] T d511a1f5f1c340fb807f8f4bcc88aca0 P b412c1a03a43464e97bb7beac4c05b89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "76eeaaee714844158f4db95d1c6f1b1d" member_type: VOTER last_known_addr { host: "127.15.239.1" port: 41753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
02:04:32.099 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet d511a1f5f1c340fb807f8f4bcc88aca0 for table 'TestAuthzTokenCache-table' with partition [<start>, <end>)
02:04:32.100 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=d511a1f5f1c340fb807f8f4bcc88aca0@[194ec164ee1c424a91b9d008d099fdd1(127.15.239.3:43333),76eeaaee714844158f4db95d1c6f1b1d(127.15.239.1:41753),b412c1a03a43464e97bb7beac4c05b89(127.15.239.2:43249)[L]]}]
02:04:32.100 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, tablet=d511a1f5f1c340fb807f8f4bcc88aca0, attempt=2, KuduRpc(method=Scan, tablet=d511a1f5f1c340fb807f8f4bcc88aca0, attempt=2, TimeoutTracker(timeout=30000, elapsed=176), Traces: [0ms] sending RPC to server master-127.15.239.60:35113, [37ms] received response from server master-127.15.239.60:35113: OK, [38ms] Sub RPC Scan: sending RPC to server b412c1a03a43464e97bb7beac4c05b89, [158ms] Sub RPC Scan: delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [158ms] Sub RPC Scan: received response from server b412c1a03a43464e97bb7beac4c05b89: Uninitialized: clean time has not yet been initialized (error 0), [168ms] Sub RPC Scan: refreshing cache from master, [168ms] Sub RPC GetTableLocations: sending RPC to server master-127.15.239.60:35113, [175ms] Sub RPC GetTableLocations: received response from server master-127.15.239.60:35113: OK, deferred=Deferred@930006057(state=PENDING, result=null, callback=wakeup thread pool-6-thread-13, errback=wakeup thread pool-6-thread-13))) after lookup
02:04:32.102 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet d511a1f5f1c340fb807f8f4bcc88aca0 for table 'TestAuthzTokenCache-table' with partition [<start>, <end>)
02:04:32.103 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=d511a1f5f1c340fb807f8f4bcc88aca0@[194ec164ee1c424a91b9d008d099fdd1(127.15.239.3:43333),76eeaaee714844158f4db95d1c6f1b1d(127.15.239.1:41753),b412c1a03a43464e97bb7beac4c05b89(127.15.239.2:43249)[L]]}]
02:04:32.104 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, tablet=d511a1f5f1c340fb807f8f4bcc88aca0, attempt=3, KuduRpc(method=Scan, tablet=d511a1f5f1c340fb807f8f4bcc88aca0, attempt=3, TimeoutTracker(timeout=30000, elapsed=182), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.15.239.60:35113, [28ms] Sub RPC GetTableLocations: received response from server master-127.15.239.60:35113: OK, [29ms] sending RPC to server b412c1a03a43464e97bb7beac4c05b89, [153ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [153ms] received response from server b412c1a03a43464e97bb7beac4c05b89: Uninitialized: clean time has not yet been initialized (error 0), [161ms] refreshing cache from master, [161ms] Sub RPC GetTableLocations: sending RPC to server master-127.15.239.60:35113, [171ms] Sub RPC GetTableLocations: received response from server master-127.15.239.60:35113: OK, deferred=Deferred@1632718475(state=PENDING, result=null, callback=wakeup thread pool-6-thread-10 -> (continuation of Deferred@1753593131 after retry RPC@690708351), errback=wakeup thread pool-6-thread-10 -> (continuation of Deferred@1753593131 after retry RPC@690708351)))) after lookup
02:04:32.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:32.102913 16841 tablet_service.cc:3018] Rejecting scan request for tablet d511a1f5f1c340fb807f8f4bcc88aca0: Uninitialized: clean time has not yet been initialized
02:04:32.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:32.105618 16833 tablet_service.cc:3018] Rejecting scan request for tablet d511a1f5f1c340fb807f8f4bcc88aca0: Uninitialized: clean time has not yet been initialized
02:04:32.107 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet d511a1f5f1c340fb807f8f4bcc88aca0 for table 'TestAuthzTokenCache-table' with partition [<start>, <end>)
02:04:32.108 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=d511a1f5f1c340fb807f8f4bcc88aca0@[194ec164ee1c424a91b9d008d099fdd1(127.15.239.3:43333),76eeaaee714844158f4db95d1c6f1b1d(127.15.239.1:41753),b412c1a03a43464e97bb7beac4c05b89(127.15.239.2:43249)[L]]}]
02:04:32.108 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, tablet=d511a1f5f1c340fb807f8f4bcc88aca0, attempt=3, KuduRpc(method=Scan, tablet=d511a1f5f1c340fb807f8f4bcc88aca0, attempt=3, TimeoutTracker(timeout=30000, elapsed=190), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.15.239.60:35113, [23ms] Sub RPC GetTableLocations: received response from server master-127.15.239.60:35113: OK, [24ms] sending RPC to server b412c1a03a43464e97bb7beac4c05b89, [160ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [160ms] received response from server b412c1a03a43464e97bb7beac4c05b89: Uninitialized: clean time has not yet been initialized (error 0), [165ms] refreshing cache from master, [165ms] Sub RPC GetTableLocations: sending RPC to server master-127.15.239.60:35113, [180ms] Sub RPC GetTableLocations: received response from server master-127.15.239.60:35113: OK, deferred=Deferred@1364238144(state=PENDING, result=null, callback=wakeup thread pool-6-thread-5 -> (continuation of Deferred@923240410 after retry RPC@1919832316), errback=wakeup thread pool-6-thread-5 -> (continuation of Deferred@923240410 after retry RPC@1919832316)))) after lookup
02:04:32.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:32.109344 16835 tablet_service.cc:3018] Rejecting scan request for tablet d511a1f5f1c340fb807f8f4bcc88aca0: Uninitialized: clean time has not yet been initialized
02:04:32.110 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet d511a1f5f1c340fb807f8f4bcc88aca0 for table 'TestAuthzTokenCache-table' with partition [<start>, <end>)
02:04:32.111 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=d511a1f5f1c340fb807f8f4bcc88aca0@[194ec164ee1c424a91b9d008d099fdd1(127.15.239.3:43333),76eeaaee714844158f4db95d1c6f1b1d(127.15.239.1:41753),b412c1a03a43464e97bb7beac4c05b89(127.15.239.2:43249)[L]]}]
02:04:32.111 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, tablet=d511a1f5f1c340fb807f8f4bcc88aca0, attempt=3, KuduRpc(method=Scan, tablet=d511a1f5f1c340fb807f8f4bcc88aca0, attempt=3, TimeoutTracker(timeout=30000, elapsed=192), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.15.239.60:35113, [19ms] Sub RPC GetTableLocations: received response from server master-127.15.239.60:35113: OK, [20ms] sending RPC to server b412c1a03a43464e97bb7beac4c05b89, [149ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [149ms] received response from server b412c1a03a43464e97bb7beac4c05b89: Uninitialized: clean time has not yet been initialized (error 0), [166ms] refreshing cache from master, [166ms] Sub RPC GetTableLocations: sending RPC to server master-127.15.239.60:35113, [185ms] Sub RPC GetTableLocations: received response from server master-127.15.239.60:35113: OK, deferred=Deferred@2145079455(state=PENDING, result=null, callback=wakeup thread pool-6-thread-6 -> (continuation of Deferred@1164124878 after retry RPC@1322337519), errback=wakeup thread pool-6-thread-6 -> (continuation of Deferred@1164124878 after retry RPC@1322337519)))) after lookup
02:04:32.117 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location b412c1a03a43464e97bb7beac4c05b89(127.15.239.2:43249) for tablet d511a1f5f1c340fb807f8f4bcc88aca0: clean time has not yet been initialized
02:04:32.117 [DEBUG - kudu-nio-3] (RemoteTablet.java:144) tablet d511a1f5f1c340fb807f8f4bcc88aca0 already removed ts b412c1a03a43464e97bb7beac4c05b89, size left is 2
02:04:32.120 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location b412c1a03a43464e97bb7beac4c05b89(127.15.239.2:43249) for tablet d511a1f5f1c340fb807f8f4bcc88aca0: clean time has not yet been initialized
02:04:32.120 [DEBUG - kudu-nio-3] (RemoteTablet.java:144) tablet d511a1f5f1c340fb807f8f4bcc88aca0 already removed ts b412c1a03a43464e97bb7beac4c05b89, size left is 2
02:04:32.121 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location b412c1a03a43464e97bb7beac4c05b89(127.15.239.2:43249) for tablet d511a1f5f1c340fb807f8f4bcc88aca0: clean time has not yet been initialized
02:04:32.124 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location b412c1a03a43464e97bb7beac4c05b89(127.15.239.2:43249) for tablet d511a1f5f1c340fb807f8f4bcc88aca0: clean time has not yet been initialized
02:04:32.125 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location b412c1a03a43464e97bb7beac4c05b89(127.15.239.2:43249) for tablet d511a1f5f1c340fb807f8f4bcc88aca0: clean time has not yet been initialized
02:04:32.125 [DEBUG - kudu-nio-3] (RemoteTablet.java:144) tablet d511a1f5f1c340fb807f8f4bcc88aca0 already removed ts b412c1a03a43464e97bb7beac4c05b89, size left is 2
02:04:32.126 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location b412c1a03a43464e97bb7beac4c05b89(127.15.239.2:43249) for tablet d511a1f5f1c340fb807f8f4bcc88aca0: clean time has not yet been initialized
02:04:32.126 [DEBUG - kudu-nio-3] (RemoteTablet.java:144) tablet d511a1f5f1c340fb807f8f4bcc88aca0 already removed ts b412c1a03a43464e97bb7beac4c05b89, size left is 2
02:04:32.126 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location b412c1a03a43464e97bb7beac4c05b89(127.15.239.2:43249) for tablet d511a1f5f1c340fb807f8f4bcc88aca0: clean time has not yet been initialized
02:04:32.126 [DEBUG - kudu-nio-3] (RemoteTablet.java:144) tablet d511a1f5f1c340fb807f8f4bcc88aca0 already removed ts b412c1a03a43464e97bb7beac4c05b89, size left is 2
02:04:32.127 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location b412c1a03a43464e97bb7beac4c05b89(127.15.239.2:43249) for tablet d511a1f5f1c340fb807f8f4bcc88aca0: clean time has not yet been initialized
02:04:32.127 [DEBUG - kudu-nio-3] (RemoteTablet.java:144) tablet d511a1f5f1c340fb807f8f4bcc88aca0 already removed ts b412c1a03a43464e97bb7beac4c05b89, size left is 2
02:04:32.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:32.134593 16843 tablet_service.cc:3018] Rejecting scan request for tablet d511a1f5f1c340fb807f8f4bcc88aca0: Uninitialized: clean time has not yet been initialized
02:04:32.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:32.139950 16844 tablet_service.cc:3018] Rejecting scan request for tablet d511a1f5f1c340fb807f8f4bcc88aca0: Uninitialized: clean time has not yet been initialized
02:04:32.142 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location b412c1a03a43464e97bb7beac4c05b89(127.15.239.2:43249) for tablet d511a1f5f1c340fb807f8f4bcc88aca0: clean time has not yet been initialized
02:04:32.143 [DEBUG - kudu-nio-3] (RemoteTablet.java:144) tablet d511a1f5f1c340fb807f8f4bcc88aca0 already removed ts b412c1a03a43464e97bb7beac4c05b89, size left is 2
02:04:32.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:32.143324 16836 tablet_service.cc:3018] Rejecting scan request for tablet d511a1f5f1c340fb807f8f4bcc88aca0: Uninitialized: clean time has not yet been initialized
02:04:32.150 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location b412c1a03a43464e97bb7beac4c05b89(127.15.239.2:43249) for tablet d511a1f5f1c340fb807f8f4bcc88aca0: clean time has not yet been initialized
02:04:32.150 [DEBUG - kudu-nio-3] (RemoteTablet.java:144) tablet d511a1f5f1c340fb807f8f4bcc88aca0 already removed ts b412c1a03a43464e97bb7beac4c05b89, size left is 2
02:04:32.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:32.156723 16835 tablet_service.cc:3018] Rejecting scan request for tablet d511a1f5f1c340fb807f8f4bcc88aca0: Uninitialized: clean time has not yet been initialized
02:04:32.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:32.169699 16837 tablet_service.cc:3018] Rejecting scan request for tablet d511a1f5f1c340fb807f8f4bcc88aca0: Uninitialized: clean time has not yet been initialized
02:04:32.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:32.174772 16838 tablet_service.cc:3018] Rejecting scan request for tablet d511a1f5f1c340fb807f8f4bcc88aca0: Uninitialized: clean time has not yet been initialized
02:04:32.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:32.179308 16841 tablet_service.cc:3018] Rejecting scan request for tablet d511a1f5f1c340fb807f8f4bcc88aca0: Uninitialized: clean time has not yet been initialized
02:04:32.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:32.180685 16839 tablet_service.cc:3018] Rejecting scan request for tablet d511a1f5f1c340fb807f8f4bcc88aca0: Uninitialized: clean time has not yet been initialized
02:04:32.200 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location b412c1a03a43464e97bb7beac4c05b89(127.15.239.2:43249) for tablet d511a1f5f1c340fb807f8f4bcc88aca0: clean time has not yet been initialized
02:04:32.200 [DEBUG - kudu-nio-3] (RemoteTablet.java:144) tablet d511a1f5f1c340fb807f8f4bcc88aca0 already removed ts b412c1a03a43464e97bb7beac4c05b89, size left is 2
02:04:32.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:32.203569 16836 tablet_service.cc:3018] Rejecting scan request for tablet d511a1f5f1c340fb807f8f4bcc88aca0: Uninitialized: clean time has not yet been initialized
02:04:32.212 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location b412c1a03a43464e97bb7beac4c05b89(127.15.239.2:43249) for tablet d511a1f5f1c340fb807f8f4bcc88aca0: clean time has not yet been initialized
02:04:32.212 [DEBUG - kudu-nio-3] (RemoteTablet.java:144) tablet d511a1f5f1c340fb807f8f4bcc88aca0 already removed ts b412c1a03a43464e97bb7beac4c05b89, size left is 2
02:04:32.215 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location b412c1a03a43464e97bb7beac4c05b89(127.15.239.2:43249) for tablet d511a1f5f1c340fb807f8f4bcc88aca0: clean time has not yet been initialized
02:04:32.216 [DEBUG - kudu-nio-3] (RemoteTablet.java:144) tablet d511a1f5f1c340fb807f8f4bcc88aca0 already removed ts b412c1a03a43464e97bb7beac4c05b89, size left is 2
02:04:32.219 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location b412c1a03a43464e97bb7beac4c05b89(127.15.239.2:43249) for tablet d511a1f5f1c340fb807f8f4bcc88aca0: clean time has not yet been initialized
02:04:32.219 [DEBUG - kudu-nio-3] (RemoteTablet.java:144) tablet d511a1f5f1c340fb807f8f4bcc88aca0 already removed ts b412c1a03a43464e97bb7beac4c05b89, size left is 2
02:04:32.223 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location b412c1a03a43464e97bb7beac4c05b89(127.15.239.2:43249) for tablet d511a1f5f1c340fb807f8f4bcc88aca0: clean time has not yet been initialized
02:04:32.223 [DEBUG - kudu-nio-3] (RemoteTablet.java:144) tablet d511a1f5f1c340fb807f8f4bcc88aca0 already removed ts b412c1a03a43464e97bb7beac4c05b89, size left is 2
02:04:32.225 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location b412c1a03a43464e97bb7beac4c05b89(127.15.239.2:43249) for tablet d511a1f5f1c340fb807f8f4bcc88aca0: clean time has not yet been initialized
02:04:32.225 [DEBUG - kudu-nio-3] (RemoteTablet.java:144) tablet d511a1f5f1c340fb807f8f4bcc88aca0 already removed ts b412c1a03a43464e97bb7beac4c05b89, size left is 2
02:04:32.237 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location b412c1a03a43464e97bb7beac4c05b89(127.15.239.2:43249) for tablet d511a1f5f1c340fb807f8f4bcc88aca0: clean time has not yet been initialized
02:04:32.238 [DEBUG - kudu-nio-3] (RemoteTablet.java:144) tablet d511a1f5f1c340fb807f8f4bcc88aca0 already removed ts b412c1a03a43464e97bb7beac4c05b89, size left is 2
02:04:32.253 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location b412c1a03a43464e97bb7beac4c05b89(127.15.239.2:43249) for tablet d511a1f5f1c340fb807f8f4bcc88aca0: clean time has not yet been initialized
02:04:32.253 [DEBUG - kudu-nio-3] (RemoteTablet.java:144) tablet d511a1f5f1c340fb807f8f4bcc88aca0 already removed ts b412c1a03a43464e97bb7beac4c05b89, size left is 2
02:04:32.269 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestAuthzTokenCache-table, tablet=d511a1f5f1c340fb807f8f4bcc88aca0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
02:04:32.286 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestAuthzTokenCache-table, tablet=d511a1f5f1c340fb807f8f4bcc88aca0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
02:04:32.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:32.228394 16843 tablet_service.cc:3018] Rejecting scan request for tablet d511a1f5f1c340fb807f8f4bcc88aca0: Uninitialized: clean time has not yet been initialized
02:04:32.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:32.237133 16833 tablet_service.cc:3018] Rejecting scan request for tablet d511a1f5f1c340fb807f8f4bcc88aca0: Uninitialized: clean time has not yet been initialized
02:04:32.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:32.302677 17156 consensus_queue.cc:1048] T d511a1f5f1c340fb807f8f4bcc88aca0 P b412c1a03a43464e97bb7beac4c05b89 [LEADER]: Connected to new peer: Peer: permanent_uuid: "194ec164ee1c424a91b9d008d099fdd1" member_type: VOTER last_known_addr { host: "127.15.239.3" port: 43333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
02:04:32.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:32.239192 16840 tablet_service.cc:3018] Rejecting scan request for tablet d511a1f5f1c340fb807f8f4bcc88aca0: Uninitialized: clean time has not yet been initialized
02:04:32.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:32.241134 16842 tablet_service.cc:3018] Rejecting scan request for tablet d511a1f5f1c340fb807f8f4bcc88aca0: Uninitialized: clean time has not yet been initialized
02:04:32.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 02:04:32.243109 16834 tablet_service.cc:3018] Rejecting scan request for tablet d511a1f5f1c340fb807f8f4bcc88aca0: Uninitialized: clean time has not yet been initialized
02:04:32.327 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestAuthzTokenCache-table, tablet=d511a1f5f1c340fb807f8f4bcc88aca0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
02:04:32.372 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestAuthzTokenCache-table, tablet=d511a1f5f1c340fb807f8f4bcc88aca0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
02:04:32.385 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestAuthzTokenCache-table, tablet=d511a1f5f1c340fb807f8f4bcc88aca0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
02:04:32.388 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestAuthzTokenCache-table, tablet=d511a1f5f1c340fb807f8f4bcc88aca0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
02:04:32.391 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location b412c1a03a43464e97bb7beac4c05b89(127.15.239.2:43249) for tablet d511a1f5f1c340fb807f8f4bcc88aca0: clean time has not yet been initialized
02:04:32.392 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestAuthzTokenCache-table, tablet=d511a1f5f1c340fb807f8f4bcc88aca0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
02:04:32.394 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestAuthzTokenCache-table, tablet=d511a1f5f1c340fb807f8f4bcc88aca0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
02:04:32.395 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location b412c1a03a43464e97bb7beac4c05b89(127.15.239.2:43249) for tablet d511a1f5f1c340fb807f8f4bcc88aca0: clean time has not yet been initialized
02:04:32.395 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestAuthzTokenCache-table, tablet=d511a1f5f1c340fb807f8f4bcc88aca0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
02:04:32.396 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location b412c1a03a43464e97bb7beac4c05b89(127.15.239.2:43249) for tablet d511a1f5f1c340fb807f8f4bcc88aca0: clean time has not yet been initialized
02:04:32.396 [DEBUG - kudu-nio-3] (RemoteTablet.java:144) tablet d511a1f5f1c340fb807f8f4bcc88aca0 already removed ts b412c1a03a43464e97bb7beac4c05b89, size left is 2
02:04:32.400 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location b412c1a03a43464e97bb7beac4c05b89(127.15.239.2:43249) for tablet d511a1f5f1c340fb807f8f4bcc88aca0: clean time has not yet been initialized
02:04:32.400 [DEBUG - kudu-nio-3] (RemoteTablet.java:144) tablet d511a1f5f1c340fb807f8f4bcc88aca0 already removed ts b412c1a03a43464e97bb7beac4c05b89, size left is 2
02:04:32.401 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestAuthzTokenCache-table, tablet=d511a1f5f1c340fb807f8f4bcc88aca0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
02:04:32.401 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestAuthzTokenCache-table, tablet=d511a1f5f1c340fb807f8f4bcc88aca0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
02:04:32.402 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestAuthzTokenCache-table, tablet=d511a1f5f1c340fb807f8f4bcc88aca0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
02:04:32.403 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestAuthzTokenCache-table, tablet=d511a1f5f1c340fb807f8f4bcc88aca0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
02:04:32.413 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestAuthzTokenCache-table, tablet=d511a1f5f1c340fb807f8f4bcc88aca0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
02:04:32.415 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestAuthzTokenCache-table, tablet=d511a1f5f1c340fb807f8f4bcc88aca0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
02:04:32.420 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet d511a1f5f1c340fb807f8f4bcc88aca0 for table 'TestAuthzTokenCache-table' with partition [<start>, <end>)
02:04:32.421 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=d511a1f5f1c340fb807f8f4bcc88aca0@[194ec164ee1c424a91b9d008d099fdd1(127.15.239.3:43333),76eeaaee714844158f4db95d1c6f1b1d(127.15.239.1:41753),b412c1a03a43464e97bb7beac4c05b89(127.15.239.2:43249)[L]]}]
02:04:32.423 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, tablet=d511a1f5f1c340fb807f8f4bcc88aca0, attempt=4, KuduRpc(method=Scan, tablet=d511a1f5f1c340fb807f8f4bcc88aca0, attempt=4, TimeoutTracker(timeout=30000, elapsed=503), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.15.239.60:35113, [23ms] Sub RPC GetTableLocations: received response from server master-127.15.239.60:35113: OK, [24ms] sending RPC to server b412c1a03a43464e97bb7beac4c05b89, [163ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [163ms] received response from server b412c1a03a43464e97bb7beac4c05b89: Uninitialized: clean time has not yet been initialized (error 0), [184ms] sending RPC to server b412c1a03a43464e97bb7beac4c05b89, [467ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [467ms] received response from server b412c1a03a43464e97bb7beac4c05b89: Uninitialized: clean time has not yet been initialized (error 0), [484ms] refreshing cache from master, [484ms] Sub RPC GetTableLocations: sending RPC to server master-127.15.239.60:35113, [492ms] Sub RPC GetTableLocations: received response from server master-127.15.239.60:35113: OK, deferred=Deferred@600718391(state=PENDING, result=null, callback=wakeup thread pool-6-thread-4 -> (continuation of Deferred@643201718 after retry RPC@2055162336), errback=wakeup thread pool-6-thread-4 -> (continuation of Deferred@643201718 after retry RPC@2055162336)))) after lookup
02:04:32.424 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet d511a1f5f1c340fb807f8f4bcc88aca0 for table 'TestAuthzTokenCache-table' with partition [<start>, <end>)
02:04:32.425 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=d511a1f5f1c340fb807f8f4bcc88aca0@[194ec164ee1c424a91b9d008d099fdd1(127.15.239.3:43333),76eeaaee714844158f4db95d1c6f1b1d(127.15.239.1:41753),b412c1a03a43464e97bb7beac4c05b89(127.15.239.2:43249)[L]]}]
02:04:32.425 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, tablet=d511a1f5f1c340fb807f8f4bcc88aca0, attempt=4, KuduRpc(method=Scan, tablet=d511a1f5f1c340fb807f8f4bcc88aca0, attempt=4, TimeoutTracker(timeout=30000, elapsed=506), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.15.239.60:35113, [20ms] Sub RPC GetTableLocations: received response from server master-127.15.239.60:35113: OK, [21ms] sending RPC to server b412c1a03a43464e97bb7beac4c05b89, [165ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [165ms] received response from server b412c1a03a43464e97bb7beac4c05b89: Uninitialized: clean time has not yet been initialized (error 0), [186ms] sending RPC to server b412c1a03a43464e97bb7beac4c05b89, [470ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [470ms] received response from server b412c1a03a43464e97bb7beac4c05b89: Uninitialized: clean time has not yet been initialized (error 0), [486ms] refreshing cache from master, [486ms] Sub RPC GetTableLocations: sending RPC to server master-127.15.239.60:35113, [498ms] Sub RPC GetTableLocations: received response from server master-127.15.239.60:35113: OK, deferred=Deferred@1954135702(state=PENDING, result=null, callback=wakeup thread pool-6-thread-7 -> (continuation of Deferred@819518480 after retry RPC@625906551), errback=wakeup thread pool-6-thread-7 -> (continuation of Deferred@819518480 after retry RPC@625906551)))) after lookup
02:04:32.427 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet d511a1f5f1c340fb807f8f4bcc88aca0 for table 'TestAuthzTokenCache-table' with partition [<start>, <end>)
02:04:32.427 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=d511a1f5f1c340fb807f8f4bcc88aca0@[194ec164ee1c424a91b9d008d099fdd1(127.15.239.3:43333),76eeaaee714844158f4db95d1c6f1b1d(127.15.239.1:41753),b412c1a03a43464e97bb7beac4c05b89(127.15.239.2:43249)[L]]}]
02:04:32.428 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, tablet=d511a1f5f1c340fb807f8f4bcc88aca0, attempt=4, KuduRpc(method=Scan, tablet=d511a1f5f1c340fb807f8f4bcc88aca0, attempt=4, TimeoutTracker(timeout=30000, elapsed=507), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC GetTableLocations: sending RPC to server master-127.15.239.60:35113, [27ms] Sub RPC GetTableLocations: received response from server master-127.15.239.60:35113: OK, [28ms] sending RPC to server b412c1a03a43464e97bb7beac4c05b89, [161ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [161ms] received response from server b412c1a03a43464e97bb7beac4c05b89: Uninitialized: clean time has not yet been initialized (error 0), [182ms] sending RPC to server b412c1a03a43464e97bb7beac4c05b89, [471ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [471ms] received response from server b412c1a03a43464e97bb7beac4c05b89: Uninitialized: clean time has not yet been initialized (error 0), [483ms] refreshing cache from master, [483ms] Sub RPC GetTableLocations: sending RPC to server master-127.15.239.60:35113, [498ms] Sub RPC GetTableLocations: received response from server master-127.15.239.60:35113: OK, deferred=Deferred@610599010(state=PENDING, result=null, callback=wakeup thread pool-6-thread-11 -> (continuation of Deferred@2005055704 after retry RPC@21807716), errback=wakeup thread pool-6-thread-11 -> (continuation of Deferred@2005055704 after retry RPC@21807716)))) after lookup
02:04:32.428 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestAuthzTokenCache-table, tablet=d511a1f5f1c340fb807f8f4bcc88aca0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
02:04:32.429 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestAuthzTokenCache-table, tablet=d511a1f5f1c340fb807f8f4bcc88aca0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
02:04:32.429 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet d511a1f5f1c340fb807f8f4bcc88aca0 for table 'TestAuthzTokenCache-table' with partition [<start>, <end>)
02:04:32.430 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=d511a1f5f1c340fb807f8f4bcc88aca0@[194ec164ee1c424a91b9d008d099fdd1(127.15.239.3:43333),76eeaaee714844158f4db95d1c6f1b1d(127.15.239.1:41753),b412c1a03a43464e97bb7beac4c05b89(127.15.239.2:43249)[L]]}]
02:04:32.430 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestAuthzTokenCache-table, tablet=d511a1f5f1c340fb807f8f4bcc88aca0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
02:04:32.430 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC ScanRequest(scannerId=null, state=OPENING, tablet=d511a1f5f1c340fb807f8f4bcc88aca0, attempt=5, KuduRpc(method=Scan, tablet=d511a1f5f1c340fb807f8f4bcc88aca0, attempt=5, TimeoutTracker(timeout=30000, elapsed=512), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.15.239.60:35113, [23ms] Sub RPC GetTableLocations: received response from server master-127.15.239.60:35113: OK, [24ms] sending RPC to server b412c1a03a43464e97bb7beac4c05b89, [160ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [160ms] received response from server b412c1a03a43464e97bb7beac4c05b89: Uninitialized: clean time has not yet been initialized (error 0), [165ms] refreshing cache from master, [165ms] Sub RPC GetTableLocations: sending RPC to server master-127.15.239.60:35113, [180ms] Sub RPC GetTableLocations: received response from server master-127.15.239.60:35113: OK, [182ms] sending RPC to server b412c1a03a43464e97bb7beac4c05b89, [464ms] delaying RPC due to: Uninitialized: clean time has not yet been initialized (error 0), [464ms] received response from server b412c1a03a43464e97bb7beac4c05b89: Uninitialized: clean time has not yet been initialized (error 0), [484ms] refreshing cache from master, [484ms] Sub RPC GetTableLocations: sending RPC to server master-127.15.239.60:35113, [502ms] Sub RPC GetTableLocations: received response from server master-127.15.239.60:35113: OK, deferred=Deferred@1364238144(state=PENDING, result=null, callback=wakeup thread pool-6-thread-5 -> (continuation of Deferred@923240410 after retry RPC@1919832316) -> (continuation of Deferred@35089705 after retry RPC@1622229451), errback=wakeup thread pool-6-thread-5 -> (continuation of Deferred@923240410 after retry RPC@1919832316) -> (continuation of Deferred@35089705 after retry RPC@1622229451)))) after lookup
02:04:32.431 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestAuthzTokenCache-table, tablet=d511a1f5f1c340fb807f8f4bcc88aca0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
02:04:32.440 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestAuthzTokenCache-table, tablet=d511a1f5f1c340fb807f8f4bcc88aca0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
02:04:32.441 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestAuthzTokenCache-table, tablet=d511a1f5f1c340fb807f8f4bcc88aca0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
02:04:32.477 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestAuthzTokenCache-table, tablet=d511a1f5f1c340fb807f8f4bcc88aca0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
02:04:32.478 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestAuthzTokenCache-table, tablet=d511a1f5f1c340fb807f8f4bcc88aca0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
02:04:32.479 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestAuthzTokenCache-table, tablet=d511a1f5f1c340fb807f8f4bcc88aca0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
02:04:32.481 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestAuthzTokenCache-table, tablet=d511a1f5f1c340fb807f8f4bcc88aca0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
02:04:32.482 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestAuthzTokenCache-table, tablet=d511a1f5f1c340fb807f8f4bcc88aca0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
02:04:32.482 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestAuthzTokenCache-table, tablet=d511a1f5f1c340fb807f8f4bcc88aca0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
02:04:32.499 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestAuthzTokenCache-table, tablet=d511a1f5f1c340fb807f8f4bcc88aca0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
02:04:32.501 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestAuthzTokenCache-table, tablet=d511a1f5f1c340fb807f8f4bcc88aca0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
02:04:32.502 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 0 rows, more = false) for scanner KuduScanner(table=TestAuthzTokenCache-table, tablet=d511a1f5f1c340fb807f8f4bcc88aca0, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
02:04:32.502 [DEBUG - main] (TestAuthzTokenCache.java:150) Sent 2 RPCs for 30 threads
02:04:32.503 [DEBUG - main] (Connection.java:575) [peer b412c1a03a43464e97bb7beac4c05b89(127.15.239.2:43249)] disconnecting while in state READY
02:04:32.503 [DEBUG - main] (Connection.java:575) [peer master-127.15.239.60:35113(127.15.239.60:35113)] disconnecting while in state READY
02:04:32.503 [DEBUG - main] (Connection.java:575) [peer master-127.15.239.62:36255(127.15.239.62:36255)] disconnecting while in state READY
02:04:32.503 [DEBUG - main] (Connection.java:575) [peer master-127.15.239.61:39633(127.15.239.61:39633)] disconnecting while in state READY
02:04:32.505 [DEBUG - kudu-nio-3] (Connection.java:239) [peer b412c1a03a43464e97bb7beac4c05b89(127.15.239.2:43249)] handling channelInactive
02:04:32.505 [DEBUG - kudu-nio-3] (Connection.java:709) [peer b412c1a03a43464e97bb7beac4c05b89(127.15.239.2:43249)] cleaning up while in state READY due to: connection closed
02:04:32.509 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.15.239.62:36255(127.15.239.62:36255)] handling channelInactive
02:04:32.509 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.15.239.62:36255(127.15.239.62:36255)] cleaning up while in state READY due to: connection closed
02:04:32.510 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.15.239.60:35113(127.15.239.60:35113)] handling channelInactive
02:04:32.510 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.15.239.60:35113(127.15.239.60:35113)] cleaning up while in state READY due to: connection closed
02:04:32.510 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
02:04:32.518 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.15.239.61:39633(127.15.239.61:39633)] handling channelInactive
02:04:32.519 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.15.239.61:39633(127.15.239.61:39633)] cleaning up while in state READY due to: connection closed
02:04:32.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:32.520045 16316 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task2tB5Xy/build/tsan/bin/kudu with pid 16648
02:04:32.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:32.561203 16316 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task2tB5Xy/build/tsan/bin/kudu with pid 16798
02:04:32.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:32.595253 16316 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task2tB5Xy/build/tsan/bin/kudu with pid 16943
02:04:32.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:32.622277 16316 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task2tB5Xy/build/tsan/bin/kudu with pid 16343
02:04:32.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:32.654119 16316 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task2tB5Xy/build/tsan/bin/kudu with pid 16422
02:04:32.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 02:04:32.679786 16316 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task2tB5Xy/build/tsan/bin/kudu with pid 16503
02:04:33.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T02:04:33Z chronyd exiting

Time: 45.625

OK (2 tests)

