JUnit version 4.13.2
.08:06:55.937 [INFO - main] (RandomUtils.java:49) Using random seed: 1786522015929
08:06:55.984 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
08:06:56.041 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
08:06:56.049 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskgk96or/test-tmp
08:06:56.052 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
08:06:56.055 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskgk96or/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
08:06:56.266 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

08:06:56.444 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
08:06:56.446 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

08:06:56.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:56.449565 24823 mini_oidc.cc:152] Starting JWKS server
08:06:56.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:56.452970 24823 webserver.cc:460] Webserver started at http://127.0.0.1:43545/ using document root <none> and password file <none>
08:06:56.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:56.453521 24823 mini_oidc.cc:189] Starting OIDC Discovery server
08:06:56.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:56.455214 24823 webserver.cc:460] Webserver started at http://127.0.0.1:37977/ using document root <none> and password file <none>
08:06:56.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-08-12T08:06:56Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
08:06:56.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-08-12T08:06:56Z Disabled control of system clock
08:06:56.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:56.507472 24823 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgk96or/build/tsan/bin/kudu
08:06:56.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgk96or/build/tsan/bin/kudu
08:06:56.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/master-0/wal
08:06:56.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/master-0/data
08:06:56.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:06:56.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:06:56.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:06:56.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:06:56.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:06:56.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:06:56.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/master-0/logs
08:06:56.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/master-0/data/info.pb
08:06:56.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:06:56.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:06:56.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:06:56.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:06:56.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:06:56.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:06:56.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:06:56.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:06:56.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
08:06:56.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:06:56.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:06:56.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:06:56.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.24.61.254:46441
08:06:56.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.24.61.254
08:06:56.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:06:56.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.24.61.212:40075
08:06:56.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:06:56.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:06:56.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:06:56.511 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:06:56.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.24.61.254:46441,127.24.61.253:33137,127.24.61.252:40207
08:06:56.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:06:56.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:43545/jwks.json with env {}
08:06:56.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:06:56.804309 24839 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
08:06:56.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:06:56.804889 24839 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:06:56.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:06:56.805447 24839 flags.cc:425] Enabled unsafe flag: --never_fsync=true
08:06:56.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:06:56.837018 24839 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
08:06:56.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:06:56.837332 24839 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
08:06:56.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:06:56.837584 24839 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
08:06:56.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:06:56.837818 24839 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
08:06:56.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:06:56.838052 24839 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
08:06:56.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:06:56.838193 24839 flags.cc:425] Enabled experimental flag: --jwks_url=http://localhost:43545/jwks.json
08:06:56.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:56.873337 24839 master_runner.cc:386] Master server non-default flags:
08:06:56.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:06:56.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.24.61.212:40075
08:06:56.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:06:56.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:06:56.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/master-0/data
08:06:56.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/master-0/wal
08:06:56.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:06:56.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.24.61.254:46441,127.24.61.253:33137,127.24.61.252:40207
08:06:56.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:06:56.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:06:56.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:06:56.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.24.61.254:46441
08:06:56.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:06:56.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:06:56.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:06:56.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:43545/jwks.json
08:06:56.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:06:56.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:06:56.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/master-0/data/info.pb
08:06:56.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.24.61.254
08:06:56.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:06:56.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:06:56.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:06:56.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:06:56.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:06:56.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:06:56.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/master-0/logs
08:06:56.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:06:56.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:06:56.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:06:56.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
08:06:56.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.18.0-SNAPSHOT
08:06:56.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
08:06:56.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:06:56.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by systest at 12 Aug 2026 06:37:03 UTC on ccycloud.quasar-wifqrz.root.comops.site
08:06:56.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 4581996
08:06:56.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:06:56.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:56.874742 24839 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:06:56.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:56.876732 24839 file_cache.cc:493] Constructed file cache file cache with capacity 419430
08:06:56.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:06:56.894810 24855 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:06:57.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:06:56.894876 24853 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:06:57.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:06:56.894824 24851 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:06:57.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:56.895838 24839 server_base.cc:1034] running on GCE node
08:06:57.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:57.991566 24839 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:06:57.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:57.994230 24839 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:06:57.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:57.995589 24839 hybrid_clock.cc:648] HybridClock initialized: now 1786522017995497 us; error 100 us; skew 500 ppm
08:06:57.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:57.996512 24839 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:06:58.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:58.002930 24839 webserver.cc:460] Webserver started at http://127.24.61.254:36929/ using document root <none> and password file <none>
08:06:58.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:58.003940 24839 fs_manager.cc:359] Metadata directory not provided
08:06:58.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:58.004159 24839 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:06:58.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:58.004701 24839 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
08:06:58.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:58.009708 24839 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/master-0/data/instance:
08:06:58.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "164d87d429da4a85a4902a8601d0b511"
08:06:58.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 08:06:58 on dist-test-slave-f0tn"
08:06:58.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:58.010955 24839 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/master-0/wal/instance:
08:06:58.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "164d87d429da4a85a4902a8601d0b511"
08:06:58.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 08:06:58 on dist-test-slave-f0tn"
08:06:58.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:58.018573 24839 fs_manager.cc:691] Time spent creating directory manager: real 0.007s	user 0.003s	sys 0.005s
08:06:58.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:58.024164 24870 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:06:58.025 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:58.025207 24839 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
08:06:58.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:58.025588 24839 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/master-0/data,/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/master-0/wal
08:06:58.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "164d87d429da4a85a4902a8601d0b511"
08:06:58.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 08:06:58 on dist-test-slave-f0tn"
08:06:58.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:58.025986 24839 fs_report.cc:383] FS layout report
08:06:58.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:06:58.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/master-0/wal
08:06:58.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/master-0/wal
08:06:58.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/master-0/data/data
08:06:58.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:06:58.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:06:58.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:06:58.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:06:58.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:06:58.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:06:58.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:06:58.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:06:58.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:06:58.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:06:58.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:06:58.069 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:58.069103 24839 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
08:06:58.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:58.070802 24839 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:06:58.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:58.071326 24839 kserver.cc:163] Server-wide thread pool size limit: 3276
08:06:58.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:58.139778 24839 rpc_server.cc:307] RPC server started. Bound to: 127.24.61.254:46441
08:06:58.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:58.139880 24957 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.61.254:46441 every 8 connection(s)
08:06:58.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:58.142792 24839 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/master-0/data/info.pb
08:06:58.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:58.148217 24962 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
08:06:58.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:58.151235 24823 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgk96or/build/tsan/bin/kudu as pid 24839
08:06:58.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:58.151719 24823 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/master-0/wal/instance
08:06:58.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:58.155268 24823 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgk96or/build/tsan/bin/kudu
08:06:58.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgk96or/build/tsan/bin/kudu
08:06:58.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/master-1/wal
08:06:58.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/master-1/data
08:06:58.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:06:58.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:06:58.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:06:58.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:06:58.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:06:58.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:06:58.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/master-1/logs
08:06:58.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/master-1/data/info.pb
08:06:58.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:06:58.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:06:58.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:06:58.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:06:58.156 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:06:58.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:06:58.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:06:58.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:06:58.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
08:06:58.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:06:58.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:06:58.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:06:58.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.24.61.253:33137
08:06:58.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.24.61.253
08:06:58.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:06:58.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.24.61.212:40075
08:06:58.157 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:06:58.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:06:58.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:06:58.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:06:58.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.24.61.254:46441,127.24.61.253:33137,127.24.61.252:40207
08:06:58.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:06:58.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:43545/jwks.json with env {}
08:06:58.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:58.159675 24962 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.61.254" port: 46441 } has no permanent_uuid. Determining permanent_uuid...
08:06:58.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:58.188947 24962 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.61.253" port: 33137 } has no permanent_uuid. Determining permanent_uuid...
08:06:58.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:06:58.191462 24874 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.24.61.253:33137: connect: Connection refused (error 111)
08:06:58.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:06:58.195571 24962 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.61.253:33137: Network error: Client connection negotiation failed: client connection to 127.24.61.253:33137: connect: Connection refused (error 111)
08:06:58.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:58.245045 24962 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.61.253" port: 33137 } attempt: 1
08:06:58.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:06:58.248883 24962 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.61.253:33137: Network error: Client connection negotiation failed: client connection to 127.24.61.253:33137: connect: Connection refused (error 111)
08:06:58.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:58.317252 24962 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.61.253" port: 33137 } attempt: 2
08:06:58.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:06:58.321415 24962 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.61.253:33137: Network error: Client connection negotiation failed: client connection to 127.24.61.253:33137: connect: Connection refused (error 111)
08:06:58.413 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:58.412801 24962 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.61.253" port: 33137 } attempt: 3
08:06:58.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:06:58.416755 24962 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.61.253:33137: Network error: Client connection negotiation failed: client connection to 127.24.61.253:33137: connect: Connection refused (error 111)
08:06:58.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:06:58.468107 24968 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
08:06:58.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:06:58.468690 24968 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:06:58.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:06:58.469156 24968 flags.cc:425] Enabled unsafe flag: --never_fsync=true
08:06:58.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:06:58.500815 24968 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
08:06:58.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:06:58.501106 24968 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
08:06:58.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:06:58.501294 24968 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
08:06:58.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:06:58.501566 24968 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
08:06:58.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:06:58.501905 24968 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
08:06:58.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:06:58.502125 24968 flags.cc:425] Enabled experimental flag: --jwks_url=http://localhost:43545/jwks.json
08:06:58.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:58.539359 24968 master_runner.cc:386] Master server non-default flags:
08:06:58.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:06:58.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.24.61.212:40075
08:06:58.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:06:58.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:06:58.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/master-1/data
08:06:58.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/master-1/wal
08:06:58.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:06:58.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.24.61.254:46441,127.24.61.253:33137,127.24.61.252:40207
08:06:58.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:06:58.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:06:58.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:06:58.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.24.61.253:33137
08:06:58.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:06:58.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:06:58.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:06:58.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:43545/jwks.json
08:06:58.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:06:58.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:06:58.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/master-1/data/info.pb
08:06:58.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.24.61.253
08:06:58.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:06:58.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:06:58.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:06:58.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:06:58.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:06:58.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:06:58.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/master-1/logs
08:06:58.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:06:58.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:06:58.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:06:58.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
08:06:58.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.18.0-SNAPSHOT
08:06:58.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
08:06:58.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:06:58.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by systest at 12 Aug 2026 06:37:03 UTC on ccycloud.quasar-wifqrz.root.comops.site
08:06:58.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 4581996
08:06:58.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:06:58.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:58.540691 24968 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:06:58.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:58.542933 24968 file_cache.cc:493] Constructed file cache file cache with capacity 419430
08:06:58.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:58.560290 24962 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.61.253" port: 33137 } attempt: 4
08:06:58.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:06:58.561636 24987 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:06:58.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:06:58.564640 24962 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.61.253:33137: Network error: Client connection negotiation failed: client connection to 127.24.61.253:33137: connect: Connection refused (error 111)
08:06:58.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:58.864074 24962 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.61.253" port: 33137 } attempt: 5
08:06:58.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:06:58.868041 24962 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.61.253:33137: Network error: Client connection negotiation failed: client connection to 127.24.61.253:33137: connect: Connection refused (error 111)
08:06:59.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:59.415580 24962 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.61.253" port: 33137 } attempt: 6
08:06:59.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:06:59.422886 24962 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.61.253:33137: Network error: Client connection negotiation failed: client connection to 127.24.61.253:33137: connect: Connection refused (error 111)
08:06:59.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:06:58.561663 24984 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:06:59.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:06:58.562601 24985 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:06:59.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:58.564467 24968 server_base.cc:1034] running on GCE node
08:06:59.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:59.669538 24968 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:06:59.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:59.672580 24968 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:06:59.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:59.674134 24968 hybrid_clock.cc:648] HybridClock initialized: now 1786522019674086 us; error 63 us; skew 500 ppm
08:06:59.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:59.675132 24968 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:06:59.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:59.686142 24968 webserver.cc:460] Webserver started at http://127.24.61.253:33775/ using document root <none> and password file <none>
08:06:59.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:59.687328 24968 fs_manager.cc:359] Metadata directory not provided
08:06:59.687 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:59.687566 24968 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:06:59.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:59.688158 24968 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
08:06:59.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:59.693266 24968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/master-1/data/instance:
08:06:59.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f0ec94f0ebe642ffb18161428b38882e"
08:06:59.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 08:06:59 on dist-test-slave-f0tn"
08:06:59.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:59.694624 24968 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/master-1/wal/instance:
08:06:59.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f0ec94f0ebe642ffb18161428b38882e"
08:06:59.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 08:06:59 on dist-test-slave-f0tn"
08:06:59.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:59.702230 24968 fs_manager.cc:691] Time spent creating directory manager: real 0.007s	user 0.003s	sys 0.005s
08:06:59.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:59.707824 24999 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:06:59.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:59.708802 24968 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.005s	sys 0.000s
08:06:59.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:59.709156 24968 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/master-1/data,/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/master-1/wal
08:06:59.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f0ec94f0ebe642ffb18161428b38882e"
08:06:59.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 08:06:59 on dist-test-slave-f0tn"
08:06:59.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:59.709542 24968 fs_report.cc:383] FS layout report
08:06:59.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:06:59.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/master-1/wal
08:06:59.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/master-1/wal
08:06:59.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/master-1/data/data
08:06:59.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:06:59.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:06:59.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:06:59.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:06:59.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:06:59.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:06:59.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:06:59.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:06:59.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:06:59.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:06:59.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:06:59.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:59.750113 24968 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
08:06:59.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:59.751695 24968 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:06:59.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:59.752218 24968 kserver.cc:163] Server-wide thread pool size limit: 3276
08:06:59.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:59.820299 24968 rpc_server.cc:307] RPC server started. Bound to: 127.24.61.253:33137
08:06:59.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:59.820405 25091 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.61.253:33137 every 8 connection(s)
08:06:59.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:59.823140 24968 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/master-1/data/info.pb
08:06:59.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:59.828501 25092 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
08:06:59.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:59.828557 24823 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgk96or/build/tsan/bin/kudu as pid 24968
08:06:59.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:59.829001 24823 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/master-1/wal/instance
08:06:59.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:59.831955 24823 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgk96or/build/tsan/bin/kudu
08:06:59.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgk96or/build/tsan/bin/kudu
08:06:59.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/master-2/wal
08:06:59.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/master-2/data
08:06:59.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:06:59.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:06:59.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:06:59.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:06:59.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:06:59.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:06:59.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/master-2/logs
08:06:59.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/master-2/data/info.pb
08:06:59.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:06:59.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:06:59.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:06:59.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:06:59.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:06:59.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:06:59.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:06:59.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:06:59.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
08:06:59.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:06:59.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:06:59.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:06:59.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.24.61.252:40207
08:06:59.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.24.61.252
08:06:59.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:06:59.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.24.61.212:40075
08:06:59.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:06:59.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:06:59.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:06:59.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:06:59.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.24.61.254:46441,127.24.61.253:33137,127.24.61.252:40207
08:06:59.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:06:59.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:43545/jwks.json with env {}
08:06:59.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:59.842530 25092 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.61.254" port: 46441 } has no permanent_uuid. Determining permanent_uuid...
08:06:59.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:59.866037 25092 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.61.253" port: 33137 } has no permanent_uuid. Determining permanent_uuid...
08:06:59.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:59.881353 25092 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.61.252" port: 40207 } has no permanent_uuid. Determining permanent_uuid...
08:06:59.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:06:59.883459 25002 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.24.61.252:40207: connect: Connection refused (error 111)
08:06:59.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:06:59.887413 25092 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.61.252:40207: Network error: Client connection negotiation failed: client connection to 127.24.61.252:40207: connect: Connection refused (error 111)
08:06:59.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:06:59.936872 25092 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.61.252" port: 40207 } attempt: 1
08:06:59.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:06:59.940693 25092 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.61.252:40207: Network error: Client connection negotiation failed: client connection to 127.24.61.252:40207: connect: Connection refused (error 111)
08:07:00.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:00.009076 25092 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.61.252" port: 40207 } attempt: 2
08:07:00.013 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:00.013264 25092 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.61.252:40207: Network error: Client connection negotiation failed: client connection to 127.24.61.252:40207: connect: Connection refused (error 111)
08:07:00.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:00.104782 25092 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.61.252" port: 40207 } attempt: 3
08:07:00.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:00.108659 25092 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.61.252:40207: Network error: Client connection negotiation failed: client connection to 127.24.61.252:40207: connect: Connection refused (error 111)
08:07:00.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:00.149991 25095 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
08:07:00.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:00.150828 25095 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:07:00.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:00.151636 25095 flags.cc:425] Enabled unsafe flag: --never_fsync=true
08:07:00.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:00.188432 25095 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
08:07:00.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:00.188728 25095 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
08:07:00.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:00.188916 25095 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
08:07:00.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:00.189143 25095 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
08:07:00.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:00.189332 25095 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
08:07:00.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:00.189500 25095 flags.cc:425] Enabled experimental flag: --jwks_url=http://localhost:43545/jwks.json
08:07:00.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:00.224610 25095 master_runner.cc:386] Master server non-default flags:
08:07:00.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:07:00.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.24.61.212:40075
08:07:00.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:07:00.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:07:00.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/master-2/data
08:07:00.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/master-2/wal
08:07:00.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:07:00.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.24.61.254:46441,127.24.61.253:33137,127.24.61.252:40207
08:07:00.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:07:00.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:07:00.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:07:00.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.24.61.252:40207
08:07:00.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:07:00.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:07:00.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:07:00.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:43545/jwks.json
08:07:00.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:07:00.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:07:00.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/master-2/data/info.pb
08:07:00.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.24.61.252
08:07:00.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:07:00.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:07:00.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:07:00.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:07:00.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:07:00.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:07:00.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/master-2/logs
08:07:00.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:07:00.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:07:00.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:07:00.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
08:07:00.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.18.0-SNAPSHOT
08:07:00.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
08:07:00.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:07:00.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by systest at 12 Aug 2026 06:37:03 UTC on ccycloud.quasar-wifqrz.root.comops.site
08:07:00.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 4581996
08:07:00.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:07:00.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:00.225982 25095 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:07:00.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:00.228188 25095 file_cache.cc:493] Constructed file cache file cache with capacity 419430
08:07:00.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:00.245738 25119 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:00.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:00.252138 25092 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.61.252" port: 40207 } attempt: 4
08:07:00.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:00.255590 25092 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.61.252:40207: Network error: Client connection negotiation failed: client connection to 127.24.61.252:40207: connect: Connection refused (error 111)
08:07:00.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:00.483325 24962 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.61.253" port: 33137 } attempt: 7
08:07:00.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:00.507289 24962 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.61.252" port: 40207 } has no permanent_uuid. Determining permanent_uuid...
08:07:00.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:00.520758 24962 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.61.252:40207: Network error: Client connection negotiation failed: client connection to 127.24.61.252:40207: connect: Connection refused (error 111)
08:07:00.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:00.554966 25092 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.61.252" port: 40207 } attempt: 5
08:07:00.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:00.559101 25092 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.61.252:40207: Network error: Client connection negotiation failed: client connection to 127.24.61.252:40207: connect: Connection refused (error 111)
08:07:00.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:00.579264 24962 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.61.252" port: 40207 } attempt: 1
08:07:00.583 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:00.582995 24962 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.61.252:40207: Network error: Client connection negotiation failed: client connection to 127.24.61.252:40207: connect: Connection refused (error 111)
08:07:00.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:00.664495 24962 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.61.252" port: 40207 } attempt: 2
08:07:00.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:00.668329 24962 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.61.252:40207: Network error: Client connection negotiation failed: client connection to 127.24.61.252:40207: connect: Connection refused (error 111)
08:07:00.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:00.753815 24962 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.61.252" port: 40207 } attempt: 3
08:07:00.757 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:00.757570 24962 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.61.252:40207: Network error: Client connection negotiation failed: client connection to 127.24.61.252:40207: connect: Connection refused (error 111)
08:07:00.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:00.898054 24962 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.61.252" port: 40207 } attempt: 4
08:07:00.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:00.901867 24962 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.61.252:40207: Network error: Client connection negotiation failed: client connection to 127.24.61.252:40207: connect: Connection refused (error 111)
08:07:01.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.106467 25092 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.61.252" port: 40207 } attempt: 6
08:07:01.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:01.124166 25092 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.61.252:40207: Network error: Client connection negotiation failed: client connection to 127.24.61.252:40207: connect: Connection refused (error 111)
08:07:01.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.185369 24962 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.61.252" port: 40207 } attempt: 5
08:07:01.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:01.189007 24962 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.24.61.252:40207: Network error: Client connection negotiation failed: client connection to 127.24.61.252:40207: connect: Connection refused (error 111)
08:07:01.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:00.245770 25124 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:01.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:00.247108 25118 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:01.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:01.354300 25122 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
08:07:01.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.354439 25095 server_base.cc:1029] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:07:01.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.357735 25095 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:07:01.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.360662 25095 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:07:01.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.362071 25095 hybrid_clock.cc:648] HybridClock initialized: now 1786522021362017 us; error 73 us; skew 500 ppm
08:07:01.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.362877 25095 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:07:01.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.369349 25095 webserver.cc:460] Webserver started at http://127.24.61.252:46623/ using document root <none> and password file <none>
08:07:01.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.370318 25095 fs_manager.cc:359] Metadata directory not provided
08:07:01.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.370505 25095 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:07:01.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.370899 25095 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
08:07:01.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.375975 25095 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/master-2/data/instance:
08:07:01.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "39818d5ab781409db0ab76464440eb2a"
08:07:01.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 08:07:01 on dist-test-slave-f0tn"
08:07:01.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.377046 25095 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/master-2/wal/instance:
08:07:01.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "39818d5ab781409db0ab76464440eb2a"
08:07:01.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 08:07:01 on dist-test-slave-f0tn"
08:07:01.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.384016 25095 fs_manager.cc:691] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.000s
08:07:01.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.389339 25144 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:07:01.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.390479 25095 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
08:07:01.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.390766 25095 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/master-2/data,/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/master-2/wal
08:07:01.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "39818d5ab781409db0ab76464440eb2a"
08:07:01.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 08:07:01 on dist-test-slave-f0tn"
08:07:01.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.391103 25095 fs_report.cc:383] FS layout report
08:07:01.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:07:01.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/master-2/wal
08:07:01.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/master-2/wal
08:07:01.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/master-2/data/data
08:07:01.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:07:01.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:07:01.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:07:01.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:07:01.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:07:01.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:07:01.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:07:01.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:07:01.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:07:01.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:07:01.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:07:01.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.437851 25095 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
08:07:01.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.439380 25095 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:07:01.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.439872 25095 kserver.cc:163] Server-wide thread pool size limit: 3276
08:07:01.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.507439 25095 rpc_server.cc:307] RPC server started. Bound to: 127.24.61.252:40207
08:07:01.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.507553 25231 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.61.252:40207 every 8 connection(s)
08:07:01.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.510146 25095 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/master-2/data/info.pb
08:07:01.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.515947 25232 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
08:07:01.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.516201 24823 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgk96or/build/tsan/bin/kudu as pid 25095
08:07:01.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.516659 24823 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/master-2/wal/instance
08:07:01.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.532858 25232 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.61.254" port: 46441 } has no permanent_uuid. Determining permanent_uuid...
08:07:01.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.562484 25232 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.61.253" port: 33137 } has no permanent_uuid. Determining permanent_uuid...
08:07:01.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.574574 25232 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.24.61.252" port: 40207 } has no permanent_uuid. Determining permanent_uuid...
08:07:01.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.591804 25232 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 39818d5ab781409db0ab76464440eb2a: Bootstrap starting.
08:07:01.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.597786 25232 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 39818d5ab781409db0ab76464440eb2a: Neither blocks nor log segments found. Creating new log.
08:07:01.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.600452 25232 log.cc:824] T 00000000000000000000000000000000 P 39818d5ab781409db0ab76464440eb2a: Log is configured to *not* fsync() on all Append() calls
08:07:01.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.604718 25232 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 39818d5ab781409db0ab76464440eb2a: No bootstrap required, opened a new log
08:07:01.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.626811 25232 raft_consensus.cc:348] T 00000000000000000000000000000000 P 39818d5ab781409db0ab76464440eb2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164d87d429da4a85a4902a8601d0b511" member_type: VOTER last_known_addr { host: "127.24.61.254" port: 46441 } } peers { permanent_uuid: "f0ec94f0ebe642ffb18161428b38882e" member_type: VOTER last_known_addr { host: "127.24.61.253" port: 33137 } } peers { permanent_uuid: "39818d5ab781409db0ab76464440eb2a" member_type: VOTER last_known_addr { host: "127.24.61.252" port: 40207 } }
08:07:01.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.627442 25232 raft_consensus.cc:374] T 00000000000000000000000000000000 P 39818d5ab781409db0ab76464440eb2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:07:01.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.627631 25232 raft_consensus.cc:729] T 00000000000000000000000000000000 P 39818d5ab781409db0ab76464440eb2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39818d5ab781409db0ab76464440eb2a, State: Initialized, Role: FOLLOWER
08:07:01.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.628726 25232 consensus_queue.cc:260] T 00000000000000000000000000000000 P 39818d5ab781409db0ab76464440eb2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164d87d429da4a85a4902a8601d0b511" member_type: VOTER last_known_addr { host: "127.24.61.254" port: 46441 } } peers { permanent_uuid: "f0ec94f0ebe642ffb18161428b38882e" member_type: VOTER last_known_addr { host: "127.24.61.253" port: 33137 } } peers { permanent_uuid: "39818d5ab781409db0ab76464440eb2a" member_type: VOTER last_known_addr { host: "127.24.61.252" port: 40207 } }
08:07:01.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.631392 25248 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39818d5ab781409db0ab76464440eb2a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164d87d429da4a85a4902a8601d0b511" member_type: VOTER last_known_addr { host: "127.24.61.254" port: 46441 } } peers { permanent_uuid: "f0ec94f0ebe642ffb18161428b38882e" member_type: VOTER last_known_addr { host: "127.24.61.253" port: 33137 } } peers { permanent_uuid: "39818d5ab781409db0ab76464440eb2a" member_type: VOTER last_known_addr { host: "127.24.61.252" port: 40207 } } }
08:07:01.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.632476 25248 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39818d5ab781409db0ab76464440eb2a [sys.catalog]: This master's current role is: FOLLOWER
08:07:01.633 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.632973 25232 sys_catalog.cc:564] T 00000000000000000000000000000000 P 39818d5ab781409db0ab76464440eb2a [sys.catalog]: configured and running, proceeding with master startup.
08:07:01.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:01.657756 25267 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 39818d5ab781409db0ab76464440eb2a: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
08:07:01.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:01.658118 25267 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
08:07:01.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.653450 25095 master_runner.cc:186] Error getting master registration for 127.24.61.254:46441: OK, instance_id { permanent_uuid: "164d87d429da4a85a4902a8601d0b511" instance_seqno: 1786522018121252 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
08:07:01.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.678617 25095 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
08:07:01.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:01.694941 25158 tablet.cc:2369] T 00000000000000000000000000000000 P 39818d5ab781409db0ab76464440eb2a: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:07:01.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.720261 25248 raft_consensus.cc:482] T 00000000000000000000000000000000 P 39818d5ab781409db0ab76464440eb2a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:07:01.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.720671 25248 raft_consensus.cc:504] T 00000000000000000000000000000000 P 39818d5ab781409db0ab76464440eb2a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164d87d429da4a85a4902a8601d0b511" member_type: VOTER last_known_addr { host: "127.24.61.254" port: 46441 } } peers { permanent_uuid: "f0ec94f0ebe642ffb18161428b38882e" member_type: VOTER last_known_addr { host: "127.24.61.253" port: 33137 } } peers { permanent_uuid: "39818d5ab781409db0ab76464440eb2a" member_type: VOTER last_known_addr { host: "127.24.61.252" port: 40207 } }
08:07:01.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.722615 25248 leader_election.cc:288] T 00000000000000000000000000000000 P 39818d5ab781409db0ab76464440eb2a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 164d87d429da4a85a4902a8601d0b511 (127.24.61.254:46441), f0ec94f0ebe642ffb18161428b38882e (127.24.61.253:33137)
08:07:01.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.741410 24962 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.61.252" port: 40207 } attempt: 6
08:07:01.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.764926 24962 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 164d87d429da4a85a4902a8601d0b511: Bootstrap starting.
08:07:01.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.771740 24962 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 164d87d429da4a85a4902a8601d0b511: Neither blocks nor log segments found. Creating new log.
08:07:01.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.773656 24962 log.cc:824] T 00000000000000000000000000000000 P 164d87d429da4a85a4902a8601d0b511: Log is configured to *not* fsync() on all Append() calls
08:07:01.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.778762 24962 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 164d87d429da4a85a4902a8601d0b511: No bootstrap required, opened a new log
08:07:01.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.807956 24962 raft_consensus.cc:348] T 00000000000000000000000000000000 P 164d87d429da4a85a4902a8601d0b511 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164d87d429da4a85a4902a8601d0b511" member_type: VOTER last_known_addr { host: "127.24.61.254" port: 46441 } } peers { permanent_uuid: "f0ec94f0ebe642ffb18161428b38882e" member_type: VOTER last_known_addr { host: "127.24.61.253" port: 33137 } } peers { permanent_uuid: "39818d5ab781409db0ab76464440eb2a" member_type: VOTER last_known_addr { host: "127.24.61.252" port: 40207 } }
08:07:01.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.808794 24962 raft_consensus.cc:374] T 00000000000000000000000000000000 P 164d87d429da4a85a4902a8601d0b511 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:07:01.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.809147 24962 raft_consensus.cc:729] T 00000000000000000000000000000000 P 164d87d429da4a85a4902a8601d0b511 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 164d87d429da4a85a4902a8601d0b511, State: Initialized, Role: FOLLOWER
08:07:01.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.810184 24962 consensus_queue.cc:260] T 00000000000000000000000000000000 P 164d87d429da4a85a4902a8601d0b511 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164d87d429da4a85a4902a8601d0b511" member_type: VOTER last_known_addr { host: "127.24.61.254" port: 46441 } } peers { permanent_uuid: "f0ec94f0ebe642ffb18161428b38882e" member_type: VOTER last_known_addr { host: "127.24.61.253" port: 33137 } } peers { permanent_uuid: "39818d5ab781409db0ab76464440eb2a" member_type: VOTER last_known_addr { host: "127.24.61.252" port: 40207 } }
08:07:01.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.813035 25272 sys_catalog.cc:455] T 00000000000000000000000000000000 P 164d87d429da4a85a4902a8601d0b511 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164d87d429da4a85a4902a8601d0b511" member_type: VOTER last_known_addr { host: "127.24.61.254" port: 46441 } } peers { permanent_uuid: "f0ec94f0ebe642ffb18161428b38882e" member_type: VOTER last_known_addr { host: "127.24.61.253" port: 33137 } } peers { permanent_uuid: "39818d5ab781409db0ab76464440eb2a" member_type: VOTER last_known_addr { host: "127.24.61.252" port: 40207 } } }
08:07:01.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.814108 25272 sys_catalog.cc:458] T 00000000000000000000000000000000 P 164d87d429da4a85a4902a8601d0b511 [sys.catalog]: This master's current role is: FOLLOWER
08:07:01.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.814929 24962 sys_catalog.cc:564] T 00000000000000000000000000000000 P 164d87d429da4a85a4902a8601d0b511 [sys.catalog]: configured and running, proceeding with master startup.
08:07:01.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.815188 24923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "39818d5ab781409db0ab76464440eb2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164d87d429da4a85a4902a8601d0b511" is_pre_election: true
08:07:01.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.816125 24923 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 164d87d429da4a85a4902a8601d0b511 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 39818d5ab781409db0ab76464440eb2a in term 0.
08:07:01.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.817605 25155 leader_election.cc:302] T 00000000000000000000000000000000 P 39818d5ab781409db0ab76464440eb2a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164d87d429da4a85a4902a8601d0b511, 39818d5ab781409db0ab76464440eb2a; no voters: 
08:07:01.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.818769 25248 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 39818d5ab781409db0ab76464440eb2a [term 0 FOLLOWER]: Leader pre-election won for term 1
08:07:01.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.819157 25248 raft_consensus.cc:482] T 00000000000000000000000000000000 P 39818d5ab781409db0ab76464440eb2a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:07:01.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.819478 25248 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 39818d5ab781409db0ab76464440eb2a [term 0 FOLLOWER]: Advancing to term 1
08:07:01.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:01.830073 24880 tablet.cc:2369] T 00000000000000000000000000000000 P 164d87d429da4a85a4902a8601d0b511: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:07:01.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.831553 25248 raft_consensus.cc:504] T 00000000000000000000000000000000 P 39818d5ab781409db0ab76464440eb2a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164d87d429da4a85a4902a8601d0b511" member_type: VOTER last_known_addr { host: "127.24.61.254" port: 46441 } } peers { permanent_uuid: "f0ec94f0ebe642ffb18161428b38882e" member_type: VOTER last_known_addr { host: "127.24.61.253" port: 33137 } } peers { permanent_uuid: "39818d5ab781409db0ab76464440eb2a" member_type: VOTER last_known_addr { host: "127.24.61.252" port: 40207 } }
08:07:01.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.844635 24923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "39818d5ab781409db0ab76464440eb2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "164d87d429da4a85a4902a8601d0b511"
08:07:01.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.845672 24923 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 164d87d429da4a85a4902a8601d0b511 [term 0 FOLLOWER]: Advancing to term 1
08:07:01.851 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.850767 25248 leader_election.cc:288] T 00000000000000000000000000000000 P 39818d5ab781409db0ab76464440eb2a [CANDIDATE]: Term 1 election: Requested vote from peers 164d87d429da4a85a4902a8601d0b511 (127.24.61.254:46441), f0ec94f0ebe642ffb18161428b38882e (127.24.61.253:33137)
08:07:01.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.857791 24923 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 164d87d429da4a85a4902a8601d0b511 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 39818d5ab781409db0ab76464440eb2a in term 1.
08:07:01.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.859709 25155 leader_election.cc:302] T 00000000000000000000000000000000 P 39818d5ab781409db0ab76464440eb2a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164d87d429da4a85a4902a8601d0b511, 39818d5ab781409db0ab76464440eb2a; no voters: 
08:07:01.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.860852 25248 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 39818d5ab781409db0ab76464440eb2a [term 1 FOLLOWER]: Leader election won for term 1
08:07:01.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.878217 25248 raft_consensus.cc:686] T 00000000000000000000000000000000 P 39818d5ab781409db0ab76464440eb2a [term 1 LEADER]: Becoming Leader. State: Replica: 39818d5ab781409db0ab76464440eb2a, State: Running, Role: LEADER
08:07:01.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.879997 25248 consensus_queue.cc:237] T 00000000000000000000000000000000 P 39818d5ab781409db0ab76464440eb2a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164d87d429da4a85a4902a8601d0b511" member_type: VOTER last_known_addr { host: "127.24.61.254" port: 46441 } } peers { permanent_uuid: "f0ec94f0ebe642ffb18161428b38882e" member_type: VOTER last_known_addr { host: "127.24.61.253" port: 33137 } } peers { permanent_uuid: "39818d5ab781409db0ab76464440eb2a" member_type: VOTER last_known_addr { host: "127.24.61.252" port: 40207 } }
08:07:01.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.894124 25284 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39818d5ab781409db0ab76464440eb2a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 39818d5ab781409db0ab76464440eb2a. Latest consensus state: current_term: 1 leader_uuid: "39818d5ab781409db0ab76464440eb2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164d87d429da4a85a4902a8601d0b511" member_type: VOTER last_known_addr { host: "127.24.61.254" port: 46441 } } peers { permanent_uuid: "f0ec94f0ebe642ffb18161428b38882e" member_type: VOTER last_known_addr { host: "127.24.61.253" port: 33137 } } peers { permanent_uuid: "39818d5ab781409db0ab76464440eb2a" member_type: VOTER last_known_addr { host: "127.24.61.252" port: 40207 } } }
08:07:01.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.894938 25284 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39818d5ab781409db0ab76464440eb2a [sys.catalog]: This master's current role is: LEADER
08:07:01.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.898892 25301 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
08:07:01.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.907920 25301 catalog_manager.cc:1484] Initializing Kudu cluster ID...
08:07:01.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:01.917066 25300 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 164d87d429da4a85a4902a8601d0b511: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
08:07:01.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:01.917797 25300 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
08:07:01.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.950699 24923 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 164d87d429da4a85a4902a8601d0b511 [term 1 FOLLOWER]: Refusing update from remote peer 39818d5ab781409db0ab76464440eb2a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
08:07:01.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.954252 25248 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 39818d5ab781409db0ab76464440eb2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "164d87d429da4a85a4902a8601d0b511" member_type: VOTER last_known_addr { host: "127.24.61.254" port: 46441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
08:07:01.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.905874 24839 master_runner.cc:186] Error getting master registration for 127.24.61.253:33137: OK, instance_id { permanent_uuid: "f0ec94f0ebe642ffb18161428b38882e" instance_seqno: 1786522019801266 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
08:07:01.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.966591 24839 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
08:07:02.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:01.999114 25272 sys_catalog.cc:455] T 00000000000000000000000000000000 P 164d87d429da4a85a4902a8601d0b511 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 39818d5ab781409db0ab76464440eb2a. Latest consensus state: current_term: 1 leader_uuid: "39818d5ab781409db0ab76464440eb2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164d87d429da4a85a4902a8601d0b511" member_type: VOTER last_known_addr { host: "127.24.61.254" port: 46441 } } peers { permanent_uuid: "f0ec94f0ebe642ffb18161428b38882e" member_type: VOTER last_known_addr { host: "127.24.61.253" port: 33137 } } peers { permanent_uuid: "39818d5ab781409db0ab76464440eb2a" member_type: VOTER last_known_addr { host: "127.24.61.252" port: 40207 } } }
08:07:02.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:02.004004 25272 sys_catalog.cc:458] T 00000000000000000000000000000000 P 164d87d429da4a85a4902a8601d0b511 [sys.catalog]: This master's current role is: FOLLOWER
08:07:02.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:02.011533 25303 mvcc.cc:205] Tried to move back new op lower bound from 7317594201871626240 to 7317594201638838272. Current Snapshot: MvccSnapshot[applied={T|T < 7317594201871626240}]
08:07:02.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:02.023412 25301 catalog_manager.cc:1347] Generated new cluster ID: 374e33df11bf458eb8f93c83c97c5595
08:07:02.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:02.023769 25301 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
08:07:02.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:02.025992 25284 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39818d5ab781409db0ab76464440eb2a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "39818d5ab781409db0ab76464440eb2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164d87d429da4a85a4902a8601d0b511" member_type: VOTER last_known_addr { host: "127.24.61.254" port: 46441 } } peers { permanent_uuid: "f0ec94f0ebe642ffb18161428b38882e" member_type: VOTER last_known_addr { host: "127.24.61.253" port: 33137 } } peers { permanent_uuid: "39818d5ab781409db0ab76464440eb2a" member_type: VOTER last_known_addr { host: "127.24.61.252" port: 40207 } } }
08:07:02.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:02.026331 25272 sys_catalog.cc:455] T 00000000000000000000000000000000 P 164d87d429da4a85a4902a8601d0b511 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "39818d5ab781409db0ab76464440eb2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164d87d429da4a85a4902a8601d0b511" member_type: VOTER last_known_addr { host: "127.24.61.254" port: 46441 } } peers { permanent_uuid: "f0ec94f0ebe642ffb18161428b38882e" member_type: VOTER last_known_addr { host: "127.24.61.253" port: 33137 } } peers { permanent_uuid: "39818d5ab781409db0ab76464440eb2a" member_type: VOTER last_known_addr { host: "127.24.61.252" port: 40207 } } }
08:07:02.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:02.026790 25284 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39818d5ab781409db0ab76464440eb2a [sys.catalog]: This master's current role is: LEADER
08:07:02.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:02.027055 25272 sys_catalog.cc:458] T 00000000000000000000000000000000 P 164d87d429da4a85a4902a8601d0b511 [sys.catalog]: This master's current role is: FOLLOWER
08:07:02.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:02.075133 25301 catalog_manager.cc:1370] Generated new certificate authority record
08:07:02.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:02.089730 25301 catalog_manager.cc:1504] Loading token signing keys...
08:07:02.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:02.125911 25301 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 39818d5ab781409db0ab76464440eb2a: Generated new TSK 0
08:07:02.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:02.129082 25301 catalog_manager.cc:1514] Initializing in-progress tserver states...
08:07:02.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:02.146997 24823 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgk96or/build/tsan/bin/kudu
08:07:02.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgk96or/build/tsan/bin/kudu
08:07:02.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/ts-0/wal
08:07:02.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/ts-0/data
08:07:02.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:07:02.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:07:02.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:07:02.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:07:02.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:07:02.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:07:02.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/ts-0/logs
08:07:02.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/ts-0/data/info.pb
08:07:02.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:07:02.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:07:02.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:07:02.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:07:02.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:07:02.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:07:02.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:07:02.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:07:02.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
08:07:02.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:07:02.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.24.61.193:0
08:07:02.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.24.61.193
08:07:02.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.24.61.193
08:07:02.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:07:02.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.24.61.254:46441,127.24.61.253:33137,127.24.61.252:40207
08:07:02.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.24.61.212:40075
08:07:02.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:07:02.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:07:02.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
08:07:02.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:02.184688 25092 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.24.61.252" port: 40207 } attempt: 7
08:07:02.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:02.245404 25092 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0ec94f0ebe642ffb18161428b38882e: Bootstrap starting.
08:07:02.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:02.252252 25092 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f0ec94f0ebe642ffb18161428b38882e: Neither blocks nor log segments found. Creating new log.
08:07:02.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:02.266539 25092 log.cc:824] T 00000000000000000000000000000000 P f0ec94f0ebe642ffb18161428b38882e: Log is configured to *not* fsync() on all Append() calls
08:07:02.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:02.283835 25092 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f0ec94f0ebe642ffb18161428b38882e: No bootstrap required, opened a new log
08:07:02.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:02.344326 25092 raft_consensus.cc:348] T 00000000000000000000000000000000 P f0ec94f0ebe642ffb18161428b38882e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164d87d429da4a85a4902a8601d0b511" member_type: VOTER last_known_addr { host: "127.24.61.254" port: 46441 } } peers { permanent_uuid: "f0ec94f0ebe642ffb18161428b38882e" member_type: VOTER last_known_addr { host: "127.24.61.253" port: 33137 } } peers { permanent_uuid: "39818d5ab781409db0ab76464440eb2a" member_type: VOTER last_known_addr { host: "127.24.61.252" port: 40207 } }
08:07:02.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:02.345253 25092 raft_consensus.cc:374] T 00000000000000000000000000000000 P f0ec94f0ebe642ffb18161428b38882e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:07:02.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:02.345692 25092 raft_consensus.cc:729] T 00000000000000000000000000000000 P f0ec94f0ebe642ffb18161428b38882e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f0ec94f0ebe642ffb18161428b38882e, State: Initialized, Role: FOLLOWER
08:07:02.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:02.346596 25092 consensus_queue.cc:260] T 00000000000000000000000000000000 P f0ec94f0ebe642ffb18161428b38882e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164d87d429da4a85a4902a8601d0b511" member_type: VOTER last_known_addr { host: "127.24.61.254" port: 46441 } } peers { permanent_uuid: "f0ec94f0ebe642ffb18161428b38882e" member_type: VOTER last_known_addr { host: "127.24.61.253" port: 33137 } } peers { permanent_uuid: "39818d5ab781409db0ab76464440eb2a" member_type: VOTER last_known_addr { host: "127.24.61.252" port: 40207 } }
08:07:02.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:02.350667 25317 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0ec94f0ebe642ffb18161428b38882e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164d87d429da4a85a4902a8601d0b511" member_type: VOTER last_known_addr { host: "127.24.61.254" port: 46441 } } peers { permanent_uuid: "f0ec94f0ebe642ffb18161428b38882e" member_type: VOTER last_known_addr { host: "127.24.61.253" port: 33137 } } peers { permanent_uuid: "39818d5ab781409db0ab76464440eb2a" member_type: VOTER last_known_addr { host: "127.24.61.252" port: 40207 } } }
08:07:02.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:02.359786 25092 sys_catalog.cc:564] T 00000000000000000000000000000000 P f0ec94f0ebe642ffb18161428b38882e [sys.catalog]: configured and running, proceeding with master startup.
08:07:02.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:02.360404 25049 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f0ec94f0ebe642ffb18161428b38882e [term 0 FOLLOWER]: Advancing to term 1
08:07:02.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:02.360908 25053 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "39818d5ab781409db0ab76464440eb2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ec94f0ebe642ffb18161428b38882e" is_pre_election: true
08:07:02.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:02.361689 25050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "39818d5ab781409db0ab76464440eb2a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f0ec94f0ebe642ffb18161428b38882e"
08:07:02.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:02.380699 25049 raft_consensus.cc:1261] T 00000000000000000000000000000000 P f0ec94f0ebe642ffb18161428b38882e [term 1 FOLLOWER]: Refusing update from remote peer 39818d5ab781409db0ab76464440eb2a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
08:07:02.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:02.382718 25317 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0ec94f0ebe642ffb18161428b38882e [sys.catalog]: This master's current role is: FOLLOWER
08:07:02.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:02.382795 25248 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 39818d5ab781409db0ab76464440eb2a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f0ec94f0ebe642ffb18161428b38882e" member_type: VOTER last_known_addr { host: "127.24.61.253" port: 33137 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
08:07:02.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:02.452247 25317 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0ec94f0ebe642ffb18161428b38882e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 39818d5ab781409db0ab76464440eb2a. Latest consensus state: current_term: 1 leader_uuid: "39818d5ab781409db0ab76464440eb2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164d87d429da4a85a4902a8601d0b511" member_type: VOTER last_known_addr { host: "127.24.61.254" port: 46441 } } peers { permanent_uuid: "f0ec94f0ebe642ffb18161428b38882e" member_type: VOTER last_known_addr { host: "127.24.61.253" port: 33137 } } peers { permanent_uuid: "39818d5ab781409db0ab76464440eb2a" member_type: VOTER last_known_addr { host: "127.24.61.252" port: 40207 } } }
08:07:02.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:02.453055 25317 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0ec94f0ebe642ffb18161428b38882e [sys.catalog]: This master's current role is: FOLLOWER
08:07:02.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:02.454111 25332 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0ec94f0ebe642ffb18161428b38882e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "39818d5ab781409db0ab76464440eb2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164d87d429da4a85a4902a8601d0b511" member_type: VOTER last_known_addr { host: "127.24.61.254" port: 46441 } } peers { permanent_uuid: "f0ec94f0ebe642ffb18161428b38882e" member_type: VOTER last_known_addr { host: "127.24.61.253" port: 33137 } } peers { permanent_uuid: "39818d5ab781409db0ab76464440eb2a" member_type: VOTER last_known_addr { host: "127.24.61.252" port: 40207 } } }
08:07:02.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:02.455247 25332 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0ec94f0ebe642ffb18161428b38882e [sys.catalog]: This master's current role is: FOLLOWER
08:07:02.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:02.484521 25349 catalog_manager.cc:1259] Loaded cluster ID: 374e33df11bf458eb8f93c83c97c5595
08:07:02.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:02.490329 25349 catalog_manager.cc:1552] T 00000000000000000000000000000000 P f0ec94f0ebe642ffb18161428b38882e: loading cluster ID for follower catalog manager: success
08:07:02.499 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:02.498725 25349 catalog_manager.cc:1574] T 00000000000000000000000000000000 P f0ec94f0ebe642ffb18161428b38882e: acquiring CA information for follower catalog manager: success
08:07:02.545 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:02.534117 25349 catalog_manager.cc:1602] T 00000000000000000000000000000000 P f0ec94f0ebe642ffb18161428b38882e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
08:07:02.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:02.841288 25312 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
08:07:02.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:02.842134 25312 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:07:02.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:02.842900 25312 flags.cc:425] Enabled unsafe flag: --never_fsync=true
08:07:02.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:02.923612 25300 catalog_manager.cc:1259] Loaded cluster ID: 374e33df11bf458eb8f93c83c97c5595
08:07:02.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:02.923897 25300 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 164d87d429da4a85a4902a8601d0b511: loading cluster ID for follower catalog manager: success
08:07:02.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:02.932690 25300 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 164d87d429da4a85a4902a8601d0b511: acquiring CA information for follower catalog manager: success
08:07:02.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:02.949534 25300 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 164d87d429da4a85a4902a8601d0b511: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
08:07:02.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:02.952644 25312 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
08:07:02.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:02.956775 25312 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.61.193
08:07:02.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:02.961886 25248 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39818d5ab781409db0ab76464440eb2a [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "39818d5ab781409db0ab76464440eb2a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164d87d429da4a85a4902a8601d0b511" member_type: VOTER last_known_addr { host: "127.24.61.254" port: 46441 } } peers { permanent_uuid: "f0ec94f0ebe642ffb18161428b38882e" member_type: VOTER last_known_addr { host: "127.24.61.253" port: 33137 } } peers { permanent_uuid: "39818d5ab781409db0ab76464440eb2a" member_type: VOTER last_known_addr { host: "127.24.61.252" port: 40207 } } }
08:07:02.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:02.976253 25248 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39818d5ab781409db0ab76464440eb2a [sys.catalog]: This master's current role is: LEADER
08:07:03.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:03.018071 25312 tablet_server_runner.cc:78] Tablet server non-default flags:
08:07:03.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:07:03.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.24.61.212:40075
08:07:03.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:07:03.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:07:03.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/ts-0/data
08:07:03.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/ts-0/wal
08:07:03.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:07:03.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:07:03.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.24.61.193:0
08:07:03.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:07:03.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:07:03.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:07:03.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/ts-0/data/info.pb
08:07:03.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.24.61.193
08:07:03.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:07:03.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.24.61.254:46441,127.24.61.253:33137,127.24.61.252:40207
08:07:03.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:07:03.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:07:03.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:07:03.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:07:03.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:07:03.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.24.61.193
08:07:03.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/ts-0/logs
08:07:03.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:07:03.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:07:03.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:07:03.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
08:07:03.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.18.0-SNAPSHOT
08:07:03.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
08:07:03.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:07:03.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by systest at 12 Aug 2026 06:37:03 UTC on ccycloud.quasar-wifqrz.root.comops.site
08:07:03.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 4581996
08:07:03.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:07:03.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:03.019625 25312 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:07:03.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:03.021792 25312 file_cache.cc:493] Constructed file cache file cache with capacity 419430
08:07:03.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:03.067759 25367 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:04.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:04.669273 25312 thread.cc:636] OpenStack (cloud detector) Time spent creating pthread: real 1.607s	user 0.470s	sys 0.684s
08:07:04.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:04.670727 25312 thread.cc:602] OpenStack (cloud detector) Time spent starting thread: real 1.609s	user 0.470s	sys 0.684s
08:07:04.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:04.670994 25312 server_base.cc:1029] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:07:04.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:04.671048 25372 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:04.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:04.669843 25368 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
08:07:04.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:04.444603 25365 debug-util.cc:398] Leaking SignalData structure 0x7b0800014860 after lost signal to thread 25312
08:07:04.676 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:03.070422 25366 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:04.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:04.677129 25312 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:07:04.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:04.685451 25312 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:07:04.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:04.693183 25312 hybrid_clock.cc:648] HybridClock initialized: now 1786522024693130 us; error 54 us; skew 500 ppm
08:07:04.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:04.694415 25312 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:07:04.717 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:04.716892 25312 webserver.cc:460] Webserver started at http://127.24.61.193:38785/ using document root <none> and password file <none>
08:07:04.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:04.718230 25312 fs_manager.cc:359] Metadata directory not provided
08:07:04.718 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:04.718533 25312 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:07:04.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:04.719125 25312 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
08:07:04.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:04.726574 25312 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/ts-0/data/instance:
08:07:04.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d85a6ca1566c4a959823d91e3140f3d5"
08:07:04.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 08:07:04 on dist-test-slave-f0tn"
08:07:04.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:04.728102 25312 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/ts-0/wal/instance:
08:07:04.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d85a6ca1566c4a959823d91e3140f3d5"
08:07:04.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 08:07:04 on dist-test-slave-f0tn"
08:07:04.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:04.744029 25312 fs_manager.cc:691] Time spent creating directory manager: real 0.015s	user 0.013s	sys 0.000s
08:07:04.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:04.762621 25384 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:07:04.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:04.764518 25312 fs_manager.cc:725] Time spent opening block manager: real 0.015s	user 0.010s	sys 0.006s
08:07:04.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:04.765185 25312 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/ts-0/data,/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/ts-0/wal
08:07:04.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d85a6ca1566c4a959823d91e3140f3d5"
08:07:04.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 08:07:04 on dist-test-slave-f0tn"
08:07:04.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:04.765888 25312 fs_report.cc:383] FS layout report
08:07:04.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:07:04.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/ts-0/wal
08:07:04.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/ts-0/wal
08:07:04.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/ts-0/data/data
08:07:04.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:07:04.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:07:04.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:07:04.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:07:04.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:07:04.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:07:04.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:07:04.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:07:04.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:07:04.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:07:04.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:07:04.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:04.876381 25312 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
08:07:04.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:04.878721 25312 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:07:04.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:04.879585 25312 kserver.cc:163] Server-wide thread pool size limit: 3276
08:07:04.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:04.888541 25312 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
08:07:04.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:04.894775 25312 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
08:07:04.895 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:04.895308 25312 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.001s	user 0.001s	sys 0.000s
08:07:04.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:04.895781 25312 ts_tablet_manager.cc:610] Registered 0 tablets
08:07:04.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:04.896234 25312 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
08:07:05.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:05.075663 25312 rpc_server.cc:307] RPC server started. Bound to: 127.24.61.193:40571
08:07:05.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:05.075784 25602 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.61.193:40571 every 8 connection(s)
08:07:05.078 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:05.078670 25312 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/ts-0/data/info.pb
08:07:05.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:05.082304 24823 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgk96or/build/tsan/bin/kudu as pid 25312
08:07:05.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:05.082814 24823 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/ts-0/wal/instance
08:07:05.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:05.094213 24823 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgk96or/build/tsan/bin/kudu
08:07:05.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgk96or/build/tsan/bin/kudu
08:07:05.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/ts-1/wal
08:07:05.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/ts-1/data
08:07:05.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:07:05.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:07:05.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:07:05.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:07:05.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:07:05.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:07:05.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/ts-1/logs
08:07:05.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/ts-1/data/info.pb
08:07:05.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:07:05.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:07:05.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:07:05.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:07:05.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:07:05.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:07:05.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:07:05.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:07:05.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
08:07:05.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:07:05.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.24.61.194:0
08:07:05.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.24.61.194
08:07:05.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.24.61.194
08:07:05.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:07:05.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.24.61.254:46441,127.24.61.253:33137,127.24.61.252:40207
08:07:05.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.24.61.212:40075
08:07:05.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:07:05.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:07:05.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
08:07:05.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:05.151857 25603 heartbeater.cc:347] Connected to a master server at 127.24.61.252:40207
08:07:05.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:05.152374 25603 heartbeater.cc:464] Registering TS with master...
08:07:05.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:05.153726 25603 heartbeater.cc:511] Master 127.24.61.252:40207 requested a full tablet report, sending...
08:07:05.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:05.156322 25608 heartbeater.cc:347] Connected to a master server at 127.24.61.254:46441
08:07:05.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:05.156670 25608 heartbeater.cc:464] Registering TS with master...
08:07:05.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:05.157277 25177 ts_manager.cc:194] Registered new tserver with Master: d85a6ca1566c4a959823d91e3140f3d5 (127.24.61.193:40571)
08:07:05.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:05.157526 25608 heartbeater.cc:511] Master 127.24.61.254:46441 requested a full tablet report, sending...
08:07:05.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:05.160223 25177 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.24.61.193:44847
08:07:05.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:05.160326 24896 ts_manager.cc:194] Registered new tserver with Master: d85a6ca1566c4a959823d91e3140f3d5 (127.24.61.193:40571)
08:07:05.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:05.171805 25604 heartbeater.cc:347] Connected to a master server at 127.24.61.253:33137
08:07:05.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:05.172169 25604 heartbeater.cc:464] Registering TS with master...
08:07:05.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:05.172909 25604 heartbeater.cc:511] Master 127.24.61.253:33137 requested a full tablet report, sending...
08:07:05.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:05.175817 25034 ts_manager.cc:194] Registered new tserver with Master: d85a6ca1566c4a959823d91e3140f3d5 (127.24.61.193:40571)
08:07:05.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:05.506155 25612 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
08:07:05.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:05.506799 25612 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:07:05.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:05.507525 25612 flags.cc:425] Enabled unsafe flag: --never_fsync=true
08:07:05.554 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:05.553984 25612 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
08:07:05.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:05.554811 25612 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.61.194
08:07:05.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:05.589761 25612 tablet_server_runner.cc:78] Tablet server non-default flags:
08:07:05.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:07:05.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.24.61.212:40075
08:07:05.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:07:05.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:07:05.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/ts-1/data
08:07:05.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/ts-1/wal
08:07:05.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:07:05.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:07:05.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.24.61.194:0
08:07:05.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:07:05.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:07:05.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:07:05.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/ts-1/data/info.pb
08:07:05.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.24.61.194
08:07:05.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:07:05.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.24.61.254:46441,127.24.61.253:33137,127.24.61.252:40207
08:07:05.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:07:05.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:07:05.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:07:05.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:07:05.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:07:05.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.24.61.194
08:07:05.591 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/ts-1/logs
08:07:05.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:07:05.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:07:05.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:07:05.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
08:07:05.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.18.0-SNAPSHOT
08:07:05.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
08:07:05.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:07:05.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by systest at 12 Aug 2026 06:37:03 UTC on ccycloud.quasar-wifqrz.root.comops.site
08:07:05.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 4581996
08:07:05.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:07:05.592 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:05.591048 25612 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:07:05.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:05.593230 25612 file_cache.cc:493] Constructed file cache file cache with capacity 419430
08:07:05.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:05.616710 25634 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:06.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:06.165107 25603 heartbeater.cc:503] Master 127.24.61.252:40207 was elected leader, sending a full tablet report...
08:07:06.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:05.619510 25633 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:06.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:05.622807 25637 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:06.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:06.787684 25636 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1168 milliseconds
08:07:06.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:06.787814 25612 server_base.cc:1029] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:07:06.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:06.791831 25612 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:07:06.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:06.794579 25612 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:07:06.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:06.795993 25612 hybrid_clock.cc:648] HybridClock initialized: now 1786522026795945 us; error 55 us; skew 500 ppm
08:07:06.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:06.797176 25612 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:07:06.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:06.805169 25612 webserver.cc:460] Webserver started at http://127.24.61.194:41119/ using document root <none> and password file <none>
08:07:06.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:06.806167 25612 fs_manager.cc:359] Metadata directory not provided
08:07:06.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:06.806363 25612 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:07:06.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:06.806756 25612 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
08:07:06.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:06.811717 25612 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/ts-1/data/instance:
08:07:06.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3485b67b72274f5f8da579248a3255c8"
08:07:06.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 08:07:06 on dist-test-slave-f0tn"
08:07:06.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:06.812981 25612 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/ts-1/wal/instance:
08:07:06.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3485b67b72274f5f8da579248a3255c8"
08:07:06.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 08:07:06 on dist-test-slave-f0tn"
08:07:06.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:06.820588 25612 fs_manager.cc:691] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.000s
08:07:06.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:06.827630 25656 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:07:06.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:06.828891 25612 fs_manager.cc:725] Time spent opening block manager: real 0.004s	user 0.006s	sys 0.000s
08:07:06.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:06.829272 25612 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/ts-1/data,/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/ts-1/wal
08:07:06.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "3485b67b72274f5f8da579248a3255c8"
08:07:06.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 08:07:06 on dist-test-slave-f0tn"
08:07:06.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:06.829713 25612 fs_report.cc:383] FS layout report
08:07:06.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:07:06.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/ts-1/wal
08:07:06.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/ts-1/wal
08:07:06.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/ts-1/data/data
08:07:06.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:07:06.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:07:06.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:07:06.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:07:06.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:07:06.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:07:06.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:07:06.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:07:06.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:07:06.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:07:06.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:07:06.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:06.880050 25612 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
08:07:06.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:06.881587 25612 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:07:06.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:06.882025 25612 kserver.cc:163] Server-wide thread pool size limit: 3276
08:07:06.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:06.884563 25612 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
08:07:06.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:06.888617 25612 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
08:07:06.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:06.888803 25612 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
08:07:06.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:06.889004 25612 ts_tablet_manager.cc:610] Registered 0 tablets
08:07:06.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:06.889145 25612 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
08:07:07.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:07.026822 25612 rpc_server.cc:307] RPC server started. Bound to: 127.24.61.194:41685
08:07:07.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:07.026925 25878 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.61.194:41685 every 8 connection(s)
08:07:07.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:07.029523 25612 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/ts-1/data/info.pb
08:07:07.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:07.030745 24823 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgk96or/build/tsan/bin/kudu as pid 25612
08:07:07.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:07.031446 24823 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/ts-1/wal/instance
08:07:07.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:07.044750 24823 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgk96or/build/tsan/bin/kudu
08:07:07.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgk96or/build/tsan/bin/kudu
08:07:07.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/ts-2/wal
08:07:07.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/ts-2/data
08:07:07.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:07:07.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:07:07.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:07:07.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:07:07.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:07:07.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:07:07.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/ts-2/logs
08:07:07.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/ts-2/data/info.pb
08:07:07.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:07:07.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:07:07.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:07:07.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:07:07.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:07:07.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:07:07.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:07:07.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:07:07.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
08:07:07.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:07:07.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.24.61.195:0
08:07:07.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.24.61.195
08:07:07.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.24.61.195
08:07:07.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:07:07.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.24.61.254:46441,127.24.61.253:33137,127.24.61.252:40207
08:07:07.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.24.61.212:40075
08:07:07.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:07:07.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:07:07.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
08:07:07.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:07.078953 25879 heartbeater.cc:347] Connected to a master server at 127.24.61.252:40207
08:07:07.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:07.079432 25879 heartbeater.cc:464] Registering TS with master...
08:07:07.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:07.080780 25879 heartbeater.cc:511] Master 127.24.61.252:40207 requested a full tablet report, sending...
08:07:07.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:07.083768 25177 ts_manager.cc:194] Registered new tserver with Master: 3485b67b72274f5f8da579248a3255c8 (127.24.61.194:41685)
08:07:07.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:07.086174 25177 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.24.61.194:36393
08:07:07.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:07.088728 25882 heartbeater.cc:347] Connected to a master server at 127.24.61.254:46441
08:07:07.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:07.089097 25882 heartbeater.cc:464] Registering TS with master...
08:07:07.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:07.090719 25882 heartbeater.cc:511] Master 127.24.61.254:46441 requested a full tablet report, sending...
08:07:07.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:07.093734 24896 ts_manager.cc:194] Registered new tserver with Master: 3485b67b72274f5f8da579248a3255c8 (127.24.61.194:41685)
08:07:07.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:07.096899 25880 heartbeater.cc:347] Connected to a master server at 127.24.61.253:33137
08:07:07.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:07.097254 25880 heartbeater.cc:464] Registering TS with master...
08:07:07.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:07.097980 25880 heartbeater.cc:511] Master 127.24.61.253:33137 requested a full tablet report, sending...
08:07:07.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:07.100251 25034 ts_manager.cc:194] Registered new tserver with Master: 3485b67b72274f5f8da579248a3255c8 (127.24.61.194:41685)
08:07:07.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:07.373510 25897 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
08:07:07.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:07.374063 25897 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:07:07.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:07.374619 25897 flags.cc:425] Enabled unsafe flag: --never_fsync=true
08:07:07.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:07.405246 25897 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
08:07:07.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:07.406204 25897 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.24.61.195
08:07:07.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:07.440274 25897 tablet_server_runner.cc:78] Tablet server non-default flags:
08:07:07.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:07:07.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.24.61.212:40075
08:07:07.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:07:07.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:07:07.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/ts-2/data
08:07:07.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/ts-2/wal
08:07:07.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:07:07.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:07:07.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.24.61.195:0
08:07:07.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:07:07.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:07:07.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:07:07.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/ts-2/data/info.pb
08:07:07.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.24.61.195
08:07:07.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:07:07.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.24.61.254:46441,127.24.61.253:33137,127.24.61.252:40207
08:07:07.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:07:07.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:07:07.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:07:07.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:07:07.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:07:07.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.24.61.195
08:07:07.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/ts-2/logs
08:07:07.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:07:07.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:07:07.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:07:07.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
08:07:07.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.18.0-SNAPSHOT
08:07:07.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
08:07:07.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:07:07.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by systest at 12 Aug 2026 06:37:03 UTC on ccycloud.quasar-wifqrz.root.comops.site
08:07:07.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 4581996
08:07:07.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:07:07.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:07.441897 25897 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:07:07.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:07.443611 25897 file_cache.cc:493] Constructed file cache file cache with capacity 419430
08:07:07.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:07.461655 25910 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:08.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:08.093202 25879 heartbeater.cc:503] Master 127.24.61.252:40207 was elected leader, sending a full tablet report...
08:07:08.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:07.461910 25911 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:08.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:07.462905 25913 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:08.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:07.464221 25897 server_base.cc:1034] running on GCE node
08:07:08.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:08.555125 25897 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:07:08.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:08.557437 25897 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:07:08.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:08.558809 25897 hybrid_clock.cc:648] HybridClock initialized: now 1786522028558778 us; error 33 us; skew 500 ppm
08:07:08.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:08.559635 25897 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:07:08.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:08.566110 25897 webserver.cc:460] Webserver started at http://127.24.61.195:41857/ using document root <none> and password file <none>
08:07:08.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:08.567056 25897 fs_manager.cc:359] Metadata directory not provided
08:07:08.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:08.567278 25897 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:07:08.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:08.567788 25897 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
08:07:08.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:08.572844 25897 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/ts-2/data/instance:
08:07:08.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f25bcf7d71df479b99062dde78725f0e"
08:07:08.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 08:07:08 on dist-test-slave-f0tn"
08:07:08.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:08.574170 25897 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/ts-2/wal/instance:
08:07:08.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f25bcf7d71df479b99062dde78725f0e"
08:07:08.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 08:07:08 on dist-test-slave-f0tn"
08:07:08.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:08.581197 25897 fs_manager.cc:691] Time spent creating directory manager: real 0.006s	user 0.006s	sys 0.000s
08:07:08.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:08.586732 25928 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:07:08.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:08.587744 25897 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.002s
08:07:08.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:08.588078 25897 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/ts-2/data,/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/ts-2/wal
08:07:08.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f25bcf7d71df479b99062dde78725f0e"
08:07:08.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 08:07:08 on dist-test-slave-f0tn"
08:07:08.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:08.588397 25897 fs_report.cc:383] FS layout report
08:07:08.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:07:08.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/ts-2/wal
08:07:08.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/ts-2/wal
08:07:08.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/ts-2/data/data
08:07:08.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:07:08.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:07:08.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:07:08.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:07:08.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:07:08.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:07:08.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:07:08.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:07:08.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:07:08.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:07:08.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:07:08.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:08.627624 25897 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
08:07:08.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:08.629271 25897 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:07:08.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:08.629804 25897 kserver.cc:163] Server-wide thread pool size limit: 3276
08:07:08.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:08.632403 25897 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
08:07:08.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:08.637422 25897 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
08:07:08.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:08.637717 25897 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
08:07:08.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:08.638059 25897 ts_tablet_manager.cc:610] Registered 0 tablets
08:07:08.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:08.638276 25897 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
08:07:08.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:08.774305 25897 rpc_server.cc:307] RPC server started. Bound to: 127.24.61.195:33319
08:07:08.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:08.774400 26133 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.24.61.195:33319 every 8 connection(s)
08:07:08.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:08.777060 25897 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/ts-2/data/info.pb
08:07:08.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:08.777904 24823 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgk96or/build/tsan/bin/kudu as pid 25897
08:07:08.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:08.778319 24823 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/ts-2/wal/instance
08:07:08.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:08.823523 26135 heartbeater.cc:347] Connected to a master server at 127.24.61.253:33137
08:07:08.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:08.823998 26135 heartbeater.cc:464] Registering TS with master...
08:07:08.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:08.824821 26136 heartbeater.cc:347] Connected to a master server at 127.24.61.254:46441
08:07:08.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:08.825129 26136 heartbeater.cc:464] Registering TS with master...
08:07:08.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:08.825207 26135 heartbeater.cc:511] Master 127.24.61.253:33137 requested a full tablet report, sending...
08:07:08.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:08.825941 26136 heartbeater.cc:511] Master 127.24.61.254:46441 requested a full tablet report, sending...
08:07:08.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:08.828437 25034 ts_manager.cc:194] Registered new tserver with Master: f25bcf7d71df479b99062dde78725f0e (127.24.61.195:33319)
08:07:08.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:08.828725 24896 ts_manager.cc:194] Registered new tserver with Master: f25bcf7d71df479b99062dde78725f0e (127.24.61.195:33319)
08:07:08.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:08.830463 26134 heartbeater.cc:347] Connected to a master server at 127.24.61.252:40207
08:07:08.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:08.830788 26134 heartbeater.cc:464] Registering TS with master...
08:07:08.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:08.831453 26134 heartbeater.cc:511] Master 127.24.61.252:40207 requested a full tablet report, sending...
08:07:08.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:08.833335 25177 ts_manager.cc:194] Registered new tserver with Master: f25bcf7d71df479b99062dde78725f0e (127.24.61.195:33319)
08:07:08.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:08.835306 25177 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.24.61.195:50609
08:07:08.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:08.841151 24823 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
08:07:08.852 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
08:07:08.854 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

08:07:08.863 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.24.61.254"
      port: 46441
    }
    bound_http_address {
      host: "127.24.61.254"
      port: 36929
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.24.61.253"
      port: 33137
    }
    bound_http_address {
      host: "127.24.61.253"
      port: 33775
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.24.61.252"
      port: 40207
    }
    bound_http_address {
      host: "127.24.61.252"
      port: 46623
    }
  }
}

08:07:08.868 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

08:07:08.870 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.24.61.193"
      port: 40571
    }
    bound_http_address {
      host: "127.24.61.193"
      port: 38785
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.24.61.194"
      port: 41685
    }
    bound_http_address {
      host: "127.24.61.194"
      port: 41119
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.24.61.195"
      port: 33319
    }
    bound_http_address {
      host: "127.24.61.195"
      port: 41857
    }
  }
}

08:07:08.870 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
08:07:09.046 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:07:09.229 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.24.61.253:33137(127.24.61.253:33137)] connecting to peer
08:07:09.285 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.24.61.254:46441(127.24.61.254:46441)] connecting to peer
08:07:09.288 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.24.61.252:40207(127.24.61.252:40207)] connecting to peer
08:07:09.319 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.24.61.253:33137(127.24.61.253:33137)] Successfully connected to peer
08:07:09.319 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.24.61.254:46441(127.24.61.254:46441)] Successfully connected to peer
08:07:09.393 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.24.61.252:40207(127.24.61.252:40207)] Successfully connected to peer
08:07:09.419 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.24.61.254
08:07:09.419 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.24.61.253
08:07:09.637 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.24.61.252
08:07:09.670 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xac069126, L:/127.0.0.1:46538 - R:/127.24.61.254:46441] using SASL/PLAIN
08:07:09.670 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x83538d02, L:/127.0.0.1:38030 - R:/127.24.61.253:33137] using SASL/PLAIN
08:07:09.688 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xcddedfa1, L:/127.0.0.1:45050 - R:/127.24.61.252:40207] using SASL/PLAIN
08:07:09.720 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:07:09.721 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=533), Traces: [0ms] refreshing cache from master, [28ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.61.253:33137, [92ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.61.254:46441, [95ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.61.252:40207, [493ms] Sub RPC ConnectToMaster: received response from server master-127.24.61.254:46441: OK, [493ms] Sub RPC ConnectToMaster: received response from server master-127.24.61.253:33137: OK, [500ms] Sub RPC ConnectToMaster: received response from server master-127.24.61.252:40207: OK, deferred=null) after lookup
08:07:09.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:09.773062 25175 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45050:
08:07:09.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "org.apache.kudu.client.TestClientFailoverSupport-KILL"
08:07:09.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
08:07:09.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:07:09.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key"
08:07:09.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
08:07:09.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
08:07:09.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:07:09.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:07:09.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:07:09.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:07:09.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:07:09.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:07:09.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column1_i"
08:07:09.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
08:07:09.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
08:07:09.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:07:09.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:07:09.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:07:09.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:07:09.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:07:09.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:07:09.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column2_i"
08:07:09.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
08:07:09.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
08:07:09.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:07:09.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:07:09.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:07:09.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:07:09.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:07:09.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:07:09.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column3_s"
08:07:09.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
08:07:09.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
08:07:09.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: true
08:07:09.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: DICT_ENCODING
08:07:09.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: LZ4
08:07:09.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 4096
08:07:09.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:07:09.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:07:09.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:07:09.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:07:09.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column4_b"
08:07:09.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BOOL
08:07:09.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
08:07:09.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:07:09.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:07:09.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:07:09.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:07:09.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:07:09.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
08:07:09.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
08:07:09.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
08:07:09.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
08:07:09.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key"
08:07:09.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
08:07:09.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:07:09.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
08:07:09.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:09.776808 25175 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table org.apache.kudu.client.TestClientFailoverSupport-KILL in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
08:07:09.831 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 8d24afbe42964b779785410b57abbfe8
08:07:09.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:09.839926 26134 heartbeater.cc:503] Master 127.24.61.252:40207 was elected leader, sending a full tablet report...
08:07:09.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:09.875620 26010 tablet_service.cc:1467] Processing CreateTablet for tablet d30f2f7900dd493b8a62f315ebe99ed6 (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-KILL [id=8d24afbe42964b779785410b57abbfe8]), partition=RANGE (key) PARTITION UNBOUNDED
08:07:09.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:09.877518 26010 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d30f2f7900dd493b8a62f315ebe99ed6. 1 dirs total, 0 dirs full, 0 dirs failed
08:07:09.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:09.877899 25468 tablet_service.cc:1467] Processing CreateTablet for tablet d30f2f7900dd493b8a62f315ebe99ed6 (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-KILL [id=8d24afbe42964b779785410b57abbfe8]), partition=RANGE (key) PARTITION UNBOUNDED
08:07:09.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:09.879673 25468 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d30f2f7900dd493b8a62f315ebe99ed6. 1 dirs total, 0 dirs full, 0 dirs failed
08:07:09.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:09.904691 25760 tablet_service.cc:1467] Processing CreateTablet for tablet d30f2f7900dd493b8a62f315ebe99ed6 (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-KILL [id=8d24afbe42964b779785410b57abbfe8]), partition=RANGE (key) PARTITION UNBOUNDED
08:07:09.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:09.906625 25760 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d30f2f7900dd493b8a62f315ebe99ed6. 1 dirs total, 0 dirs full, 0 dirs failed
08:07:09.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:09.913506 26205 tablet_bootstrap.cc:492] T d30f2f7900dd493b8a62f315ebe99ed6 P d85a6ca1566c4a959823d91e3140f3d5: Bootstrap starting.
08:07:09.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:09.914773 26207 tablet_bootstrap.cc:492] T d30f2f7900dd493b8a62f315ebe99ed6 P f25bcf7d71df479b99062dde78725f0e: Bootstrap starting.
08:07:09.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:09.919392 26205 tablet_bootstrap.cc:654] T d30f2f7900dd493b8a62f315ebe99ed6 P d85a6ca1566c4a959823d91e3140f3d5: Neither blocks nor log segments found. Creating new log.
08:07:09.921 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:09.921131 26205 log.cc:824] T d30f2f7900dd493b8a62f315ebe99ed6 P d85a6ca1566c4a959823d91e3140f3d5: Log is configured to *not* fsync() on all Append() calls
08:07:09.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:09.921785 26207 tablet_bootstrap.cc:654] T d30f2f7900dd493b8a62f315ebe99ed6 P f25bcf7d71df479b99062dde78725f0e: Neither blocks nor log segments found. Creating new log.
08:07:09.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:09.923959 26207 log.cc:824] T d30f2f7900dd493b8a62f315ebe99ed6 P f25bcf7d71df479b99062dde78725f0e: Log is configured to *not* fsync() on all Append() calls
08:07:09.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:09.926055 26205 tablet_bootstrap.cc:492] T d30f2f7900dd493b8a62f315ebe99ed6 P d85a6ca1566c4a959823d91e3140f3d5: No bootstrap required, opened a new log
08:07:09.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:09.926566 26205 ts_tablet_manager.cc:1397] T d30f2f7900dd493b8a62f315ebe99ed6 P d85a6ca1566c4a959823d91e3140f3d5: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.004s
08:07:09.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:09.929462 26207 tablet_bootstrap.cc:492] T d30f2f7900dd493b8a62f315ebe99ed6 P f25bcf7d71df479b99062dde78725f0e: No bootstrap required, opened a new log
08:07:09.930 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:09.929926 26207 ts_tablet_manager.cc:1397] T d30f2f7900dd493b8a62f315ebe99ed6 P f25bcf7d71df479b99062dde78725f0e: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.006s
08:07:09.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:09.933794 26210 tablet_bootstrap.cc:492] T d30f2f7900dd493b8a62f315ebe99ed6 P 3485b67b72274f5f8da579248a3255c8: Bootstrap starting.
08:07:09.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:09.940331 26210 tablet_bootstrap.cc:654] T d30f2f7900dd493b8a62f315ebe99ed6 P 3485b67b72274f5f8da579248a3255c8: Neither blocks nor log segments found. Creating new log.
08:07:09.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:09.942425 26210 log.cc:824] T d30f2f7900dd493b8a62f315ebe99ed6 P 3485b67b72274f5f8da579248a3255c8: Log is configured to *not* fsync() on all Append() calls
08:07:09.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:09.946918 26210 tablet_bootstrap.cc:492] T d30f2f7900dd493b8a62f315ebe99ed6 P 3485b67b72274f5f8da579248a3255c8: No bootstrap required, opened a new log
08:07:09.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:09.947335 26210 ts_tablet_manager.cc:1397] T d30f2f7900dd493b8a62f315ebe99ed6 P 3485b67b72274f5f8da579248a3255c8: Time spent bootstrapping tablet: real 0.014s	user 0.003s	sys 0.008s
08:07:09.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:09.958480 26207 raft_consensus.cc:348] T d30f2f7900dd493b8a62f315ebe99ed6 P f25bcf7d71df479b99062dde78725f0e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f25bcf7d71df479b99062dde78725f0e" member_type: VOTER last_known_addr { host: "127.24.61.195" port: 33319 } } peers { permanent_uuid: "d85a6ca1566c4a959823d91e3140f3d5" member_type: VOTER last_known_addr { host: "127.24.61.193" port: 40571 } } peers { permanent_uuid: "3485b67b72274f5f8da579248a3255c8" member_type: VOTER last_known_addr { host: "127.24.61.194" port: 41685 } }
08:07:09.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:09.959291 26207 raft_consensus.cc:374] T d30f2f7900dd493b8a62f315ebe99ed6 P f25bcf7d71df479b99062dde78725f0e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:07:09.959 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:09.959566 26207 raft_consensus.cc:729] T d30f2f7900dd493b8a62f315ebe99ed6 P f25bcf7d71df479b99062dde78725f0e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f25bcf7d71df479b99062dde78725f0e, State: Initialized, Role: FOLLOWER
08:07:09.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:09.960386 26207 consensus_queue.cc:260] T d30f2f7900dd493b8a62f315ebe99ed6 P f25bcf7d71df479b99062dde78725f0e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f25bcf7d71df479b99062dde78725f0e" member_type: VOTER last_known_addr { host: "127.24.61.195" port: 33319 } } peers { permanent_uuid: "d85a6ca1566c4a959823d91e3140f3d5" member_type: VOTER last_known_addr { host: "127.24.61.193" port: 40571 } } peers { permanent_uuid: "3485b67b72274f5f8da579248a3255c8" member_type: VOTER last_known_addr { host: "127.24.61.194" port: 41685 } }
08:07:09.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:09.961987 26205 raft_consensus.cc:348] T d30f2f7900dd493b8a62f315ebe99ed6 P d85a6ca1566c4a959823d91e3140f3d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f25bcf7d71df479b99062dde78725f0e" member_type: VOTER last_known_addr { host: "127.24.61.195" port: 33319 } } peers { permanent_uuid: "d85a6ca1566c4a959823d91e3140f3d5" member_type: VOTER last_known_addr { host: "127.24.61.193" port: 40571 } } peers { permanent_uuid: "3485b67b72274f5f8da579248a3255c8" member_type: VOTER last_known_addr { host: "127.24.61.194" port: 41685 } }
08:07:09.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:09.962864 26205 raft_consensus.cc:374] T d30f2f7900dd493b8a62f315ebe99ed6 P d85a6ca1566c4a959823d91e3140f3d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:07:09.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:09.963166 26205 raft_consensus.cc:729] T d30f2f7900dd493b8a62f315ebe99ed6 P d85a6ca1566c4a959823d91e3140f3d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d85a6ca1566c4a959823d91e3140f3d5, State: Initialized, Role: FOLLOWER
08:07:09.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:09.964046 26207 ts_tablet_manager.cc:1428] T d30f2f7900dd493b8a62f315ebe99ed6 P f25bcf7d71df479b99062dde78725f0e: Time spent starting tablet: real 0.034s	user 0.029s	sys 0.005s
08:07:09.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:09.964022 26205 consensus_queue.cc:260] T d30f2f7900dd493b8a62f315ebe99ed6 P d85a6ca1566c4a959823d91e3140f3d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f25bcf7d71df479b99062dde78725f0e" member_type: VOTER last_known_addr { host: "127.24.61.195" port: 33319 } } peers { permanent_uuid: "d85a6ca1566c4a959823d91e3140f3d5" member_type: VOTER last_known_addr { host: "127.24.61.193" port: 40571 } } peers { permanent_uuid: "3485b67b72274f5f8da579248a3255c8" member_type: VOTER last_known_addr { host: "127.24.61.194" port: 41685 } }
08:07:09.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:09.985037 26205 ts_tablet_manager.cc:1428] T d30f2f7900dd493b8a62f315ebe99ed6 P d85a6ca1566c4a959823d91e3140f3d5: Time spent starting tablet: real 0.058s	user 0.030s	sys 0.016s
08:07:09.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:09.984735 26210 raft_consensus.cc:348] T d30f2f7900dd493b8a62f315ebe99ed6 P 3485b67b72274f5f8da579248a3255c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f25bcf7d71df479b99062dde78725f0e" member_type: VOTER last_known_addr { host: "127.24.61.195" port: 33319 } } peers { permanent_uuid: "d85a6ca1566c4a959823d91e3140f3d5" member_type: VOTER last_known_addr { host: "127.24.61.193" port: 40571 } } peers { permanent_uuid: "3485b67b72274f5f8da579248a3255c8" member_type: VOTER last_known_addr { host: "127.24.61.194" port: 41685 } }
08:07:09.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:09.985432 26210 raft_consensus.cc:374] T d30f2f7900dd493b8a62f315ebe99ed6 P 3485b67b72274f5f8da579248a3255c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:07:09.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:09.985729 26210 raft_consensus.cc:729] T d30f2f7900dd493b8a62f315ebe99ed6 P 3485b67b72274f5f8da579248a3255c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3485b67b72274f5f8da579248a3255c8, State: Initialized, Role: FOLLOWER
08:07:09.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:09.986544 26210 consensus_queue.cc:260] T d30f2f7900dd493b8a62f315ebe99ed6 P 3485b67b72274f5f8da579248a3255c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f25bcf7d71df479b99062dde78725f0e" member_type: VOTER last_known_addr { host: "127.24.61.195" port: 33319 } } peers { permanent_uuid: "d85a6ca1566c4a959823d91e3140f3d5" member_type: VOTER last_known_addr { host: "127.24.61.193" port: 40571 } } peers { permanent_uuid: "3485b67b72274f5f8da579248a3255c8" member_type: VOTER last_known_addr { host: "127.24.61.194" port: 41685 } }
08:07:09.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:09.992204 26210 ts_tablet_manager.cc:1428] T d30f2f7900dd493b8a62f315ebe99ed6 P 3485b67b72274f5f8da579248a3255c8: Time spent starting tablet: real 0.045s	user 0.029s	sys 0.007s
08:07:10.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:10.048712 26141 tablet.cc:2369] T d30f2f7900dd493b8a62f315ebe99ed6 P f25bcf7d71df479b99062dde78725f0e: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:07:10.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:10.062104 25893 tablet.cc:2369] T d30f2f7900dd493b8a62f315ebe99ed6 P 3485b67b72274f5f8da579248a3255c8: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:07:10.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:10.098162 26215 raft_consensus.cc:482] T d30f2f7900dd493b8a62f315ebe99ed6 P d85a6ca1566c4a959823d91e3140f3d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:07:10.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:10.098660 26215 raft_consensus.cc:504] T d30f2f7900dd493b8a62f315ebe99ed6 P d85a6ca1566c4a959823d91e3140f3d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f25bcf7d71df479b99062dde78725f0e" member_type: VOTER last_known_addr { host: "127.24.61.195" port: 33319 } } peers { permanent_uuid: "d85a6ca1566c4a959823d91e3140f3d5" member_type: VOTER last_known_addr { host: "127.24.61.193" port: 40571 } } peers { permanent_uuid: "3485b67b72274f5f8da579248a3255c8" member_type: VOTER last_known_addr { host: "127.24.61.194" port: 41685 } }
08:07:10.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:10.101060 26215 leader_election.cc:288] T d30f2f7900dd493b8a62f315ebe99ed6 P d85a6ca1566c4a959823d91e3140f3d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f25bcf7d71df479b99062dde78725f0e (127.24.61.195:33319), 3485b67b72274f5f8da579248a3255c8 (127.24.61.194:41685)
08:07:10.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:10.116032 26050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d30f2f7900dd493b8a62f315ebe99ed6" candidate_uuid: "d85a6ca1566c4a959823d91e3140f3d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f25bcf7d71df479b99062dde78725f0e" is_pre_election: true
08:07:10.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:10.116618 25792 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d30f2f7900dd493b8a62f315ebe99ed6" candidate_uuid: "d85a6ca1566c4a959823d91e3140f3d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3485b67b72274f5f8da579248a3255c8" is_pre_election: true
08:07:10.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:10.116799 26050 raft_consensus.cc:2454] T d30f2f7900dd493b8a62f315ebe99ed6 P f25bcf7d71df479b99062dde78725f0e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d85a6ca1566c4a959823d91e3140f3d5 in term 0.
08:07:10.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:10.117333 25613 tablet.cc:2369] T d30f2f7900dd493b8a62f315ebe99ed6 P d85a6ca1566c4a959823d91e3140f3d5: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:07:10.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:10.117478 25792 raft_consensus.cc:2454] T d30f2f7900dd493b8a62f315ebe99ed6 P 3485b67b72274f5f8da579248a3255c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d85a6ca1566c4a959823d91e3140f3d5 in term 0.
08:07:10.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:10.118283 25390 leader_election.cc:302] T d30f2f7900dd493b8a62f315ebe99ed6 P d85a6ca1566c4a959823d91e3140f3d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d85a6ca1566c4a959823d91e3140f3d5, f25bcf7d71df479b99062dde78725f0e; no voters: 
08:07:10.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:10.119190 26215 raft_consensus.cc:2781] T d30f2f7900dd493b8a62f315ebe99ed6 P d85a6ca1566c4a959823d91e3140f3d5 [term 0 FOLLOWER]: Leader pre-election won for term 1
08:07:10.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:10.119477 26215 raft_consensus.cc:482] T d30f2f7900dd493b8a62f315ebe99ed6 P d85a6ca1566c4a959823d91e3140f3d5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:07:10.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:10.119781 26215 raft_consensus.cc:3037] T d30f2f7900dd493b8a62f315ebe99ed6 P d85a6ca1566c4a959823d91e3140f3d5 [term 0 FOLLOWER]: Advancing to term 1
08:07:10.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:10.124421 26215 raft_consensus.cc:504] T d30f2f7900dd493b8a62f315ebe99ed6 P d85a6ca1566c4a959823d91e3140f3d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f25bcf7d71df479b99062dde78725f0e" member_type: VOTER last_known_addr { host: "127.24.61.195" port: 33319 } } peers { permanent_uuid: "d85a6ca1566c4a959823d91e3140f3d5" member_type: VOTER last_known_addr { host: "127.24.61.193" port: 40571 } } peers { permanent_uuid: "3485b67b72274f5f8da579248a3255c8" member_type: VOTER last_known_addr { host: "127.24.61.194" port: 41685 } }
08:07:10.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:10.126149 26215 leader_election.cc:288] T d30f2f7900dd493b8a62f315ebe99ed6 P d85a6ca1566c4a959823d91e3140f3d5 [CANDIDATE]: Term 1 election: Requested vote from peers f25bcf7d71df479b99062dde78725f0e (127.24.61.195:33319), 3485b67b72274f5f8da579248a3255c8 (127.24.61.194:41685)
08:07:10.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:10.126799 26050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d30f2f7900dd493b8a62f315ebe99ed6" candidate_uuid: "d85a6ca1566c4a959823d91e3140f3d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f25bcf7d71df479b99062dde78725f0e"
08:07:10.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:10.127243 26050 raft_consensus.cc:3037] T d30f2f7900dd493b8a62f315ebe99ed6 P f25bcf7d71df479b99062dde78725f0e [term 0 FOLLOWER]: Advancing to term 1
08:07:10.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:10.127156 25792 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d30f2f7900dd493b8a62f315ebe99ed6" candidate_uuid: "d85a6ca1566c4a959823d91e3140f3d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3485b67b72274f5f8da579248a3255c8"
08:07:10.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:10.127700 25792 raft_consensus.cc:3037] T d30f2f7900dd493b8a62f315ebe99ed6 P 3485b67b72274f5f8da579248a3255c8 [term 0 FOLLOWER]: Advancing to term 1
08:07:10.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:10.131489 26050 raft_consensus.cc:2454] T d30f2f7900dd493b8a62f315ebe99ed6 P f25bcf7d71df479b99062dde78725f0e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d85a6ca1566c4a959823d91e3140f3d5 in term 1.
08:07:10.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:10.132277 25390 leader_election.cc:302] T d30f2f7900dd493b8a62f315ebe99ed6 P d85a6ca1566c4a959823d91e3140f3d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d85a6ca1566c4a959823d91e3140f3d5, f25bcf7d71df479b99062dde78725f0e; no voters: 
08:07:10.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:10.132395 25792 raft_consensus.cc:2454] T d30f2f7900dd493b8a62f315ebe99ed6 P 3485b67b72274f5f8da579248a3255c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d85a6ca1566c4a959823d91e3140f3d5 in term 1.
08:07:10.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:10.133293 26215 raft_consensus.cc:2781] T d30f2f7900dd493b8a62f315ebe99ed6 P d85a6ca1566c4a959823d91e3140f3d5 [term 1 FOLLOWER]: Leader election won for term 1
08:07:10.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:10.135305 26215 raft_consensus.cc:686] T d30f2f7900dd493b8a62f315ebe99ed6 P d85a6ca1566c4a959823d91e3140f3d5 [term 1 LEADER]: Becoming Leader. State: Replica: d85a6ca1566c4a959823d91e3140f3d5, State: Running, Role: LEADER
08:07:10.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:10.137238 26215 consensus_queue.cc:237] T d30f2f7900dd493b8a62f315ebe99ed6 P d85a6ca1566c4a959823d91e3140f3d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f25bcf7d71df479b99062dde78725f0e" member_type: VOTER last_known_addr { host: "127.24.61.195" port: 33319 } } peers { permanent_uuid: "d85a6ca1566c4a959823d91e3140f3d5" member_type: VOTER last_known_addr { host: "127.24.61.193" port: 40571 } } peers { permanent_uuid: "3485b67b72274f5f8da579248a3255c8" member_type: VOTER last_known_addr { host: "127.24.61.194" port: 41685 } }
08:07:10.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:10.157750 25177 catalog_manager.cc:5495] T d30f2f7900dd493b8a62f315ebe99ed6 P d85a6ca1566c4a959823d91e3140f3d5 reported cstate change: term changed from 0 to 1, leader changed from <none> to d85a6ca1566c4a959823d91e3140f3d5 (127.24.61.193). New cstate: current_term: 1 leader_uuid: "d85a6ca1566c4a959823d91e3140f3d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f25bcf7d71df479b99062dde78725f0e" member_type: VOTER last_known_addr { host: "127.24.61.195" port: 33319 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d85a6ca1566c4a959823d91e3140f3d5" member_type: VOTER last_known_addr { host: "127.24.61.193" port: 40571 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3485b67b72274f5f8da579248a3255c8" member_type: VOTER last_known_addr { host: "127.24.61.194" port: 41685 } health_report { overall_health: UNKNOWN } } }
08:07:10.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:10.645262 26215 consensus_queue.cc:1035] T d30f2f7900dd493b8a62f315ebe99ed6 P d85a6ca1566c4a959823d91e3140f3d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f25bcf7d71df479b99062dde78725f0e" member_type: VOTER last_known_addr { host: "127.24.61.195" port: 33319 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
08:07:10.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:10.666828 26235 consensus_queue.cc:1035] T d30f2f7900dd493b8a62f315ebe99ed6 P d85a6ca1566c4a959823d91e3140f3d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3485b67b72274f5f8da579248a3255c8" member_type: VOTER last_known_addr { host: "127.24.61.194" port: 41685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:07:10.717 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 8d24afbe42964b779785410b57abbfe8
08:07:10.737 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet d30f2f7900dd493b8a62f315ebe99ed6 for table 'org.apache.kudu.client.TestClientFailoverSupport-KILL' with partition [<start>, <end>)
08:07:10.743 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299993, tablet=d30f2f7900dd493b8a62f315ebe99ed6@[3485b67b72274f5f8da579248a3255c8(127.24.61.194:41685),d85a6ca1566c4a959823d91e3140f3d5(127.24.61.193:40571)[L],f25bcf7d71df479b99062dde78725f0e(127.24.61.195:33319)]}]
08:07:10.745 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=19), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC GetTableLocations: sending RPC to server master-127.24.61.252:40207, [9ms] Sub RPC GetTableLocations: received response from server master-127.24.61.252:40207: OK, deferred=null) after lookup
08:07:10.756 [DEBUG - kudu-nio-0] (Connection.java:748) [peer d85a6ca1566c4a959823d91e3140f3d5(127.24.61.193:40571)] connecting to peer
08:07:10.758 [DEBUG - kudu-nio-1] (Connection.java:757) [peer d85a6ca1566c4a959823d91e3140f3d5(127.24.61.193:40571)] Successfully connected to peer
08:07:10.811 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xb3b9eb80, L:/127.0.0.1:47728 - R:/127.24.61.193:40571] using TOKEN/null
08:07:11.071 [DEBUG - kudu-nio-1] (AsyncKuduScanner.java:1374) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 10 rows, more = false) for scanner KuduScanner(table=org.apache.kudu.client.TestClientFailoverSupport-KILL, tablet=d30f2f7900dd493b8a62f315ebe99ed6, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:11.074 [INFO - Time-limited test] (MiniKuduCluster.java:399) Killing master server 127.24.61.252:40207
08:07:11.075 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: stop_daemon {
  id {
    type: MASTER
    index: 2
  }
}

08:07:11.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:11.076504 24823 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgk96or/build/tsan/bin/kudu with pid 25095
08:07:11.153 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
08:07:11.154 [INFO - Time-limited test] (MiniKuduCluster.java:475) Killing tablet server 127.24.61.193:40571
08:07:11.155 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: stop_daemon {
  id {
    type: TSERVER
    index: 0
  }
}

08:07:11.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:11.155499 24823 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgk96or/build/tsan/bin/kudu with pid 25312
08:07:11.161 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.24.61.252:40207(127.24.61.252:40207)] handling channelInactive
08:07:11.163 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.24.61.252:40207(127.24.61.252:40207)] cleaning up while in state READY due to: connection closed
08:07:11.205 [DEBUG - kudu-nio-1] (Connection.java:239) [peer d85a6ca1566c4a959823d91e3140f3d5(127.24.61.193:40571)] handling channelInactive
08:07:11.205 [DEBUG - kudu-nio-1] (Connection.java:709) [peer d85a6ca1566c4a959823d91e3140f3d5(127.24.61.193:40571)] cleaning up while in state READY due to: connection closed
08:07:11.207 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
08:07:11.208 [DEBUG - Time-limited test] (Connection.java:748) [peer d85a6ca1566c4a959823d91e3140f3d5(127.24.61.193:40571)] connecting to peer
08:07:11.210 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer d85a6ca1566c4a959823d91e3140f3d5(127.24.61.193:40571): Connection refused: /127.24.61.193:40571
08:07:11.210 [DEBUG - kudu-nio-0] (Connection.java:709) [peer d85a6ca1566c4a959823d91e3140f3d5(127.24.61.193:40571)] cleaning up while in state CONNECTING due to: Failed to connect to peer d85a6ca1566c4a959823d91e3140f3d5(127.24.61.193:40571): Connection refused: /127.24.61.193:40571
08:07:11.211 [INFO - kudu-nio-0] (AsyncKuduClient.java:2355) Invalidating location d85a6ca1566c4a959823d91e3140f3d5(127.24.61.193:40571) for tablet d30f2f7900dd493b8a62f315ebe99ed6: Failed to connect to peer d85a6ca1566c4a959823d91e3140f3d5(127.24.61.193:40571): Connection refused: /127.24.61.193:40571
08:07:11.229 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.24.61.252:40207(127.24.61.252:40207)] connecting to peer
08:07:11.231 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207
08:07:11.232 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.24.61.252:40207(127.24.61.252:40207)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207
08:07:11.232 [INFO - kudu-nio-1] (AsyncKuduClient.java:2355) Invalidating location master-127.24.61.252:40207(127.24.61.252:40207) for tablet Kudu Master: Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207
08:07:11.250 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.24.61.252:40207(127.24.61.252:40207)] connecting to peer
08:07:11.252 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207
08:07:11.252 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.24.61.252:40207(127.24.61.252:40207)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207
08:07:11.253 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.24.61.252:40207: Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207
08:07:11.259 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.24.61.253:33137,127.24.61.254:46441,127.24.61.252:40207; will retry
08:07:11.270 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.24.61.252:40207(127.24.61.252:40207)] connecting to peer
08:07:11.272 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207
08:07:11.272 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.24.61.252:40207(127.24.61.252:40207)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207
08:07:11.273 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.24.61.252:40207: Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207
08:07:11.274 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.24.61.253:33137,127.24.61.254:46441,127.24.61.252:40207; will retry
08:07:11.289 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.24.61.252:40207(127.24.61.252:40207)] connecting to peer
08:07:11.291 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207
08:07:11.292 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.24.61.252:40207(127.24.61.252:40207)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207
08:07:11.292 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.24.61.252:40207: Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207
08:07:11.297 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.24.61.253:33137,127.24.61.254:46441,127.24.61.252:40207; will retry
08:07:11.309 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.24.61.252:40207(127.24.61.252:40207)] connecting to peer
08:07:11.314 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207
08:07:11.314 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.24.61.252:40207(127.24.61.252:40207)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207
08:07:11.314 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.24.61.252:40207: Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207
08:07:11.314 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.24.61.253:33137,127.24.61.254:46441,127.24.61.252:40207; will retry
08:07:11.350 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.24.61.252:40207(127.24.61.252:40207)] connecting to peer
08:07:11.352 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207
08:07:11.353 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.24.61.252:40207(127.24.61.252:40207)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207
08:07:11.353 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.24.61.252:40207: Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207
08:07:11.354 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.24.61.253:33137,127.24.61.254:46441,127.24.61.252:40207; will retry
08:07:11.409 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.24.61.252:40207(127.24.61.252:40207)] connecting to peer
08:07:11.411 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207
08:07:11.411 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.24.61.252:40207(127.24.61.252:40207)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207
08:07:11.411 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.24.61.252:40207: Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207
08:07:11.413 [WARN - kudu-nio-1] (ConnectToCluster.java:305) Unable to find the leader master 127.24.61.253:33137,127.24.61.254:46441,127.24.61.252:40207; will retry
08:07:11.530 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.24.61.252:40207(127.24.61.252:40207)] connecting to peer
08:07:11.532 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207
08:07:11.532 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.24.61.252:40207(127.24.61.252:40207)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207
08:07:11.533 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.24.61.252:40207: Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207
08:07:11.534 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.24.61.253:33137,127.24.61.254:46441,127.24.61.252:40207; will retry
08:07:11.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:11.679787 26134 heartbeater.cc:644] Failed to heartbeat to 127.24.61.252:40207 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.24.61.252:40207: connect: Connection refused (error 111)
08:07:11.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:11.697217 25879 heartbeater.cc:644] Failed to heartbeat to 127.24.61.252:40207 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.24.61.252:40207: connect: Connection refused (error 111)
08:07:11.710 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.24.61.252:40207(127.24.61.252:40207)] connecting to peer
08:07:11.711 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207
08:07:11.712 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.24.61.252:40207(127.24.61.252:40207)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207
08:07:11.712 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.24.61.252:40207: Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207
08:07:11.713 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.24.61.253:33137,127.24.61.254:46441,127.24.61.252:40207; will retry
08:07:11.869 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.24.61.252:40207(127.24.61.252:40207)] connecting to peer
08:07:11.873 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207
08:07:11.873 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.24.61.252:40207(127.24.61.252:40207)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207
08:07:11.873 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.24.61.252:40207: Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207
08:07:11.873 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.24.61.253:33137,127.24.61.254:46441,127.24.61.252:40207; will retry
08:07:12.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.255645 26264 raft_consensus.cc:482] T 00000000000000000000000000000000 P 164d87d429da4a85a4902a8601d0b511 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 39818d5ab781409db0ab76464440eb2a)
08:07:12.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.256078 26264 raft_consensus.cc:504] T 00000000000000000000000000000000 P 164d87d429da4a85a4902a8601d0b511 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164d87d429da4a85a4902a8601d0b511" member_type: VOTER last_known_addr { host: "127.24.61.254" port: 46441 } } peers { permanent_uuid: "f0ec94f0ebe642ffb18161428b38882e" member_type: VOTER last_known_addr { host: "127.24.61.253" port: 33137 } } peers { permanent_uuid: "39818d5ab781409db0ab76464440eb2a" member_type: VOTER last_known_addr { host: "127.24.61.252" port: 40207 } }
08:07:12.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.257886 26264 leader_election.cc:288] T 00000000000000000000000000000000 P 164d87d429da4a85a4902a8601d0b511 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f0ec94f0ebe642ffb18161428b38882e (127.24.61.253:33137), 39818d5ab781409db0ab76464440eb2a (127.24.61.252:40207)
08:07:12.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.258828 25049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "164d87d429da4a85a4902a8601d0b511" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "f0ec94f0ebe642ffb18161428b38882e" is_pre_election: true
08:07:12.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:12.260138 24874 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.24.61.252:40207: connect: Connection refused (error 111) [suppressed 12 similar messages]
08:07:12.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:12.263662 24874 leader_election.cc:334] T 00000000000000000000000000000000 P 164d87d429da4a85a4902a8601d0b511 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 39818d5ab781409db0ab76464440eb2a (127.24.61.252:40207): Network error: Client connection negotiation failed: client connection to 127.24.61.252:40207: connect: Connection refused (error 111)
08:07:12.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.264035 24874 leader_election.cc:302] T 00000000000000000000000000000000 P 164d87d429da4a85a4902a8601d0b511 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 164d87d429da4a85a4902a8601d0b511; no voters: 39818d5ab781409db0ab76464440eb2a, f0ec94f0ebe642ffb18161428b38882e
08:07:12.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.264667 26264 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 164d87d429da4a85a4902a8601d0b511 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
08:07:12.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.303563 26268 raft_consensus.cc:482] T 00000000000000000000000000000000 P f0ec94f0ebe642ffb18161428b38882e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 39818d5ab781409db0ab76464440eb2a)
08:07:12.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.304104 26268 raft_consensus.cc:504] T 00000000000000000000000000000000 P f0ec94f0ebe642ffb18161428b38882e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164d87d429da4a85a4902a8601d0b511" member_type: VOTER last_known_addr { host: "127.24.61.254" port: 46441 } } peers { permanent_uuid: "f0ec94f0ebe642ffb18161428b38882e" member_type: VOTER last_known_addr { host: "127.24.61.253" port: 33137 } } peers { permanent_uuid: "39818d5ab781409db0ab76464440eb2a" member_type: VOTER last_known_addr { host: "127.24.61.252" port: 40207 } }
08:07:12.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.306176 26268 leader_election.cc:288] T 00000000000000000000000000000000 P f0ec94f0ebe642ffb18161428b38882e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 164d87d429da4a85a4902a8601d0b511 (127.24.61.254:46441), 39818d5ab781409db0ab76464440eb2a (127.24.61.252:40207)
08:07:12.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.307318 24923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f0ec94f0ebe642ffb18161428b38882e" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "164d87d429da4a85a4902a8601d0b511" is_pre_election: true
08:07:12.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.307986 24923 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 164d87d429da4a85a4902a8601d0b511 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f0ec94f0ebe642ffb18161428b38882e in term 1.
08:07:12.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:12.308471 25002 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.24.61.252:40207: connect: Connection refused (error 111) [suppressed 6 similar messages]
08:07:12.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.309228 25003 leader_election.cc:302] T 00000000000000000000000000000000 P f0ec94f0ebe642ffb18161428b38882e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 164d87d429da4a85a4902a8601d0b511, f0ec94f0ebe642ffb18161428b38882e; no voters: 
08:07:12.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.310216 26268 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f0ec94f0ebe642ffb18161428b38882e [term 1 FOLLOWER]: Leader pre-election won for term 2
08:07:12.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.310468 26268 raft_consensus.cc:482] T 00000000000000000000000000000000 P f0ec94f0ebe642ffb18161428b38882e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 39818d5ab781409db0ab76464440eb2a)
08:07:12.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.310817 26268 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f0ec94f0ebe642ffb18161428b38882e [term 1 FOLLOWER]: Advancing to term 2
08:07:12.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:12.311878 25002 leader_election.cc:334] T 00000000000000000000000000000000 P f0ec94f0ebe642ffb18161428b38882e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 39818d5ab781409db0ab76464440eb2a (127.24.61.252:40207): Network error: Client connection negotiation failed: client connection to 127.24.61.252:40207: connect: Connection refused (error 111)
08:07:12.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.317281 26268 raft_consensus.cc:504] T 00000000000000000000000000000000 P f0ec94f0ebe642ffb18161428b38882e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164d87d429da4a85a4902a8601d0b511" member_type: VOTER last_known_addr { host: "127.24.61.254" port: 46441 } } peers { permanent_uuid: "f0ec94f0ebe642ffb18161428b38882e" member_type: VOTER last_known_addr { host: "127.24.61.253" port: 33137 } } peers { permanent_uuid: "39818d5ab781409db0ab76464440eb2a" member_type: VOTER last_known_addr { host: "127.24.61.252" port: 40207 } }
08:07:12.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.318719 26268 leader_election.cc:288] T 00000000000000000000000000000000 P f0ec94f0ebe642ffb18161428b38882e [CANDIDATE]: Term 2 election: Requested vote from peers 164d87d429da4a85a4902a8601d0b511 (127.24.61.254:46441), 39818d5ab781409db0ab76464440eb2a (127.24.61.252:40207)
08:07:12.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.319576 24923 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "f0ec94f0ebe642ffb18161428b38882e" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "164d87d429da4a85a4902a8601d0b511"
08:07:12.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.320084 24923 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 164d87d429da4a85a4902a8601d0b511 [term 1 FOLLOWER]: Advancing to term 2
08:07:12.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:12.321595 25002 leader_election.cc:334] T 00000000000000000000000000000000 P f0ec94f0ebe642ffb18161428b38882e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 39818d5ab781409db0ab76464440eb2a (127.24.61.252:40207): Network error: Client connection negotiation failed: client connection to 127.24.61.252:40207: connect: Connection refused (error 111)
08:07:12.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.326401 24923 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 164d87d429da4a85a4902a8601d0b511 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f0ec94f0ebe642ffb18161428b38882e in term 2.
08:07:12.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.327189 25003 leader_election.cc:302] T 00000000000000000000000000000000 P f0ec94f0ebe642ffb18161428b38882e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 164d87d429da4a85a4902a8601d0b511, f0ec94f0ebe642ffb18161428b38882e; no voters: 39818d5ab781409db0ab76464440eb2a
08:07:12.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.327778 26268 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f0ec94f0ebe642ffb18161428b38882e [term 2 FOLLOWER]: Leader election won for term 2
08:07:12.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.328593 26268 raft_consensus.cc:686] T 00000000000000000000000000000000 P f0ec94f0ebe642ffb18161428b38882e [term 2 LEADER]: Becoming Leader. State: Replica: f0ec94f0ebe642ffb18161428b38882e, State: Running, Role: LEADER
08:07:12.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.329455 26268 consensus_queue.cc:237] T 00000000000000000000000000000000 P f0ec94f0ebe642ffb18161428b38882e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164d87d429da4a85a4902a8601d0b511" member_type: VOTER last_known_addr { host: "127.24.61.254" port: 46441 } } peers { permanent_uuid: "f0ec94f0ebe642ffb18161428b38882e" member_type: VOTER last_known_addr { host: "127.24.61.253" port: 33137 } } peers { permanent_uuid: "39818d5ab781409db0ab76464440eb2a" member_type: VOTER last_known_addr { host: "127.24.61.252" port: 40207 } }
08:07:12.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.333242 26275 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0ec94f0ebe642ffb18161428b38882e [sys.catalog]: SysCatalogTable state changed. Reason: New leader f0ec94f0ebe642ffb18161428b38882e. Latest consensus state: current_term: 2 leader_uuid: "f0ec94f0ebe642ffb18161428b38882e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164d87d429da4a85a4902a8601d0b511" member_type: VOTER last_known_addr { host: "127.24.61.254" port: 46441 } } peers { permanent_uuid: "f0ec94f0ebe642ffb18161428b38882e" member_type: VOTER last_known_addr { host: "127.24.61.253" port: 33137 } } peers { permanent_uuid: "39818d5ab781409db0ab76464440eb2a" member_type: VOTER last_known_addr { host: "127.24.61.252" port: 40207 } } }
08:07:12.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.334008 26275 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0ec94f0ebe642ffb18161428b38882e [sys.catalog]: This master's current role is: LEADER
08:07:12.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.335537 26279 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
08:07:12.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.342473 26279 catalog_manager.cc:669] Loaded metadata for table org.apache.kudu.client.TestClientFailoverSupport-KILL [id=8d24afbe42964b779785410b57abbfe8]
08:07:12.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.347106 26279 tablet_loader.cc:96] loaded metadata for tablet d30f2f7900dd493b8a62f315ebe99ed6 (table org.apache.kudu.client.TestClientFailoverSupport-KILL [id=8d24afbe42964b779785410b57abbfe8])
08:07:12.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.347954 26279 catalog_manager.cc:1484] Initializing Kudu cluster ID...
08:07:12.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.350689 26279 catalog_manager.cc:1259] Loaded cluster ID: 374e33df11bf458eb8f93c83c97c5595
08:07:12.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.350858 26279 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
08:07:12.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.354261 26279 catalog_manager.cc:1504] Loading token signing keys...
08:07:12.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.356868 26279 catalog_manager.cc:5879] T 00000000000000000000000000000000 P f0ec94f0ebe642ffb18161428b38882e: Loaded TSK: 0
08:07:12.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.358255 26279 catalog_manager.cc:1514] Initializing in-progress tserver states...
08:07:12.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.522054 26280 raft_consensus.cc:482] T d30f2f7900dd493b8a62f315ebe99ed6 P f25bcf7d71df479b99062dde78725f0e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d85a6ca1566c4a959823d91e3140f3d5)
08:07:12.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.522455 26280 raft_consensus.cc:504] T d30f2f7900dd493b8a62f315ebe99ed6 P f25bcf7d71df479b99062dde78725f0e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f25bcf7d71df479b99062dde78725f0e" member_type: VOTER last_known_addr { host: "127.24.61.195" port: 33319 } } peers { permanent_uuid: "d85a6ca1566c4a959823d91e3140f3d5" member_type: VOTER last_known_addr { host: "127.24.61.193" port: 40571 } } peers { permanent_uuid: "3485b67b72274f5f8da579248a3255c8" member_type: VOTER last_known_addr { host: "127.24.61.194" port: 41685 } }
08:07:12.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.524080 26281 raft_consensus.cc:482] T d30f2f7900dd493b8a62f315ebe99ed6 P 3485b67b72274f5f8da579248a3255c8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d85a6ca1566c4a959823d91e3140f3d5)
08:07:12.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.524468 26281 raft_consensus.cc:504] T d30f2f7900dd493b8a62f315ebe99ed6 P 3485b67b72274f5f8da579248a3255c8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f25bcf7d71df479b99062dde78725f0e" member_type: VOTER last_known_addr { host: "127.24.61.195" port: 33319 } } peers { permanent_uuid: "d85a6ca1566c4a959823d91e3140f3d5" member_type: VOTER last_known_addr { host: "127.24.61.193" port: 40571 } } peers { permanent_uuid: "3485b67b72274f5f8da579248a3255c8" member_type: VOTER last_known_addr { host: "127.24.61.194" port: 41685 } }
08:07:12.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.525090 26280 leader_election.cc:288] T d30f2f7900dd493b8a62f315ebe99ed6 P f25bcf7d71df479b99062dde78725f0e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers d85a6ca1566c4a959823d91e3140f3d5 (127.24.61.193:40571), 3485b67b72274f5f8da579248a3255c8 (127.24.61.194:41685)
08:07:12.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.526773 26281 leader_election.cc:288] T d30f2f7900dd493b8a62f315ebe99ed6 P 3485b67b72274f5f8da579248a3255c8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f25bcf7d71df479b99062dde78725f0e (127.24.61.195:33319), d85a6ca1566c4a959823d91e3140f3d5 (127.24.61.193:40571)
08:07:12.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:12.531116 25935 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.24.61.193:40571: connect: Connection refused (error 111)
08:07:12.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:12.532893 25666 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.24.61.193:40571: connect: Connection refused (error 111)
08:07:12.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:12.537143 25935 leader_election.cc:334] T d30f2f7900dd493b8a62f315ebe99ed6 P f25bcf7d71df479b99062dde78725f0e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d85a6ca1566c4a959823d91e3140f3d5 (127.24.61.193:40571): Network error: Client connection negotiation failed: client connection to 127.24.61.193:40571: connect: Connection refused (error 111)
08:07:12.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:12.540341 25666 leader_election.cc:334] T d30f2f7900dd493b8a62f315ebe99ed6 P 3485b67b72274f5f8da579248a3255c8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d85a6ca1566c4a959823d91e3140f3d5 (127.24.61.193:40571): Network error: Client connection negotiation failed: client connection to 127.24.61.193:40571: connect: Connection refused (error 111)
08:07:12.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.541193 25792 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d30f2f7900dd493b8a62f315ebe99ed6" candidate_uuid: "f25bcf7d71df479b99062dde78725f0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "3485b67b72274f5f8da579248a3255c8" is_pre_election: true
08:07:12.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.541752 25792 raft_consensus.cc:2454] T d30f2f7900dd493b8a62f315ebe99ed6 P 3485b67b72274f5f8da579248a3255c8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f25bcf7d71df479b99062dde78725f0e in term 1.
08:07:12.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.542699 25935 leader_election.cc:302] T d30f2f7900dd493b8a62f315ebe99ed6 P f25bcf7d71df479b99062dde78725f0e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3485b67b72274f5f8da579248a3255c8, f25bcf7d71df479b99062dde78725f0e; no voters: d85a6ca1566c4a959823d91e3140f3d5
08:07:12.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.543370 26280 raft_consensus.cc:2781] T d30f2f7900dd493b8a62f315ebe99ed6 P f25bcf7d71df479b99062dde78725f0e [term 1 FOLLOWER]: Leader pre-election won for term 2
08:07:12.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.543630 26280 raft_consensus.cc:482] T d30f2f7900dd493b8a62f315ebe99ed6 P f25bcf7d71df479b99062dde78725f0e [term 1 FOLLOWER]: Starting leader election (detected failure of leader d85a6ca1566c4a959823d91e3140f3d5)
08:07:12.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.543962 26280 raft_consensus.cc:3037] T d30f2f7900dd493b8a62f315ebe99ed6 P f25bcf7d71df479b99062dde78725f0e [term 1 FOLLOWER]: Advancing to term 2
08:07:12.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.547180 26047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d30f2f7900dd493b8a62f315ebe99ed6" candidate_uuid: "3485b67b72274f5f8da579248a3255c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "f25bcf7d71df479b99062dde78725f0e" is_pre_election: true
08:07:12.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.549289 26280 raft_consensus.cc:504] T d30f2f7900dd493b8a62f315ebe99ed6 P f25bcf7d71df479b99062dde78725f0e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f25bcf7d71df479b99062dde78725f0e" member_type: VOTER last_known_addr { host: "127.24.61.195" port: 33319 } } peers { permanent_uuid: "d85a6ca1566c4a959823d91e3140f3d5" member_type: VOTER last_known_addr { host: "127.24.61.193" port: 40571 } } peers { permanent_uuid: "3485b67b72274f5f8da579248a3255c8" member_type: VOTER last_known_addr { host: "127.24.61.194" port: 41685 } }
08:07:12.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.550316 26047 raft_consensus.cc:2379] T d30f2f7900dd493b8a62f315ebe99ed6 P f25bcf7d71df479b99062dde78725f0e [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3485b67b72274f5f8da579248a3255c8 in current term 2: Already voted for candidate f25bcf7d71df479b99062dde78725f0e in this term.
08:07:12.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.551067 26280 leader_election.cc:288] T d30f2f7900dd493b8a62f315ebe99ed6 P f25bcf7d71df479b99062dde78725f0e [CANDIDATE]: Term 2 election: Requested vote from peers d85a6ca1566c4a959823d91e3140f3d5 (127.24.61.193:40571), 3485b67b72274f5f8da579248a3255c8 (127.24.61.194:41685)
08:07:12.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.552549 25792 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d30f2f7900dd493b8a62f315ebe99ed6" candidate_uuid: "f25bcf7d71df479b99062dde78725f0e" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "3485b67b72274f5f8da579248a3255c8"
08:07:12.553 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.553025 25792 raft_consensus.cc:3037] T d30f2f7900dd493b8a62f315ebe99ed6 P 3485b67b72274f5f8da579248a3255c8 [term 1 FOLLOWER]: Advancing to term 2
08:07:12.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:12.554608 25935 leader_election.cc:334] T d30f2f7900dd493b8a62f315ebe99ed6 P f25bcf7d71df479b99062dde78725f0e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d85a6ca1566c4a959823d91e3140f3d5 (127.24.61.193:40571): Network error: Client connection negotiation failed: client connection to 127.24.61.193:40571: connect: Connection refused (error 111)
08:07:12.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.555722 25665 leader_election.cc:302] T d30f2f7900dd493b8a62f315ebe99ed6 P 3485b67b72274f5f8da579248a3255c8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3485b67b72274f5f8da579248a3255c8; no voters: d85a6ca1566c4a959823d91e3140f3d5, f25bcf7d71df479b99062dde78725f0e
08:07:12.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.557957 25792 raft_consensus.cc:2454] T d30f2f7900dd493b8a62f315ebe99ed6 P 3485b67b72274f5f8da579248a3255c8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f25bcf7d71df479b99062dde78725f0e in term 2.
08:07:12.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.558334 26281 raft_consensus.cc:2726] T d30f2f7900dd493b8a62f315ebe99ed6 P 3485b67b72274f5f8da579248a3255c8 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
08:07:12.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.558791 25935 leader_election.cc:302] T d30f2f7900dd493b8a62f315ebe99ed6 P f25bcf7d71df479b99062dde78725f0e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3485b67b72274f5f8da579248a3255c8, f25bcf7d71df479b99062dde78725f0e; no voters: d85a6ca1566c4a959823d91e3140f3d5
08:07:12.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.559510 26280 raft_consensus.cc:2781] T d30f2f7900dd493b8a62f315ebe99ed6 P f25bcf7d71df479b99062dde78725f0e [term 2 FOLLOWER]: Leader election won for term 2
08:07:12.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.561106 26280 raft_consensus.cc:686] T d30f2f7900dd493b8a62f315ebe99ed6 P f25bcf7d71df479b99062dde78725f0e [term 2 LEADER]: Becoming Leader. State: Replica: f25bcf7d71df479b99062dde78725f0e, State: Running, Role: LEADER
08:07:12.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.562213 26280 consensus_queue.cc:237] T d30f2f7900dd493b8a62f315ebe99ed6 P f25bcf7d71df479b99062dde78725f0e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 1.11, Last appended by leader: 11, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f25bcf7d71df479b99062dde78725f0e" member_type: VOTER last_known_addr { host: "127.24.61.195" port: 33319 } } peers { permanent_uuid: "d85a6ca1566c4a959823d91e3140f3d5" member_type: VOTER last_known_addr { host: "127.24.61.193" port: 40571 } } peers { permanent_uuid: "3485b67b72274f5f8da579248a3255c8" member_type: VOTER last_known_addr { host: "127.24.61.194" port: 41685 } }
08:07:12.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.572351 25034 catalog_manager.cc:5495] T d30f2f7900dd493b8a62f315ebe99ed6 P f25bcf7d71df479b99062dde78725f0e reported cstate change: term changed from 1 to 2, leader changed from d85a6ca1566c4a959823d91e3140f3d5 (127.24.61.193) to f25bcf7d71df479b99062dde78725f0e (127.24.61.195). New cstate: current_term: 2 leader_uuid: "f25bcf7d71df479b99062dde78725f0e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f25bcf7d71df479b99062dde78725f0e" member_type: VOTER last_known_addr { host: "127.24.61.195" port: 33319 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d85a6ca1566c4a959823d91e3140f3d5" member_type: VOTER last_known_addr { host: "127.24.61.193" port: 40571 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3485b67b72274f5f8da579248a3255c8" member_type: VOTER last_known_addr { host: "127.24.61.194" port: 41685 } health_report { overall_health: UNKNOWN } } }
08:07:12.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.600214 24923 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 164d87d429da4a85a4902a8601d0b511 [term 2 FOLLOWER]: Refusing update from remote peer f0ec94f0ebe642ffb18161428b38882e: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
08:07:12.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.601683 26275 consensus_queue.cc:1035] T 00000000000000000000000000000000 P f0ec94f0ebe642ffb18161428b38882e [LEADER]: Connected to new peer: Peer: permanent_uuid: "164d87d429da4a85a4902a8601d0b511" member_type: VOTER last_known_addr { host: "127.24.61.254" port: 46441 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
08:07:12.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:12.602298 25002 consensus_peers.cc:487] T 00000000000000000000000000000000 P f0ec94f0ebe642ffb18161428b38882e -> Peer 39818d5ab781409db0ab76464440eb2a (127.24.61.252:40207): Couldn't send request to peer 39818d5ab781409db0ab76464440eb2a. Status: Network error: Client connection negotiation failed: client connection to 127.24.61.252:40207: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
08:07:12.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.607031 26264 sys_catalog.cc:455] T 00000000000000000000000000000000 P 164d87d429da4a85a4902a8601d0b511 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f0ec94f0ebe642ffb18161428b38882e. Latest consensus state: current_term: 2 leader_uuid: "f0ec94f0ebe642ffb18161428b38882e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164d87d429da4a85a4902a8601d0b511" member_type: VOTER last_known_addr { host: "127.24.61.254" port: 46441 } } peers { permanent_uuid: "f0ec94f0ebe642ffb18161428b38882e" member_type: VOTER last_known_addr { host: "127.24.61.253" port: 33137 } } peers { permanent_uuid: "39818d5ab781409db0ab76464440eb2a" member_type: VOTER last_known_addr { host: "127.24.61.252" port: 40207 } } }
08:07:12.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.607694 26264 sys_catalog.cc:458] T 00000000000000000000000000000000 P 164d87d429da4a85a4902a8601d0b511 [sys.catalog]: This master's current role is: FOLLOWER
08:07:12.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.610795 26275 sys_catalog.cc:455] T 00000000000000000000000000000000 P f0ec94f0ebe642ffb18161428b38882e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "f0ec94f0ebe642ffb18161428b38882e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164d87d429da4a85a4902a8601d0b511" member_type: VOTER last_known_addr { host: "127.24.61.254" port: 46441 } } peers { permanent_uuid: "f0ec94f0ebe642ffb18161428b38882e" member_type: VOTER last_known_addr { host: "127.24.61.253" port: 33137 } } peers { permanent_uuid: "39818d5ab781409db0ab76464440eb2a" member_type: VOTER last_known_addr { host: "127.24.61.252" port: 40207 } } }
08:07:12.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.611480 26275 sys_catalog.cc:458] T 00000000000000000000000000000000 P f0ec94f0ebe642ffb18161428b38882e [sys.catalog]: This master's current role is: LEADER
08:07:12.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.614514 26264 sys_catalog.cc:455] T 00000000000000000000000000000000 P 164d87d429da4a85a4902a8601d0b511 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "f0ec94f0ebe642ffb18161428b38882e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "164d87d429da4a85a4902a8601d0b511" member_type: VOTER last_known_addr { host: "127.24.61.254" port: 46441 } } peers { permanent_uuid: "f0ec94f0ebe642ffb18161428b38882e" member_type: VOTER last_known_addr { host: "127.24.61.253" port: 33137 } } peers { permanent_uuid: "39818d5ab781409db0ab76464440eb2a" member_type: VOTER last_known_addr { host: "127.24.61.252" port: 40207 } } }
08:07:12.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.615218 26264 sys_catalog.cc:458] T 00000000000000000000000000000000 P 164d87d429da4a85a4902a8601d0b511 [sys.catalog]: This master's current role is: FOLLOWER
08:07:12.829 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.24.61.252:40207(127.24.61.252:40207)] connecting to peer
08:07:12.832 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207
08:07:12.832 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.24.61.252:40207(127.24.61.252:40207)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207
08:07:12.832 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.24.61.252:40207: Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207
08:07:12.837 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:07:12.840 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableLocations, tablet=Kudu Master, attempt=11, TimeoutTracker(timeout=29979, elapsed=1608), Traces: [0ms] sending RPC to server master-127.24.61.252:40207, [3ms] received response from server master-127.24.61.252:40207: Network error: Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207, [3ms] delaying RPC due to: Network error: Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207, [19ms] refreshing cache from master, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.61.253:33137, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.61.254:46441, [20ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.61.252:40207, [23ms] Sub RPC ConnectToMaster: received response from server master-127.24.61.252:40207: Network error: Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207, [25ms] Sub RPC ConnectToMaster: received response from server master-127.24.61.254:46441: OK, [26ms] Sub RPC ConnectToMaster: received response from server master-127.24.61.253:33137: OK, [31ms] delaying RPC due to: Service unavailable: Master config (127.24.61.253:33137,127.24.61.254:46441,127.24.61.252:40207) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.61.253:33137, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.61.254:46441, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.61.252:40207, [43ms] Sub RPC ConnectToMaster: received response from server master-127.24.61.252:40207: Network error: Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207, [44ms] Sub RPC ConnectToMaster: received response from server master-127.24.61.253:33137: OK, [45ms] Sub RPC ConnectToMaster: received response from server master-127.24.61.254:46441: OK, [46ms] delaying RPC due to: Service unavailable: Master config (127.24.61.253:33137,127.24.61.254:46441,127.24.61.252:40207) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207, [59ms] refreshing cache from master, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.61.253:33137, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.61.254:46441, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.61.252:40207, [63ms] Sub RPC ConnectToMaster: received response from server master-127.24.61.252:40207: Network error: Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207, [63ms] Sub RPC ConnectToMaster: received response from server master-127.24.61.254:46441: OK, [67ms] Sub RPC ConnectToMaster: received response from server master-127.24.61.253:33137: OK, [68ms] delaying RPC due to: Service unavailable: Master config (127.24.61.253:33137,127.24.61.254:46441,127.24.61.252:40207) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207, [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.61.253:33137, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.61.254:46441, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.61.252:40207, [84ms] Sub RPC ConnectToMaster: received response from server master-127.24.61.253:33137: OK, [85ms] Sub RPC ConnectToMaster: received response from server master-127.24.61.254:46441: OK, [85ms] Sub RPC ConnectToMaster: received response from server master-127.24.61.252:40207: Network error: Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207, [85ms] delaying RPC due to: Service unavailable: Master config (127.24.61.253:33137,127.24.61.254:46441,127.24.61.252:40207) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.61.253:33137, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.61.254:46441, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.61.252:40207, [124ms] Sub RPC ConnectToMaster: received response from server master-127.24.61.254:46441: OK, [124ms] Sub RPC ConnectToMaster: received response from server master-127.24.61.252:40207: Network error: Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207, [125ms] Sub RPC ConnectToMaster: received response from server master-127.24.61.253:33137: OK, [125ms] delaying RPC due to: Service unavailable: Master config (127.24.61.253:33137,127.24.61.254:46441,127.24.61.252:40207) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207, [179ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.61.253:33137, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.61.254:46441, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.61.252:40207, [182ms] Sub RPC ConnectToMaster: received response from server master-127.24.61.252:40207: Network error: Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207, [183ms] Sub RPC ConnectToMaster: received response from server master-127.24.61.253:33137: OK, [184ms] Sub RPC ConnectToMaster: received response from server master-127.24.61.254:46441: OK, [184ms] delaying RPC due to: Service unavailable: Master config (127.24.61.253:33137,127.24.61.254:46441,127.24.61.252:40207) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207, [300ms] refreshing cache from master, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.61.253:33137, [300ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.61.254:46441, [301ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.61.252:40207, [304ms] Sub RPC ConnectToMaster: received response from server master-127.24.61.252:40207: Network error: Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207, [304ms] Sub RPC ConnectToMaster: received response from server master-127.24.61.254:46441: OK, [305ms] Sub RPC ConnectToMaster: received response from server master-127.24.61.253:33137: OK, [305ms] delaying RPC due to: Service unavailable: Master config (127.24.61.253:33137,127.24.61.254:46441,127.24.61.252:40207) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207, [479ms] refreshing cache from master, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.61.253:33137, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.61.254:46441, [480ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.61.252:40207, [483ms] Sub RPC ConnectToMaster: received response from server master-127.24.61.252:40207: Network error: Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207, [484ms] Sub RPC ConnectToMaster: received response from server master-127.24.61.254:46441: OK, [484ms] Sub RPC ConnectToMaster: received response from server master-127.24.61.253:33137: OK, [484ms] delaying RPC due to: Service unavailable: Master config (127.24.61.253:33137,127.24.61.254:46441,127.24.61.252:40207) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207, [639ms] refreshing cache from master, [639ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.61.253:33137, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.61.254:46441, [640ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.61.252:40207, [643ms] Sub RPC ConnectToMaster: received response from server master-127.24.61.254:46441: OK, [643ms] Sub RPC ConnectToMaster: received response from server master-127.24.61.253:33137: OK, [644ms] Sub RPC ConnectToMaster: received response from server master-127.24.61.252:40207: Network error: Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207, [644ms] delaying RPC due to: Service unavailable: Master config (127.24.61.253:33137,127.24.61.254:46441,127.24.61.252:40207) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207, [1599ms] refreshing cache from master, [1600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.61.253:33137, [1600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.61.254:46441, [1600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.61.252:40207, [1603ms] Sub RPC ConnectToMaster: received response from server master-127.24.61.252:40207: Network error: Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207, [1604ms] Sub RPC ConnectToMaster: received response from server master-127.24.61.254:46441: OK, [1607ms] Sub RPC ConnectToMaster: received response from server master-127.24.61.253:33137: OK, deferred=Deferred@1643620222(state=PENDING, result=null, callback=get tablet locations from the master for table org.apache.kudu.client.TestClientFailoverSupport-KILL -> release master lookup permit -> retry RPC -> (continuation of Deferred@2125648673 after retry RPC after error@338264217) -> (continuation of Deferred@1204455088 after retry RPC after error@458888544) -> (continuation of Deferred@1931077361 after retry RPC after error@728534339) -> (continuation of Deferred@947941784 after retry RPC after error@1941607165) -> (continuation of Deferred@1328073749 after retry RPC after error@6379046) -> (continuation of Deferred@995552003 after retry RPC after error@475839470) -> (continuation of Deferred@354259988 after retry RPC after error@533143799) -> (continuation of Deferred@323346175 after retry RPC after error@1782547634) -> (continuation of Deferred@326828245 after retry RPC after error@899500757), errback=passthrough -> release master lookup permit -> retry RPC after error -> (continuation of Deferred@2125648673 after retry RPC after error@338264217) -> (continuation of Deferred@1204455088 after retry RPC after error@458888544) -> (continuation of Deferred@1931077361 after retry RPC after error@728534339) -> (continuation of Deferred@947941784 after retry RPC after error@1941607165) -> (continuation of Deferred@1328073749 after retry RPC after error@6379046) -> (continuation of Deferred@995552003 after retry RPC after error@475839470) -> (continuation of Deferred@354259988 after retry RPC after error@533143799) -> (continuation of Deferred@323346175 after retry RPC after error@1782547634) -> (continuation of Deferred@326828245 after retry RPC after error@899500757))) after lookup
08:07:12.846 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet d30f2f7900dd493b8a62f315ebe99ed6 for table 'org.apache.kudu.client.TestClientFailoverSupport-KILL' with partition [<start>, <end>)
08:07:12.847 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=d30f2f7900dd493b8a62f315ebe99ed6@[3485b67b72274f5f8da579248a3255c8(127.24.61.194:41685),d85a6ca1566c4a959823d91e3140f3d5(127.24.61.193:40571),f25bcf7d71df479b99062dde78725f0e(127.24.61.195:33319)[L]]}]
08:07:12.850 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=d30f2f7900dd493b8a62f315ebe99ed6, attempt=2, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=1640), Traces: [0ms] sending RPC to server d85a6ca1566c4a959823d91e3140f3d5, [3ms] received response from server d85a6ca1566c4a959823d91e3140f3d5: Network error: Failed to connect to peer d85a6ca1566c4a959823d91e3140f3d5(127.24.61.193:40571): Connection refused: /127.24.61.193:40571, [4ms] delaying RPC due to: Network error: Failed to connect to peer d85a6ca1566c4a959823d91e3140f3d5(127.24.61.193:40571): Connection refused: /127.24.61.193:40571, [22ms] refreshing cache from master, [22ms] Sub RPC GetTableLocations: sending RPC to server master-127.24.61.252:40207, [25ms] Sub RPC GetTableLocations: received response from server master-127.24.61.252:40207: Network error: Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207, [25ms] Sub RPC GetTableLocations: delaying RPC due to: Network error: Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207, [41ms] Sub RPC GetTableLocations: refreshing cache from master, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.61.253:33137, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.61.254:46441, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.61.252:40207, [45ms] Sub RPC ConnectToMaster: received response from server master-127.24.61.252:40207: Network error: Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207, [47ms] Sub RPC ConnectToMaster: received response from server master-127.24.61.254:46441: OK, [48ms] Sub RPC ConnectToMaster: received response from server master-127.24.61.253:33137: OK, [53ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.24.61.253:33137,127.24.61.254:46441,127.24.61.252:40207) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207, [62ms] Sub RPC GetTableLocations: refreshing cache from master, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.61.253:33137, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.61.254:46441, [63ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.61.252:40207, [65ms] Sub RPC ConnectToMaster: received response from server master-127.24.61.252:40207: Network error: Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207, [66ms] Sub RPC ConnectToMaster: received response from server master-127.24.61.253:33137: OK, [67ms] Sub RPC ConnectToMaster: received response from server master-127.24.61.254:46441: OK, [68ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.24.61.253:33137,127.24.61.254:46441,127.24.61.252:40207) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207, [81ms] Sub RPC GetTableLocations: refreshing cache from master, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.61.253:33137, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.61.254:46441, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.61.252:40207, [85ms] Sub RPC ConnectToMaster: received response from server master-127.24.61.252:40207: Network error: Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207, [85ms] Sub RPC ConnectToMaster: received response from server master-127.24.61.254:46441: OK, [89ms] Sub RPC ConnectToMaster: received response from server master-127.24.61.253:33137: OK, [90ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.24.61.253:33137,127.24.61.254:46441,127.24.61.252:40207) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207, [102ms] Sub RPC GetTableLocations: refreshing cache from master, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.61.253:33137, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.61.254:46441, [102ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.61.252:40207, [106ms] Sub RPC ConnectToMaster: received response from server master-127.24.61.253:33137: OK, [107ms] Sub RPC ConnectToMaster: received response from server master-127.24.61.254:46441: OK, [107ms] Sub RPC ConnectToMaster: received response from server master-127.24.61.252:40207: Network error: Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207, [107ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.24.61.253:33137,127.24.61.254:46441,127.24.61.252:40207) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207, [142ms] Sub RPC GetTableLocations: refreshing cache from master, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.61.253:33137, [142ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.61.254:46441, [143ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.61.252:40207, [146ms] Sub RPC ConnectToMaster: received response from server master-127.24.61.254:46441: OK, [146ms] Sub RPC ConnectToMaster: received response from server master-127.24.61.252:40207: Network error: Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207, [147ms] Sub RPC ConnectToMaster: received response from server master-127.24.61.253:33137: OK, [147ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.24.61.253:33137,127.24.61.254:46441,127.24.61.252:40207) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207, [201ms] Sub RPC GetTableLocations: refreshing cache from master, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.61.253:33137, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.61.254:46441, [202ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.61.252:40207, [204ms] Sub RPC ConnectToMaster: received response from server master-127.24.61.252:40207: Network error: Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207, [205ms] Sub RPC ConnectToMaster: received response from server master-127.24.61.253:33137: OK, [206ms] Sub RPC ConnectToMaster: received response from server master-127.24.61.254:46441: OK, [206ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.24.61.253:33137,127.24.61.254:46441,127.24.61.252:40207) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207, [322ms] Sub RPC GetTableLocations: refreshing cache from master, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.61.253:33137, [322ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.61.254:46441, [323ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.61.252:40207, [326ms] Sub RPC ConnectToMaster: received response from server master-127.24.61.252:40207: Network error: Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207, [326ms] Sub RPC ConnectToMaster: received response from server master-127.24.61.254:46441: OK, [327ms] Sub RPC ConnectToMaster: received response from server master-127.24.61.253:33137: OK, [327ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.24.61.253:33137,127.24.61.254:46441,127.24.61.252:40207) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207, [501ms] Sub RPC GetTableLocations: refreshing cache from master, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.61.253:33137, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.61.254:46441, [502ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.61.252:40207, [505ms] Sub RPC ConnectToMaster: received response from server master-127.24.61.252:40207: Network error: Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207, [506ms] Sub RPC ConnectToMaster: received response from server master-127.24.61.254:46441: OK, [506ms] Sub RPC ConnectToMaster: received response from server master-127.24.61.253:33137: OK, [506ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.24.61.253:33137,127.24.61.254:46441,127.24.61.252:40207) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207, [661ms] Sub RPC GetTableLocations: refreshing cache from master, [661ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.61.253:33137, [662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.61.254:46441, [662ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.61.252:40207, [665ms] Sub RPC ConnectToMaster: received response from server master-127.24.61.254:46441: OK, [665ms] Sub RPC ConnectToMaster: received response from server master-127.24.61.253:33137: OK, [666ms] Sub RPC ConnectToMaster: received response from server master-127.24.61.252:40207: Network error: Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207, [666ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.24.61.253:33137,127.24.61.254:46441,127.24.61.252:40207) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207, [1621ms] Sub RPC GetTableLocations: refreshing cache from master, [1622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.61.253:33137, [1622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.61.254:46441, [1622ms] Sub RPC ConnectToMaster: sending RPC to server master-127.24.61.252:40207, [1625ms] Sub RPC ConnectToMaster: received response from server master-127.24.61.252:40207: Network error: Failed to connect to peer master-127.24.61.252:40207(127.24.61.252:40207): Connection refused: /127.24.61.252:40207, [1626ms] Sub RPC ConnectToMaster: received response from server master-127.24.61.254:46441: OK, [1629ms] Sub RPC ConnectToMaster: received response from server master-127.24.61.253:33137: OK, [1635ms] Sub RPC GetTableLocations: sending RPC to server master-127.24.61.253:33137, [1639ms] Sub RPC GetTableLocations: received response from server master-127.24.61.253:33137: OK, deferred=Deferred@505333515(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$83/1604193830@552801b5 -> passthrough -> wakeup thread Time-limited test, errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@abc3227 -> wakeup thread Time-limited test)) after lookup
08:07:12.852 [DEBUG - kudu-nio-0] (Connection.java:748) [peer f25bcf7d71df479b99062dde78725f0e(127.24.61.195:33319)] connecting to peer
08:07:12.853 [DEBUG - kudu-nio-0] (Connection.java:757) [peer f25bcf7d71df479b99062dde78725f0e(127.24.61.195:33319)] Successfully connected to peer
08:07:12.881 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x95c19cda, L:/127.0.0.1:54694 - R:/127.24.61.195:33319] using TOKEN/null
08:07:12.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.891108 25792 raft_consensus.cc:1261] T d30f2f7900dd493b8a62f315ebe99ed6 P 3485b67b72274f5f8da579248a3255c8 [term 2 FOLLOWER]: Refusing update from remote peer f25bcf7d71df479b99062dde78725f0e: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 2 index: 13. (index mismatch)
08:07:12.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:12.892033 25935 consensus_peers.cc:487] T d30f2f7900dd493b8a62f315ebe99ed6 P f25bcf7d71df479b99062dde78725f0e -> Peer d85a6ca1566c4a959823d91e3140f3d5 (127.24.61.193:40571): Couldn't send request to peer d85a6ca1566c4a959823d91e3140f3d5. Status: Network error: Client connection negotiation failed: client connection to 127.24.61.193:40571: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
08:07:12.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.892912 26280 consensus_queue.cc:1035] T d30f2f7900dd493b8a62f315ebe99ed6 P f25bcf7d71df479b99062dde78725f0e [LEADER]: Connected to new peer: Peer: permanent_uuid: "3485b67b72274f5f8da579248a3255c8" member_type: VOTER last_known_addr { host: "127.24.61.194" port: 41685 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
08:07:12.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.895797 25880 heartbeater.cc:503] Master 127.24.61.253:33137 was elected leader, sending a full tablet report...
08:07:12.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.906539 26316 mvcc.cc:205] Tried to move back new op lower bound from 7317594246705315840 to 7317594245382672384. Current Snapshot: MvccSnapshot[applied={T|T < 7317594246705315840}]
08:07:12.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.909137 26314 mvcc.cc:205] Tried to move back new op lower bound from 7317594246705315840 to 7317594245382672384. Current Snapshot: MvccSnapshot[applied={T|T < 7317594246705315840}]
08:07:12.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:12.912786 26135 heartbeater.cc:503] Master 127.24.61.253:33137 was elected leader, sending a full tablet report...
08:07:13.056 [DEBUG - kudu-nio-0] (AsyncKuduScanner.java:1374) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 20 rows, more = false) for scanner KuduScanner(table=org.apache.kudu.client.TestClientFailoverSupport-KILL, tablet=d30f2f7900dd493b8a62f315ebe99ed6, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:13.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:13.063419 25027 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:38030:
08:07:13.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "org.apache.kudu.client.TestClientFailoverSupport-KILL" }
08:07:13.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:13.064112 25027 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:38030:
08:07:13.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "org.apache.kudu.client.TestClientFailoverSupport-KILL" }
08:07:13.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:13.080111 25027 catalog_manager.cc:5782] T 00000000000000000000000000000000 P f0ec94f0ebe642ffb18161428b38882e: Sending DeleteTablet for 3 replicas of tablet d30f2f7900dd493b8a62f315ebe99ed6
08:07:13.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:13.097049 26010 tablet_service.cc:1514] Processing DeleteTablet for tablet d30f2f7900dd493b8a62f315ebe99ed6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 08:07:13 UTC) from {username='slave'} at 127.0.0.1:54704
08:07:13.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:13.110586 26336 tablet_replica.cc:330] T d30f2f7900dd493b8a62f315ebe99ed6 P f25bcf7d71df479b99062dde78725f0e: stopping tablet replica
08:07:13.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:13.111858 26336 raft_consensus.cc:2229] T d30f2f7900dd493b8a62f315ebe99ed6 P f25bcf7d71df479b99062dde78725f0e [term 2 LEADER]: Raft consensus shutting down.
08:07:13.113 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:13.113607 26336 raft_consensus.cc:2258] T d30f2f7900dd493b8a62f315ebe99ed6 P f25bcf7d71df479b99062dde78725f0e [term 2 FOLLOWER]: Raft consensus is shut down!
08:07:13.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:13.113508 25003 catalog_manager.cc:4584] TS d85a6ca1566c4a959823d91e3140f3d5 (127.24.61.193:40571): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet d30f2f7900dd493b8a62f315ebe99ed6: Network error: Client connection negotiation failed: client connection to 127.24.61.193:40571: connect: Connection refused (error 111)
08:07:13.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:13.117370 26336 ts_tablet_manager.cc:1905] T d30f2f7900dd493b8a62f315ebe99ed6 P f25bcf7d71df479b99062dde78725f0e: Deleting tablet data with delete state TABLET_DATA_DELETED
08:07:13.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:13.130440 25760 tablet_service.cc:1514] Processing DeleteTablet for tablet d30f2f7900dd493b8a62f315ebe99ed6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 08:07:13 UTC) from {username='slave'} at 127.0.0.1:35364
08:07:13.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:13.132330 26336 ts_tablet_manager.cc:1918] T d30f2f7900dd493b8a62f315ebe99ed6 P f25bcf7d71df479b99062dde78725f0e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.22
08:07:13.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:13.132654 26344 tablet_replica.cc:330] T d30f2f7900dd493b8a62f315ebe99ed6 P 3485b67b72274f5f8da579248a3255c8: stopping tablet replica
08:07:13.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:13.132915 26336 log.cc:1196] T d30f2f7900dd493b8a62f315ebe99ed6 P f25bcf7d71df479b99062dde78725f0e: Deleting WAL directory at /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/ts-2/wal/wals/d30f2f7900dd493b8a62f315ebe99ed6
08:07:13.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:13.133672 26344 raft_consensus.cc:2229] T d30f2f7900dd493b8a62f315ebe99ed6 P 3485b67b72274f5f8da579248a3255c8 [term 2 FOLLOWER]: Raft consensus shutting down.
08:07:13.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:13.133911 26336 ts_tablet_manager.cc:1939] T d30f2f7900dd493b8a62f315ebe99ed6 P f25bcf7d71df479b99062dde78725f0e: Deleting consensus metadata
08:07:13.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:13.134815 26344 raft_consensus.cc:2258] T d30f2f7900dd493b8a62f315ebe99ed6 P 3485b67b72274f5f8da579248a3255c8 [term 2 FOLLOWER]: Raft consensus is shut down!
08:07:13.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:13.137593 25002 catalog_manager.cc:4841] TS f25bcf7d71df479b99062dde78725f0e (127.24.61.195:33319): tablet d30f2f7900dd493b8a62f315ebe99ed6 (table org.apache.kudu.client.TestClientFailoverSupport-KILL [id=8d24afbe42964b779785410b57abbfe8]) successfully deleted
08:07:13.138 [DEBUG - main] (Connection.java:575) [peer f25bcf7d71df479b99062dde78725f0e(127.24.61.195:33319)] disconnecting while in state READY
08:07:13.139 [DEBUG - main] (Connection.java:575) [peer master-127.24.61.252:40207(127.24.61.252:40207)] disconnecting while in state TERMINATED
08:07:13.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:13.143689 26344 ts_tablet_manager.cc:1905] T d30f2f7900dd493b8a62f315ebe99ed6 P 3485b67b72274f5f8da579248a3255c8: Deleting tablet data with delete state TABLET_DATA_DELETED
08:07:13.156 [DEBUG - main] (Connection.java:575) [peer d85a6ca1566c4a959823d91e3140f3d5(127.24.61.193:40571)] disconnecting while in state TERMINATED
08:07:13.157 [DEBUG - main] (Connection.java:575) [peer master-127.24.61.253:33137(127.24.61.253:33137)] disconnecting while in state READY
08:07:13.157 [DEBUG - main] (Connection.java:575) [peer master-127.24.61.254:46441(127.24.61.254:46441)] disconnecting while in state READY
08:07:13.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:13.160081 26344 ts_tablet_manager.cc:1918] T d30f2f7900dd493b8a62f315ebe99ed6 P 3485b67b72274f5f8da579248a3255c8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.22
08:07:13.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:13.160686 26344 log.cc:1196] T d30f2f7900dd493b8a62f315ebe99ed6 P 3485b67b72274f5f8da579248a3255c8: Deleting WAL directory at /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4427234669188011129/ts-1/wal/wals/d30f2f7900dd493b8a62f315ebe99ed6
08:07:13.161 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.24.61.254:46441(127.24.61.254:46441)] handling channelInactive
08:07:13.161 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.24.61.254:46441(127.24.61.254:46441)] cleaning up while in state READY due to: connection closed
08:07:13.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:13.161819 26344 ts_tablet_manager.cc:1939] T d30f2f7900dd493b8a62f315ebe99ed6 P 3485b67b72274f5f8da579248a3255c8: Deleting consensus metadata
08:07:13.164 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:07:13.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:13.166122 25003 catalog_manager.cc:4841] TS 3485b67b72274f5f8da579248a3255c8 (127.24.61.194:41685): tablet d30f2f7900dd493b8a62f315ebe99ed6 (table org.apache.kudu.client.TestClientFailoverSupport-KILL [id=8d24afbe42964b779785410b57abbfe8]) successfully deleted
08:07:13.168 [DEBUG - kudu-nio-0] (Connection.java:239) [peer f25bcf7d71df479b99062dde78725f0e(127.24.61.195:33319)] handling channelInactive
08:07:13.168 [DEBUG - kudu-nio-0] (Connection.java:709) [peer f25bcf7d71df479b99062dde78725f0e(127.24.61.195:33319)] cleaning up while in state READY due to: connection closed
08:07:13.168 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.24.61.253:33137(127.24.61.253:33137)] handling channelInactive
08:07:13.168 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.24.61.253:33137(127.24.61.253:33137)] cleaning up while in state READY due to: connection closed
08:07:13.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:13.169538 24823 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgk96or/build/tsan/bin/kudu with pid 25612
08:07:13.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:13.252861 24823 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgk96or/build/tsan/bin/kudu with pid 25897
08:07:13.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:13.293550 24823 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgk96or/build/tsan/bin/kudu with pid 24839
08:07:13.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:13.327148 24823 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgk96or/build/tsan/bin/kudu with pid 24968
08:07:14.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-08-12T08:07:14Z chronyd exiting
.08:07:15.785 [INFO - main] (RandomUtils.java:49) Using random seed: 1786522035785
08:07:15.787 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
08:07:15.788 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
08:07:15.788 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskgk96or/test-tmp
08:07:15.788 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
08:07:15.789 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskgk96or/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
08:07:15.790 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

08:07:16.121 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
08:07:16.122 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

08:07:16.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:16.125511 26352 mini_oidc.cc:152] Starting JWKS server
08:07:16.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:16.129094 26352 webserver.cc:460] Webserver started at http://127.0.0.1:42397/ using document root <none> and password file <none>
08:07:16.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:16.129601 26352 mini_oidc.cc:189] Starting OIDC Discovery server
08:07:16.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:16.131810 26352 webserver.cc:460] Webserver started at http://127.0.0.1:38925/ using document root <none> and password file <none>
08:07:16.173 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-08-12T08:07:16Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
08:07:16.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-08-12T08:07:16Z Disabled control of system clock
08:07:16.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:16.185894 26352 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgk96or/build/tsan/bin/kudu
08:07:16.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgk96or/build/tsan/bin/kudu
08:07:16.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/master-0/wal
08:07:16.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/master-0/data
08:07:16.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:07:16.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:07:16.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:07:16.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:07:16.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:07:16.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:07:16.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/master-0/logs
08:07:16.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/master-0/data/info.pb
08:07:16.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:07:16.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:07:16.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:07:16.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:07:16.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:07:16.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:07:16.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:07:16.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:07:16.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
08:07:16.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:07:16.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:07:16.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:07:16.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.25.188.62:34681
08:07:16.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.25.188.62
08:07:16.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:07:16.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.25.188.20:33377
08:07:16.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:07:16.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:07:16.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:07:16.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:07:16.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.25.188.62:34681,127.25.188.61:37789,127.25.188.60:39957
08:07:16.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:07:16.187 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:42397/jwks.json with env {}
08:07:16.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:16.482959 26373 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
08:07:16.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:16.483559 26373 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:07:16.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:16.484097 26373 flags.cc:425] Enabled unsafe flag: --never_fsync=true
08:07:16.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:16.515213 26373 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
08:07:16.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:16.515585 26373 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
08:07:16.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:16.515929 26373 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
08:07:16.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:16.516240 26373 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
08:07:16.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:16.516539 26373 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
08:07:16.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:16.516742 26373 flags.cc:425] Enabled experimental flag: --jwks_url=http://localhost:42397/jwks.json
08:07:16.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:16.558058 26373 master_runner.cc:386] Master server non-default flags:
08:07:16.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:07:16.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.25.188.20:33377
08:07:16.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:07:16.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:07:16.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/master-0/data
08:07:16.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/master-0/wal
08:07:16.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:07:16.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.25.188.62:34681,127.25.188.61:37789,127.25.188.60:39957
08:07:16.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:07:16.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:07:16.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:07:16.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.25.188.62:34681
08:07:16.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:07:16.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:07:16.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:07:16.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:42397/jwks.json
08:07:16.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:07:16.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:07:16.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/master-0/data/info.pb
08:07:16.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.25.188.62
08:07:16.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:07:16.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:07:16.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:07:16.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:07:16.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:07:16.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:07:16.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/master-0/logs
08:07:16.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:07:16.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:07:16.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:07:16.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
08:07:16.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.18.0-SNAPSHOT
08:07:16.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
08:07:16.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:07:16.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by systest at 12 Aug 2026 06:37:03 UTC on ccycloud.quasar-wifqrz.root.comops.site
08:07:16.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 4581996
08:07:16.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:07:16.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:16.559482 26373 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:07:16.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:16.561290 26373 file_cache.cc:493] Constructed file cache file cache with capacity 419430
08:07:16.581 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:16.580315 26384 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:17.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:16.580521 26390 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:17.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:16.582772 26373 server_base.cc:1034] running on GCE node
08:07:17.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:16.581930 26383 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:17.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:17.677546 26373 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:07:17.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:17.680619 26373 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:07:17.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:17.682073 26373 hybrid_clock.cc:648] HybridClock initialized: now 1786522037682024 us; error 65 us; skew 500 ppm
08:07:17.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:17.683094 26373 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:07:17.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:17.689419 26373 webserver.cc:460] Webserver started at http://127.25.188.62:38811/ using document root <none> and password file <none>
08:07:17.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:17.690344 26373 fs_manager.cc:359] Metadata directory not provided
08:07:17.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:17.690531 26373 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:07:17.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:17.690940 26373 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
08:07:17.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:17.695809 26373 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/master-0/data/instance:
08:07:17.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "24369b54bb044e73b317e8452914980e"
08:07:17.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 08:07:17 on dist-test-slave-f0tn"
08:07:17.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:17.696885 26373 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/master-0/wal/instance:
08:07:17.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "24369b54bb044e73b317e8452914980e"
08:07:17.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 08:07:17 on dist-test-slave-f0tn"
08:07:17.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:17.706187 26373 fs_manager.cc:691] Time spent creating directory manager: real 0.009s	user 0.007s	sys 0.000s
08:07:17.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:17.712471 26401 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:07:17.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:17.713583 26373 fs_manager.cc:725] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.001s
08:07:17.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:17.713888 26373 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/master-0/data,/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/master-0/wal
08:07:17.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "24369b54bb044e73b317e8452914980e"
08:07:17.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 08:07:17 on dist-test-slave-f0tn"
08:07:17.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:17.714184 26373 fs_report.cc:383] FS layout report
08:07:17.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:07:17.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/master-0/wal
08:07:17.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/master-0/wal
08:07:17.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/master-0/data/data
08:07:17.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:07:17.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:07:17.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:07:17.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:07:17.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:07:17.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:07:17.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:07:17.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:07:17.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:07:17.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:07:17.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:07:17.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:17.759572 26373 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
08:07:17.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:17.761034 26373 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:07:17.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:17.761500 26373 kserver.cc:163] Server-wide thread pool size limit: 3276
08:07:17.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:17.828759 26373 rpc_server.cc:307] RPC server started. Bound to: 127.25.188.62:34681
08:07:17.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:17.828855 26495 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.188.62:34681 every 8 connection(s)
08:07:17.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:17.831440 26373 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/master-0/data/info.pb
08:07:17.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:17.836272 26352 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgk96or/build/tsan/bin/kudu as pid 26373
08:07:17.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:17.836546 26496 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
08:07:17.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:17.836736 26352 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/master-0/wal/instance
08:07:17.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:17.840183 26352 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgk96or/build/tsan/bin/kudu
08:07:17.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgk96or/build/tsan/bin/kudu
08:07:17.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/master-1/wal
08:07:17.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/master-1/data
08:07:17.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:07:17.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:07:17.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:07:17.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:07:17.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:07:17.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:07:17.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/master-1/logs
08:07:17.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/master-1/data/info.pb
08:07:17.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:07:17.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:07:17.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:07:17.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:07:17.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:07:17.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:07:17.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:07:17.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:07:17.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
08:07:17.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:07:17.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:07:17.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:07:17.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.25.188.61:37789
08:07:17.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.25.188.61
08:07:17.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:07:17.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.25.188.20:33377
08:07:17.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:07:17.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:07:17.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:07:17.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:07:17.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.25.188.62:34681,127.25.188.61:37789,127.25.188.60:39957
08:07:17.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:07:17.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:42397/jwks.json with env {}
08:07:17.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:17.850674 26496 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.188.62" port: 34681 } has no permanent_uuid. Determining permanent_uuid...
08:07:17.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:17.882069 26496 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.188.61" port: 37789 } has no permanent_uuid. Determining permanent_uuid...
08:07:17.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:17.884286 26405 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.188.61:37789: connect: Connection refused (error 111)
08:07:17.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:17.888077 26496 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.188.61:37789: Network error: Client connection negotiation failed: client connection to 127.25.188.61:37789: connect: Connection refused (error 111)
08:07:17.938 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:17.937494 26496 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.188.61" port: 37789 } attempt: 1
08:07:17.941 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:17.941488 26496 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.188.61:37789: Network error: Client connection negotiation failed: client connection to 127.25.188.61:37789: connect: Connection refused (error 111)
08:07:18.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:18.009960 26496 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.188.61" port: 37789 } attempt: 2
08:07:18.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:18.013679 26496 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.188.61:37789: Network error: Client connection negotiation failed: client connection to 127.25.188.61:37789: connect: Connection refused (error 111)
08:07:18.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:18.105172 26496 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.188.61" port: 37789 } attempt: 3
08:07:18.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:18.109257 26496 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.188.61:37789: Network error: Client connection negotiation failed: client connection to 127.25.188.61:37789: connect: Connection refused (error 111)
08:07:18.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:18.145117 26498 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
08:07:18.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:18.145747 26498 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:07:18.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:18.146232 26498 flags.cc:425] Enabled unsafe flag: --never_fsync=true
08:07:18.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:18.176813 26498 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
08:07:18.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:18.177085 26498 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
08:07:18.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:18.177273 26498 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
08:07:18.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:18.177510 26498 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
08:07:18.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:18.177722 26498 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
08:07:18.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:18.177862 26498 flags.cc:425] Enabled experimental flag: --jwks_url=http://localhost:42397/jwks.json
08:07:18.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:18.212255 26498 master_runner.cc:386] Master server non-default flags:
08:07:18.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:07:18.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.25.188.20:33377
08:07:18.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:07:18.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:07:18.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/master-1/data
08:07:18.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/master-1/wal
08:07:18.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:07:18.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.25.188.62:34681,127.25.188.61:37789,127.25.188.60:39957
08:07:18.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:07:18.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:07:18.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:07:18.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.25.188.61:37789
08:07:18.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:07:18.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:07:18.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:07:18.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:42397/jwks.json
08:07:18.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:07:18.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:07:18.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/master-1/data/info.pb
08:07:18.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.25.188.61
08:07:18.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:07:18.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:07:18.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:07:18.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:07:18.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:07:18.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:07:18.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/master-1/logs
08:07:18.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:07:18.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:07:18.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:07:18.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
08:07:18.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.18.0-SNAPSHOT
08:07:18.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
08:07:18.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:07:18.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by systest at 12 Aug 2026 06:37:03 UTC on ccycloud.quasar-wifqrz.root.comops.site
08:07:18.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 4581996
08:07:18.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:07:18.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:18.213780 26498 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:07:18.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:18.216075 26498 file_cache.cc:493] Constructed file cache file cache with capacity 419430
08:07:18.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:18.236631 26511 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:18.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:18.252665 26496 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.188.61" port: 37789 } attempt: 4
08:07:18.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:18.256229 26496 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.188.61:37789: Network error: Client connection negotiation failed: client connection to 127.25.188.61:37789: connect: Connection refused (error 111)
08:07:18.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:18.555784 26496 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.188.61" port: 37789 } attempt: 5
08:07:18.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:18.559679 26496 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.188.61:37789: Network error: Client connection negotiation failed: client connection to 127.25.188.61:37789: connect: Connection refused (error 111)
08:07:19.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:19.107245 26496 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.188.61" port: 37789 } attempt: 6
08:07:19.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:19.114055 26496 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.188.61:37789: Network error: Client connection negotiation failed: client connection to 127.25.188.61:37789: connect: Connection refused (error 111)
08:07:19.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:18.236753 26514 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:19.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:18.237478 26518 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:19.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:19.339102 26516 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
08:07:19.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:19.339265 26498 server_base.cc:1029] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:07:19.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:19.342592 26498 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:07:19.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:19.345813 26498 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:07:19.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:19.347466 26498 hybrid_clock.cc:648] HybridClock initialized: now 1786522039347422 us; error 44 us; skew 500 ppm
08:07:19.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:19.348358 26498 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:07:19.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:19.359892 26498 webserver.cc:460] Webserver started at http://127.25.188.61:38267/ using document root <none> and password file <none>
08:07:19.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:19.360814 26498 fs_manager.cc:359] Metadata directory not provided
08:07:19.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:19.361004 26498 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:07:19.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:19.361462 26498 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
08:07:19.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:19.366787 26498 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/master-1/data/instance:
08:07:19.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c6e4ef8a98eb452cb3b3b247f68bb112"
08:07:19.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 08:07:19 on dist-test-slave-f0tn"
08:07:19.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:19.370127 26498 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/master-1/wal/instance:
08:07:19.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c6e4ef8a98eb452cb3b3b247f68bb112"
08:07:19.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 08:07:19 on dist-test-slave-f0tn"
08:07:19.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:19.378152 26498 fs_manager.cc:691] Time spent creating directory manager: real 0.007s	user 0.007s	sys 0.000s
08:07:19.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:19.383755 26536 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:07:19.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:19.384729 26498 fs_manager.cc:725] Time spent opening block manager: real 0.004s	user 0.006s	sys 0.000s
08:07:19.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:19.385069 26498 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/master-1/data,/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/master-1/wal
08:07:19.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c6e4ef8a98eb452cb3b3b247f68bb112"
08:07:19.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 08:07:19 on dist-test-slave-f0tn"
08:07:19.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:19.385455 26498 fs_report.cc:383] FS layout report
08:07:19.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:07:19.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/master-1/wal
08:07:19.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/master-1/wal
08:07:19.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/master-1/data/data
08:07:19.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:07:19.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:07:19.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:07:19.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:07:19.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:07:19.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:07:19.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:07:19.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:07:19.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:07:19.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:07:19.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:07:19.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:19.417086 26498 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
08:07:19.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:19.418730 26498 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:07:19.419 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:19.419237 26498 kserver.cc:163] Server-wide thread pool size limit: 3276
08:07:19.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:19.487558 26498 rpc_server.cc:307] RPC server started. Bound to: 127.25.188.61:37789
08:07:19.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:19.487673 26621 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.188.61:37789 every 8 connection(s)
08:07:19.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:19.490376 26498 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/master-1/data/info.pb
08:07:19.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:19.495563 26622 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
08:07:19.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:19.499920 26352 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgk96or/build/tsan/bin/kudu as pid 26498
08:07:19.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:19.500253 26352 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/master-1/wal/instance
08:07:19.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:19.502276 26352 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgk96or/build/tsan/bin/kudu
08:07:19.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgk96or/build/tsan/bin/kudu
08:07:19.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/master-2/wal
08:07:19.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/master-2/data
08:07:19.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:07:19.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:07:19.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:07:19.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:07:19.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:07:19.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:07:19.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/master-2/logs
08:07:19.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/master-2/data/info.pb
08:07:19.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:07:19.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:07:19.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:07:19.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:07:19.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:07:19.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:07:19.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:07:19.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:07:19.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
08:07:19.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:07:19.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:07:19.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:07:19.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.25.188.60:39957
08:07:19.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.25.188.60
08:07:19.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:07:19.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.25.188.20:33377
08:07:19.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:07:19.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:07:19.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:07:19.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:07:19.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.25.188.62:34681,127.25.188.61:37789,127.25.188.60:39957
08:07:19.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:07:19.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:42397/jwks.json with env {}
08:07:19.509 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:19.507401 26622 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.188.62" port: 34681 } has no permanent_uuid. Determining permanent_uuid...
08:07:19.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:19.533618 26622 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.188.61" port: 37789 } has no permanent_uuid. Determining permanent_uuid...
08:07:19.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:19.549912 26622 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.188.60" port: 39957 } has no permanent_uuid. Determining permanent_uuid...
08:07:19.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:19.552243 26542 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.188.60:39957: connect: Connection refused (error 111)
08:07:19.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:19.556124 26622 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.188.60:39957: Network error: Client connection negotiation failed: client connection to 127.25.188.60:39957: connect: Connection refused (error 111)
08:07:19.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:19.605566 26622 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.188.60" port: 39957 } attempt: 1
08:07:19.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:19.609225 26622 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.188.60:39957: Network error: Client connection negotiation failed: client connection to 127.25.188.60:39957: connect: Connection refused (error 111)
08:07:19.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:19.677608 26622 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.188.60" port: 39957 } attempt: 2
08:07:19.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:19.681310 26622 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.188.60:39957: Network error: Client connection negotiation failed: client connection to 127.25.188.60:39957: connect: Connection refused (error 111)
08:07:19.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:19.772691 26622 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.188.60" port: 39957 } attempt: 3
08:07:19.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:19.776448 26622 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.188.60:39957: Network error: Client connection negotiation failed: client connection to 127.25.188.60:39957: connect: Connection refused (error 111)
08:07:19.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:19.826133 26632 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
08:07:19.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:19.826946 26632 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:07:19.827 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:19.827739 26632 flags.cc:425] Enabled unsafe flag: --never_fsync=true
08:07:19.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:19.871531 26632 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
08:07:19.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:19.871829 26632 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
08:07:19.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:19.872047 26632 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
08:07:19.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:19.872251 26632 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
08:07:19.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:19.872440 26632 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
08:07:19.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:19.872592 26632 flags.cc:425] Enabled experimental flag: --jwks_url=http://localhost:42397/jwks.json
08:07:19.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:19.907639 26632 master_runner.cc:386] Master server non-default flags:
08:07:19.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:07:19.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.25.188.20:33377
08:07:19.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:07:19.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:07:19.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/master-2/data
08:07:19.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/master-2/wal
08:07:19.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:07:19.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.25.188.62:34681,127.25.188.61:37789,127.25.188.60:39957
08:07:19.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:07:19.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:07:19.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:07:19.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.25.188.60:39957
08:07:19.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:07:19.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:07:19.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:07:19.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:42397/jwks.json
08:07:19.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:07:19.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:07:19.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/master-2/data/info.pb
08:07:19.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.25.188.60
08:07:19.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:07:19.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:07:19.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:07:19.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:07:19.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:07:19.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:07:19.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/master-2/logs
08:07:19.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:07:19.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:07:19.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:07:19.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
08:07:19.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.18.0-SNAPSHOT
08:07:19.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
08:07:19.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:07:19.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by systest at 12 Aug 2026 06:37:03 UTC on ccycloud.quasar-wifqrz.root.comops.site
08:07:19.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 4581996
08:07:19.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:07:19.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:19.908820 26632 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:07:19.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:19.910436 26632 file_cache.cc:493] Constructed file cache file cache with capacity 419430
08:07:19.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:19.919839 26622 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.188.60" port: 39957 } attempt: 4
08:07:19.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:19.924527 26622 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.188.60:39957: Network error: Client connection negotiation failed: client connection to 127.25.188.60:39957: connect: Connection refused (error 111)
08:07:19.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:19.927883 26651 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:20.175 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:20.174618 26496 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.188.61" port: 37789 } attempt: 7
08:07:20.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:20.187633 26496 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.188.60" port: 39957 } has no permanent_uuid. Determining permanent_uuid...
08:07:20.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:20.192484 26496 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.188.60:39957: Network error: Client connection negotiation failed: client connection to 127.25.188.60:39957: connect: Connection refused (error 111)
08:07:20.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:20.223930 26622 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.188.60" port: 39957 } attempt: 5
08:07:20.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:20.227993 26622 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.188.60:39957: Network error: Client connection negotiation failed: client connection to 127.25.188.60:39957: connect: Connection refused (error 111)
08:07:20.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:20.251020 26496 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.188.60" port: 39957 } attempt: 1
08:07:20.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:20.254817 26496 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.188.60:39957: Network error: Client connection negotiation failed: client connection to 127.25.188.60:39957: connect: Connection refused (error 111)
08:07:20.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:20.336313 26496 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.188.60" port: 39957 } attempt: 2
08:07:20.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:20.340279 26496 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.188.60:39957: Network error: Client connection negotiation failed: client connection to 127.25.188.60:39957: connect: Connection refused (error 111)
08:07:20.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:20.425806 26496 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.188.60" port: 39957 } attempt: 3
08:07:20.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:20.429601 26496 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.188.60:39957: Network error: Client connection negotiation failed: client connection to 127.25.188.60:39957: connect: Connection refused (error 111)
08:07:20.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:20.570116 26496 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.188.60" port: 39957 } attempt: 4
08:07:20.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:20.573997 26496 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.188.60:39957: Network error: Client connection negotiation failed: client connection to 127.25.188.60:39957: connect: Connection refused (error 111)
08:07:20.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:20.775393 26622 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.188.60" port: 39957 } attempt: 6
08:07:20.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:20.781785 26622 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.188.60:39957: Network error: Client connection negotiation failed: client connection to 127.25.188.60:39957: connect: Connection refused (error 111)
08:07:20.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:20.857482 26496 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.188.60" port: 39957 } attempt: 5
08:07:20.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:20.861272 26496 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.25.188.60:39957: Network error: Client connection negotiation failed: client connection to 127.25.188.60:39957: connect: Connection refused (error 111)
08:07:21.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:19.928853 26650 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:21.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:19.930111 26632 server_base.cc:1034] running on GCE node
08:07:21.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:19.927894 26653 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:21.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.040045 26632 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:07:21.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.042788 26632 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:07:21.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.044138 26632 hybrid_clock.cc:648] HybridClock initialized: now 1786522041044094 us; error 63 us; skew 500 ppm
08:07:21.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.044943 26632 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:07:21.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.051334 26632 webserver.cc:460] Webserver started at http://127.25.188.60:36127/ using document root <none> and password file <none>
08:07:21.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.052314 26632 fs_manager.cc:359] Metadata directory not provided
08:07:21.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.052507 26632 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:07:21.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.052911 26632 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
08:07:21.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.057885 26632 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/master-2/data/instance:
08:07:21.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "8f9f4dfbae09418b968427a8264da4c8"
08:07:21.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 08:07:21 on dist-test-slave-f0tn"
08:07:21.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.058948 26632 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/master-2/wal/instance:
08:07:21.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "8f9f4dfbae09418b968427a8264da4c8"
08:07:21.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 08:07:21 on dist-test-slave-f0tn"
08:07:21.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.066329 26632 fs_manager.cc:691] Time spent creating directory manager: real 0.007s	user 0.007s	sys 0.001s
08:07:21.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.071813 26675 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:07:21.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.072817 26632 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.005s	sys 0.000s
08:07:21.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.073177 26632 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/master-2/data,/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/master-2/wal
08:07:21.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "8f9f4dfbae09418b968427a8264da4c8"
08:07:21.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 08:07:21 on dist-test-slave-f0tn"
08:07:21.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.073562 26632 fs_report.cc:383] FS layout report
08:07:21.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:07:21.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/master-2/wal
08:07:21.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/master-2/wal
08:07:21.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/master-2/data/data
08:07:21.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:07:21.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:07:21.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:07:21.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:07:21.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:07:21.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:07:21.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:07:21.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:07:21.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:07:21.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:07:21.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:07:21.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.148906 26632 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
08:07:21.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.150550 26632 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:07:21.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.151054 26632 kserver.cc:163] Server-wide thread pool size limit: 3276
08:07:21.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.220665 26632 rpc_server.cc:307] RPC server started. Bound to: 127.25.188.60:39957
08:07:21.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.220752 26773 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.188.60:39957 every 8 connection(s)
08:07:21.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.223556 26632 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/master-2/data/info.pb
08:07:21.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.224140 26352 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgk96or/build/tsan/bin/kudu as pid 26632
08:07:21.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.224483 26352 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/master-2/wal/instance
08:07:21.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.230291 26774 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
08:07:21.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.248415 26774 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.188.62" port: 34681 } has no permanent_uuid. Determining permanent_uuid...
08:07:21.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.274995 26774 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.188.61" port: 37789 } has no permanent_uuid. Determining permanent_uuid...
08:07:21.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.286582 26774 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.25.188.60" port: 39957 } has no permanent_uuid. Determining permanent_uuid...
08:07:21.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.303493 26774 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8f9f4dfbae09418b968427a8264da4c8: Bootstrap starting.
08:07:21.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.309856 26774 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8f9f4dfbae09418b968427a8264da4c8: Neither blocks nor log segments found. Creating new log.
08:07:21.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.311566 26774 log.cc:824] T 00000000000000000000000000000000 P 8f9f4dfbae09418b968427a8264da4c8: Log is configured to *not* fsync() on all Append() calls
08:07:21.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.315884 26774 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8f9f4dfbae09418b968427a8264da4c8: No bootstrap required, opened a new log
08:07:21.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.338368 26774 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8f9f4dfbae09418b968427a8264da4c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24369b54bb044e73b317e8452914980e" member_type: VOTER last_known_addr { host: "127.25.188.62" port: 34681 } } peers { permanent_uuid: "c6e4ef8a98eb452cb3b3b247f68bb112" member_type: VOTER last_known_addr { host: "127.25.188.61" port: 37789 } } peers { permanent_uuid: "8f9f4dfbae09418b968427a8264da4c8" member_type: VOTER last_known_addr { host: "127.25.188.60" port: 39957 } }
08:07:21.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.339030 26774 raft_consensus.cc:374] T 00000000000000000000000000000000 P 8f9f4dfbae09418b968427a8264da4c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:07:21.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.339303 26774 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8f9f4dfbae09418b968427a8264da4c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f9f4dfbae09418b968427a8264da4c8, State: Initialized, Role: FOLLOWER
08:07:21.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.340209 26774 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8f9f4dfbae09418b968427a8264da4c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24369b54bb044e73b317e8452914980e" member_type: VOTER last_known_addr { host: "127.25.188.62" port: 34681 } } peers { permanent_uuid: "c6e4ef8a98eb452cb3b3b247f68bb112" member_type: VOTER last_known_addr { host: "127.25.188.61" port: 37789 } } peers { permanent_uuid: "8f9f4dfbae09418b968427a8264da4c8" member_type: VOTER last_known_addr { host: "127.25.188.60" port: 39957 } }
08:07:21.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.343362 26795 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8f9f4dfbae09418b968427a8264da4c8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24369b54bb044e73b317e8452914980e" member_type: VOTER last_known_addr { host: "127.25.188.62" port: 34681 } } peers { permanent_uuid: "c6e4ef8a98eb452cb3b3b247f68bb112" member_type: VOTER last_known_addr { host: "127.25.188.61" port: 37789 } } peers { permanent_uuid: "8f9f4dfbae09418b968427a8264da4c8" member_type: VOTER last_known_addr { host: "127.25.188.60" port: 39957 } } }
08:07:21.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.344237 26795 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8f9f4dfbae09418b968427a8264da4c8 [sys.catalog]: This master's current role is: FOLLOWER
08:07:21.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.345095 26774 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8f9f4dfbae09418b968427a8264da4c8 [sys.catalog]: configured and running, proceeding with master startup.
08:07:21.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:21.367226 26812 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 8f9f4dfbae09418b968427a8264da4c8: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
08:07:21.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:21.367512 26812 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
08:07:21.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.364123 26632 master_runner.cc:186] Error getting master registration for 127.25.188.62:34681: OK, instance_id { permanent_uuid: "24369b54bb044e73b317e8452914980e" instance_seqno: 1786522037810390 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
08:07:21.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.396523 26632 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
08:07:21.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:21.406894 26689 tablet.cc:2369] T 00000000000000000000000000000000 P 8f9f4dfbae09418b968427a8264da4c8: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:07:21.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.413807 26496 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.188.60" port: 39957 } attempt: 6
08:07:21.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.436841 26496 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 24369b54bb044e73b317e8452914980e: Bootstrap starting.
08:07:21.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.444296 26496 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 24369b54bb044e73b317e8452914980e: Neither blocks nor log segments found. Creating new log.
08:07:21.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.447046 26496 log.cc:824] T 00000000000000000000000000000000 P 24369b54bb044e73b317e8452914980e: Log is configured to *not* fsync() on all Append() calls
08:07:21.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.452245 26496 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 24369b54bb044e73b317e8452914980e: No bootstrap required, opened a new log
08:07:21.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.483785 26496 raft_consensus.cc:348] T 00000000000000000000000000000000 P 24369b54bb044e73b317e8452914980e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24369b54bb044e73b317e8452914980e" member_type: VOTER last_known_addr { host: "127.25.188.62" port: 34681 } } peers { permanent_uuid: "c6e4ef8a98eb452cb3b3b247f68bb112" member_type: VOTER last_known_addr { host: "127.25.188.61" port: 37789 } } peers { permanent_uuid: "8f9f4dfbae09418b968427a8264da4c8" member_type: VOTER last_known_addr { host: "127.25.188.60" port: 39957 } }
08:07:21.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.484736 26496 raft_consensus.cc:374] T 00000000000000000000000000000000 P 24369b54bb044e73b317e8452914980e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:07:21.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.485044 26496 raft_consensus.cc:729] T 00000000000000000000000000000000 P 24369b54bb044e73b317e8452914980e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 24369b54bb044e73b317e8452914980e, State: Initialized, Role: FOLLOWER
08:07:21.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.486095 26496 consensus_queue.cc:260] T 00000000000000000000000000000000 P 24369b54bb044e73b317e8452914980e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24369b54bb044e73b317e8452914980e" member_type: VOTER last_known_addr { host: "127.25.188.62" port: 34681 } } peers { permanent_uuid: "c6e4ef8a98eb452cb3b3b247f68bb112" member_type: VOTER last_known_addr { host: "127.25.188.61" port: 37789 } } peers { permanent_uuid: "8f9f4dfbae09418b968427a8264da4c8" member_type: VOTER last_known_addr { host: "127.25.188.60" port: 39957 } }
08:07:21.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.495631 26818 sys_catalog.cc:455] T 00000000000000000000000000000000 P 24369b54bb044e73b317e8452914980e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24369b54bb044e73b317e8452914980e" member_type: VOTER last_known_addr { host: "127.25.188.62" port: 34681 } } peers { permanent_uuid: "c6e4ef8a98eb452cb3b3b247f68bb112" member_type: VOTER last_known_addr { host: "127.25.188.61" port: 37789 } } peers { permanent_uuid: "8f9f4dfbae09418b968427a8264da4c8" member_type: VOTER last_known_addr { host: "127.25.188.60" port: 39957 } } }
08:07:21.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.496749 26818 sys_catalog.cc:458] T 00000000000000000000000000000000 P 24369b54bb044e73b317e8452914980e [sys.catalog]: This master's current role is: FOLLOWER
08:07:21.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.497645 26496 sys_catalog.cc:564] T 00000000000000000000000000000000 P 24369b54bb044e73b317e8452914980e [sys.catalog]: configured and running, proceeding with master startup.
08:07:21.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:21.520015 26408 tablet.cc:2369] T 00000000000000000000000000000000 P 24369b54bb044e73b317e8452914980e: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:07:21.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:21.529630 26840 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 24369b54bb044e73b317e8452914980e: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
08:07:21.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:21.530277 26840 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
08:07:21.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.531111 26373 master_runner.cc:186] Error getting master registration for 127.25.188.61:37789: OK, instance_id { permanent_uuid: "c6e4ef8a98eb452cb3b3b247f68bb112" instance_seqno: 1786522039468742 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
08:07:21.566 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.566682 26373 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
08:07:21.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.593170 26795 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8f9f4dfbae09418b968427a8264da4c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:07:21.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.593817 26795 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8f9f4dfbae09418b968427a8264da4c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24369b54bb044e73b317e8452914980e" member_type: VOTER last_known_addr { host: "127.25.188.62" port: 34681 } } peers { permanent_uuid: "c6e4ef8a98eb452cb3b3b247f68bb112" member_type: VOTER last_known_addr { host: "127.25.188.61" port: 37789 } } peers { permanent_uuid: "8f9f4dfbae09418b968427a8264da4c8" member_type: VOTER last_known_addr { host: "127.25.188.60" port: 39957 } }
08:07:21.599 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.598091 26795 leader_election.cc:288] T 00000000000000000000000000000000 P 8f9f4dfbae09418b968427a8264da4c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 24369b54bb044e73b317e8452914980e (127.25.188.62:34681), c6e4ef8a98eb452cb3b3b247f68bb112 (127.25.188.61:37789)
08:07:21.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.599589 26448 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8f9f4dfbae09418b968427a8264da4c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24369b54bb044e73b317e8452914980e" is_pre_election: true
08:07:21.601 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.600633 26448 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 24369b54bb044e73b317e8452914980e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f9f4dfbae09418b968427a8264da4c8 in term 0.
08:07:21.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.602075 26677 leader_election.cc:302] T 00000000000000000000000000000000 P 8f9f4dfbae09418b968427a8264da4c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24369b54bb044e73b317e8452914980e, 8f9f4dfbae09418b968427a8264da4c8; no voters: 
08:07:21.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.602954 26795 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8f9f4dfbae09418b968427a8264da4c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
08:07:21.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.603329 26795 raft_consensus.cc:482] T 00000000000000000000000000000000 P 8f9f4dfbae09418b968427a8264da4c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:07:21.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.603691 26795 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8f9f4dfbae09418b968427a8264da4c8 [term 0 FOLLOWER]: Advancing to term 1
08:07:21.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.610924 26795 raft_consensus.cc:504] T 00000000000000000000000000000000 P 8f9f4dfbae09418b968427a8264da4c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24369b54bb044e73b317e8452914980e" member_type: VOTER last_known_addr { host: "127.25.188.62" port: 34681 } } peers { permanent_uuid: "c6e4ef8a98eb452cb3b3b247f68bb112" member_type: VOTER last_known_addr { host: "127.25.188.61" port: 37789 } } peers { permanent_uuid: "8f9f4dfbae09418b968427a8264da4c8" member_type: VOTER last_known_addr { host: "127.25.188.60" port: 39957 } }
08:07:21.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.614439 26448 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8f9f4dfbae09418b968427a8264da4c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "24369b54bb044e73b317e8452914980e"
08:07:21.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.615091 26448 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 24369b54bb044e73b317e8452914980e [term 0 FOLLOWER]: Advancing to term 1
08:07:21.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.617599 26795 leader_election.cc:288] T 00000000000000000000000000000000 P 8f9f4dfbae09418b968427a8264da4c8 [CANDIDATE]: Term 1 election: Requested vote from peers 24369b54bb044e73b317e8452914980e (127.25.188.62:34681), c6e4ef8a98eb452cb3b3b247f68bb112 (127.25.188.61:37789)
08:07:21.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.622747 26448 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 24369b54bb044e73b317e8452914980e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8f9f4dfbae09418b968427a8264da4c8 in term 1.
08:07:21.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.635721 26677 leader_election.cc:302] T 00000000000000000000000000000000 P 8f9f4dfbae09418b968427a8264da4c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24369b54bb044e73b317e8452914980e, 8f9f4dfbae09418b968427a8264da4c8; no voters: 
08:07:21.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.637027 26795 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 8f9f4dfbae09418b968427a8264da4c8 [term 1 FOLLOWER]: Leader election won for term 1
08:07:21.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.639305 26795 raft_consensus.cc:686] T 00000000000000000000000000000000 P 8f9f4dfbae09418b968427a8264da4c8 [term 1 LEADER]: Becoming Leader. State: Replica: 8f9f4dfbae09418b968427a8264da4c8, State: Running, Role: LEADER
08:07:21.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.640537 26795 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8f9f4dfbae09418b968427a8264da4c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24369b54bb044e73b317e8452914980e" member_type: VOTER last_known_addr { host: "127.25.188.62" port: 34681 } } peers { permanent_uuid: "c6e4ef8a98eb452cb3b3b247f68bb112" member_type: VOTER last_known_addr { host: "127.25.188.61" port: 37789 } } peers { permanent_uuid: "8f9f4dfbae09418b968427a8264da4c8" member_type: VOTER last_known_addr { host: "127.25.188.60" port: 39957 } }
08:07:21.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.657685 26842 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8f9f4dfbae09418b968427a8264da4c8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8f9f4dfbae09418b968427a8264da4c8. Latest consensus state: current_term: 1 leader_uuid: "8f9f4dfbae09418b968427a8264da4c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24369b54bb044e73b317e8452914980e" member_type: VOTER last_known_addr { host: "127.25.188.62" port: 34681 } } peers { permanent_uuid: "c6e4ef8a98eb452cb3b3b247f68bb112" member_type: VOTER last_known_addr { host: "127.25.188.61" port: 37789 } } peers { permanent_uuid: "8f9f4dfbae09418b968427a8264da4c8" member_type: VOTER last_known_addr { host: "127.25.188.60" port: 39957 } } }
08:07:21.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.658612 26842 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8f9f4dfbae09418b968427a8264da4c8 [sys.catalog]: This master's current role is: LEADER
08:07:21.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.669821 26847 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
08:07:21.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.677122 26847 catalog_manager.cc:1484] Initializing Kudu cluster ID...
08:07:21.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.699599 26448 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 24369b54bb044e73b317e8452914980e [term 1 FOLLOWER]: Refusing update from remote peer 8f9f4dfbae09418b968427a8264da4c8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
08:07:21.702 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.701418 26842 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 8f9f4dfbae09418b968427a8264da4c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24369b54bb044e73b317e8452914980e" member_type: VOTER last_known_addr { host: "127.25.188.62" port: 34681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
08:07:21.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.726364 26818 sys_catalog.cc:455] T 00000000000000000000000000000000 P 24369b54bb044e73b317e8452914980e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8f9f4dfbae09418b968427a8264da4c8. Latest consensus state: current_term: 1 leader_uuid: "8f9f4dfbae09418b968427a8264da4c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24369b54bb044e73b317e8452914980e" member_type: VOTER last_known_addr { host: "127.25.188.62" port: 34681 } } peers { permanent_uuid: "c6e4ef8a98eb452cb3b3b247f68bb112" member_type: VOTER last_known_addr { host: "127.25.188.61" port: 37789 } } peers { permanent_uuid: "8f9f4dfbae09418b968427a8264da4c8" member_type: VOTER last_known_addr { host: "127.25.188.60" port: 39957 } } }
08:07:21.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.727146 26818 sys_catalog.cc:458] T 00000000000000000000000000000000 P 24369b54bb044e73b317e8452914980e [sys.catalog]: This master's current role is: FOLLOWER
08:07:21.741 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.740300 26849 mvcc.cc:205] Tried to move back new op lower bound from 7317594282766028800 to 7317594282570407936. Current Snapshot: MvccSnapshot[applied={T|T < 7317594282766028800}]
08:07:21.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.742580 26795 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8f9f4dfbae09418b968427a8264da4c8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8f9f4dfbae09418b968427a8264da4c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24369b54bb044e73b317e8452914980e" member_type: VOTER last_known_addr { host: "127.25.188.62" port: 34681 } } peers { permanent_uuid: "c6e4ef8a98eb452cb3b3b247f68bb112" member_type: VOTER last_known_addr { host: "127.25.188.61" port: 37789 } } peers { permanent_uuid: "8f9f4dfbae09418b968427a8264da4c8" member_type: VOTER last_known_addr { host: "127.25.188.60" port: 39957 } } }
08:07:21.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.743358 26795 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8f9f4dfbae09418b968427a8264da4c8 [sys.catalog]: This master's current role is: LEADER
08:07:21.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.747448 26847 catalog_manager.cc:1347] Generated new cluster ID: f4dc253ee82f4b4897e4af3956f95b93
08:07:21.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.747756 26847 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
08:07:21.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.767781 26818 sys_catalog.cc:455] T 00000000000000000000000000000000 P 24369b54bb044e73b317e8452914980e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8f9f4dfbae09418b968427a8264da4c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24369b54bb044e73b317e8452914980e" member_type: VOTER last_known_addr { host: "127.25.188.62" port: 34681 } } peers { permanent_uuid: "c6e4ef8a98eb452cb3b3b247f68bb112" member_type: VOTER last_known_addr { host: "127.25.188.61" port: 37789 } } peers { permanent_uuid: "8f9f4dfbae09418b968427a8264da4c8" member_type: VOTER last_known_addr { host: "127.25.188.60" port: 39957 } } }
08:07:21.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.768600 26818 sys_catalog.cc:458] T 00000000000000000000000000000000 P 24369b54bb044e73b317e8452914980e [sys.catalog]: This master's current role is: FOLLOWER
08:07:21.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.794121 26847 catalog_manager.cc:1370] Generated new certificate authority record
08:07:21.797 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.796994 26847 catalog_manager.cc:1504] Loading token signing keys...
08:07:21.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.820125 26847 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 8f9f4dfbae09418b968427a8264da4c8: Generated new TSK 0
08:07:21.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.822060 26847 catalog_manager.cc:1514] Initializing in-progress tserver states...
08:07:21.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.842299 26622 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.25.188.60" port: 39957 } attempt: 7
08:07:21.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.844748 26352 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgk96or/build/tsan/bin/kudu
08:07:21.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgk96or/build/tsan/bin/kudu
08:07:21.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/ts-0/wal
08:07:21.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/ts-0/data
08:07:21.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:07:21.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:07:21.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:07:21.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:07:21.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:07:21.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:07:21.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/ts-0/logs
08:07:21.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/ts-0/data/info.pb
08:07:21.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:07:21.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:07:21.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:07:21.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:07:21.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:07:21.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:07:21.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:07:21.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:07:21.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
08:07:21.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:07:21.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.25.188.1:0
08:07:21.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.25.188.1
08:07:21.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.25.188.1
08:07:21.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:07:21.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.25.188.62:34681,127.25.188.61:37789,127.25.188.60:39957
08:07:21.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.25.188.20:33377
08:07:21.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:07:21.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:07:21.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
08:07:21.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.885131 26622 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c6e4ef8a98eb452cb3b3b247f68bb112: Bootstrap starting.
08:07:21.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.892105 26622 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c6e4ef8a98eb452cb3b3b247f68bb112: Neither blocks nor log segments found. Creating new log.
08:07:21.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.894619 26622 log.cc:824] T 00000000000000000000000000000000 P c6e4ef8a98eb452cb3b3b247f68bb112: Log is configured to *not* fsync() on all Append() calls
08:07:21.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.913985 26622 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c6e4ef8a98eb452cb3b3b247f68bb112: No bootstrap required, opened a new log
08:07:21.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.987900 26622 raft_consensus.cc:348] T 00000000000000000000000000000000 P c6e4ef8a98eb452cb3b3b247f68bb112 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24369b54bb044e73b317e8452914980e" member_type: VOTER last_known_addr { host: "127.25.188.62" port: 34681 } } peers { permanent_uuid: "c6e4ef8a98eb452cb3b3b247f68bb112" member_type: VOTER last_known_addr { host: "127.25.188.61" port: 37789 } } peers { permanent_uuid: "8f9f4dfbae09418b968427a8264da4c8" member_type: VOTER last_known_addr { host: "127.25.188.60" port: 39957 } }
08:07:21.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.990345 26622 raft_consensus.cc:374] T 00000000000000000000000000000000 P c6e4ef8a98eb452cb3b3b247f68bb112 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:07:21.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.991328 26622 raft_consensus.cc:729] T 00000000000000000000000000000000 P c6e4ef8a98eb452cb3b3b247f68bb112 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6e4ef8a98eb452cb3b3b247f68bb112, State: Initialized, Role: FOLLOWER
08:07:21.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:21.993711 26622 consensus_queue.cc:260] T 00000000000000000000000000000000 P c6e4ef8a98eb452cb3b3b247f68bb112 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24369b54bb044e73b317e8452914980e" member_type: VOTER last_known_addr { host: "127.25.188.62" port: 34681 } } peers { permanent_uuid: "c6e4ef8a98eb452cb3b3b247f68bb112" member_type: VOTER last_known_addr { host: "127.25.188.61" port: 37789 } } peers { permanent_uuid: "8f9f4dfbae09418b968427a8264da4c8" member_type: VOTER last_known_addr { host: "127.25.188.60" port: 39957 } }
08:07:22.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:22.014106 26578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8f9f4dfbae09418b968427a8264da4c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6e4ef8a98eb452cb3b3b247f68bb112" is_pre_election: true
08:07:22.018 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:22.015795 26577 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "8f9f4dfbae09418b968427a8264da4c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6e4ef8a98eb452cb3b3b247f68bb112"
08:07:22.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:22.018860 26578 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c6e4ef8a98eb452cb3b3b247f68bb112 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8f9f4dfbae09418b968427a8264da4c8 in term 0.
08:07:22.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:22.025805 26576 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c6e4ef8a98eb452cb3b3b247f68bb112 [term 0 FOLLOWER]: Advancing to term 1
08:07:22.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:22.032750 26576 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c6e4ef8a98eb452cb3b3b247f68bb112 [term 1 FOLLOWER]: Refusing update from remote peer 8f9f4dfbae09418b968427a8264da4c8: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
08:07:22.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:22.036962 26622 sys_catalog.cc:564] T 00000000000000000000000000000000 P c6e4ef8a98eb452cb3b3b247f68bb112 [sys.catalog]: configured and running, proceeding with master startup.
08:07:22.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:22.036989 26795 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 8f9f4dfbae09418b968427a8264da4c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6e4ef8a98eb452cb3b3b247f68bb112" member_type: VOTER last_known_addr { host: "127.25.188.61" port: 37789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
08:07:22.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:22.037580 26861 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6e4ef8a98eb452cb3b3b247f68bb112 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24369b54bb044e73b317e8452914980e" member_type: VOTER last_known_addr { host: "127.25.188.62" port: 34681 } } peers { permanent_uuid: "c6e4ef8a98eb452cb3b3b247f68bb112" member_type: VOTER last_known_addr { host: "127.25.188.61" port: 37789 } } peers { permanent_uuid: "8f9f4dfbae09418b968427a8264da4c8" member_type: VOTER last_known_addr { host: "127.25.188.60" port: 39957 } } }
08:07:22.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:22.044507 26861 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6e4ef8a98eb452cb3b3b247f68bb112 [sys.catalog]: This master's current role is: FOLLOWER
08:07:22.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:22.079535 26869 mvcc.cc:205] Tried to move back new op lower bound from 7317594282766028800 to 7317594282570407936. Current Snapshot: MvccSnapshot[applied={T|T < 7317594282766028800}]
08:07:22.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:22.094936 26865 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6e4ef8a98eb452cb3b3b247f68bb112 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "8f9f4dfbae09418b968427a8264da4c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24369b54bb044e73b317e8452914980e" member_type: VOTER last_known_addr { host: "127.25.188.62" port: 34681 } } peers { permanent_uuid: "c6e4ef8a98eb452cb3b3b247f68bb112" member_type: VOTER last_known_addr { host: "127.25.188.61" port: 37789 } } peers { permanent_uuid: "8f9f4dfbae09418b968427a8264da4c8" member_type: VOTER last_known_addr { host: "127.25.188.60" port: 39957 } } }
08:07:22.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:22.096609 26861 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6e4ef8a98eb452cb3b3b247f68bb112 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8f9f4dfbae09418b968427a8264da4c8. Latest consensus state: current_term: 1 leader_uuid: "8f9f4dfbae09418b968427a8264da4c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24369b54bb044e73b317e8452914980e" member_type: VOTER last_known_addr { host: "127.25.188.62" port: 34681 } } peers { permanent_uuid: "c6e4ef8a98eb452cb3b3b247f68bb112" member_type: VOTER last_known_addr { host: "127.25.188.61" port: 37789 } } peers { permanent_uuid: "8f9f4dfbae09418b968427a8264da4c8" member_type: VOTER last_known_addr { host: "127.25.188.60" port: 39957 } } }
08:07:22.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:22.097357 26861 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6e4ef8a98eb452cb3b3b247f68bb112 [sys.catalog]: This master's current role is: FOLLOWER
08:07:22.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:22.098053 26865 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6e4ef8a98eb452cb3b3b247f68bb112 [sys.catalog]: This master's current role is: FOLLOWER
08:07:22.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:22.146731 26889 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
08:07:22.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:22.348009 26858 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
08:07:22.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:22.348584 26858 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:07:22.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:22.349160 26858 flags.cc:425] Enabled unsafe flag: --never_fsync=true
08:07:22.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:22.381199 26858 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
08:07:22.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:22.382189 26858 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.188.1
08:07:22.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:22.421468 26858 tablet_server_runner.cc:78] Tablet server non-default flags:
08:07:22.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:07:22.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.25.188.20:33377
08:07:22.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:07:22.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:07:22.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/ts-0/data
08:07:22.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/ts-0/wal
08:07:22.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:07:22.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:07:22.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.25.188.1:0
08:07:22.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:07:22.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:07:22.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:07:22.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/ts-0/data/info.pb
08:07:22.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.25.188.1
08:07:22.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:07:22.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.25.188.62:34681,127.25.188.61:37789,127.25.188.60:39957
08:07:22.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:07:22.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:07:22.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:07:22.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:07:22.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:07:22.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.25.188.1
08:07:22.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/ts-0/logs
08:07:22.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:07:22.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:07:22.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:07:22.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
08:07:22.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.18.0-SNAPSHOT
08:07:22.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
08:07:22.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:07:22.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by systest at 12 Aug 2026 06:37:03 UTC on ccycloud.quasar-wifqrz.root.comops.site
08:07:22.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 4581996
08:07:22.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:07:22.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:22.423048 26858 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:07:22.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:22.424836 26858 file_cache.cc:493] Constructed file cache file cache with capacity 419430
08:07:22.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:22.450390 26896 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:22.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:22.536062 26840 catalog_manager.cc:1259] Loaded cluster ID: f4dc253ee82f4b4897e4af3956f95b93
08:07:22.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:22.536365 26840 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 24369b54bb044e73b317e8452914980e: loading cluster ID for follower catalog manager: success
08:07:22.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:22.539546 26795 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8f9f4dfbae09418b968427a8264da4c8 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "8f9f4dfbae09418b968427a8264da4c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24369b54bb044e73b317e8452914980e" member_type: VOTER last_known_addr { host: "127.25.188.62" port: 34681 } } peers { permanent_uuid: "c6e4ef8a98eb452cb3b3b247f68bb112" member_type: VOTER last_known_addr { host: "127.25.188.61" port: 37789 } } peers { permanent_uuid: "8f9f4dfbae09418b968427a8264da4c8" member_type: VOTER last_known_addr { host: "127.25.188.60" port: 39957 } } }
08:07:22.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:22.540951 26795 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8f9f4dfbae09418b968427a8264da4c8 [sys.catalog]: This master's current role is: LEADER
08:07:22.544 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:22.543947 26840 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 24369b54bb044e73b317e8452914980e: acquiring CA information for follower catalog manager: success
08:07:22.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:22.570567 26840 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 24369b54bb044e73b317e8452914980e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
08:07:23.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:23.165874 26889 catalog_manager.cc:1259] Loaded cluster ID: f4dc253ee82f4b4897e4af3956f95b93
08:07:23.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:23.166522 26889 catalog_manager.cc:1552] T 00000000000000000000000000000000 P c6e4ef8a98eb452cb3b3b247f68bb112: loading cluster ID for follower catalog manager: success
08:07:23.174 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:23.174489 26889 catalog_manager.cc:1574] T 00000000000000000000000000000000 P c6e4ef8a98eb452cb3b3b247f68bb112: acquiring CA information for follower catalog manager: success
08:07:23.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:23.191005 26889 catalog_manager.cc:1602] T 00000000000000000000000000000000 P c6e4ef8a98eb452cb3b3b247f68bb112: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
08:07:24.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:22.457998 26897 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:24.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:23.840417 26895 debug-util.cc:398] Leaking SignalData structure 0x7b0800014860 after lost signal to thread 26858
08:07:24.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:24.139941 26895 kernel_stack_watchdog.cc:198] Thread 26858 stuck at /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/thread.cc:637 for 386ms:
08:07:24.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
08:07:24.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
08:07:24.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
08:07:24.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
08:07:24.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:24.139070 26900 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:24.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:24.141644 26858 thread.cc:636] OpenStack (cloud detector) Time spent creating pthread: real 1.690s	user 0.518s	sys 0.938s
08:07:24.142 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:24.142059 26858 thread.cc:602] OpenStack (cloud detector) Time spent starting thread: real 1.690s	user 0.518s	sys 0.939s
08:07:24.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:24.145596 26898 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1686 milliseconds
08:07:24.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:24.145625 26858 server_base.cc:1029] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:07:24.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:24.147320 26858 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:07:24.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:24.161989 26858 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:07:24.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:24.167798 26858 hybrid_clock.cc:648] HybridClock initialized: now 1786522044167709 us; error 98 us; skew 500 ppm
08:07:24.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:24.169014 26858 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:07:24.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:24.214174 26858 webserver.cc:460] Webserver started at http://127.25.188.1:41647/ using document root <none> and password file <none>
08:07:24.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:24.215691 26858 fs_manager.cc:359] Metadata directory not provided
08:07:24.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:24.215996 26858 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:07:24.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:24.216609 26858 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
08:07:24.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:24.241073 26858 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/ts-0/data/instance:
08:07:24.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "cd9ec0d9af0a4e0caabe63c9dd03697a"
08:07:24.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 08:07:24 on dist-test-slave-f0tn"
08:07:24.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:24.243273 26858 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/ts-0/wal/instance:
08:07:24.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "cd9ec0d9af0a4e0caabe63c9dd03697a"
08:07:24.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 08:07:24 on dist-test-slave-f0tn"
08:07:24.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:24.267616 26858 fs_manager.cc:691] Time spent creating directory manager: real 0.024s	user 0.016s	sys 0.006s
08:07:24.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:24.294399 26919 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:07:24.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:24.296011 26858 fs_manager.cc:725] Time spent opening block manager: real 0.024s	user 0.013s	sys 0.011s
08:07:24.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:24.296651 26858 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/ts-0/data,/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/ts-0/wal
08:07:24.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "cd9ec0d9af0a4e0caabe63c9dd03697a"
08:07:24.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 08:07:24 on dist-test-slave-f0tn"
08:07:24.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:24.297444 26858 fs_report.cc:383] FS layout report
08:07:24.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:07:24.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/ts-0/wal
08:07:24.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/ts-0/wal
08:07:24.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/ts-0/data/data
08:07:24.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:07:24.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:07:24.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:07:24.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:07:24.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:07:24.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:07:24.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:07:24.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:07:24.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:07:24.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:07:24.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:07:24.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:24.403913 26858 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
08:07:24.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:24.409809 26858 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:07:24.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:24.410708 26858 kserver.cc:163] Server-wide thread pool size limit: 3276
08:07:24.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:24.426082 26858 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
08:07:24.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:24.446938 26858 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
08:07:24.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:24.447554 26858 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.001s	user 0.001s	sys 0.001s
08:07:24.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:24.448079 26858 ts_tablet_manager.cc:610] Registered 0 tablets
08:07:24.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:24.448469 26858 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
08:07:24.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:24.733206 26858 rpc_server.cc:307] RPC server started. Bound to: 127.25.188.1:38437
08:07:24.733 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:24.733311 27121 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.188.1:38437 every 8 connection(s)
08:07:24.736 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:24.736292 26858 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/ts-0/data/info.pb
08:07:24.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:24.746167 26352 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgk96or/build/tsan/bin/kudu as pid 26858
08:07:24.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:24.746696 26352 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/ts-0/wal/instance
08:07:24.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:24.788081 26352 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgk96or/build/tsan/bin/kudu
08:07:24.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgk96or/build/tsan/bin/kudu
08:07:24.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/ts-1/wal
08:07:24.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/ts-1/data
08:07:24.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:07:24.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:07:24.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:07:24.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:07:24.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:07:24.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:07:24.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/ts-1/logs
08:07:24.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/ts-1/data/info.pb
08:07:24.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:07:24.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:07:24.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:07:24.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:07:24.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:07:24.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:07:24.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:07:24.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:07:24.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
08:07:24.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:07:24.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.25.188.2:0
08:07:24.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.25.188.2
08:07:24.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.25.188.2
08:07:24.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:07:24.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.25.188.62:34681,127.25.188.61:37789,127.25.188.60:39957
08:07:24.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.25.188.20:33377
08:07:24.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:07:24.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:07:24.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
08:07:24.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:24.812431 27128 heartbeater.cc:347] Connected to a master server at 127.25.188.62:34681
08:07:24.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:24.812979 27128 heartbeater.cc:464] Registering TS with master...
08:07:24.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:24.815871 27128 heartbeater.cc:511] Master 127.25.188.62:34681 requested a full tablet report, sending...
08:07:24.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:24.819483 26424 ts_manager.cc:194] Registered new tserver with Master: cd9ec0d9af0a4e0caabe63c9dd03697a (127.25.188.1:38437)
08:07:24.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:24.821687 27123 heartbeater.cc:347] Connected to a master server at 127.25.188.60:39957
08:07:24.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:24.822059 27123 heartbeater.cc:464] Registering TS with master...
08:07:24.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:24.822911 27123 heartbeater.cc:511] Master 127.25.188.60:39957 requested a full tablet report, sending...
08:07:24.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:24.823761 27124 heartbeater.cc:347] Connected to a master server at 127.25.188.61:37789
08:07:24.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:24.824113 27124 heartbeater.cc:464] Registering TS with master...
08:07:24.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:24.824916 27124 heartbeater.cc:511] Master 127.25.188.61:37789 requested a full tablet report, sending...
08:07:24.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:24.827580 26712 ts_manager.cc:194] Registered new tserver with Master: cd9ec0d9af0a4e0caabe63c9dd03697a (127.25.188.1:38437)
08:07:24.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:24.835872 26562 ts_manager.cc:194] Registered new tserver with Master: cd9ec0d9af0a4e0caabe63c9dd03697a (127.25.188.1:38437)
08:07:24.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:24.838826 26712 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.188.1:40691
08:07:25.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:25.143930 27144 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
08:07:25.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:25.144495 27144 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:07:25.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:25.145074 27144 flags.cc:425] Enabled unsafe flag: --never_fsync=true
08:07:25.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:25.177975 27144 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
08:07:25.179 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:25.178913 27144 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.188.2
08:07:25.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:25.215662 27144 tablet_server_runner.cc:78] Tablet server non-default flags:
08:07:25.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:07:25.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.25.188.20:33377
08:07:25.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:07:25.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:07:25.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/ts-1/data
08:07:25.216 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/ts-1/wal
08:07:25.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:07:25.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:07:25.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.25.188.2:0
08:07:25.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:07:25.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:07:25.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:07:25.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/ts-1/data/info.pb
08:07:25.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.25.188.2
08:07:25.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:07:25.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.25.188.62:34681,127.25.188.61:37789,127.25.188.60:39957
08:07:25.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:07:25.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:07:25.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:07:25.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:07:25.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:07:25.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.25.188.2
08:07:25.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/ts-1/logs
08:07:25.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:07:25.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:07:25.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:07:25.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
08:07:25.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.18.0-SNAPSHOT
08:07:25.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
08:07:25.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:07:25.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by systest at 12 Aug 2026 06:37:03 UTC on ccycloud.quasar-wifqrz.root.comops.site
08:07:25.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 4581996
08:07:25.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:07:25.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:25.217305 27144 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:07:25.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:25.219722 27144 file_cache.cc:493] Constructed file cache file cache with capacity 419430
08:07:25.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:25.244103 27156 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:25.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:25.850148 27123 heartbeater.cc:503] Master 127.25.188.60:39957 was elected leader, sending a full tablet report...
08:07:26.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:25.244374 27157 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:26.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:26.637393 27152 debug-util.cc:398] Leaking SignalData structure 0x7b0800014860 after lost signal to thread 27144
08:07:26.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:26.654415 27144 thread.cc:636] OpenStack (cloud detector) Time spent creating pthread: real 1.412s	user 0.512s	sys 0.858s
08:07:26.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:26.656232 27144 thread.cc:602] OpenStack (cloud detector) Time spent starting thread: real 1.414s	user 0.513s	sys 0.858s
08:07:26.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:26.656430 27158 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1413 milliseconds
08:07:26.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:26.656714 27144 server_base.cc:1029] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:07:26.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:26.656822 27161 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:26.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:26.660326 27144 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:07:26.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:26.662472 27144 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:07:26.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:26.663836 27144 hybrid_clock.cc:648] HybridClock initialized: now 1786522046663799 us; error 47 us; skew 500 ppm
08:07:26.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:26.664695 27144 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:07:26.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:26.671329 27144 webserver.cc:460] Webserver started at http://127.25.188.2:40015/ using document root <none> and password file <none>
08:07:26.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:26.672266 27144 fs_manager.cc:359] Metadata directory not provided
08:07:26.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:26.672454 27144 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:07:26.672 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:26.672847 27144 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
08:07:26.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:26.677688 27144 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/ts-1/data/instance:
08:07:26.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "66c5262333af49538a7ebf357438d66a"
08:07:26.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 08:07:26 on dist-test-slave-f0tn"
08:07:26.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:26.678762 27144 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/ts-1/wal/instance:
08:07:26.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "66c5262333af49538a7ebf357438d66a"
08:07:26.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 08:07:26 on dist-test-slave-f0tn"
08:07:26.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:26.686407 27144 fs_manager.cc:691] Time spent creating directory manager: real 0.007s	user 0.007s	sys 0.000s
08:07:26.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:26.691888 27176 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:07:26.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:26.693038 27144 fs_manager.cc:725] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.001s
08:07:26.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:26.693331 27144 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/ts-1/data,/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/ts-1/wal
08:07:26.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "66c5262333af49538a7ebf357438d66a"
08:07:26.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 08:07:26 on dist-test-slave-f0tn"
08:07:26.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:26.693730 27144 fs_report.cc:383] FS layout report
08:07:26.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:07:26.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/ts-1/wal
08:07:26.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/ts-1/wal
08:07:26.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/ts-1/data/data
08:07:26.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:07:26.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:07:26.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:07:26.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:07:26.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:07:26.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:07:26.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:07:26.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:07:26.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:07:26.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:07:26.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:07:26.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:26.742339 27144 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
08:07:26.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:26.743893 27144 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:07:26.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:26.744385 27144 kserver.cc:163] Server-wide thread pool size limit: 3276
08:07:26.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:26.747010 27144 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
08:07:26.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:26.751119 27144 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
08:07:26.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:26.751322 27144 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
08:07:26.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:26.751617 27144 ts_tablet_manager.cc:610] Registered 0 tablets
08:07:26.751 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:26.751782 27144 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
08:07:26.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:26.891093 27144 rpc_server.cc:307] RPC server started. Bound to: 127.25.188.2:35231
08:07:26.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:26.891197 27397 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.188.2:35231 every 8 connection(s)
08:07:26.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:26.893834 27144 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/ts-1/data/info.pb
08:07:26.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:26.895983 26352 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgk96or/build/tsan/bin/kudu as pid 27144
08:07:26.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:26.896661 26352 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/ts-1/wal/instance
08:07:26.914 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:26.914443 26352 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgk96or/build/tsan/bin/kudu
08:07:26.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgk96or/build/tsan/bin/kudu
08:07:26.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/ts-2/wal
08:07:26.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/ts-2/data
08:07:26.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:07:26.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:07:26.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:07:26.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:07:26.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:07:26.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:07:26.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/ts-2/logs
08:07:26.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/ts-2/data/info.pb
08:07:26.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:07:26.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:07:26.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:07:26.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:07:26.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:07:26.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:07:26.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:07:26.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:07:26.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
08:07:26.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:07:26.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.25.188.3:0
08:07:26.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.25.188.3
08:07:26.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.25.188.3
08:07:26.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:07:26.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.25.188.62:34681,127.25.188.61:37789,127.25.188.60:39957
08:07:26.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.25.188.20:33377
08:07:26.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:07:26.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:07:26.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
08:07:26.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:26.947324 27398 heartbeater.cc:347] Connected to a master server at 127.25.188.60:39957
08:07:26.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:26.947767 27398 heartbeater.cc:464] Registering TS with master...
08:07:26.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:26.948890 27398 heartbeater.cc:511] Master 127.25.188.60:39957 requested a full tablet report, sending...
08:07:26.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:26.951678 27403 heartbeater.cc:347] Connected to a master server at 127.25.188.62:34681
08:07:26.952 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:26.952400 27403 heartbeater.cc:464] Registering TS with master...
08:07:26.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:26.953267 27403 heartbeater.cc:511] Master 127.25.188.62:34681 requested a full tablet report, sending...
08:07:26.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:26.953272 26712 ts_manager.cc:194] Registered new tserver with Master: 66c5262333af49538a7ebf357438d66a (127.25.188.2:35231)
08:07:26.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:26.955210 26712 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.188.2:39443
08:07:26.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:26.956058 26424 ts_manager.cc:194] Registered new tserver with Master: 66c5262333af49538a7ebf357438d66a (127.25.188.2:35231)
08:07:26.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:26.961689 27399 heartbeater.cc:347] Connected to a master server at 127.25.188.61:37789
08:07:26.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:26.961982 27399 heartbeater.cc:464] Registering TS with master...
08:07:26.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:26.962563 27399 heartbeater.cc:511] Master 127.25.188.61:37789 requested a full tablet report, sending...
08:07:26.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:26.964805 26562 ts_manager.cc:194] Registered new tserver with Master: 66c5262333af49538a7ebf357438d66a (127.25.188.2:35231)
08:07:27.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:27.261875 27415 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
08:07:27.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:27.262349 27415 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:07:27.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:27.262800 27415 flags.cc:425] Enabled unsafe flag: --never_fsync=true
08:07:27.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:27.294001 27415 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
08:07:27.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:27.294843 27415 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.25.188.3
08:07:27.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:27.330922 27415 tablet_server_runner.cc:78] Tablet server non-default flags:
08:07:27.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:07:27.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.25.188.20:33377
08:07:27.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:07:27.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:07:27.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/ts-2/data
08:07:27.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/ts-2/wal
08:07:27.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:07:27.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:07:27.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.25.188.3:0
08:07:27.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:07:27.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:07:27.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:07:27.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/ts-2/data/info.pb
08:07:27.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.25.188.3
08:07:27.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:07:27.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.25.188.62:34681,127.25.188.61:37789,127.25.188.60:39957
08:07:27.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:07:27.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:07:27.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:07:27.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:07:27.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:07:27.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.25.188.3
08:07:27.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/ts-2/logs
08:07:27.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:07:27.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:07:27.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:07:27.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
08:07:27.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.18.0-SNAPSHOT
08:07:27.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
08:07:27.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:07:27.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by systest at 12 Aug 2026 06:37:03 UTC on ccycloud.quasar-wifqrz.root.comops.site
08:07:27.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 4581996
08:07:27.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:07:27.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:27.332321 27415 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:07:27.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:27.334101 27415 file_cache.cc:493] Constructed file cache file cache with capacity 419430
08:07:27.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:27.352819 27426 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:27.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:27.960409 27398 heartbeater.cc:503] Master 127.25.188.60:39957 was elected leader, sending a full tablet report...
08:07:28.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:27.352978 27425 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:28.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:27.353307 27428 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:28.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:27.354378 27415 server_base.cc:1034] running on GCE node
08:07:28.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:28.462724 27415 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:07:28.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:28.465397 27415 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:07:28.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:28.466826 27415 hybrid_clock.cc:648] HybridClock initialized: now 1786522048466791 us; error 48 us; skew 500 ppm
08:07:28.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:28.467613 27415 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:07:28.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:28.473935 27415 webserver.cc:460] Webserver started at http://127.25.188.3:43503/ using document root <none> and password file <none>
08:07:28.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:28.474835 27415 fs_manager.cc:359] Metadata directory not provided
08:07:28.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:28.475024 27415 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:07:28.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:28.475418 27415 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
08:07:28.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:28.480264 27415 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/ts-2/data/instance:
08:07:28.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "a86097c640f8443fa8e30feea68f203c"
08:07:28.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 08:07:28 on dist-test-slave-f0tn"
08:07:28.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:28.481312 27415 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/ts-2/wal/instance:
08:07:28.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "a86097c640f8443fa8e30feea68f203c"
08:07:28.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 08:07:28 on dist-test-slave-f0tn"
08:07:28.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:28.488654 27415 fs_manager.cc:691] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.000s
08:07:28.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:28.495745 27444 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:07:28.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:28.496874 27415 fs_manager.cc:725] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.001s
08:07:28.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:28.497217 27415 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/ts-2/data,/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/ts-2/wal
08:07:28.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "a86097c640f8443fa8e30feea68f203c"
08:07:28.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 08:07:28 on dist-test-slave-f0tn"
08:07:28.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:28.497601 27415 fs_report.cc:383] FS layout report
08:07:28.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:07:28.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/ts-2/wal
08:07:28.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/ts-2/wal
08:07:28.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/ts-2/data/data
08:07:28.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:07:28.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:07:28.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:07:28.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:07:28.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:07:28.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:07:28.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:07:28.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:07:28.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:07:28.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:07:28.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:07:28.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:28.547775 27415 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
08:07:28.549 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:28.549438 27415 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:07:28.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:28.550009 27415 kserver.cc:163] Server-wide thread pool size limit: 3276
08:07:28.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:28.552695 27415 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
08:07:28.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:28.557075 27415 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
08:07:28.557 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:28.557307 27415 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
08:07:28.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:28.557655 27415 ts_tablet_manager.cc:610] Registered 0 tablets
08:07:28.558 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:28.557847 27415 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
08:07:28.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:28.691810 27415 rpc_server.cc:307] RPC server started. Bound to: 127.25.188.3:39859
08:07:28.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:28.691939 27652 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.188.3:39859 every 8 connection(s)
08:07:28.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:28.694625 27415 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/ts-2/data/info.pb
08:07:28.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:28.701126 26352 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgk96or/build/tsan/bin/kudu as pid 27415
08:07:28.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:28.701604 26352 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/ts-2/wal/instance
08:07:28.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:28.731823 27658 heartbeater.cc:347] Connected to a master server at 127.25.188.62:34681
08:07:28.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:28.732038 27656 heartbeater.cc:347] Connected to a master server at 127.25.188.61:37789
08:07:28.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:28.732344 27658 heartbeater.cc:464] Registering TS with master...
08:07:28.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:28.732360 27656 heartbeater.cc:464] Registering TS with master...
08:07:28.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:28.733639 27658 heartbeater.cc:511] Master 127.25.188.62:34681 requested a full tablet report, sending...
08:07:28.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:28.734198 27656 heartbeater.cc:511] Master 127.25.188.61:37789 requested a full tablet report, sending...
08:07:28.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:28.736963 26424 ts_manager.cc:194] Registered new tserver with Master: a86097c640f8443fa8e30feea68f203c (127.25.188.3:39859)
08:07:28.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:28.737845 26562 ts_manager.cc:194] Registered new tserver with Master: a86097c640f8443fa8e30feea68f203c (127.25.188.3:39859)
08:07:28.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:28.738844 27654 heartbeater.cc:347] Connected to a master server at 127.25.188.60:39957
08:07:28.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:28.739205 27654 heartbeater.cc:464] Registering TS with master...
08:07:28.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:28.739946 27654 heartbeater.cc:511] Master 127.25.188.60:39957 requested a full tablet report, sending...
08:07:28.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:28.741892 26712 ts_manager.cc:194] Registered new tserver with Master: a86097c640f8443fa8e30feea68f203c (127.25.188.3:39859)
08:07:28.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:28.743841 26712 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.25.188.3:43365
08:07:28.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:28.759486 26352 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
08:07:28.769 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
08:07:28.770 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

08:07:28.772 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.25.188.62"
      port: 34681
    }
    bound_http_address {
      host: "127.25.188.62"
      port: 38811
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.25.188.61"
      port: 37789
    }
    bound_http_address {
      host: "127.25.188.61"
      port: 38267
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.25.188.60"
      port: 39957
    }
    bound_http_address {
      host: "127.25.188.60"
      port: 36127
    }
  }
}

08:07:28.772 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

08:07:28.774 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.25.188.1"
      port: 38437
    }
    bound_http_address {
      host: "127.25.188.1"
      port: 41647
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.25.188.2"
      port: 35231
    }
    bound_http_address {
      host: "127.25.188.2"
      port: 40015
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.25.188.3"
      port: 39859
    }
    bound_http_address {
      host: "127.25.188.3"
      port: 43503
    }
  }
}

08:07:28.774 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
08:07:28.777 [ERROR - main] (ResourceLeakDetector.java:327) LEAK: HashedWheelTimer.release() was not called before it's garbage-collected. See https://netty.io/wiki/reference-counted-objects.html for more information.
Recent access records: 
Created at:
	io.netty.util.HashedWheelTimer.<init>(HashedWheelTimer.java:312)
	io.netty.util.HashedWheelTimer.<init>(HashedWheelTimer.java:251)
	io.netty.util.HashedWheelTimer.<init>(HashedWheelTimer.java:224)
	io.netty.util.HashedWheelTimer.<init>(HashedWheelTimer.java:203)
	io.netty.util.HashedWheelTimer.<init>(HashedWheelTimer.java:185)
	org.apache.kudu.client.AsyncKuduScanner.<init>(AsyncKuduScanner.java:296)
	org.apache.kudu.client.AsyncKuduScanner.<init>(AsyncKuduScanner.java:431)
	org.apache.kudu.client.AsyncKuduScanner$AsyncKuduScannerBuilder.build(AsyncKuduScanner.java:1417)
	org.apache.kudu.client.TestClientFailoverSupport$1.get(TestClientFailoverSupport.java:82)
	org.apache.kudu.test.junit.AssertHelpers.assertEventuallyTrue(AssertHelpers.java:40)
	org.apache.kudu.client.TestClientFailoverSupport.waitUntilRowCount(TestClientFailoverSupport.java:78)
	org.apache.kudu.client.TestClientFailoverSupport.doTestMasterFailover(TestClientFailoverSupport.java:123)
	org.apache.kudu.client.TestClientFailoverSupport.testKillLeaderMaster(TestClientFailoverSupport.java:96)
	sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	java.lang.reflect.Method.invoke(Method.java:498)
	org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
	org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
	org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
	org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
	org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299)
	org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293)
	java.util.concurrent.FutureTask.run(FutureTask.java:266)
	java.lang.Thread.run(Thread.java:750)
08:07:28.778 [ERROR - main] (ResourceLeakDetector.java:327) LEAK: HashedWheelTimer.release() was not called before it's garbage-collected. See https://netty.io/wiki/reference-counted-objects.html for more information.
Recent access records: 
Created at:
	io.netty.util.HashedWheelTimer.<init>(HashedWheelTimer.java:312)
	io.netty.util.HashedWheelTimer.<init>(HashedWheelTimer.java:251)
	io.netty.util.HashedWheelTimer.<init>(HashedWheelTimer.java:224)
	io.netty.util.HashedWheelTimer.<init>(HashedWheelTimer.java:203)
	io.netty.util.HashedWheelTimer.<init>(HashedWheelTimer.java:185)
	org.apache.kudu.client.AsyncKuduScanner.<init>(AsyncKuduScanner.java:296)
	org.apache.kudu.client.AsyncKuduScanner.<init>(AsyncKuduScanner.java:431)
	org.apache.kudu.client.AsyncKuduScanner$AsyncKuduScannerBuilder.build(AsyncKuduScanner.java:1417)
	org.apache.kudu.client.TestClientFailoverSupport$1.get(TestClientFailoverSupport.java:82)
	org.apache.kudu.test.junit.AssertHelpers.assertEventuallyTrue(AssertHelpers.java:40)
	org.apache.kudu.client.TestClientFailoverSupport.waitUntilRowCount(TestClientFailoverSupport.java:78)
	org.apache.kudu.client.TestClientFailoverSupport.doTestMasterFailover(TestClientFailoverSupport.java:149)
	org.apache.kudu.client.TestClientFailoverSupport.testKillLeaderMaster(TestClientFailoverSupport.java:96)
	sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	java.lang.reflect.Method.invoke(Method.java:498)
	org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59)
	org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
	org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56)
	org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
	org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299)
	org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293)
	java.util.concurrent.FutureTask.run(FutureTask.java:266)
	java.lang.Thread.run(Thread.java:750)
08:07:28.780 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:07:28.782 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.25.188.61:37789(127.25.188.61:37789)] connecting to peer
08:07:28.784 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.25.188.62:34681(127.25.188.62:34681)] connecting to peer
08:07:28.790 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.25.188.60:39957(127.25.188.60:39957)] connecting to peer
08:07:28.790 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.25.188.61:37789(127.25.188.61:37789)] Successfully connected to peer
08:07:28.793 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.25.188.62:34681(127.25.188.62:34681)] Successfully connected to peer
08:07:28.797 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.25.188.62
08:07:28.799 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.25.188.61
08:07:28.805 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.25.188.60:39957(127.25.188.60:39957)] Successfully connected to peer
08:07:28.820 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.25.188.60
08:07:28.825 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xf8b91790, L:/127.0.0.1:44386 - R:/127.25.188.62:34681] using SASL/PLAIN
08:07:28.841 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x5223ca45, L:/127.0.0.1:41848 - R:/127.25.188.61:37789] using SASL/PLAIN
08:07:28.847 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0xccdc34f4, L:/127.0.0.1:53642 - R:/127.25.188.60:39957] using SASL/PLAIN
08:07:28.851 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:07:28.852 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=70), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.188.61:37789, [1ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.188.62:34681, [7ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.188.60:39957, [46ms] Sub RPC ConnectToMaster: received response from server master-127.25.188.62:34681: OK, [63ms] Sub RPC ConnectToMaster: received response from server master-127.25.188.61:37789: OK, [68ms] Sub RPC ConnectToMaster: received response from server master-127.25.188.60:39957: OK, deferred=null) after lookup
08:07:28.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:28.857722 26712 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:53642:
08:07:28.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "org.apache.kudu.client.TestClientFailoverSupport-RESTART"
08:07:28.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
08:07:28.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:07:28.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key"
08:07:28.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
08:07:28.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
08:07:28.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:07:28.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:07:28.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:07:28.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:07:28.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:07:28.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:07:28.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column1_i"
08:07:28.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
08:07:28.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
08:07:28.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:07:28.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:07:28.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:07:28.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:07:28.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:07:28.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:07:28.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column2_i"
08:07:28.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
08:07:28.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
08:07:28.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:07:28.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:07:28.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:07:28.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:07:28.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:07:28.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:07:28.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column3_s"
08:07:28.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
08:07:28.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
08:07:28.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: true
08:07:28.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: DICT_ENCODING
08:07:28.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: LZ4
08:07:28.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 4096
08:07:28.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:07:28.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:07:28.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:07:28.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:07:28.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column4_b"
08:07:28.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BOOL
08:07:28.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
08:07:28.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:07:28.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:07:28.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:07:28.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:07:28.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:07:28.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
08:07:28.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
08:07:28.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
08:07:28.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
08:07:28.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key"
08:07:28.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
08:07:28.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:07:28.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
08:07:28.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:28.861553 26712 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table org.apache.kudu.client.TestClientFailoverSupport-RESTART in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
08:07:28.930 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 9ad88cfd45724ef6916b5734a1a2504c
08:07:28.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:28.989782 27273 tablet_service.cc:1467] Processing CreateTablet for tablet bbe8b447b807421f9bf69b944f9d6d62 (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-RESTART [id=9ad88cfd45724ef6916b5734a1a2504c]), partition=RANGE (key) PARTITION UNBOUNDED
08:07:28.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:28.991302 27533 tablet_service.cc:1467] Processing CreateTablet for tablet bbe8b447b807421f9bf69b944f9d6d62 (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-RESTART [id=9ad88cfd45724ef6916b5734a1a2504c]), partition=RANGE (key) PARTITION UNBOUNDED
08:07:28.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:28.992076 27273 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bbe8b447b807421f9bf69b944f9d6d62. 1 dirs total, 0 dirs full, 0 dirs failed
08:07:28.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:28.992166 27013 tablet_service.cc:1467] Processing CreateTablet for tablet bbe8b447b807421f9bf69b944f9d6d62 (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-RESTART [id=9ad88cfd45724ef6916b5734a1a2504c]), partition=RANGE (key) PARTITION UNBOUNDED
08:07:28.994 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:28.993188 27533 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bbe8b447b807421f9bf69b944f9d6d62. 1 dirs total, 0 dirs full, 0 dirs failed
08:07:28.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:28.993940 27013 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bbe8b447b807421f9bf69b944f9d6d62. 1 dirs total, 0 dirs full, 0 dirs failed
08:07:29.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.027956 27704 tablet_bootstrap.cc:492] T bbe8b447b807421f9bf69b944f9d6d62 P 66c5262333af49538a7ebf357438d66a: Bootstrap starting.
08:07:29.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.029343 27703 tablet_bootstrap.cc:492] T bbe8b447b807421f9bf69b944f9d6d62 P a86097c640f8443fa8e30feea68f203c: Bootstrap starting.
08:07:29.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.035284 27705 tablet_bootstrap.cc:492] T bbe8b447b807421f9bf69b944f9d6d62 P cd9ec0d9af0a4e0caabe63c9dd03697a: Bootstrap starting.
08:07:29.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.037201 27703 tablet_bootstrap.cc:654] T bbe8b447b807421f9bf69b944f9d6d62 P a86097c640f8443fa8e30feea68f203c: Neither blocks nor log segments found. Creating new log.
08:07:29.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.037204 27704 tablet_bootstrap.cc:654] T bbe8b447b807421f9bf69b944f9d6d62 P 66c5262333af49538a7ebf357438d66a: Neither blocks nor log segments found. Creating new log.
08:07:29.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.039541 27704 log.cc:824] T bbe8b447b807421f9bf69b944f9d6d62 P 66c5262333af49538a7ebf357438d66a: Log is configured to *not* fsync() on all Append() calls
08:07:29.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.039778 27703 log.cc:824] T bbe8b447b807421f9bf69b944f9d6d62 P a86097c640f8443fa8e30feea68f203c: Log is configured to *not* fsync() on all Append() calls
08:07:29.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.042752 27705 tablet_bootstrap.cc:654] T bbe8b447b807421f9bf69b944f9d6d62 P cd9ec0d9af0a4e0caabe63c9dd03697a: Neither blocks nor log segments found. Creating new log.
08:07:29.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.045035 27705 log.cc:824] T bbe8b447b807421f9bf69b944f9d6d62 P cd9ec0d9af0a4e0caabe63c9dd03697a: Log is configured to *not* fsync() on all Append() calls
08:07:29.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.052904 27703 tablet_bootstrap.cc:492] T bbe8b447b807421f9bf69b944f9d6d62 P a86097c640f8443fa8e30feea68f203c: No bootstrap required, opened a new log
08:07:29.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.053789 27703 ts_tablet_manager.cc:1397] T bbe8b447b807421f9bf69b944f9d6d62 P a86097c640f8443fa8e30feea68f203c: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.007s
08:07:29.057 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.057281 27704 tablet_bootstrap.cc:492] T bbe8b447b807421f9bf69b944f9d6d62 P 66c5262333af49538a7ebf357438d66a: No bootstrap required, opened a new log
08:07:29.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.058007 27704 ts_tablet_manager.cc:1397] T bbe8b447b807421f9bf69b944f9d6d62 P 66c5262333af49538a7ebf357438d66a: Time spent bootstrapping tablet: real 0.031s	user 0.007s	sys 0.019s
08:07:29.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.058921 27705 tablet_bootstrap.cc:492] T bbe8b447b807421f9bf69b944f9d6d62 P cd9ec0d9af0a4e0caabe63c9dd03697a: No bootstrap required, opened a new log
08:07:29.059 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.059376 27705 ts_tablet_manager.cc:1397] T bbe8b447b807421f9bf69b944f9d6d62 P cd9ec0d9af0a4e0caabe63c9dd03697a: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.004s
08:07:29.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.081003 27704 raft_consensus.cc:348] T bbe8b447b807421f9bf69b944f9d6d62 P 66c5262333af49538a7ebf357438d66a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a86097c640f8443fa8e30feea68f203c" member_type: VOTER last_known_addr { host: "127.25.188.3" port: 39859 } } peers { permanent_uuid: "66c5262333af49538a7ebf357438d66a" member_type: VOTER last_known_addr { host: "127.25.188.2" port: 35231 } } peers { permanent_uuid: "cd9ec0d9af0a4e0caabe63c9dd03697a" member_type: VOTER last_known_addr { host: "127.25.188.1" port: 38437 } }
08:07:29.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.081769 27704 raft_consensus.cc:374] T bbe8b447b807421f9bf69b944f9d6d62 P 66c5262333af49538a7ebf357438d66a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:07:29.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.081979 27704 raft_consensus.cc:729] T bbe8b447b807421f9bf69b944f9d6d62 P 66c5262333af49538a7ebf357438d66a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66c5262333af49538a7ebf357438d66a, State: Initialized, Role: FOLLOWER
08:07:29.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.082943 27704 consensus_queue.cc:260] T bbe8b447b807421f9bf69b944f9d6d62 P 66c5262333af49538a7ebf357438d66a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a86097c640f8443fa8e30feea68f203c" member_type: VOTER last_known_addr { host: "127.25.188.3" port: 39859 } } peers { permanent_uuid: "66c5262333af49538a7ebf357438d66a" member_type: VOTER last_known_addr { host: "127.25.188.2" port: 35231 } } peers { permanent_uuid: "cd9ec0d9af0a4e0caabe63c9dd03697a" member_type: VOTER last_known_addr { host: "127.25.188.1" port: 38437 } }
08:07:29.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.085364 27703 raft_consensus.cc:348] T bbe8b447b807421f9bf69b944f9d6d62 P a86097c640f8443fa8e30feea68f203c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a86097c640f8443fa8e30feea68f203c" member_type: VOTER last_known_addr { host: "127.25.188.3" port: 39859 } } peers { permanent_uuid: "66c5262333af49538a7ebf357438d66a" member_type: VOTER last_known_addr { host: "127.25.188.2" port: 35231 } } peers { permanent_uuid: "cd9ec0d9af0a4e0caabe63c9dd03697a" member_type: VOTER last_known_addr { host: "127.25.188.1" port: 38437 } }
08:07:29.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.086297 27703 raft_consensus.cc:374] T bbe8b447b807421f9bf69b944f9d6d62 P a86097c640f8443fa8e30feea68f203c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:07:29.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.086593 27703 raft_consensus.cc:729] T bbe8b447b807421f9bf69b944f9d6d62 P a86097c640f8443fa8e30feea68f203c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a86097c640f8443fa8e30feea68f203c, State: Initialized, Role: FOLLOWER
08:07:29.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.086755 27704 ts_tablet_manager.cc:1428] T bbe8b447b807421f9bf69b944f9d6d62 P 66c5262333af49538a7ebf357438d66a: Time spent starting tablet: real 0.028s	user 0.019s	sys 0.008s
08:07:29.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.087338 27705 raft_consensus.cc:348] T bbe8b447b807421f9bf69b944f9d6d62 P cd9ec0d9af0a4e0caabe63c9dd03697a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a86097c640f8443fa8e30feea68f203c" member_type: VOTER last_known_addr { host: "127.25.188.3" port: 39859 } } peers { permanent_uuid: "66c5262333af49538a7ebf357438d66a" member_type: VOTER last_known_addr { host: "127.25.188.2" port: 35231 } } peers { permanent_uuid: "cd9ec0d9af0a4e0caabe63c9dd03697a" member_type: VOTER last_known_addr { host: "127.25.188.1" port: 38437 } }
08:07:29.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.087639 27703 consensus_queue.cc:260] T bbe8b447b807421f9bf69b944f9d6d62 P a86097c640f8443fa8e30feea68f203c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a86097c640f8443fa8e30feea68f203c" member_type: VOTER last_known_addr { host: "127.25.188.3" port: 39859 } } peers { permanent_uuid: "66c5262333af49538a7ebf357438d66a" member_type: VOTER last_known_addr { host: "127.25.188.2" port: 35231 } } peers { permanent_uuid: "cd9ec0d9af0a4e0caabe63c9dd03697a" member_type: VOTER last_known_addr { host: "127.25.188.1" port: 38437 } }
08:07:29.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.088265 27705 raft_consensus.cc:374] T bbe8b447b807421f9bf69b944f9d6d62 P cd9ec0d9af0a4e0caabe63c9dd03697a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:07:29.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.088548 27705 raft_consensus.cc:729] T bbe8b447b807421f9bf69b944f9d6d62 P cd9ec0d9af0a4e0caabe63c9dd03697a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cd9ec0d9af0a4e0caabe63c9dd03697a, State: Initialized, Role: FOLLOWER
08:07:29.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.089574 27705 consensus_queue.cc:260] T bbe8b447b807421f9bf69b944f9d6d62 P cd9ec0d9af0a4e0caabe63c9dd03697a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a86097c640f8443fa8e30feea68f203c" member_type: VOTER last_known_addr { host: "127.25.188.3" port: 39859 } } peers { permanent_uuid: "66c5262333af49538a7ebf357438d66a" member_type: VOTER last_known_addr { host: "127.25.188.2" port: 35231 } } peers { permanent_uuid: "cd9ec0d9af0a4e0caabe63c9dd03697a" member_type: VOTER last_known_addr { host: "127.25.188.1" port: 38437 } }
08:07:29.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.099644 27703 ts_tablet_manager.cc:1428] T bbe8b447b807421f9bf69b944f9d6d62 P a86097c640f8443fa8e30feea68f203c: Time spent starting tablet: real 0.046s	user 0.034s	sys 0.007s
08:07:29.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.100355 27654 heartbeater.cc:503] Master 127.25.188.60:39957 was elected leader, sending a full tablet report...
08:07:29.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.105940 27705 ts_tablet_manager.cc:1428] T bbe8b447b807421f9bf69b944f9d6d62 P cd9ec0d9af0a4e0caabe63c9dd03697a: Time spent starting tablet: real 0.046s	user 0.029s	sys 0.012s
08:07:29.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:29.194798 27410 tablet.cc:2369] T bbe8b447b807421f9bf69b944f9d6d62 P 66c5262333af49538a7ebf357438d66a: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:07:29.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:29.209013 27661 tablet.cc:2369] T bbe8b447b807421f9bf69b944f9d6d62 P a86097c640f8443fa8e30feea68f203c: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:07:29.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.281793 27712 raft_consensus.cc:482] T bbe8b447b807421f9bf69b944f9d6d62 P 66c5262333af49538a7ebf357438d66a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:07:29.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.282330 27712 raft_consensus.cc:504] T bbe8b447b807421f9bf69b944f9d6d62 P 66c5262333af49538a7ebf357438d66a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a86097c640f8443fa8e30feea68f203c" member_type: VOTER last_known_addr { host: "127.25.188.3" port: 39859 } } peers { permanent_uuid: "66c5262333af49538a7ebf357438d66a" member_type: VOTER last_known_addr { host: "127.25.188.2" port: 35231 } } peers { permanent_uuid: "cd9ec0d9af0a4e0caabe63c9dd03697a" member_type: VOTER last_known_addr { host: "127.25.188.1" port: 38437 } }
08:07:29.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.284719 27712 leader_election.cc:288] T bbe8b447b807421f9bf69b944f9d6d62 P 66c5262333af49538a7ebf357438d66a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a86097c640f8443fa8e30feea68f203c (127.25.188.3:39859), cd9ec0d9af0a4e0caabe63c9dd03697a (127.25.188.1:38437)
08:07:29.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:29.287412 27139 tablet.cc:2369] T bbe8b447b807421f9bf69b944f9d6d62 P cd9ec0d9af0a4e0caabe63c9dd03697a: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:07:29.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.292366 27716 raft_consensus.cc:482] T bbe8b447b807421f9bf69b944f9d6d62 P cd9ec0d9af0a4e0caabe63c9dd03697a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:07:29.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.292858 27716 raft_consensus.cc:504] T bbe8b447b807421f9bf69b944f9d6d62 P cd9ec0d9af0a4e0caabe63c9dd03697a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a86097c640f8443fa8e30feea68f203c" member_type: VOTER last_known_addr { host: "127.25.188.3" port: 39859 } } peers { permanent_uuid: "66c5262333af49538a7ebf357438d66a" member_type: VOTER last_known_addr { host: "127.25.188.2" port: 35231 } } peers { permanent_uuid: "cd9ec0d9af0a4e0caabe63c9dd03697a" member_type: VOTER last_known_addr { host: "127.25.188.1" port: 38437 } }
08:07:29.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.297282 27716 leader_election.cc:288] T bbe8b447b807421f9bf69b944f9d6d62 P cd9ec0d9af0a4e0caabe63c9dd03697a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a86097c640f8443fa8e30feea68f203c (127.25.188.3:39859), 66c5262333af49538a7ebf357438d66a (127.25.188.2:35231)
08:07:29.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.302343 27046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbe8b447b807421f9bf69b944f9d6d62" candidate_uuid: "66c5262333af49538a7ebf357438d66a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd9ec0d9af0a4e0caabe63c9dd03697a" is_pre_election: true
08:07:29.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.303359 27046 raft_consensus.cc:2454] T bbe8b447b807421f9bf69b944f9d6d62 P cd9ec0d9af0a4e0caabe63c9dd03697a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66c5262333af49538a7ebf357438d66a in term 0.
08:07:29.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.304960 27177 leader_election.cc:302] T bbe8b447b807421f9bf69b944f9d6d62 P 66c5262333af49538a7ebf357438d66a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66c5262333af49538a7ebf357438d66a, cd9ec0d9af0a4e0caabe63c9dd03697a; no voters: 
08:07:29.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.305770 27712 raft_consensus.cc:2781] T bbe8b447b807421f9bf69b944f9d6d62 P 66c5262333af49538a7ebf357438d66a [term 0 FOLLOWER]: Leader pre-election won for term 1
08:07:29.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.306165 27712 raft_consensus.cc:482] T bbe8b447b807421f9bf69b944f9d6d62 P 66c5262333af49538a7ebf357438d66a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:07:29.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.306479 27712 raft_consensus.cc:3037] T bbe8b447b807421f9bf69b944f9d6d62 P 66c5262333af49538a7ebf357438d66a [term 0 FOLLOWER]: Advancing to term 1
08:07:29.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.307065 27562 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbe8b447b807421f9bf69b944f9d6d62" candidate_uuid: "66c5262333af49538a7ebf357438d66a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a86097c640f8443fa8e30feea68f203c" is_pre_election: true
08:07:29.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.307989 27562 raft_consensus.cc:2454] T bbe8b447b807421f9bf69b944f9d6d62 P a86097c640f8443fa8e30feea68f203c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66c5262333af49538a7ebf357438d66a in term 0.
08:07:29.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.312484 27712 raft_consensus.cc:504] T bbe8b447b807421f9bf69b944f9d6d62 P 66c5262333af49538a7ebf357438d66a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a86097c640f8443fa8e30feea68f203c" member_type: VOTER last_known_addr { host: "127.25.188.3" port: 39859 } } peers { permanent_uuid: "66c5262333af49538a7ebf357438d66a" member_type: VOTER last_known_addr { host: "127.25.188.2" port: 35231 } } peers { permanent_uuid: "cd9ec0d9af0a4e0caabe63c9dd03697a" member_type: VOTER last_known_addr { host: "127.25.188.1" port: 38437 } }
08:07:29.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.313021 27562 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbe8b447b807421f9bf69b944f9d6d62" candidate_uuid: "cd9ec0d9af0a4e0caabe63c9dd03697a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a86097c640f8443fa8e30feea68f203c" is_pre_election: true
08:07:29.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.313612 27562 raft_consensus.cc:2454] T bbe8b447b807421f9bf69b944f9d6d62 P a86097c640f8443fa8e30feea68f203c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd9ec0d9af0a4e0caabe63c9dd03697a in term 0.
08:07:29.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.314479 27712 leader_election.cc:288] T bbe8b447b807421f9bf69b944f9d6d62 P 66c5262333af49538a7ebf357438d66a [CANDIDATE]: Term 1 election: Requested vote from peers a86097c640f8443fa8e30feea68f203c (127.25.188.3:39859), cd9ec0d9af0a4e0caabe63c9dd03697a (127.25.188.1:38437)
08:07:29.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.315157 26920 leader_election.cc:302] T bbe8b447b807421f9bf69b944f9d6d62 P cd9ec0d9af0a4e0caabe63c9dd03697a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a86097c640f8443fa8e30feea68f203c, cd9ec0d9af0a4e0caabe63c9dd03697a; no voters: 
08:07:29.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.315562 27562 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbe8b447b807421f9bf69b944f9d6d62" candidate_uuid: "66c5262333af49538a7ebf357438d66a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a86097c640f8443fa8e30feea68f203c"
08:07:29.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.315765 27046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbe8b447b807421f9bf69b944f9d6d62" candidate_uuid: "66c5262333af49538a7ebf357438d66a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cd9ec0d9af0a4e0caabe63c9dd03697a"
08:07:29.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.316088 27562 raft_consensus.cc:3037] T bbe8b447b807421f9bf69b944f9d6d62 P a86097c640f8443fa8e30feea68f203c [term 0 FOLLOWER]: Advancing to term 1
08:07:29.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.316298 27046 raft_consensus.cc:3037] T bbe8b447b807421f9bf69b944f9d6d62 P cd9ec0d9af0a4e0caabe63c9dd03697a [term 0 FOLLOWER]: Advancing to term 1
08:07:29.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.318832 27310 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbe8b447b807421f9bf69b944f9d6d62" candidate_uuid: "cd9ec0d9af0a4e0caabe63c9dd03697a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66c5262333af49538a7ebf357438d66a" is_pre_election: true
08:07:29.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.319900 27310 raft_consensus.cc:2379] T bbe8b447b807421f9bf69b944f9d6d62 P 66c5262333af49538a7ebf357438d66a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cd9ec0d9af0a4e0caabe63c9dd03697a in current term 1: Already voted for candidate 66c5262333af49538a7ebf357438d66a in this term.
08:07:29.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.322737 27046 raft_consensus.cc:2454] T bbe8b447b807421f9bf69b944f9d6d62 P cd9ec0d9af0a4e0caabe63c9dd03697a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66c5262333af49538a7ebf357438d66a in term 1.
08:07:29.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.323185 27716 raft_consensus.cc:2741] T bbe8b447b807421f9bf69b944f9d6d62 P cd9ec0d9af0a4e0caabe63c9dd03697a [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
08:07:29.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.323781 27177 leader_election.cc:302] T bbe8b447b807421f9bf69b944f9d6d62 P 66c5262333af49538a7ebf357438d66a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66c5262333af49538a7ebf357438d66a, cd9ec0d9af0a4e0caabe63c9dd03697a; no voters: 
08:07:29.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.324513 27712 raft_consensus.cc:2781] T bbe8b447b807421f9bf69b944f9d6d62 P 66c5262333af49538a7ebf357438d66a [term 1 FOLLOWER]: Leader election won for term 1
08:07:29.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.327373 27712 raft_consensus.cc:686] T bbe8b447b807421f9bf69b944f9d6d62 P 66c5262333af49538a7ebf357438d66a [term 1 LEADER]: Becoming Leader. State: Replica: 66c5262333af49538a7ebf357438d66a, State: Running, Role: LEADER
08:07:29.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.328554 27562 raft_consensus.cc:2454] T bbe8b447b807421f9bf69b944f9d6d62 P a86097c640f8443fa8e30feea68f203c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66c5262333af49538a7ebf357438d66a in term 1.
08:07:29.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.328506 27712 consensus_queue.cc:237] T bbe8b447b807421f9bf69b944f9d6d62 P 66c5262333af49538a7ebf357438d66a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a86097c640f8443fa8e30feea68f203c" member_type: VOTER last_known_addr { host: "127.25.188.3" port: 39859 } } peers { permanent_uuid: "66c5262333af49538a7ebf357438d66a" member_type: VOTER last_known_addr { host: "127.25.188.2" port: 35231 } } peers { permanent_uuid: "cd9ec0d9af0a4e0caabe63c9dd03697a" member_type: VOTER last_known_addr { host: "127.25.188.1" port: 38437 } }
08:07:29.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.341126 26710 catalog_manager.cc:5495] T bbe8b447b807421f9bf69b944f9d6d62 P 66c5262333af49538a7ebf357438d66a reported cstate change: term changed from 0 to 1, leader changed from <none> to 66c5262333af49538a7ebf357438d66a (127.25.188.2). New cstate: current_term: 1 leader_uuid: "66c5262333af49538a7ebf357438d66a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a86097c640f8443fa8e30feea68f203c" member_type: VOTER last_known_addr { host: "127.25.188.3" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66c5262333af49538a7ebf357438d66a" member_type: VOTER last_known_addr { host: "127.25.188.2" port: 35231 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cd9ec0d9af0a4e0caabe63c9dd03697a" member_type: VOTER last_known_addr { host: "127.25.188.1" port: 38437 } health_report { overall_health: UNKNOWN } } }
08:07:29.568 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:894) Opened table 9ad88cfd45724ef6916b5734a1a2504c
08:07:29.573 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:2538) Learned about tablet bbe8b447b807421f9bf69b944f9d6d62 for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
08:07:29.573 [DEBUG - kudu-nio-0] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=bbe8b447b807421f9bf69b944f9d6d62@[66c5262333af49538a7ebf357438d66a(127.25.188.2:35231)[L],a86097c640f8443fa8e30feea68f203c(127.25.188.3:39859),cd9ec0d9af0a4e0caabe63c9dd03697a(127.25.188.1:38437)]}]
08:07:29.573 [DEBUG - kudu-nio-0] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=4), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.25.188.60:39957, [3ms] Sub RPC GetTableLocations: received response from server master-127.25.188.60:39957: OK, deferred=null) after lookup
08:07:29.574 [DEBUG - kudu-nio-0] (Connection.java:748) [peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231)] connecting to peer
08:07:29.576 [DEBUG - kudu-nio-1] (Connection.java:757) [peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231)] Successfully connected to peer
08:07:29.601 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x9716a7d8, L:/127.0.0.1:34022 - R:/127.25.188.2:35231] using TOKEN/null
08:07:29.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.615859 27562 raft_consensus.cc:1261] T bbe8b447b807421f9bf69b944f9d6d62 P a86097c640f8443fa8e30feea68f203c [term 1 FOLLOWER]: Refusing update from remote peer 66c5262333af49538a7ebf357438d66a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
08:07:29.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.615788 27046 raft_consensus.cc:1261] T bbe8b447b807421f9bf69b944f9d6d62 P cd9ec0d9af0a4e0caabe63c9dd03697a [term 1 FOLLOWER]: Refusing update from remote peer 66c5262333af49538a7ebf357438d66a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
08:07:29.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.617333 27712 consensus_queue.cc:1035] T bbe8b447b807421f9bf69b944f9d6d62 P 66c5262333af49538a7ebf357438d66a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a86097c640f8443fa8e30feea68f203c" member_type: VOTER last_known_addr { host: "127.25.188.3" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
08:07:29.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.618032 27727 consensus_queue.cc:1035] T bbe8b447b807421f9bf69b944f9d6d62 P 66c5262333af49538a7ebf357438d66a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cd9ec0d9af0a4e0caabe63c9dd03697a" member_type: VOTER last_known_addr { host: "127.25.188.1" port: 38437 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
08:07:29.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.638229 27730 mvcc.cc:205] Tried to move back new op lower bound from 7317594315210416128 to 7317594314058719232. Current Snapshot: MvccSnapshot[applied={T|T < 7317594315210416128}]
08:07:29.837 [DEBUG - kudu-nio-1] (AsyncKuduScanner.java:1374) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 10 rows, more = false) for scanner KuduScanner(table=org.apache.kudu.client.TestClientFailoverSupport-RESTART, tablet=bbe8b447b807421f9bf69b944f9d6d62, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:29.838 [INFO - Time-limited test] (MiniKuduCluster.java:399) Killing master server 127.25.188.60:39957
08:07:29.839 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: stop_daemon {
  id {
    type: MASTER
    index: 2
  }
}

08:07:29.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.839996 26352 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgk96or/build/tsan/bin/kudu with pid 26632
08:07:29.881 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.25.188.60:39957(127.25.188.60:39957)] handling channelInactive
08:07:29.881 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.188.60:39957(127.25.188.60:39957)] cleaning up while in state READY due to: connection closed
08:07:29.883 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
08:07:29.883 [INFO - Time-limited test] (MiniKuduCluster.java:380) Starting master server 127.25.188.60:39957
08:07:29.887 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: start_daemon {
  id {
    type: MASTER
    index: 2
  }
}

08:07:29.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:29.888458 26352 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskgk96or/build/tsan/bin/kudu
08:07:29.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskgk96or/build/tsan/bin/kudu
08:07:29.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/master-2/wal
08:07:29.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/master-2/data
08:07:29.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:07:29.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:07:29.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:07:29.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:07:29.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:07:29.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:07:29.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/master-2/logs
08:07:29.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/master-2/data/info.pb
08:07:29.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:07:29.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:07:29.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:07:29.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:07:29.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:07:29.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:07:29.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:07:29.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:07:29.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
08:07:29.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:07:29.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:07:29.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:07:29.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.25.188.60:39957
08:07:29.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.25.188.60
08:07:29.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=36127
08:07:29.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.25.188.20:33377
08:07:29.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:07:29.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:07:29.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:07:29.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:07:29.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.25.188.62:34681,127.25.188.61:37789,127.25.188.60:39957
08:07:29.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:07:29.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:42397/jwks.json with env {}
08:07:30.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:30.247789 27751 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
08:07:30.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:30.248358 27751 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:07:30.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:30.248900 27751 flags.cc:425] Enabled unsafe flag: --never_fsync=true
08:07:30.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:30.280876 27751 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
08:07:30.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:30.281162 27751 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
08:07:30.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:30.281366 27751 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
08:07:30.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:30.281611 27751 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
08:07:30.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:30.281827 27751 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
08:07:30.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:30.281973 27751 flags.cc:425] Enabled experimental flag: --jwks_url=http://localhost:42397/jwks.json
08:07:30.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:30.319617 27751 master_runner.cc:386] Master server non-default flags:
08:07:30.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:07:30.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.25.188.20:33377
08:07:30.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:07:30.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:07:30.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/master-2/data
08:07:30.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/master-2/wal
08:07:30.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:07:30.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.25.188.62:34681,127.25.188.61:37789,127.25.188.60:39957
08:07:30.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:07:30.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:07:30.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:07:30.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.25.188.60:39957
08:07:30.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:07:30.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:07:30.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:07:30.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:42397/jwks.json
08:07:30.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:07:30.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:07:30.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/master-2/data/info.pb
08:07:30.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.25.188.60
08:07:30.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=36127
08:07:30.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:07:30.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:07:30.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:07:30.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:07:30.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:07:30.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/master-2/logs
08:07:30.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:07:30.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:07:30.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:07:30.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
08:07:30.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.18.0-SNAPSHOT
08:07:30.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
08:07:30.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:07:30.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by systest at 12 Aug 2026 06:37:03 UTC on ccycloud.quasar-wifqrz.root.comops.site
08:07:30.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 4581996
08:07:30.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:07:30.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:30.321213 27751 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:07:30.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:30.323087 27751 file_cache.cc:493] Constructed file cache file cache with capacity 419430
08:07:30.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:30.342914 27759 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:30.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:30.688572 27398 heartbeater.cc:644] Failed to heartbeat to 127.25.188.60:39957 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.25.188.60:39957: connect: Connection refused (error 111)
08:07:30.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:30.691591 27123 heartbeater.cc:644] Failed to heartbeat to 127.25.188.60:39957 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.25.188.60:39957: connect: Connection refused (error 111)
08:07:30.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:30.693867 27654 heartbeater.cc:644] Failed to heartbeat to 127.25.188.60:39957 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.25.188.60:39957: connect: Connection refused (error 111)
08:07:30.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:30.854547 27784 raft_consensus.cc:482] T 00000000000000000000000000000000 P c6e4ef8a98eb452cb3b3b247f68bb112 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8f9f4dfbae09418b968427a8264da4c8)
08:07:30.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:30.855007 27784 raft_consensus.cc:504] T 00000000000000000000000000000000 P c6e4ef8a98eb452cb3b3b247f68bb112 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24369b54bb044e73b317e8452914980e" member_type: VOTER last_known_addr { host: "127.25.188.62" port: 34681 } } peers { permanent_uuid: "c6e4ef8a98eb452cb3b3b247f68bb112" member_type: VOTER last_known_addr { host: "127.25.188.61" port: 37789 } } peers { permanent_uuid: "8f9f4dfbae09418b968427a8264da4c8" member_type: VOTER last_known_addr { host: "127.25.188.60" port: 39957 } }
08:07:30.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:30.859330 26448 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "c6e4ef8a98eb452cb3b3b247f68bb112" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "24369b54bb044e73b317e8452914980e" is_pre_election: true
08:07:30.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:30.862602 27784 leader_election.cc:288] T 00000000000000000000000000000000 P c6e4ef8a98eb452cb3b3b247f68bb112 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 24369b54bb044e73b317e8452914980e (127.25.188.62:34681), 8f9f4dfbae09418b968427a8264da4c8 (127.25.188.60:39957)
08:07:30.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:30.863502 26542 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.188.60:39957: connect: Connection refused (error 111) [suppressed 6 similar messages]
08:07:30.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:30.866386 26542 leader_election.cc:334] T 00000000000000000000000000000000 P c6e4ef8a98eb452cb3b3b247f68bb112 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8f9f4dfbae09418b968427a8264da4c8 (127.25.188.60:39957): Network error: Client connection negotiation failed: client connection to 127.25.188.60:39957: connect: Connection refused (error 111)
08:07:30.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:30.866709 26542 leader_election.cc:302] T 00000000000000000000000000000000 P c6e4ef8a98eb452cb3b3b247f68bb112 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6e4ef8a98eb452cb3b3b247f68bb112; no voters: 24369b54bb044e73b317e8452914980e, 8f9f4dfbae09418b968427a8264da4c8
08:07:30.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:30.867547 27784 raft_consensus.cc:2726] T 00000000000000000000000000000000 P c6e4ef8a98eb452cb3b3b247f68bb112 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
08:07:31.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.288950 27794 raft_consensus.cc:482] T 00000000000000000000000000000000 P 24369b54bb044e73b317e8452914980e [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8f9f4dfbae09418b968427a8264da4c8)
08:07:31.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.289568 27794 raft_consensus.cc:504] T 00000000000000000000000000000000 P 24369b54bb044e73b317e8452914980e [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24369b54bb044e73b317e8452914980e" member_type: VOTER last_known_addr { host: "127.25.188.62" port: 34681 } } peers { permanent_uuid: "c6e4ef8a98eb452cb3b3b247f68bb112" member_type: VOTER last_known_addr { host: "127.25.188.61" port: 37789 } } peers { permanent_uuid: "8f9f4dfbae09418b968427a8264da4c8" member_type: VOTER last_known_addr { host: "127.25.188.60" port: 39957 } }
08:07:31.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.293220 26578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "24369b54bb044e73b317e8452914980e" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "c6e4ef8a98eb452cb3b3b247f68bb112" is_pre_election: true
08:07:31.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.293946 26578 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c6e4ef8a98eb452cb3b3b247f68bb112 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24369b54bb044e73b317e8452914980e in term 1.
08:07:31.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.295239 26405 leader_election.cc:302] T 00000000000000000000000000000000 P 24369b54bb044e73b317e8452914980e [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24369b54bb044e73b317e8452914980e, c6e4ef8a98eb452cb3b3b247f68bb112; no voters: 
08:07:31.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.298211 27797 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 24369b54bb044e73b317e8452914980e [term 1 FOLLOWER]: Leader pre-election won for term 2
08:07:31.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.298699 27797 raft_consensus.cc:482] T 00000000000000000000000000000000 P 24369b54bb044e73b317e8452914980e [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8f9f4dfbae09418b968427a8264da4c8)
08:07:31.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.299211 27797 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 24369b54bb044e73b317e8452914980e [term 1 FOLLOWER]: Advancing to term 2
08:07:31.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.301468 27794 leader_election.cc:288] T 00000000000000000000000000000000 P 24369b54bb044e73b317e8452914980e [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6e4ef8a98eb452cb3b3b247f68bb112 (127.25.188.61:37789), 8f9f4dfbae09418b968427a8264da4c8 (127.25.188.60:39957)
08:07:31.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.308287 27797 raft_consensus.cc:504] T 00000000000000000000000000000000 P 24369b54bb044e73b317e8452914980e [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24369b54bb044e73b317e8452914980e" member_type: VOTER last_known_addr { host: "127.25.188.62" port: 34681 } } peers { permanent_uuid: "c6e4ef8a98eb452cb3b3b247f68bb112" member_type: VOTER last_known_addr { host: "127.25.188.61" port: 37789 } } peers { permanent_uuid: "8f9f4dfbae09418b968427a8264da4c8" member_type: VOTER last_known_addr { host: "127.25.188.60" port: 39957 } }
08:07:31.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.310422 27797 leader_election.cc:288] T 00000000000000000000000000000000 P 24369b54bb044e73b317e8452914980e [CANDIDATE]: Term 2 election: Requested vote from peers c6e4ef8a98eb452cb3b3b247f68bb112 (127.25.188.61:37789), 8f9f4dfbae09418b968427a8264da4c8 (127.25.188.60:39957)
08:07:31.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.311223 26578 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "24369b54bb044e73b317e8452914980e" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "c6e4ef8a98eb452cb3b3b247f68bb112"
08:07:31.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:31.311297 26405 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.188.60:39957: connect: Connection refused (error 111) [suppressed 12 similar messages]
08:07:31.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.311764 26578 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c6e4ef8a98eb452cb3b3b247f68bb112 [term 1 FOLLOWER]: Advancing to term 2
08:07:31.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.319726 26578 raft_consensus.cc:2454] T 00000000000000000000000000000000 P c6e4ef8a98eb452cb3b3b247f68bb112 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24369b54bb044e73b317e8452914980e in term 2.
08:07:31.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.320832 26405 leader_election.cc:302] T 00000000000000000000000000000000 P 24369b54bb044e73b317e8452914980e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24369b54bb044e73b317e8452914980e, c6e4ef8a98eb452cb3b3b247f68bb112; no voters: 
08:07:31.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.321580 27797 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 24369b54bb044e73b317e8452914980e [term 2 FOLLOWER]: Leader election won for term 2
08:07:31.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.322047 27797 raft_consensus.cc:686] T 00000000000000000000000000000000 P 24369b54bb044e73b317e8452914980e [term 2 LEADER]: Becoming Leader. State: Replica: 24369b54bb044e73b317e8452914980e, State: Running, Role: LEADER
08:07:31.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:31.322589 26405 leader_election.cc:334] T 00000000000000000000000000000000 P 24369b54bb044e73b317e8452914980e [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 8f9f4dfbae09418b968427a8264da4c8 (127.25.188.60:39957): Network error: Client connection negotiation failed: client connection to 127.25.188.60:39957: connect: Connection refused (error 111)
08:07:31.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.323028 27797 consensus_queue.cc:237] T 00000000000000000000000000000000 P 24369b54bb044e73b317e8452914980e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24369b54bb044e73b317e8452914980e" member_type: VOTER last_known_addr { host: "127.25.188.62" port: 34681 } } peers { permanent_uuid: "c6e4ef8a98eb452cb3b3b247f68bb112" member_type: VOTER last_known_addr { host: "127.25.188.61" port: 37789 } } peers { permanent_uuid: "8f9f4dfbae09418b968427a8264da4c8" member_type: VOTER last_known_addr { host: "127.25.188.60" port: 39957 } }
08:07:31.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:31.326110 26405 leader_election.cc:334] T 00000000000000000000000000000000 P 24369b54bb044e73b317e8452914980e [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 8f9f4dfbae09418b968427a8264da4c8 (127.25.188.60:39957): Network error: Client connection negotiation failed: client connection to 127.25.188.60:39957: connect: Connection refused (error 111)
08:07:31.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.328263 27794 sys_catalog.cc:455] T 00000000000000000000000000000000 P 24369b54bb044e73b317e8452914980e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 24369b54bb044e73b317e8452914980e. Latest consensus state: current_term: 2 leader_uuid: "24369b54bb044e73b317e8452914980e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24369b54bb044e73b317e8452914980e" member_type: VOTER last_known_addr { host: "127.25.188.62" port: 34681 } } peers { permanent_uuid: "c6e4ef8a98eb452cb3b3b247f68bb112" member_type: VOTER last_known_addr { host: "127.25.188.61" port: 37789 } } peers { permanent_uuid: "8f9f4dfbae09418b968427a8264da4c8" member_type: VOTER last_known_addr { host: "127.25.188.60" port: 39957 } } }
08:07:31.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.329067 27794 sys_catalog.cc:458] T 00000000000000000000000000000000 P 24369b54bb044e73b317e8452914980e [sys.catalog]: This master's current role is: LEADER
08:07:31.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.330899 27803 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
08:07:31.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.338613 27803 catalog_manager.cc:669] Loaded metadata for table org.apache.kudu.client.TestClientFailoverSupport-RESTART [id=9ad88cfd45724ef6916b5734a1a2504c]
08:07:31.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.343334 27803 tablet_loader.cc:96] loaded metadata for tablet bbe8b447b807421f9bf69b944f9d6d62 (table org.apache.kudu.client.TestClientFailoverSupport-RESTART [id=9ad88cfd45724ef6916b5734a1a2504c])
08:07:31.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.344233 27803 catalog_manager.cc:1484] Initializing Kudu cluster ID...
08:07:31.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.347347 27803 catalog_manager.cc:1259] Loaded cluster ID: f4dc253ee82f4b4897e4af3956f95b93
08:07:31.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.347724 27803 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
08:07:31.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.351966 27803 catalog_manager.cc:1504] Loading token signing keys...
08:07:31.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.354727 27803 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 24369b54bb044e73b317e8452914980e: Loaded TSK: 0
08:07:31.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.355906 27803 catalog_manager.cc:1514] Initializing in-progress tserver states...
08:07:31.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:30.342943 27760 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:31.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:30.343906 27768 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:07:31.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:31.568959 27766 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
08:07:31.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.569052 27751 server_base.cc:1029] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:07:31.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.573232 27751 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:07:31.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.576939 27751 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:07:31.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.578428 27751 hybrid_clock.cc:648] HybridClock initialized: now 1786522051578395 us; error 53 us; skew 500 ppm
08:07:31.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.579309 27751 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:07:31.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.586854 27751 webserver.cc:460] Webserver started at http://127.25.188.60:36127/ using document root <none> and password file <none>
08:07:31.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.587950 27751 fs_manager.cc:359] Metadata directory not provided
08:07:31.588 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.588228 27751 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:07:31.597 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.596937 27751 fs_manager.cc:709] Time spent opening directory manager: real 0.006s	user 0.003s	sys 0.003s
08:07:31.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.602283 27811 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:07:31.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.603724 27751 fs_manager.cc:725] Time spent opening block manager: real 0.004s	user 0.001s	sys 0.002s
08:07:31.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.604043 27751 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/master-2/data,/tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/master-2/wal
08:07:31.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "8f9f4dfbae09418b968427a8264da4c8"
08:07:31.606 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-12 08:07:21 on dist-test-slave-f0tn"
08:07:31.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.606662 27751 fs_report.cc:383] FS layout report
08:07:31.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:07:31.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/master-2/wal
08:07:31.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/master-2/wal
08:07:31.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/master-2/data/data
08:07:31.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:07:31.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:07:31.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:07:31.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:07:31.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:07:31.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:07:31.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:07:31.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:07:31.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:07:31.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:07:31.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:07:31.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.648521 27751 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
08:07:31.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.650182 27751 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:07:31.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.650689 27751 kserver.cc:163] Server-wide thread pool size limit: 3276
08:07:31.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:31.719609 26405 consensus_peers.cc:487] T 00000000000000000000000000000000 P 24369b54bb044e73b317e8452914980e -> Peer 8f9f4dfbae09418b968427a8264da4c8 (127.25.188.60:39957): Couldn't send request to peer 8f9f4dfbae09418b968427a8264da4c8. Status: Network error: Client connection negotiation failed: client connection to 127.25.188.60:39957: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
08:07:31.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.805181 27751 rpc_server.cc:307] RPC server started. Bound to: 127.25.188.60:39957
08:07:31.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.805395 27902 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.25.188.60:39957 every 8 connection(s)
08:07:31.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.808359 27751 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskgk96or/test-tmp/mini-kudu-cluster4171529790767772751/master-2/data/info.pb
08:07:31.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.814074 26352 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskgk96or/build/tsan/bin/kudu as pid 27751
08:07:31.815 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
08:07:31.815 [INFO - Time-limited test] (MiniKuduCluster.java:475) Killing tablet server 127.25.188.2:35231
08:07:31.816 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: stop_daemon {
  id {
    type: TSERVER
    index: 1
  }
}

08:07:31.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.816416 26352 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgk96or/build/tsan/bin/kudu with pid 27144
08:07:31.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.825819 27904 sys_catalog.cc:263] Verifying existing consensus state
08:07:31.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.833519 27904 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8f9f4dfbae09418b968427a8264da4c8: Bootstrap starting.
08:07:31.875 [DEBUG - kudu-nio-1] (Connection.java:239) [peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231)] handling channelInactive
08:07:31.875 [DEBUG - kudu-nio-1] (Connection.java:709) [peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231)] cleaning up while in state READY due to: connection closed
08:07:31.875 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
08:07:31.876 [DEBUG - Time-limited test] (Connection.java:748) [peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231)] connecting to peer
08:07:31.878 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231): Connection refused: /127.25.188.2:35231
08:07:31.878 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231)] cleaning up while in state CONNECTING due to: Failed to connect to peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231): Connection refused: /127.25.188.2:35231
08:07:31.879 [INFO - kudu-nio-0] (AsyncKuduClient.java:2355) Invalidating location 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231) for tablet bbe8b447b807421f9bf69b944f9d6d62: Failed to connect to peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231): Connection refused: /127.25.188.2:35231
08:07:31.882 [DEBUG - pool-6-thread-1] (Connection.java:748) [peer master-127.25.188.60:39957(127.25.188.60:39957)] connecting to peer
08:07:31.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.882975 27904 log.cc:824] T 00000000000000000000000000000000 P 8f9f4dfbae09418b968427a8264da4c8: Log is configured to *not* fsync() on all Append() calls
08:07:31.886 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.25.188.60:39957(127.25.188.60:39957)] Successfully connected to peer
08:07:31.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.888218 26578 raft_consensus.cc:1261] T 00000000000000000000000000000000 P c6e4ef8a98eb452cb3b3b247f68bb112 [term 2 FOLLOWER]: Refusing update from remote peer 24369b54bb044e73b317e8452914980e: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 2 index: 8. (index mismatch)
08:07:31.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.890043 27794 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 24369b54bb044e73b317e8452914980e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6e4ef8a98eb452cb3b3b247f68bb112" member_type: VOTER last_known_addr { host: "127.25.188.61" port: 37789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
08:07:31.896 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.25.188.60
08:07:31.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.895663 27913 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6e4ef8a98eb452cb3b3b247f68bb112 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 24369b54bb044e73b317e8452914980e. Latest consensus state: current_term: 2 leader_uuid: "24369b54bb044e73b317e8452914980e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24369b54bb044e73b317e8452914980e" member_type: VOTER last_known_addr { host: "127.25.188.62" port: 34681 } } peers { permanent_uuid: "c6e4ef8a98eb452cb3b3b247f68bb112" member_type: VOTER last_known_addr { host: "127.25.188.61" port: 37789 } } peers { permanent_uuid: "8f9f4dfbae09418b968427a8264da4c8" member_type: VOTER last_known_addr { host: "127.25.188.60" port: 39957 } } }
08:07:31.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.896417 27913 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6e4ef8a98eb452cb3b3b247f68bb112 [sys.catalog]: This master's current role is: FOLLOWER
08:07:31.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.917903 27904 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8f9f4dfbae09418b968427a8264da4c8: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=5 ignored=0} mutations{seen=2 ignored=0} orphaned_commits=0. Pending: 0 replicates
08:07:31.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.919135 27904 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8f9f4dfbae09418b968427a8264da4c8: Bootstrap complete.
08:07:31.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.927731 27917 sys_catalog.cc:455] T 00000000000000000000000000000000 P 24369b54bb044e73b317e8452914980e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "24369b54bb044e73b317e8452914980e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24369b54bb044e73b317e8452914980e" member_type: VOTER last_known_addr { host: "127.25.188.62" port: 34681 } } peers { permanent_uuid: "c6e4ef8a98eb452cb3b3b247f68bb112" member_type: VOTER last_known_addr { host: "127.25.188.61" port: 37789 } } peers { permanent_uuid: "8f9f4dfbae09418b968427a8264da4c8" member_type: VOTER last_known_addr { host: "127.25.188.60" port: 39957 } } }
08:07:31.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.928886 27917 sys_catalog.cc:458] T 00000000000000000000000000000000 P 24369b54bb044e73b317e8452914980e [sys.catalog]: This master's current role is: LEADER
08:07:31.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.932272 27913 sys_catalog.cc:455] T 00000000000000000000000000000000 P c6e4ef8a98eb452cb3b3b247f68bb112 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "24369b54bb044e73b317e8452914980e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24369b54bb044e73b317e8452914980e" member_type: VOTER last_known_addr { host: "127.25.188.62" port: 34681 } } peers { permanent_uuid: "c6e4ef8a98eb452cb3b3b247f68bb112" member_type: VOTER last_known_addr { host: "127.25.188.61" port: 37789 } } peers { permanent_uuid: "8f9f4dfbae09418b968427a8264da4c8" member_type: VOTER last_known_addr { host: "127.25.188.60" port: 39957 } } }
08:07:31.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.932999 27913 sys_catalog.cc:458] T 00000000000000000000000000000000 P c6e4ef8a98eb452cb3b3b247f68bb112 [sys.catalog]: This master's current role is: FOLLOWER
08:07:31.938 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x337c6af8, L:/127.0.0.1:53728 - R:/127.25.188.60:39957] using SASL/PLAIN
08:07:31.942 [DEBUG - kudu-nio-1] (RemoteTablet.java:166) master-127.25.188.60:39957 was demoted as the leader for Kudu Master
08:07:31.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.953368 27904 raft_consensus.cc:348] T 00000000000000000000000000000000 P 8f9f4dfbae09418b968427a8264da4c8 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24369b54bb044e73b317e8452914980e" member_type: VOTER last_known_addr { host: "127.25.188.62" port: 34681 } } peers { permanent_uuid: "c6e4ef8a98eb452cb3b3b247f68bb112" member_type: VOTER last_known_addr { host: "127.25.188.61" port: 37789 } } peers { permanent_uuid: "8f9f4dfbae09418b968427a8264da4c8" member_type: VOTER last_known_addr { host: "127.25.188.60" port: 39957 } }
08:07:31.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.956923 27904 raft_consensus.cc:729] T 00000000000000000000000000000000 P 8f9f4dfbae09418b968427a8264da4c8 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8f9f4dfbae09418b968427a8264da4c8, State: Initialized, Role: FOLLOWER
08:07:31.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.957970 27904 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8f9f4dfbae09418b968427a8264da4c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24369b54bb044e73b317e8452914980e" member_type: VOTER last_known_addr { host: "127.25.188.62" port: 34681 } } peers { permanent_uuid: "c6e4ef8a98eb452cb3b3b247f68bb112" member_type: VOTER last_known_addr { host: "127.25.188.61" port: 37789 } } peers { permanent_uuid: "8f9f4dfbae09418b968427a8264da4c8" member_type: VOTER last_known_addr { host: "127.25.188.60" port: 39957 } }
08:07:31.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.960470 27929 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8f9f4dfbae09418b968427a8264da4c8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24369b54bb044e73b317e8452914980e" member_type: VOTER last_known_addr { host: "127.25.188.62" port: 34681 } } peers { permanent_uuid: "c6e4ef8a98eb452cb3b3b247f68bb112" member_type: VOTER last_known_addr { host: "127.25.188.61" port: 37789 } } peers { permanent_uuid: "8f9f4dfbae09418b968427a8264da4c8" member_type: VOTER last_known_addr { host: "127.25.188.60" port: 39957 } } }
08:07:31.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.961122 27929 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8f9f4dfbae09418b968427a8264da4c8 [sys.catalog]: This master's current role is: FOLLOWER
08:07:31.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.961928 27904 sys_catalog.cc:564] T 00000000000000000000000000000000 P 8f9f4dfbae09418b968427a8264da4c8 [sys.catalog]: configured and running, proceeding with master startup.
08:07:31.969 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:07:31.970 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableLocations, tablet=Kudu Master, attempt=2, TimeoutTracker(timeout=29994, elapsed=87), Traces: [0ms] sending RPC to server master-127.25.188.60:39957, [60ms] delaying RPC due to: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [60ms] received response from server master-127.25.188.60:39957: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [80ms] refreshing cache from master, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.188.61:37789, [80ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.188.62:34681, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.188.60:39957, [85ms] Sub RPC ConnectToMaster: received response from server master-127.25.188.61:37789: OK, [86ms] Sub RPC ConnectToMaster: received response from server master-127.25.188.62:34681: OK, deferred=Deferred@927174898(state=PENDING, result=null, callback=get tablet locations from the master for table org.apache.kudu.client.TestClientFailoverSupport-RESTART -> release master lookup permit -> retry RPC, errback=passthrough -> release master lookup permit -> retry RPC after error)) after lookup
08:07:31.972 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.25.188.60:39957: Catalog manager is not initialized. State: Starting
08:07:31.975 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet bbe8b447b807421f9bf69b944f9d6d62 for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
08:07:31.975 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=bbe8b447b807421f9bf69b944f9d6d62@[66c5262333af49538a7ebf357438d66a(127.25.188.2:35231)[L],a86097c640f8443fa8e30feea68f203c(127.25.188.3:39859),cd9ec0d9af0a4e0caabe63c9dd03697a(127.25.188.1:38437)]}]
08:07:31.976 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=bbe8b447b807421f9bf69b944f9d6d62, attempt=2, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=99), Traces: [0ms] sending RPC to server 66c5262333af49538a7ebf357438d66a, [2ms] received response from server 66c5262333af49538a7ebf357438d66a: Network error: Failed to connect to peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231): Connection refused: /127.25.188.2:35231, [3ms] delaying RPC due to: Network error: Failed to connect to peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231): Connection refused: /127.25.188.2:35231, [6ms] refreshing cache from master, [6ms] Sub RPC GetTableLocations: sending RPC to server master-127.25.188.60:39957, [66ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [66ms] Sub RPC GetTableLocations: received response from server master-127.25.188.60:39957: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [86ms] Sub RPC GetTableLocations: refreshing cache from master, [86ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.188.61:37789, [86ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.188.62:34681, [87ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.188.60:39957, [91ms] Sub RPC ConnectToMaster: received response from server master-127.25.188.61:37789: OK, [92ms] Sub RPC ConnectToMaster: received response from server master-127.25.188.62:34681: OK, [94ms] Sub RPC GetTableLocations: sending RPC to server master-127.25.188.62:34681, [96ms] Sub RPC ConnectToMaster: received response from server master-127.25.188.60:39957: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [98ms] Sub RPC GetTableLocations: received response from server master-127.25.188.62:34681: OK, deferred=Deferred@333830016(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$83/1604193830@1d86be2c -> passthrough -> wakeup thread Time-limited test, errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@3669696e -> wakeup thread Time-limited test)) after lookup
08:07:31.976 [DEBUG - kudu-nio-1] (Connection.java:748) [peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231)] connecting to peer
08:07:31.979 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231): Connection refused: /127.25.188.2:35231
08:07:31.979 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231)] cleaning up while in state CONNECTING due to: Failed to connect to peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231): Connection refused: /127.25.188.2:35231
08:07:31.979 [INFO - kudu-nio-0] (AsyncKuduClient.java:2355) Invalidating location 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231) for tablet bbe8b447b807421f9bf69b944f9d6d62: Failed to connect to peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231): Connection refused: /127.25.188.2:35231
08:07:31.995 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.995424 27943 catalog_manager.cc:1259] Loaded cluster ID: f4dc253ee82f4b4897e4af3956f95b93
08:07:31.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:31.995718 27943 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 8f9f4dfbae09418b968427a8264da4c8: loading cluster ID for follower catalog manager: success
08:07:32.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:32.002238 27943 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 8f9f4dfbae09418b968427a8264da4c8: acquiring CA information for follower catalog manager: success
08:07:32.008 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet bbe8b447b807421f9bf69b944f9d6d62 for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
08:07:32.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:32.007750 27943 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 8f9f4dfbae09418b968427a8264da4c8: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
08:07:32.008 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=bbe8b447b807421f9bf69b944f9d6d62@[66c5262333af49538a7ebf357438d66a(127.25.188.2:35231)[L],a86097c640f8443fa8e30feea68f203c(127.25.188.3:39859),cd9ec0d9af0a4e0caabe63c9dd03697a(127.25.188.1:38437)]}]
08:07:32.009 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=bbe8b447b807421f9bf69b944f9d6d62, attempt=4, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=133), Traces: [0ms] sending RPC to server 66c5262333af49538a7ebf357438d66a, [2ms] received response from server 66c5262333af49538a7ebf357438d66a: Network error: Failed to connect to peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231): Connection refused: /127.25.188.2:35231, [3ms] delaying RPC due to: Network error: Failed to connect to peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231): Connection refused: /127.25.188.2:35231, [6ms] refreshing cache from master, [6ms] Sub RPC GetTableLocations: sending RPC to server master-127.25.188.60:39957, [66ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [66ms] Sub RPC GetTableLocations: received response from server master-127.25.188.60:39957: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [86ms] Sub RPC GetTableLocations: refreshing cache from master, [86ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.188.61:37789, [86ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.188.62:34681, [87ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.188.60:39957, [91ms] Sub RPC ConnectToMaster: received response from server master-127.25.188.61:37789: OK, [92ms] Sub RPC ConnectToMaster: received response from server master-127.25.188.62:34681: OK, [94ms] Sub RPC GetTableLocations: sending RPC to server master-127.25.188.62:34681, [96ms] Sub RPC ConnectToMaster: received response from server master-127.25.188.60:39957: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [98ms] Sub RPC GetTableLocations: received response from server master-127.25.188.62:34681: OK, [100ms] sending RPC to server 66c5262333af49538a7ebf357438d66a, [103ms] received response from server 66c5262333af49538a7ebf357438d66a: Network error: Failed to connect to peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231): Connection refused: /127.25.188.2:35231, [104ms] delaying RPC due to: Network error: Failed to connect to peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231): Connection refused: /127.25.188.2:35231, [126ms] refreshing cache from master, [127ms] Sub RPC GetTableLocations: sending RPC to server master-127.25.188.62:34681, [131ms] Sub RPC GetTableLocations: received response from server master-127.25.188.62:34681: OK, deferred=Deferred@333830016(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$83/1604193830@1d86be2c -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@927174898 after retry RPC@639249554), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@3669696e -> wakeup thread Time-limited test -> (continuation of Deferred@927174898 after retry RPC@639249554))) after lookup
08:07:32.010 [DEBUG - kudu-nio-1] (Connection.java:748) [peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231)] connecting to peer
08:07:32.011 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231): Connection refused: /127.25.188.2:35231
08:07:32.011 [DEBUG - kudu-nio-1] (Connection.java:709) [peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231)] cleaning up while in state CONNECTING due to: Failed to connect to peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231): Connection refused: /127.25.188.2:35231
08:07:32.012 [INFO - kudu-nio-1] (AsyncKuduClient.java:2355) Invalidating location 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231) for tablet bbe8b447b807421f9bf69b944f9d6d62: Failed to connect to peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231): Connection refused: /127.25.188.2:35231
08:07:32.048 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet bbe8b447b807421f9bf69b944f9d6d62 for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
08:07:32.048 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=bbe8b447b807421f9bf69b944f9d6d62@[66c5262333af49538a7ebf357438d66a(127.25.188.2:35231)[L],a86097c640f8443fa8e30feea68f203c(127.25.188.3:39859),cd9ec0d9af0a4e0caabe63c9dd03697a(127.25.188.1:38437)]}]
08:07:32.050 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=bbe8b447b807421f9bf69b944f9d6d62, attempt=6, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=172), Traces: [0ms] sending RPC to server 66c5262333af49538a7ebf357438d66a, [2ms] received response from server 66c5262333af49538a7ebf357438d66a: Network error: Failed to connect to peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231): Connection refused: /127.25.188.2:35231, [3ms] delaying RPC due to: Network error: Failed to connect to peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231): Connection refused: /127.25.188.2:35231, [6ms] refreshing cache from master, [6ms] Sub RPC GetTableLocations: sending RPC to server master-127.25.188.60:39957, [66ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [66ms] Sub RPC GetTableLocations: received response from server master-127.25.188.60:39957: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [86ms] Sub RPC GetTableLocations: refreshing cache from master, [86ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.188.61:37789, [86ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.188.62:34681, [87ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.188.60:39957, [91ms] Sub RPC ConnectToMaster: received response from server master-127.25.188.61:37789: OK, [92ms] Sub RPC ConnectToMaster: received response from server master-127.25.188.62:34681: OK, [94ms] Sub RPC GetTableLocations: sending RPC to server master-127.25.188.62:34681, [96ms] Sub RPC ConnectToMaster: received response from server master-127.25.188.60:39957: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [98ms] Sub RPC GetTableLocations: received response from server master-127.25.188.62:34681: OK, [100ms] sending RPC to server 66c5262333af49538a7ebf357438d66a, [103ms] received response from server 66c5262333af49538a7ebf357438d66a: Network error: Failed to connect to peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231): Connection refused: /127.25.188.2:35231, [104ms] delaying RPC due to: Network error: Failed to connect to peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231): Connection refused: /127.25.188.2:35231, [126ms] refreshing cache from master, [127ms] Sub RPC GetTableLocations: sending RPC to server master-127.25.188.62:34681, [131ms] Sub RPC GetTableLocations: received response from server master-127.25.188.62:34681: OK, [134ms] sending RPC to server 66c5262333af49538a7ebf357438d66a, [135ms] received response from server 66c5262333af49538a7ebf357438d66a: Network error: Failed to connect to peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231): Connection refused: /127.25.188.2:35231, [136ms] delaying RPC due to: Network error: Failed to connect to peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231): Connection refused: /127.25.188.2:35231, [167ms] refreshing cache from master, [167ms] Sub RPC GetTableLocations: sending RPC to server master-127.25.188.62:34681, [171ms] Sub RPC GetTableLocations: received response from server master-127.25.188.62:34681: OK, deferred=Deferred@333830016(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$83/1604193830@1d86be2c -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@927174898 after retry RPC@639249554) -> (continuation of Deferred@1180668464 after retry RPC@2115303547), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@3669696e -> wakeup thread Time-limited test -> (continuation of Deferred@927174898 after retry RPC@639249554) -> (continuation of Deferred@1180668464 after retry RPC@2115303547))) after lookup
08:07:32.051 [DEBUG - kudu-nio-1] (Connection.java:748) [peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231)] connecting to peer
08:07:32.052 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231): Connection refused: /127.25.188.2:35231
08:07:32.052 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231)] cleaning up while in state CONNECTING due to: Failed to connect to peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231): Connection refused: /127.25.188.2:35231
08:07:32.053 [INFO - kudu-nio-0] (AsyncKuduClient.java:2355) Invalidating location 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231) for tablet bbe8b447b807421f9bf69b944f9d6d62: Failed to connect to peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231): Connection refused: /127.25.188.2:35231
08:07:32.066 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet bbe8b447b807421f9bf69b944f9d6d62 for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
08:07:32.067 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=bbe8b447b807421f9bf69b944f9d6d62@[66c5262333af49538a7ebf357438d66a(127.25.188.2:35231)[L],a86097c640f8443fa8e30feea68f203c(127.25.188.3:39859),cd9ec0d9af0a4e0caabe63c9dd03697a(127.25.188.1:38437)]}]
08:07:32.068 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=bbe8b447b807421f9bf69b944f9d6d62, attempt=8, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=191), Traces: [0ms] sending RPC to server 66c5262333af49538a7ebf357438d66a, [2ms] received response from server 66c5262333af49538a7ebf357438d66a: Network error: Failed to connect to peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231): Connection refused: /127.25.188.2:35231, [3ms] delaying RPC due to: Network error: Failed to connect to peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231): Connection refused: /127.25.188.2:35231, [6ms] refreshing cache from master, [6ms] Sub RPC GetTableLocations: sending RPC to server master-127.25.188.60:39957, [66ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [66ms] Sub RPC GetTableLocations: received response from server master-127.25.188.60:39957: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [86ms] Sub RPC GetTableLocations: refreshing cache from master, [86ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.188.61:37789, [86ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.188.62:34681, [87ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.188.60:39957, [91ms] Sub RPC ConnectToMaster: received response from server master-127.25.188.61:37789: OK, [92ms] Sub RPC ConnectToMaster: received response from server master-127.25.188.62:34681: OK, [94ms] Sub RPC GetTableLocations: sending RPC to server master-127.25.188.62:34681, [96ms] Sub RPC ConnectToMaster: received response from server master-127.25.188.60:39957: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [98ms] Sub RPC GetTableLocations: received response from server master-127.25.188.62:34681: OK, [100ms] sending RPC to server 66c5262333af49538a7ebf357438d66a, [103ms] received response from server 66c5262333af49538a7ebf357438d66a: Network error: Failed to connect to peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231): Connection refused: /127.25.188.2:35231, [104ms] delaying RPC due to: Network error: Failed to connect to peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231): Connection refused: /127.25.188.2:35231, [126ms] refreshing cache from master, [127ms] Sub RPC GetTableLocations: sending RPC to server master-127.25.188.62:34681, [131ms] Sub RPC GetTableLocations: received response from server master-127.25.188.62:34681: OK, [134ms] sending RPC to server 66c5262333af49538a7ebf357438d66a, [135ms] received response from server 66c5262333af49538a7ebf357438d66a: Network error: Failed to connect to peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231): Connection refused: /127.25.188.2:35231, [136ms] delaying RPC due to: Network error: Failed to connect to peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231): Connection refused: /127.25.188.2:35231, [167ms] refreshing cache from master, [167ms] Sub RPC GetTableLocations: sending RPC to server master-127.25.188.62:34681, [171ms] Sub RPC GetTableLocations: received response from server master-127.25.188.62:34681: OK, [174ms] sending RPC to server 66c5262333af49538a7ebf357438d66a, [177ms] received response from server 66c5262333af49538a7ebf357438d66a: Network error: Failed to connect to peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231): Connection refused: /127.25.188.2:35231, [177ms] delaying RPC due to: Network error: Failed to connect to peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231): Connection refused: /127.25.188.2:35231, [186ms] refreshing cache from master, [186ms] Sub RPC GetTableLocations: sending RPC to server master-127.25.188.62:34681, [190ms] Sub RPC GetTableLocations: received response from server master-127.25.188.62:34681: OK, deferred=Deferred@333830016(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$83/1604193830@1d86be2c -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@927174898 after retry RPC@639249554) -> (continuation of Deferred@1180668464 after retry RPC@2115303547) -> (continuation of Deferred@2097362299 after retry RPC@613272960), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@3669696e -> wakeup thread Time-limited test -> (continuation of Deferred@927174898 after retry RPC@639249554) -> (continuation of Deferred@1180668464 after retry RPC@2115303547) -> (continuation of Deferred@2097362299 after retry RPC@613272960))) after lookup
08:07:32.069 [DEBUG - kudu-nio-1] (Connection.java:748) [peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231)] connecting to peer
08:07:32.070 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231): Connection refused: /127.25.188.2:35231
08:07:32.070 [DEBUG - kudu-nio-1] (Connection.java:709) [peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231)] cleaning up while in state CONNECTING due to: Failed to connect to peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231): Connection refused: /127.25.188.2:35231
08:07:32.070 [INFO - kudu-nio-1] (AsyncKuduClient.java:2355) Invalidating location 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231) for tablet bbe8b447b807421f9bf69b944f9d6d62: Failed to connect to peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231): Connection refused: /127.25.188.2:35231
08:07:32.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:32.314133 27858 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 8f9f4dfbae09418b968427a8264da4c8 [term 1 FOLLOWER]: Advancing to term 2
08:07:32.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:32.330924 27958 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8f9f4dfbae09418b968427a8264da4c8 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "24369b54bb044e73b317e8452914980e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24369b54bb044e73b317e8452914980e" member_type: VOTER last_known_addr { host: "127.25.188.62" port: 34681 } } peers { permanent_uuid: "c6e4ef8a98eb452cb3b3b247f68bb112" member_type: VOTER last_known_addr { host: "127.25.188.61" port: 37789 } } peers { permanent_uuid: "8f9f4dfbae09418b968427a8264da4c8" member_type: VOTER last_known_addr { host: "127.25.188.60" port: 39957 } } }
08:07:32.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:32.332265 27958 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8f9f4dfbae09418b968427a8264da4c8 [sys.catalog]: This master's current role is: FOLLOWER
08:07:32.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:32.336503 27929 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8f9f4dfbae09418b968427a8264da4c8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 24369b54bb044e73b317e8452914980e. Latest consensus state: current_term: 2 leader_uuid: "24369b54bb044e73b317e8452914980e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24369b54bb044e73b317e8452914980e" member_type: VOTER last_known_addr { host: "127.25.188.62" port: 34681 } } peers { permanent_uuid: "c6e4ef8a98eb452cb3b3b247f68bb112" member_type: VOTER last_known_addr { host: "127.25.188.61" port: 37789 } } peers { permanent_uuid: "8f9f4dfbae09418b968427a8264da4c8" member_type: VOTER last_known_addr { host: "127.25.188.60" port: 39957 } } }
08:07:32.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:32.337268 27929 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8f9f4dfbae09418b968427a8264da4c8 [sys.catalog]: This master's current role is: FOLLOWER
08:07:32.447 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet bbe8b447b807421f9bf69b944f9d6d62 for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
08:07:32.448 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=bbe8b447b807421f9bf69b944f9d6d62@[66c5262333af49538a7ebf357438d66a(127.25.188.2:35231)[L],a86097c640f8443fa8e30feea68f203c(127.25.188.3:39859),cd9ec0d9af0a4e0caabe63c9dd03697a(127.25.188.1:38437)]}]
08:07:32.448 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=bbe8b447b807421f9bf69b944f9d6d62, attempt=10, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=572), Traces: [0ms] sending RPC to server 66c5262333af49538a7ebf357438d66a, [2ms] received response from server 66c5262333af49538a7ebf357438d66a: Network error: Failed to connect to peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231): Connection refused: /127.25.188.2:35231, [3ms] delaying RPC due to: Network error: Failed to connect to peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231): Connection refused: /127.25.188.2:35231, [6ms] refreshing cache from master, [6ms] Sub RPC GetTableLocations: sending RPC to server master-127.25.188.60:39957, [66ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [66ms] Sub RPC GetTableLocations: received response from server master-127.25.188.60:39957: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [86ms] Sub RPC GetTableLocations: refreshing cache from master, [86ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.188.61:37789, [86ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.188.62:34681, [87ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.188.60:39957, [91ms] Sub RPC ConnectToMaster: received response from server master-127.25.188.61:37789: OK, [92ms] Sub RPC ConnectToMaster: received response from server master-127.25.188.62:34681: OK, [94ms] Sub RPC GetTableLocations: sending RPC to server master-127.25.188.62:34681, [96ms] Sub RPC ConnectToMaster: received response from server master-127.25.188.60:39957: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [98ms] Sub RPC GetTableLocations: received response from server master-127.25.188.62:34681: OK, [100ms] sending RPC to server 66c5262333af49538a7ebf357438d66a, [103ms] received response from server 66c5262333af49538a7ebf357438d66a: Network error: Failed to connect to peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231): Connection refused: /127.25.188.2:35231, [104ms] delaying RPC due to: Network error: Failed to connect to peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231): Connection refused: /127.25.188.2:35231, [126ms] refreshing cache from master, [127ms] Sub RPC GetTableLocations: sending RPC to server master-127.25.188.62:34681, [131ms] Sub RPC GetTableLocations: received response from server master-127.25.188.62:34681: OK, [134ms] sending RPC to server 66c5262333af49538a7ebf357438d66a, [135ms] received response from server 66c5262333af49538a7ebf357438d66a: Network error: Failed to connect to peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231): Connection refused: /127.25.188.2:35231, [136ms] delaying RPC due to: Network error: Failed to connect to peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231): Connection refused: /127.25.188.2:35231, [167ms] refreshing cache from master, [167ms] Sub RPC GetTableLocations: sending RPC to server master-127.25.188.62:34681, [171ms] Sub RPC GetTableLocations: received response from server master-127.25.188.62:34681: OK, [174ms] sending RPC to server 66c5262333af49538a7ebf357438d66a, [177ms] received response from server 66c5262333af49538a7ebf357438d66a: Network error: Failed to connect to peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231): Connection refused: /127.25.188.2:35231, [177ms] delaying RPC due to: Network error: Failed to connect to peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231): Connection refused: /127.25.188.2:35231, [186ms] refreshing cache from master, [186ms] Sub RPC GetTableLocations: sending RPC to server master-127.25.188.62:34681, [190ms] Sub RPC GetTableLocations: received response from server master-127.25.188.62:34681: OK, [192ms] sending RPC to server 66c5262333af49538a7ebf357438d66a, [194ms] received response from server 66c5262333af49538a7ebf357438d66a: Network error: Failed to connect to peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231): Connection refused: /127.25.188.2:35231, [194ms] delaying RPC due to: Network error: Failed to connect to peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231): Connection refused: /127.25.188.2:35231, [567ms] refreshing cache from master, [567ms] Sub RPC GetTableLocations: sending RPC to server master-127.25.188.62:34681, [571ms] Sub RPC GetTableLocations: received response from server master-127.25.188.62:34681: OK, deferred=Deferred@333830016(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$83/1604193830@1d86be2c -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@927174898 after retry RPC@639249554) -> (continuation of Deferred@1180668464 after retry RPC@2115303547) -> (continuation of Deferred@2097362299 after retry RPC@613272960) -> (continuation of Deferred@741028153 after retry RPC@89397051), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@3669696e -> wakeup thread Time-limited test -> (continuation of Deferred@927174898 after retry RPC@639249554) -> (continuation of Deferred@1180668464 after retry RPC@2115303547) -> (continuation of Deferred@2097362299 after retry RPC@613272960) -> (continuation of Deferred@741028153 after retry RPC@89397051))) after lookup
08:07:32.449 [DEBUG - kudu-nio-1] (Connection.java:748) [peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231)] connecting to peer
08:07:32.451 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231): Connection refused: /127.25.188.2:35231
08:07:32.451 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231)] cleaning up while in state CONNECTING due to: Failed to connect to peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231): Connection refused: /127.25.188.2:35231
08:07:32.451 [INFO - kudu-nio-0] (AsyncKuduClient.java:2355) Invalidating location 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231) for tablet bbe8b447b807421f9bf69b944f9d6d62: Failed to connect to peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231): Connection refused: /127.25.188.2:35231
08:07:32.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:32.674871 27658 heartbeater.cc:503] Master 127.25.188.62:34681 was elected leader, sending a full tablet report...
08:07:32.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:32.684845 27128 heartbeater.cc:503] Master 127.25.188.62:34681 was elected leader, sending a full tablet report...
08:07:32.752 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:32.752070 27654 heartbeater.cc:347] Connected to a master server at 127.25.188.60:39957
08:07:32.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:32.754144 27123 heartbeater.cc:347] Connected to a master server at 127.25.188.60:39957
08:07:32.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:32.759676 27840 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "a86097c640f8443fa8e30feea68f203c" instance_seqno: 1786522048661435) as {username='slave'} at 127.25.188.3:49689; Asking this server to re-register.
08:07:32.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:32.759725 27837 master_service.cc:432] Got heartbeat from unknown tserver (permanent_uuid: "cd9ec0d9af0a4e0caabe63c9dd03697a" instance_seqno: 1786522044691671) as {username='slave'} at 127.25.188.1:58327; Asking this server to re-register.
08:07:32.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:32.761451 27654 heartbeater.cc:464] Registering TS with master...
08:07:32.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:32.761561 27123 heartbeater.cc:464] Registering TS with master...
08:07:32.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:32.765543 27837 ts_manager.cc:194] Registered new tserver with Master: cd9ec0d9af0a4e0caabe63c9dd03697a (127.25.188.1:38437)
08:07:32.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:32.765730 27840 ts_manager.cc:194] Registered new tserver with Master: a86097c640f8443fa8e30feea68f203c (127.25.188.3:39859)
08:07:32.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:32.795706 27968 raft_consensus.cc:482] T bbe8b447b807421f9bf69b944f9d6d62 P a86097c640f8443fa8e30feea68f203c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66c5262333af49538a7ebf357438d66a)
08:07:32.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:32.796149 27968 raft_consensus.cc:504] T bbe8b447b807421f9bf69b944f9d6d62 P a86097c640f8443fa8e30feea68f203c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a86097c640f8443fa8e30feea68f203c" member_type: VOTER last_known_addr { host: "127.25.188.3" port: 39859 } } peers { permanent_uuid: "66c5262333af49538a7ebf357438d66a" member_type: VOTER last_known_addr { host: "127.25.188.2" port: 35231 } } peers { permanent_uuid: "cd9ec0d9af0a4e0caabe63c9dd03697a" member_type: VOTER last_known_addr { host: "127.25.188.1" port: 38437 } }
08:07:32.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:32.798570 27968 leader_election.cc:288] T bbe8b447b807421f9bf69b944f9d6d62 P a86097c640f8443fa8e30feea68f203c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66c5262333af49538a7ebf357438d66a (127.25.188.2:35231), cd9ec0d9af0a4e0caabe63c9dd03697a (127.25.188.1:38437)
08:07:32.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:32.800343 27446 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.188.2:35231: connect: Connection refused (error 111)
08:07:32.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:32.822957 27446 leader_election.cc:334] T bbe8b447b807421f9bf69b944f9d6d62 P a86097c640f8443fa8e30feea68f203c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 66c5262333af49538a7ebf357438d66a (127.25.188.2:35231): Network error: Client connection negotiation failed: client connection to 127.25.188.2:35231: connect: Connection refused (error 111)
08:07:32.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:32.827369 27046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbe8b447b807421f9bf69b944f9d6d62" candidate_uuid: "a86097c640f8443fa8e30feea68f203c" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "cd9ec0d9af0a4e0caabe63c9dd03697a" is_pre_election: true
08:07:32.829 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:32.828966 27446 leader_election.cc:302] T bbe8b447b807421f9bf69b944f9d6d62 P a86097c640f8443fa8e30feea68f203c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a86097c640f8443fa8e30feea68f203c; no voters: 66c5262333af49538a7ebf357438d66a, cd9ec0d9af0a4e0caabe63c9dd03697a
08:07:32.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:32.829824 27968 raft_consensus.cc:2726] T bbe8b447b807421f9bf69b944f9d6d62 P a86097c640f8443fa8e30feea68f203c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
08:07:32.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:32.876487 27917 sys_catalog.cc:455] T 00000000000000000000000000000000 P 24369b54bb044e73b317e8452914980e [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "24369b54bb044e73b317e8452914980e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "24369b54bb044e73b317e8452914980e" member_type: VOTER last_known_addr { host: "127.25.188.62" port: 34681 } } peers { permanent_uuid: "c6e4ef8a98eb452cb3b3b247f68bb112" member_type: VOTER last_known_addr { host: "127.25.188.61" port: 37789 } } peers { permanent_uuid: "8f9f4dfbae09418b968427a8264da4c8" member_type: VOTER last_known_addr { host: "127.25.188.60" port: 39957 } } }
08:07:32.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:32.877727 27917 sys_catalog.cc:458] T 00000000000000000000000000000000 P 24369b54bb044e73b317e8452914980e [sys.catalog]: This master's current role is: LEADER
08:07:33.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:33.284853 27984 raft_consensus.cc:482] T bbe8b447b807421f9bf69b944f9d6d62 P cd9ec0d9af0a4e0caabe63c9dd03697a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66c5262333af49538a7ebf357438d66a)
08:07:33.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:33.285367 27984 raft_consensus.cc:504] T bbe8b447b807421f9bf69b944f9d6d62 P cd9ec0d9af0a4e0caabe63c9dd03697a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a86097c640f8443fa8e30feea68f203c" member_type: VOTER last_known_addr { host: "127.25.188.3" port: 39859 } } peers { permanent_uuid: "66c5262333af49538a7ebf357438d66a" member_type: VOTER last_known_addr { host: "127.25.188.2" port: 35231 } } peers { permanent_uuid: "cd9ec0d9af0a4e0caabe63c9dd03697a" member_type: VOTER last_known_addr { host: "127.25.188.1" port: 38437 } }
08:07:33.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:33.287096 27984 leader_election.cc:288] T bbe8b447b807421f9bf69b944f9d6d62 P cd9ec0d9af0a4e0caabe63c9dd03697a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a86097c640f8443fa8e30feea68f203c (127.25.188.3:39859), 66c5262333af49538a7ebf357438d66a (127.25.188.2:35231)
08:07:33.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:33.288115 27562 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbe8b447b807421f9bf69b944f9d6d62" candidate_uuid: "cd9ec0d9af0a4e0caabe63c9dd03697a" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "a86097c640f8443fa8e30feea68f203c" is_pre_election: true
08:07:33.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:33.288653 27562 raft_consensus.cc:2454] T bbe8b447b807421f9bf69b944f9d6d62 P a86097c640f8443fa8e30feea68f203c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cd9ec0d9af0a4e0caabe63c9dd03697a in term 1.
08:07:33.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:33.290005 26920 leader_election.cc:302] T bbe8b447b807421f9bf69b944f9d6d62 P cd9ec0d9af0a4e0caabe63c9dd03697a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a86097c640f8443fa8e30feea68f203c, cd9ec0d9af0a4e0caabe63c9dd03697a; no voters: 
08:07:33.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:33.290772 27984 raft_consensus.cc:2781] T bbe8b447b807421f9bf69b944f9d6d62 P cd9ec0d9af0a4e0caabe63c9dd03697a [term 1 FOLLOWER]: Leader pre-election won for term 2
08:07:33.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:33.290843 26920 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.25.188.2:35231: connect: Connection refused (error 111)
08:07:33.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:33.291050 27984 raft_consensus.cc:482] T bbe8b447b807421f9bf69b944f9d6d62 P cd9ec0d9af0a4e0caabe63c9dd03697a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 66c5262333af49538a7ebf357438d66a)
08:07:33.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:33.291383 27984 raft_consensus.cc:3037] T bbe8b447b807421f9bf69b944f9d6d62 P cd9ec0d9af0a4e0caabe63c9dd03697a [term 1 FOLLOWER]: Advancing to term 2
08:07:33.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:33.295410 26920 leader_election.cc:334] T bbe8b447b807421f9bf69b944f9d6d62 P cd9ec0d9af0a4e0caabe63c9dd03697a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 66c5262333af49538a7ebf357438d66a (127.25.188.2:35231): Network error: Client connection negotiation failed: client connection to 127.25.188.2:35231: connect: Connection refused (error 111)
08:07:33.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:33.297329 27984 raft_consensus.cc:504] T bbe8b447b807421f9bf69b944f9d6d62 P cd9ec0d9af0a4e0caabe63c9dd03697a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a86097c640f8443fa8e30feea68f203c" member_type: VOTER last_known_addr { host: "127.25.188.3" port: 39859 } } peers { permanent_uuid: "66c5262333af49538a7ebf357438d66a" member_type: VOTER last_known_addr { host: "127.25.188.2" port: 35231 } } peers { permanent_uuid: "cd9ec0d9af0a4e0caabe63c9dd03697a" member_type: VOTER last_known_addr { host: "127.25.188.1" port: 38437 } }
08:07:33.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:33.298859 27984 leader_election.cc:288] T bbe8b447b807421f9bf69b944f9d6d62 P cd9ec0d9af0a4e0caabe63c9dd03697a [CANDIDATE]: Term 2 election: Requested vote from peers a86097c640f8443fa8e30feea68f203c (127.25.188.3:39859), 66c5262333af49538a7ebf357438d66a (127.25.188.2:35231)
08:07:33.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:33.299705 27562 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbe8b447b807421f9bf69b944f9d6d62" candidate_uuid: "cd9ec0d9af0a4e0caabe63c9dd03697a" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "a86097c640f8443fa8e30feea68f203c"
08:07:33.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:33.300264 27562 raft_consensus.cc:3037] T bbe8b447b807421f9bf69b944f9d6d62 P a86097c640f8443fa8e30feea68f203c [term 1 FOLLOWER]: Advancing to term 2
08:07:33.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:33.303103 26920 leader_election.cc:334] T bbe8b447b807421f9bf69b944f9d6d62 P cd9ec0d9af0a4e0caabe63c9dd03697a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 66c5262333af49538a7ebf357438d66a (127.25.188.2:35231): Network error: Client connection negotiation failed: client connection to 127.25.188.2:35231: connect: Connection refused (error 111)
08:07:33.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:33.305290 27562 raft_consensus.cc:2454] T bbe8b447b807421f9bf69b944f9d6d62 P a86097c640f8443fa8e30feea68f203c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cd9ec0d9af0a4e0caabe63c9dd03697a in term 2.
08:07:33.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:33.306154 26920 leader_election.cc:302] T bbe8b447b807421f9bf69b944f9d6d62 P cd9ec0d9af0a4e0caabe63c9dd03697a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a86097c640f8443fa8e30feea68f203c, cd9ec0d9af0a4e0caabe63c9dd03697a; no voters: 66c5262333af49538a7ebf357438d66a
08:07:33.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:33.306741 27984 raft_consensus.cc:2781] T bbe8b447b807421f9bf69b944f9d6d62 P cd9ec0d9af0a4e0caabe63c9dd03697a [term 2 FOLLOWER]: Leader election won for term 2
08:07:33.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:33.308794 27984 raft_consensus.cc:686] T bbe8b447b807421f9bf69b944f9d6d62 P cd9ec0d9af0a4e0caabe63c9dd03697a [term 2 LEADER]: Becoming Leader. State: Replica: cd9ec0d9af0a4e0caabe63c9dd03697a, State: Running, Role: LEADER
08:07:33.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:33.309990 27984 consensus_queue.cc:237] T bbe8b447b807421f9bf69b944f9d6d62 P cd9ec0d9af0a4e0caabe63c9dd03697a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 1.11, Last appended by leader: 11, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a86097c640f8443fa8e30feea68f203c" member_type: VOTER last_known_addr { host: "127.25.188.3" port: 39859 } } peers { permanent_uuid: "66c5262333af49538a7ebf357438d66a" member_type: VOTER last_known_addr { host: "127.25.188.2" port: 35231 } } peers { permanent_uuid: "cd9ec0d9af0a4e0caabe63c9dd03697a" member_type: VOTER last_known_addr { host: "127.25.188.1" port: 38437 } }
08:07:33.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:33.319967 26423 catalog_manager.cc:5495] T bbe8b447b807421f9bf69b944f9d6d62 P cd9ec0d9af0a4e0caabe63c9dd03697a reported cstate change: term changed from 1 to 2, leader changed from 66c5262333af49538a7ebf357438d66a (127.25.188.2) to cd9ec0d9af0a4e0caabe63c9dd03697a (127.25.188.1). New cstate: current_term: 2 leader_uuid: "cd9ec0d9af0a4e0caabe63c9dd03697a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a86097c640f8443fa8e30feea68f203c" member_type: VOTER last_known_addr { host: "127.25.188.3" port: 39859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66c5262333af49538a7ebf357438d66a" member_type: VOTER last_known_addr { host: "127.25.188.2" port: 35231 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cd9ec0d9af0a4e0caabe63c9dd03697a" member_type: VOTER last_known_addr { host: "127.25.188.1" port: 38437 } health_report { overall_health: HEALTHY } } }
08:07:33.487 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet bbe8b447b807421f9bf69b944f9d6d62 for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
08:07:33.487 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=bbe8b447b807421f9bf69b944f9d6d62@[66c5262333af49538a7ebf357438d66a(127.25.188.2:35231),a86097c640f8443fa8e30feea68f203c(127.25.188.3:39859),cd9ec0d9af0a4e0caabe63c9dd03697a(127.25.188.1:38437)[L]]}]
08:07:33.488 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=bbe8b447b807421f9bf69b944f9d6d62, attempt=12, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=1612), Traces: [0ms] sending RPC to server 66c5262333af49538a7ebf357438d66a, [2ms] received response from server 66c5262333af49538a7ebf357438d66a: Network error: Failed to connect to peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231): Connection refused: /127.25.188.2:35231, [3ms] delaying RPC due to: Network error: Failed to connect to peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231): Connection refused: /127.25.188.2:35231, [6ms] refreshing cache from master, [6ms] Sub RPC GetTableLocations: sending RPC to server master-127.25.188.60:39957, [66ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [66ms] Sub RPC GetTableLocations: received response from server master-127.25.188.60:39957: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [86ms] Sub RPC GetTableLocations: refreshing cache from master, [86ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.188.61:37789, [86ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.188.62:34681, [87ms] Sub RPC ConnectToMaster: sending RPC to server master-127.25.188.60:39957, [91ms] Sub RPC ConnectToMaster: received response from server master-127.25.188.61:37789: OK, [92ms] Sub RPC ConnectToMaster: received response from server master-127.25.188.62:34681: OK, [94ms] Sub RPC GetTableLocations: sending RPC to server master-127.25.188.62:34681, [96ms] Sub RPC ConnectToMaster: received response from server master-127.25.188.60:39957: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [98ms] Sub RPC GetTableLocations: received response from server master-127.25.188.62:34681: OK, [100ms] sending RPC to server 66c5262333af49538a7ebf357438d66a, [103ms] received response from server 66c5262333af49538a7ebf357438d66a: Network error: Failed to connect to peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231): Connection refused: /127.25.188.2:35231, [104ms] delaying RPC due to: Network error: Failed to connect to peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231): Connection refused: /127.25.188.2:35231, [126ms] refreshing cache from master, [127ms] Sub RPC GetTableLocations: sending RPC to server master-127.25.188.62:34681, [131ms] Sub RPC GetTableLocations: received response from server master-127.25.188.62:34681: OK, [134ms] sending RPC to server 66c5262333af49538a7ebf357438d66a, [135ms] received response from server 66c5262333af49538a7ebf357438d66a: Network error: Failed to connect to peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231): Connection refused: /127.25.188.2:35231, [136ms] delaying RPC due to: Network error: Failed to connect to peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231): Connection refused: /127.25.188.2:35231, [167ms] refreshing cache from master, [167ms] Sub RPC GetTableLocations: sending RPC to server master-127.25.188.62:34681, [171ms] Sub RPC GetTableLocations: received response from server master-127.25.188.62:34681: OK, [174ms] sending RPC to server 66c5262333af49538a7ebf357438d66a, [177ms] received response from server 66c5262333af49538a7ebf357438d66a: Network error: Failed to connect to peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231): Connection refused: /127.25.188.2:35231, [177ms] delaying RPC due to: Network error: Failed to connect to peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231): Connection refused: /127.25.188.2:35231, [186ms] refreshing cache from master, [186ms] Sub RPC GetTableLocations: sending RPC to server master-127.25.188.62:34681, [190ms] Sub RPC GetTableLocations: received response from server master-127.25.188.62:34681: OK, [192ms] sending RPC to server 66c5262333af49538a7ebf357438d66a, [194ms] received response from server 66c5262333af49538a7ebf357438d66a: Network error: Failed to connect to peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231): Connection refused: /127.25.188.2:35231, [194ms] delaying RPC due to: Network error: Failed to connect to peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231): Connection refused: /127.25.188.2:35231, [567ms] refreshing cache from master, [567ms] Sub RPC GetTableLocations: sending RPC to server master-127.25.188.62:34681, [571ms] Sub RPC GetTableLocations: received response from server master-127.25.188.62:34681: OK, [573ms] sending RPC to server 66c5262333af49538a7ebf357438d66a, [575ms] received response from server 66c5262333af49538a7ebf357438d66a: Network error: Failed to connect to peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231): Connection refused: /127.25.188.2:35231, [575ms] delaying RPC due to: Network error: Failed to connect to peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231): Connection refused: /127.25.188.2:35231, [1606ms] refreshing cache from master, [1606ms] Sub RPC GetTableLocations: sending RPC to server master-127.25.188.62:34681, [1610ms] Sub RPC GetTableLocations: received response from server master-127.25.188.62:34681: OK, deferred=Deferred@333830016(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$83/1604193830@1d86be2c -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@927174898 after retry RPC@639249554) -> (continuation of Deferred@1180668464 after retry RPC@2115303547) -> (continuation of Deferred@2097362299 after retry RPC@613272960) -> (continuation of Deferred@741028153 after retry RPC@89397051) -> (continuation of Deferred@1677410366 after retry RPC@1186168501), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@3669696e -> wakeup thread Time-limited test -> (continuation of Deferred@927174898 after retry RPC@639249554) -> (continuation of Deferred@1180668464 after retry RPC@2115303547) -> (continuation of Deferred@2097362299 after retry RPC@613272960) -> (continuation of Deferred@741028153 after retry RPC@89397051) -> (continuation of Deferred@1677410366 after retry RPC@1186168501))) after lookup
08:07:33.489 [DEBUG - kudu-nio-1] (Connection.java:748) [peer cd9ec0d9af0a4e0caabe63c9dd03697a(127.25.188.1:38437)] connecting to peer
08:07:33.491 [DEBUG - kudu-nio-1] (Connection.java:757) [peer cd9ec0d9af0a4e0caabe63c9dd03697a(127.25.188.1:38437)] Successfully connected to peer
08:07:33.522 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0xad2e13eb, L:/127.0.0.1:49678 - R:/127.25.188.1:38437] using TOKEN/null
08:07:33.537 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:33.537317 27562 raft_consensus.cc:1261] T bbe8b447b807421f9bf69b944f9d6d62 P a86097c640f8443fa8e30feea68f203c [term 2 FOLLOWER]: Refusing update from remote peer cd9ec0d9af0a4e0caabe63c9dd03697a: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 2 index: 13. (index mismatch)
08:07:33.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:33.539598 27989 consensus_queue.cc:1035] T bbe8b447b807421f9bf69b944f9d6d62 P cd9ec0d9af0a4e0caabe63c9dd03697a [LEADER]: Connected to new peer: Peer: permanent_uuid: "a86097c640f8443fa8e30feea68f203c" member_type: VOTER last_known_addr { host: "127.25.188.3" port: 39859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
08:07:33.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:33.540954 26920 consensus_peers.cc:487] T bbe8b447b807421f9bf69b944f9d6d62 P cd9ec0d9af0a4e0caabe63c9dd03697a -> Peer 66c5262333af49538a7ebf357438d66a (127.25.188.2:35231): Couldn't send request to peer 66c5262333af49538a7ebf357438d66a. Status: Network error: Client connection negotiation failed: client connection to 127.25.188.2:35231: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
08:07:33.737 [DEBUG - kudu-nio-1] (AsyncKuduScanner.java:1374) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 20 rows, more = false) for scanner KuduScanner(table=org.apache.kudu.client.TestClientFailoverSupport-RESTART, tablet=bbe8b447b807421f9bf69b944f9d6d62, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:07:33.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:33.739725 26423 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:44386:
08:07:33.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "org.apache.kudu.client.TestClientFailoverSupport-RESTART" }
08:07:33.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:33.740447 26423 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:44386:
08:07:33.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "org.apache.kudu.client.TestClientFailoverSupport-RESTART" }
08:07:33.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:33.766654 26423 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 24369b54bb044e73b317e8452914980e: Sending DeleteTablet for 3 replicas of tablet bbe8b447b807421f9bf69b944f9d6d62
08:07:33.792 [DEBUG - main] (Connection.java:575) [peer master-127.25.188.61:37789(127.25.188.61:37789)] disconnecting while in state READY
08:07:33.792 [DEBUG - main] (Connection.java:575) [peer master-127.25.188.60:39957(127.25.188.60:39957)] disconnecting while in state READY
08:07:33.792 [DEBUG - main] (Connection.java:575) [peer 66c5262333af49538a7ebf357438d66a(127.25.188.2:35231)] disconnecting while in state TERMINATED
08:07:33.793 [DEBUG - main] (Connection.java:575) [peer cd9ec0d9af0a4e0caabe63c9dd03697a(127.25.188.1:38437)] disconnecting while in state READY
08:07:33.795 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.25.188.61:37789(127.25.188.61:37789)] handling channelInactive
08:07:33.795 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.25.188.61:37789(127.25.188.61:37789)] cleaning up while in state READY due to: connection closed
08:07:33.795 [DEBUG - main] (Connection.java:575) [peer master-127.25.188.62:34681(127.25.188.62:34681)] disconnecting while in state READY
08:07:33.797 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.25.188.60:39957(127.25.188.60:39957)] handling channelInactive
08:07:33.797 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.188.60:39957(127.25.188.60:39957)] cleaning up while in state READY due to: connection closed
08:07:33.798 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:07:33.799 [DEBUG - kudu-nio-1] (Connection.java:239) [peer cd9ec0d9af0a4e0caabe63c9dd03697a(127.25.188.1:38437)] handling channelInactive
08:07:33.799 [DEBUG - kudu-nio-1] (Connection.java:709) [peer cd9ec0d9af0a4e0caabe63c9dd03697a(127.25.188.1:38437)] cleaning up while in state READY due to: connection closed
08:07:33.799 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.25.188.62:34681(127.25.188.62:34681)] handling channelInactive
08:07:33.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:33.800215 26352 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgk96or/build/tsan/bin/kudu with pid 26858
08:07:33.811 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.25.188.62:34681(127.25.188.62:34681)] cleaning up while in state READY due to: connection closed
08:07:33.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:33.839164 27533 tablet_service.cc:1514] Processing DeleteTablet for tablet bbe8b447b807421f9bf69b944f9d6d62 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-12 08:07:33 UTC) from {username='slave'} at 127.0.0.1:47378
08:07:33.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:33.846944 26402 catalog_manager.cc:4584] TS 66c5262333af49538a7ebf357438d66a (127.25.188.2:35231): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet bbe8b447b807421f9bf69b944f9d6d62: Network error: Client connection negotiation failed: client connection to 127.25.188.2:35231: connect: Connection refused (error 111)
08:07:33.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:33.854318 28038 tablet_replica.cc:330] T bbe8b447b807421f9bf69b944f9d6d62 P a86097c640f8443fa8e30feea68f203c: stopping tablet replica
08:07:33.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:33.855217 28038 raft_consensus.cc:2229] T bbe8b447b807421f9bf69b944f9d6d62 P a86097c640f8443fa8e30feea68f203c [term 2 FOLLOWER]: Raft consensus shutting down.
08:07:33.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:33.856356 28038 raft_consensus.cc:2258] T bbe8b447b807421f9bf69b944f9d6d62 P a86097c640f8443fa8e30feea68f203c [term 2 FOLLOWER]: Raft consensus is shut down!
08:07:33.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:33.859890 28038 ts_tablet_manager.cc:1905] T bbe8b447b807421f9bf69b944f9d6d62 P a86097c640f8443fa8e30feea68f203c: Deleting tablet data with delete state TABLET_DATA_DELETED
08:07:33.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:33.877475 26352 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgk96or/build/tsan/bin/kudu with pid 27415
08:07:33.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260812 08:07:33.878170 28032 negotiation.cc:337] Failed RPC negotiation. Trace:
08:07:33.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0812 08:07:33.818329 (+     0us) reactor.cc:625] Submitting negotiation task for client connection to 127.25.188.1:38437 (local address 127.0.0.1:49682)
08:07:33.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0812 08:07:33.818780 (+   451us) negotiation.cc:107] Waiting for socket to connect
08:07:33.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0812 08:07:33.818823 (+    43us) client_negotiation.cc:174] Beginning negotiation
08:07:33.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0812 08:07:33.819102 (+   279us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
08:07:33.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0812 08:07:33.877070 (+ 57968us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.25.188.1:38437: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
08:07:33.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"client-negotiator.queue_time_us":72}
08:07:33.922 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:33.921995 26352 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgk96or/build/tsan/bin/kudu with pid 26373
08:07:33.958 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:33.958055 26352 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgk96or/build/tsan/bin/kudu with pid 26498
08:07:33.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260812 08:07:33.990010 26352 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskgk96or/build/tsan/bin/kudu with pid 27751
08:07:35.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-08-12T08:07:35Z chronyd exiting

Time: 40.265

OK (2 tests)

