JUnit version 4.13.2
.14:05:43.550 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1783519543541
14:05:43.603 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
14:05:43.673 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
14:05:43.684 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskVqKZyE/test-tmp
14:05:43.691 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
14:05:43.695 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskVqKZyE/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
14:05:43.946 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

14:05:44.117 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
14:05:44.118 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

14:05:44.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:44.122236 22760 mini_oidc.cc:150] Starting JWKS server
14:05:44.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:44.125612 22760 webserver.cc:533] Webserver started at http://127.0.0.1:43857/ using document root <none> and password file <none>
14:05:44.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:44.126029 22760 mini_oidc.cc:186] Starting OIDC Discovery server
14:05:44.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:44.127784 22760 webserver.cc:533] Webserver started at http://127.0.0.1:43261/ using document root <none> and password file <none>
14:05:44.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T14:05:44Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
14:05:44.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T14:05:44Z Disabled control of system clock
14:05:44.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:44.188108 22760 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskVqKZyE/build/tsan/bin/kudu
14:05:44.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskVqKZyE/build/tsan/bin/kudu
14:05:44.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/master-0/wal
14:05:44.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/master-0/data
14:05:44.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:05:44.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:05:44.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:05:44.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:05:44.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:05:44.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:05:44.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/master-0/logs
14:05:44.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/master-0/data/info.pb
14:05:44.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:05:44.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:05:44.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:05:44.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:05:44.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:05:44.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:05:44.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:05:44.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:05:44.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
14:05:44.193 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:05:44.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:05:44.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:05:44.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.22.58.62:45123
14:05:44.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.22.58.62
14:05:44.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:05:44.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.22.58.20:39717
14:05:44.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:05:44.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:05:44.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:05:44.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:05:44.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.22.58.62:45123,127.22.58.61:40329,127.22.58.60:34817
14:05:44.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:05:44.196 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:43857/jwks.json with env {}
14:05:44.495 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:44.495101 22772 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:05:44.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:44.495826 22772 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:05:44.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:44.496703 22772 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:05:44.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:44.529583 22772 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
14:05:44.530 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:44.529992 22772 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:05:44.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:44.530326 22772 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
14:05:44.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:44.530697 22772 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
14:05:44.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:44.531070 22772 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
14:05:44.531 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:44.531351 22772 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:43857/jwks.json
14:05:44.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:44.568066 22772 master_runner.cc:387] Master server non-default flags:
14:05:44.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:05:44.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.22.58.20:39717
14:05:44.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:05:44.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:05:44.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/master-0/data
14:05:44.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/master-0/wal
14:05:44.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:05:44.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.22.58.62:45123,127.22.58.61:40329,127.22.58.60:34817
14:05:44.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:05:44.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:05:44.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:05:44.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.22.58.62:45123
14:05:44.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:05:44.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:05:44.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:05:44.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:43857/jwks.json
14:05:44.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:05:44.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:05:44.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/master-0/data/info.pb
14:05:44.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.22.58.62
14:05:44.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:05:44.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:05:44.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:05:44.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:05:44.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:05:44.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:05:44.575 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/master-0/logs
14:05:44.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:05:44.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:05:44.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:05:44.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
14:05:44.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:05:44.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
14:05:44.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:05:44.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 13:43:23 UTC on e7f111948823
14:05:44.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12775
14:05:44.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:05:44.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:44.569779 22772 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:05:44.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:44.572157 22772 file_cache.cc:504] Constructed file cache file cache with capacity 419430
14:05:44.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:44.585989 22778 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:05:45.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:44.586057 22779 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:05:45.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:45.807936 22780 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1220 milliseconds
14:05:45.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:45.809672 22781 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:05:45.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:45.812542 22772 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.227s	user 0.358s	sys 0.864s
14:05:45.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:45.812948 22772 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.227s	user 0.358s	sys 0.864s
14:05:45.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:45.813261 22772 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:05:45.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:45.814929 22772 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:05:45.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:45.818348 22772 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:05:45.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:45.820432 22772 hybrid_clock.cc:648] HybridClock initialized: now 1783519545820371 us; error 63 us; skew 500 ppm
14:05:45.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:45.821671 22772 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:05:45.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:45.831235 22772 webserver.cc:533] Webserver started at http://127.22.58.62:36183/ using document root <none> and password file <none>
14:05:45.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:45.832741 22772 fs_manager.cc:362] Metadata directory not provided
14:05:45.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:45.833084 22772 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:05:45.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:45.833722 22772 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:05:45.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:45.841176 22772 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/master-0/data/instance:
14:05:45.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1de5161cc99c47bfbc1f45835cb1d1cb"
14:05:45.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:05:45 on dist-test-slave-gws2"
14:05:45.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:45.843168 22772 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/master-0/wal/instance:
14:05:45.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1de5161cc99c47bfbc1f45835cb1d1cb"
14:05:45.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:05:45 on dist-test-slave-gws2"
14:05:45.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:45.855247 22772 fs_manager.cc:696] Time spent creating directory manager: real 0.011s	user 0.009s	sys 0.002s
14:05:45.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:45.864705 22788 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:05:45.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:45.866578 22772 fs_manager.cc:730] Time spent opening block manager: real 0.006s	user 0.004s	sys 0.002s
14:05:45.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:45.867115 22772 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/master-0/data,/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/master-0/wal
14:05:45.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1de5161cc99c47bfbc1f45835cb1d1cb"
14:05:45.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:05:45 on dist-test-slave-gws2"
14:05:45.869 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:45.868263 22772 fs_report.cc:389] FS layout report
14:05:45.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:05:45.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/master-0/wal
14:05:45.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/master-0/wal
14:05:45.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/master-0/data/data
14:05:45.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:05:45.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:05:45.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:05:45.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:05:45.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:05:45.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:05:45.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:05:45.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:05:45.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:05:45.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:05:45.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:05:45.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:45.943086 22772 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:05:45.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:45.944782 22772 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:05:45.945 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:45.945211 22772 kserver.cc:163] Server-wide thread pool size limit: 3276
14:05:46.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:46.023448 22772 rpc_server.cc:307] RPC server started. Bound to: 127.22.58.62:45123
14:05:46.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:46.023545 22839 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.58.62:45123 every 8 connection(s)
14:05:46.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:46.026211 22772 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/master-0/data/info.pb
14:05:46.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:46.032099 22840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
14:05:46.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:46.035486 22760 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskVqKZyE/build/tsan/bin/kudu as pid 22772
14:05:46.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:46.036031 22760 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/master-0/wal/instance
14:05:46.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:46.041294 22760 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskVqKZyE/build/tsan/bin/kudu
14:05:46.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskVqKZyE/build/tsan/bin/kudu
14:05:46.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/master-1/wal
14:05:46.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/master-1/data
14:05:46.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:05:46.042 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:05:46.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:05:46.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:05:46.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:05:46.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:05:46.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/master-1/logs
14:05:46.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/master-1/data/info.pb
14:05:46.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:05:46.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:05:46.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:05:46.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:05:46.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:05:46.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:05:46.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:05:46.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:05:46.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
14:05:46.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:05:46.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:05:46.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:05:46.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.22.58.61:40329
14:05:46.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.22.58.61
14:05:46.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:05:46.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.22.58.20:39717
14:05:46.050 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:05:46.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:05:46.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:05:46.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:05:46.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.22.58.62:45123,127.22.58.61:40329,127.22.58.60:34817
14:05:46.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:05:46.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:43857/jwks.json with env {}
14:05:46.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:46.048015 22840 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.58.62" port: 45123 } has no permanent_uuid. Determining permanent_uuid...
14:05:46.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:46.080922 22840 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.58.61" port: 40329 } has no permanent_uuid. Determining permanent_uuid...
14:05:46.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:46.083659 22789 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.58.61:40329: connect: Connection refused (error 111)
14:05:46.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:46.088236 22840 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.58.61:40329: Network error: Client connection negotiation failed: client connection to 127.22.58.61:40329: connect: Connection refused (error 111)
14:05:46.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:46.137733 22840 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.58.61" port: 40329 } attempt: 1
14:05:46.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:46.143030 22840 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.58.61:40329: Network error: Client connection negotiation failed: client connection to 127.22.58.61:40329: connect: Connection refused (error 111)
14:05:46.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:46.211470 22840 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.58.61" port: 40329 } attempt: 2
14:05:46.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:46.218390 22840 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.58.61:40329: Network error: Client connection negotiation failed: client connection to 127.22.58.61:40329: connect: Connection refused (error 111)
14:05:46.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:46.309878 22840 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.58.61" port: 40329 } attempt: 3
14:05:46.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:46.314497 22840 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.58.61:40329: Network error: Client connection negotiation failed: client connection to 127.22.58.61:40329: connect: Connection refused (error 111)
14:05:46.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:46.363391 22842 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:05:46.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:46.364089 22842 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:05:46.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:46.364882 22842 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:05:46.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:46.398063 22842 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
14:05:46.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:46.398471 22842 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:05:46.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:46.398833 22842 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
14:05:46.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:46.399173 22842 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
14:05:46.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:46.399539 22842 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
14:05:46.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:46.399827 22842 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:43857/jwks.json
14:05:46.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:46.437135 22842 master_runner.cc:387] Master server non-default flags:
14:05:46.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:05:46.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.22.58.20:39717
14:05:46.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:05:46.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:05:46.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/master-1/data
14:05:46.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/master-1/wal
14:05:46.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:05:46.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.22.58.62:45123,127.22.58.61:40329,127.22.58.60:34817
14:05:46.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:05:46.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:05:46.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:05:46.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.22.58.61:40329
14:05:46.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:05:46.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:05:46.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:05:46.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:43857/jwks.json
14:05:46.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:05:46.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:05:46.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/master-1/data/info.pb
14:05:46.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.22.58.61
14:05:46.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:05:46.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:05:46.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:05:46.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:05:46.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:05:46.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:05:46.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/master-1/logs
14:05:46.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:05:46.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:05:46.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:05:46.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
14:05:46.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:05:46.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
14:05:46.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:05:46.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 13:43:23 UTC on e7f111948823
14:05:46.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12775
14:05:46.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:05:46.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:46.438942 22842 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:05:46.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:46.441314 22842 file_cache.cc:504] Constructed file cache file cache with capacity 419430
14:05:46.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:46.453682 22851 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:05:46.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:46.457980 22840 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.58.61" port: 40329 } attempt: 4
14:05:46.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:46.465502 22840 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.58.61:40329: Network error: Client connection negotiation failed: client connection to 127.22.58.61:40329: connect: Connection refused (error 111)
14:05:46.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:46.764925 22840 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.58.61" port: 40329 } attempt: 5
14:05:46.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:46.772262 22840 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.58.61:40329: Network error: Client connection negotiation failed: client connection to 127.22.58.61:40329: connect: Connection refused (error 111)
14:05:47.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:47.319865 22840 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.58.61" port: 40329 } attempt: 6
14:05:47.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:47.334167 22840 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.58.61:40329: Network error: Client connection negotiation failed: client connection to 127.22.58.61:40329: connect: Connection refused (error 111)
14:05:47.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:46.456053 22852 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:05:47.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:46.467881 22854 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:05:47.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:47.704190 22853 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1247 milliseconds
14:05:47.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:47.704238 22842 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:05:47.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:47.709241 22842 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:05:47.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:47.713610 22842 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:05:47.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:47.715059 22842 hybrid_clock.cc:648] HybridClock initialized: now 1783519547715018 us; error 67 us; skew 500 ppm
14:05:47.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:47.716074 22842 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:05:47.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:47.723023 22842 webserver.cc:533] Webserver started at http://127.22.58.61:44491/ using document root <none> and password file <none>
14:05:47.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:47.724000 22842 fs_manager.cc:362] Metadata directory not provided
14:05:47.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:47.724208 22842 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:05:47.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:47.724730 22842 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:05:47.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:47.729614 22842 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/master-1/data/instance:
14:05:47.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "5e0fc4cd83084f2eb905d081a292954d"
14:05:47.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:05:47 on dist-test-slave-gws2"
14:05:47.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:47.730913 22842 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/master-1/wal/instance:
14:05:47.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "5e0fc4cd83084f2eb905d081a292954d"
14:05:47.731 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:05:47 on dist-test-slave-gws2"
14:05:47.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:47.738644 22842 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.001s
14:05:47.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:47.745299 22863 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:05:47.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:47.746570 22842 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.006s	sys 0.000s
14:05:47.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:47.746996 22842 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/master-1/data,/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/master-1/wal
14:05:47.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "5e0fc4cd83084f2eb905d081a292954d"
14:05:47.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:05:47 on dist-test-slave-gws2"
14:05:47.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:47.747507 22842 fs_report.cc:389] FS layout report
14:05:47.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:05:47.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/master-1/wal
14:05:47.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/master-1/wal
14:05:47.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/master-1/data/data
14:05:47.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:05:47.748 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:05:47.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:05:47.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:05:47.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:05:47.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:05:47.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:05:47.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:05:47.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:05:47.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:05:47.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:05:47.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:47.798380 22842 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:05:47.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:47.799930 22842 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:05:47.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:47.800349 22842 kserver.cc:163] Server-wide thread pool size limit: 3276
14:05:47.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:47.873044 22842 rpc_server.cc:307] RPC server started. Bound to: 127.22.58.61:40329
14:05:47.873 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:47.873167 22914 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.58.61:40329 every 8 connection(s)
14:05:47.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:47.875636 22842 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/master-1/data/info.pb
14:05:47.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:47.881340 22915 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
14:05:47.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:47.883284 22760 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskVqKZyE/build/tsan/bin/kudu as pid 22842
14:05:47.884 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:47.883774 22760 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/master-1/wal/instance
14:05:47.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:47.886811 22760 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskVqKZyE/build/tsan/bin/kudu
14:05:47.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskVqKZyE/build/tsan/bin/kudu
14:05:47.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/master-2/wal
14:05:47.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/master-2/data
14:05:47.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:05:47.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:05:47.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:05:47.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:05:47.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:05:47.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:05:47.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/master-2/logs
14:05:47.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/master-2/data/info.pb
14:05:47.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:05:47.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:05:47.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:05:47.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:05:47.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:05:47.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:05:47.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:05:47.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:05:47.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
14:05:47.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:05:47.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:05:47.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:05:47.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.22.58.60:34817
14:05:47.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.22.58.60
14:05:47.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:05:47.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.22.58.20:39717
14:05:47.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:05:47.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:05:47.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:05:47.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:05:47.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.22.58.62:45123,127.22.58.61:40329,127.22.58.60:34817
14:05:47.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:05:47.891 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:43857/jwks.json with env {}
14:05:47.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:47.899132 22915 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.58.62" port: 45123 } has no permanent_uuid. Determining permanent_uuid...
14:05:47.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:47.923585 22915 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.58.61" port: 40329 } has no permanent_uuid. Determining permanent_uuid...
14:05:47.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:47.938848 22915 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.58.60" port: 34817 } has no permanent_uuid. Determining permanent_uuid...
14:05:47.942 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:47.941711 22864 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.58.60:34817: connect: Connection refused (error 111)
14:05:47.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:47.946421 22915 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.58.60:34817: Network error: Client connection negotiation failed: client connection to 127.22.58.60:34817: connect: Connection refused (error 111)
14:05:47.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:47.995970 22915 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.58.60" port: 34817 } attempt: 1
14:05:48.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:48.001245 22915 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.58.60:34817: Network error: Client connection negotiation failed: client connection to 127.22.58.60:34817: connect: Connection refused (error 111)
14:05:48.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:48.069674 22915 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.58.60" port: 34817 } attempt: 2
14:05:48.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:48.074844 22915 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.58.60:34817: Network error: Client connection negotiation failed: client connection to 127.22.58.60:34817: connect: Connection refused (error 111)
14:05:48.166 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:48.166301 22915 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.58.60" port: 34817 } attempt: 3
14:05:48.171 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:48.170919 22915 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.58.60:34817: Network error: Client connection negotiation failed: client connection to 127.22.58.60:34817: connect: Connection refused (error 111)
14:05:48.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:48.212212 22917 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:05:48.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:48.212903 22917 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:05:48.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:48.213581 22917 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:05:48.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:48.247692 22917 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
14:05:48.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:48.248070 22917 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:05:48.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:48.248418 22917 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
14:05:48.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:48.248785 22917 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
14:05:48.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:48.249178 22917 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
14:05:48.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:48.249445 22917 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:43857/jwks.json
14:05:48.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:48.287215 22917 master_runner.cc:387] Master server non-default flags:
14:05:48.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:05:48.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.22.58.20:39717
14:05:48.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:05:48.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:05:48.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/master-2/data
14:05:48.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/master-2/wal
14:05:48.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:05:48.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.22.58.62:45123,127.22.58.61:40329,127.22.58.60:34817
14:05:48.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:05:48.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:05:48.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:05:48.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.22.58.60:34817
14:05:48.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:05:48.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:05:48.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:05:48.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:43857/jwks.json
14:05:48.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:05:48.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:05:48.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/master-2/data/info.pb
14:05:48.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.22.58.60
14:05:48.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:05:48.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:05:48.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:05:48.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:05:48.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:05:48.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:05:48.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/master-2/logs
14:05:48.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:05:48.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:05:48.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:05:48.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
14:05:48.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:05:48.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
14:05:48.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:05:48.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 13:43:23 UTC on e7f111948823
14:05:48.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12775
14:05:48.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:05:48.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:48.289072 22917 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:05:48.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:48.291569 22917 file_cache.cc:504] Constructed file cache file cache with capacity 419430
14:05:48.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:48.304056 22927 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:05:48.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:48.314368 22915 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.58.60" port: 34817 } attempt: 4
14:05:48.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:48.323022 22915 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.58.60:34817: Network error: Client connection negotiation failed: client connection to 127.22.58.60:34817: connect: Connection refused (error 111)
14:05:48.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:48.394788 22840 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.58.61" port: 40329 } attempt: 7
14:05:48.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:48.439313 22840 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.58.60" port: 34817 } has no permanent_uuid. Determining permanent_uuid...
14:05:48.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:48.467501 22840 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.58.60:34817: Network error: Client connection negotiation failed: client connection to 127.22.58.60:34817: connect: Connection refused (error 111)
14:05:48.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:48.526069 22840 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.58.60" port: 34817 } attempt: 1
14:05:48.536 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:48.535966 22840 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.58.60:34817: Network error: Client connection negotiation failed: client connection to 127.22.58.60:34817: connect: Connection refused (error 111)
14:05:48.618 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:48.617573 22840 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.58.60" port: 34817 } attempt: 2
14:05:48.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:48.626560 22840 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.58.60:34817: Network error: Client connection negotiation failed: client connection to 127.22.58.60:34817: connect: Connection refused (error 111)
14:05:48.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:48.622634 22915 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.58.60" port: 34817 } attempt: 5
14:05:48.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:48.635217 22915 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.58.60:34817: Network error: Client connection negotiation failed: client connection to 127.22.58.60:34817: connect: Connection refused (error 111)
14:05:48.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:48.712190 22840 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.58.60" port: 34817 } attempt: 3
14:05:48.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:48.721043 22840 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.58.60:34817: Network error: Client connection negotiation failed: client connection to 127.22.58.60:34817: connect: Connection refused (error 111)
14:05:48.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:48.861608 22840 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.58.60" port: 34817 } attempt: 4
14:05:48.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:48.877372 22840 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.58.60:34817: Network error: Client connection negotiation failed: client connection to 127.22.58.60:34817: connect: Connection refused (error 111)
14:05:49.162 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:49.160940 22840 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.58.60" port: 34817 } attempt: 5
14:05:49.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:49.169569 22840 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.58.60:34817: Network error: Client connection negotiation failed: client connection to 127.22.58.60:34817: connect: Connection refused (error 111)
14:05:49.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:49.182766 22915 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.58.60" port: 34817 } attempt: 6
14:05:49.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:49.219718 22915 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.58.60:34817: Network error: Client connection negotiation failed: client connection to 127.22.58.60:34817: connect: Connection refused (error 111)
14:05:49.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:49.722106 22840 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.58.60" port: 34817 } attempt: 6
14:05:49.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:49.748615 22840 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.22.58.60:34817: Network error: Client connection negotiation failed: client connection to 127.22.58.60:34817: connect: Connection refused (error 111)
14:05:49.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:49.707367 22926 debug-util.cc:398] Leaking SignalData structure 0x7b0800028020 after lost signal to thread 22917
14:05:49.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:49.904894 22917 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.601s	user 0.594s	sys 0.997s
14:05:49.905 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:49.905339 22917 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.602s	user 0.594s	sys 0.997s
14:05:49.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:48.304953 22928 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:05:49.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:49.907358 22930 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:05:49.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:49.910583 22929 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1602 milliseconds
14:05:49.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:49.910742 22917 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:05:49.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:49.912132 22917 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:05:49.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:49.915077 22917 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:05:49.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:49.916467 22917 hybrid_clock.cc:648] HybridClock initialized: now 1783519549916436 us; error 38 us; skew 500 ppm
14:05:49.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:49.917395 22917 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:05:49.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:49.923935 22917 webserver.cc:533] Webserver started at http://127.22.58.60:41583/ using document root <none> and password file <none>
14:05:49.925 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:49.925137 22917 fs_manager.cc:362] Metadata directory not provided
14:05:49.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:49.925418 22917 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:05:49.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:49.926017 22917 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:05:49.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:49.930435 22917 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/master-2/data/instance:
14:05:49.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1eb8d31ae6124cd5bf4defdcada1e8b2"
14:05:49.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:05:49 on dist-test-slave-gws2"
14:05:49.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:49.931911 22917 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/master-2/wal/instance:
14:05:49.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1eb8d31ae6124cd5bf4defdcada1e8b2"
14:05:49.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:05:49 on dist-test-slave-gws2"
14:05:49.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:49.939656 22917 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.002s
14:05:49.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:49.945950 22944 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:05:49.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:49.947192 22917 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.001s
14:05:49.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:49.947573 22917 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/master-2/data,/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/master-2/wal
14:05:49.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1eb8d31ae6124cd5bf4defdcada1e8b2"
14:05:49.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:05:49 on dist-test-slave-gws2"
14:05:49.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:49.948010 22917 fs_report.cc:389] FS layout report
14:05:49.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:05:49.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/master-2/wal
14:05:49.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/master-2/wal
14:05:49.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/master-2/data/data
14:05:49.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:05:49.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:05:49.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:05:49.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:05:49.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:05:49.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:05:49.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:05:49.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:05:49.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:05:49.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:05:49.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:05:50.002 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.001559 22917 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:05:50.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.003393 22917 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:05:50.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.003957 22917 kserver.cc:163] Server-wide thread pool size limit: 3276
14:05:50.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.089160 22917 rpc_server.cc:307] RPC server started. Bound to: 127.22.58.60:34817
14:05:50.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.089212 22995 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.58.60:34817 every 8 connection(s)
14:05:50.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.092252 22917 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/master-2/data/info.pb
14:05:50.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.094254 22760 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskVqKZyE/build/tsan/bin/kudu as pid 22917
14:05:50.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.094898 22760 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/master-2/wal/instance
14:05:50.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.100512 22996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
14:05:50.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.120965 22996 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.58.62" port: 45123 } has no permanent_uuid. Determining permanent_uuid...
14:05:50.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.148380 22996 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.58.61" port: 40329 } has no permanent_uuid. Determining permanent_uuid...
14:05:50.159 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.159193 22996 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.22.58.60" port: 34817 } has no permanent_uuid. Determining permanent_uuid...
14:05:50.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.177640 22996 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1eb8d31ae6124cd5bf4defdcada1e8b2: Bootstrap starting.
14:05:50.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.185995 22996 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1eb8d31ae6124cd5bf4defdcada1e8b2: Neither blocks nor log segments found. Creating new log.
14:05:50.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.188022 22996 log.cc:826] T 00000000000000000000000000000000 P 1eb8d31ae6124cd5bf4defdcada1e8b2: Log is configured to *not* fsync() on all Append() calls
14:05:50.195 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.194589 22996 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1eb8d31ae6124cd5bf4defdcada1e8b2: No bootstrap required, opened a new log
14:05:50.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.216049 22996 raft_consensus.cc:359] T 00000000000000000000000000000000 P 1eb8d31ae6124cd5bf4defdcada1e8b2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5161cc99c47bfbc1f45835cb1d1cb" member_type: VOTER last_known_addr { host: "127.22.58.62" port: 45123 } } peers { permanent_uuid: "5e0fc4cd83084f2eb905d081a292954d" member_type: VOTER last_known_addr { host: "127.22.58.61" port: 40329 } } peers { permanent_uuid: "1eb8d31ae6124cd5bf4defdcada1e8b2" member_type: VOTER last_known_addr { host: "127.22.58.60" port: 34817 } }
14:05:50.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.217067 22996 raft_consensus.cc:385] T 00000000000000000000000000000000 P 1eb8d31ae6124cd5bf4defdcada1e8b2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:05:50.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.217809 22996 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1eb8d31ae6124cd5bf4defdcada1e8b2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1eb8d31ae6124cd5bf4defdcada1e8b2, State: Initialized, Role: FOLLOWER
14:05:50.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.218961 22996 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1eb8d31ae6124cd5bf4defdcada1e8b2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5161cc99c47bfbc1f45835cb1d1cb" member_type: VOTER last_known_addr { host: "127.22.58.62" port: 45123 } } peers { permanent_uuid: "5e0fc4cd83084f2eb905d081a292954d" member_type: VOTER last_known_addr { host: "127.22.58.61" port: 40329 } } peers { permanent_uuid: "1eb8d31ae6124cd5bf4defdcada1e8b2" member_type: VOTER last_known_addr { host: "127.22.58.60" port: 34817 } }
14:05:50.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.221333 23004 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1eb8d31ae6124cd5bf4defdcada1e8b2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5161cc99c47bfbc1f45835cb1d1cb" member_type: VOTER last_known_addr { host: "127.22.58.62" port: 45123 } } peers { permanent_uuid: "5e0fc4cd83084f2eb905d081a292954d" member_type: VOTER last_known_addr { host: "127.22.58.61" port: 40329 } } peers { permanent_uuid: "1eb8d31ae6124cd5bf4defdcada1e8b2" member_type: VOTER last_known_addr { host: "127.22.58.60" port: 34817 } } }
14:05:50.222 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.222076 23004 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1eb8d31ae6124cd5bf4defdcada1e8b2 [sys.catalog]: This master's current role is: FOLLOWER
14:05:50.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.223302 22996 sys_catalog.cc:565] T 00000000000000000000000000000000 P 1eb8d31ae6124cd5bf4defdcada1e8b2 [sys.catalog]: configured and running, proceeding with master startup.
14:05:50.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:50.256423 23015 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 1eb8d31ae6124cd5bf4defdcada1e8b2: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
14:05:50.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:50.256783 23015 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
14:05:50.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:50.260484 22950 tablet.cc:2406] T 00000000000000000000000000000000 P 1eb8d31ae6124cd5bf4defdcada1e8b2: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:05:50.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.280395 22915 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.58.60" port: 34817 } attempt: 7
14:05:50.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.249029 22917 master_runner.cc:187] Error getting master registration for 127.22.58.62:45123: OK, instance_id { permanent_uuid: "1de5161cc99c47bfbc1f45835cb1d1cb" instance_seqno: 1783519546002391 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
14:05:50.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.284730 22917 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
14:05:50.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.304736 22915 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5e0fc4cd83084f2eb905d081a292954d: Bootstrap starting.
14:05:50.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.313431 22915 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5e0fc4cd83084f2eb905d081a292954d: Neither blocks nor log segments found. Creating new log.
14:05:50.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.315630 22915 log.cc:826] T 00000000000000000000000000000000 P 5e0fc4cd83084f2eb905d081a292954d: Log is configured to *not* fsync() on all Append() calls
14:05:50.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.317662 23004 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1eb8d31ae6124cd5bf4defdcada1e8b2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:05:50.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.318226 23004 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1eb8d31ae6124cd5bf4defdcada1e8b2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5161cc99c47bfbc1f45835cb1d1cb" member_type: VOTER last_known_addr { host: "127.22.58.62" port: 45123 } } peers { permanent_uuid: "5e0fc4cd83084f2eb905d081a292954d" member_type: VOTER last_known_addr { host: "127.22.58.61" port: 40329 } } peers { permanent_uuid: "1eb8d31ae6124cd5bf4defdcada1e8b2" member_type: VOTER last_known_addr { host: "127.22.58.60" port: 34817 } }
14:05:50.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.321161 22915 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5e0fc4cd83084f2eb905d081a292954d: No bootstrap required, opened a new log
14:05:50.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.321524 23004 leader_election.cc:290] T 00000000000000000000000000000000 P 1eb8d31ae6124cd5bf4defdcada1e8b2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1de5161cc99c47bfbc1f45835cb1d1cb (127.22.58.62:45123), 5e0fc4cd83084f2eb905d081a292954d (127.22.58.61:40329)
14:05:50.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.353438 22915 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5e0fc4cd83084f2eb905d081a292954d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5161cc99c47bfbc1f45835cb1d1cb" member_type: VOTER last_known_addr { host: "127.22.58.62" port: 45123 } } peers { permanent_uuid: "5e0fc4cd83084f2eb905d081a292954d" member_type: VOTER last_known_addr { host: "127.22.58.61" port: 40329 } } peers { permanent_uuid: "1eb8d31ae6124cd5bf4defdcada1e8b2" member_type: VOTER last_known_addr { host: "127.22.58.60" port: 34817 } }
14:05:50.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.354897 22915 raft_consensus.cc:385] T 00000000000000000000000000000000 P 5e0fc4cd83084f2eb905d081a292954d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:05:50.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.355533 22915 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5e0fc4cd83084f2eb905d081a292954d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5e0fc4cd83084f2eb905d081a292954d, State: Initialized, Role: FOLLOWER
14:05:50.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.356799 22915 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5e0fc4cd83084f2eb905d081a292954d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5161cc99c47bfbc1f45835cb1d1cb" member_type: VOTER last_known_addr { host: "127.22.58.62" port: 45123 } } peers { permanent_uuid: "5e0fc4cd83084f2eb905d081a292954d" member_type: VOTER last_known_addr { host: "127.22.58.61" port: 40329 } } peers { permanent_uuid: "1eb8d31ae6124cd5bf4defdcada1e8b2" member_type: VOTER last_known_addr { host: "127.22.58.60" port: 34817 } }
14:05:50.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.360117 23019 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e0fc4cd83084f2eb905d081a292954d [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5161cc99c47bfbc1f45835cb1d1cb" member_type: VOTER last_known_addr { host: "127.22.58.62" port: 45123 } } peers { permanent_uuid: "5e0fc4cd83084f2eb905d081a292954d" member_type: VOTER last_known_addr { host: "127.22.58.61" port: 40329 } } peers { permanent_uuid: "1eb8d31ae6124cd5bf4defdcada1e8b2" member_type: VOTER last_known_addr { host: "127.22.58.60" port: 34817 } } }
14:05:50.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.361304 23019 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e0fc4cd83084f2eb905d081a292954d [sys.catalog]: This master's current role is: FOLLOWER
14:05:50.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.361907 22915 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5e0fc4cd83084f2eb905d081a292954d [sys.catalog]: configured and running, proceeding with master startup.
14:05:50.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.362118 22890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1eb8d31ae6124cd5bf4defdcada1e8b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0fc4cd83084f2eb905d081a292954d" is_pre_election: true
14:05:50.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.363015 22890 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 5e0fc4cd83084f2eb905d081a292954d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1eb8d31ae6124cd5bf4defdcada1e8b2 in term 0.
14:05:50.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.364629 22945 leader_election.cc:304] T 00000000000000000000000000000000 P 1eb8d31ae6124cd5bf4defdcada1e8b2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1eb8d31ae6124cd5bf4defdcada1e8b2, 5e0fc4cd83084f2eb905d081a292954d; no voters: 
14:05:50.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.365471 23004 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1eb8d31ae6124cd5bf4defdcada1e8b2 [term 0 FOLLOWER]: Leader pre-election won for term 1
14:05:50.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.365844 23004 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1eb8d31ae6124cd5bf4defdcada1e8b2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:05:50.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.366258 23004 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1eb8d31ae6124cd5bf4defdcada1e8b2 [term 0 FOLLOWER]: Advancing to term 1
14:05:50.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.376058 23004 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1eb8d31ae6124cd5bf4defdcada1e8b2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5161cc99c47bfbc1f45835cb1d1cb" member_type: VOTER last_known_addr { host: "127.22.58.62" port: 45123 } } peers { permanent_uuid: "5e0fc4cd83084f2eb905d081a292954d" member_type: VOTER last_known_addr { host: "127.22.58.61" port: 40329 } } peers { permanent_uuid: "1eb8d31ae6124cd5bf4defdcada1e8b2" member_type: VOTER last_known_addr { host: "127.22.58.60" port: 34817 } }
14:05:50.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.386709 22890 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1eb8d31ae6124cd5bf4defdcada1e8b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5e0fc4cd83084f2eb905d081a292954d"
14:05:50.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.387496 22890 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5e0fc4cd83084f2eb905d081a292954d [term 0 FOLLOWER]: Advancing to term 1
14:05:50.395 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.390612 23004 leader_election.cc:290] T 00000000000000000000000000000000 P 1eb8d31ae6124cd5bf4defdcada1e8b2 [CANDIDATE]: Term 1 election: Requested vote from peers 1de5161cc99c47bfbc1f45835cb1d1cb (127.22.58.62:45123), 5e0fc4cd83084f2eb905d081a292954d (127.22.58.61:40329)
14:05:50.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.407869 22890 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 5e0fc4cd83084f2eb905d081a292954d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1eb8d31ae6124cd5bf4defdcada1e8b2 in term 1.
14:05:50.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.410501 22945 leader_election.cc:304] T 00000000000000000000000000000000 P 1eb8d31ae6124cd5bf4defdcada1e8b2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1eb8d31ae6124cd5bf4defdcada1e8b2, 5e0fc4cd83084f2eb905d081a292954d; no voters: 
14:05:50.411 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.411414 23004 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1eb8d31ae6124cd5bf4defdcada1e8b2 [term 1 FOLLOWER]: Leader election won for term 1
14:05:50.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.414721 23004 raft_consensus.cc:697] T 00000000000000000000000000000000 P 1eb8d31ae6124cd5bf4defdcada1e8b2 [term 1 LEADER]: Becoming Leader. State: Replica: 1eb8d31ae6124cd5bf4defdcada1e8b2, State: Running, Role: LEADER
14:05:50.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.416217 23004 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1eb8d31ae6124cd5bf4defdcada1e8b2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5161cc99c47bfbc1f45835cb1d1cb" member_type: VOTER last_known_addr { host: "127.22.58.62" port: 45123 } } peers { permanent_uuid: "5e0fc4cd83084f2eb905d081a292954d" member_type: VOTER last_known_addr { host: "127.22.58.61" port: 40329 } } peers { permanent_uuid: "1eb8d31ae6124cd5bf4defdcada1e8b2" member_type: VOTER last_known_addr { host: "127.22.58.60" port: 34817 } }
14:05:50.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.436771 23028 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1eb8d31ae6124cd5bf4defdcada1e8b2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1eb8d31ae6124cd5bf4defdcada1e8b2. Latest consensus state: current_term: 1 leader_uuid: "1eb8d31ae6124cd5bf4defdcada1e8b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5161cc99c47bfbc1f45835cb1d1cb" member_type: VOTER last_known_addr { host: "127.22.58.62" port: 45123 } } peers { permanent_uuid: "5e0fc4cd83084f2eb905d081a292954d" member_type: VOTER last_known_addr { host: "127.22.58.61" port: 40329 } } peers { permanent_uuid: "1eb8d31ae6124cd5bf4defdcada1e8b2" member_type: VOTER last_known_addr { host: "127.22.58.60" port: 34817 } } }
14:05:50.438 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.437794 23028 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1eb8d31ae6124cd5bf4defdcada1e8b2 [sys.catalog]: This master's current role is: LEADER
14:05:50.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:50.445266 23032 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 5e0fc4cd83084f2eb905d081a292954d: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
14:05:50.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:50.446167 23032 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
14:05:50.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.448141 23034 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
14:05:50.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.457701 23034 catalog_manager.cc:1520] Initializing Kudu cluster ID...
14:05:50.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.434621 22842 master_runner.cc:187] Error getting master registration for 127.22.58.62:45123: OK, instance_id { permanent_uuid: "1de5161cc99c47bfbc1f45835cb1d1cb" instance_seqno: 1783519546002391 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
14:05:50.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.479631 22842 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
14:05:50.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.485283 22890 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 5e0fc4cd83084f2eb905d081a292954d [term 1 FOLLOWER]: Refusing update from remote peer 1eb8d31ae6124cd5bf4defdcada1e8b2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
14:05:50.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.487908 23028 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 1eb8d31ae6124cd5bf4defdcada1e8b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5e0fc4cd83084f2eb905d081a292954d" member_type: VOTER last_known_addr { host: "127.22.58.61" port: 40329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:05:50.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.531608 23019 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e0fc4cd83084f2eb905d081a292954d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1eb8d31ae6124cd5bf4defdcada1e8b2. Latest consensus state: current_term: 1 leader_uuid: "1eb8d31ae6124cd5bf4defdcada1e8b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5161cc99c47bfbc1f45835cb1d1cb" member_type: VOTER last_known_addr { host: "127.22.58.62" port: 45123 } } peers { permanent_uuid: "5e0fc4cd83084f2eb905d081a292954d" member_type: VOTER last_known_addr { host: "127.22.58.61" port: 40329 } } peers { permanent_uuid: "1eb8d31ae6124cd5bf4defdcada1e8b2" member_type: VOTER last_known_addr { host: "127.22.58.60" port: 34817 } } }
14:05:50.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.532881 23019 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e0fc4cd83084f2eb905d081a292954d [sys.catalog]: This master's current role is: FOLLOWER
14:05:50.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.541127 23035 mvcc.cc:204] Tried to move back new op lower bound from 7305296078767562752 to 7305296078516977664. Current Snapshot: MvccSnapshot[applied={T|T < 7305296078767562752}]
14:05:50.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.548081 23004 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1eb8d31ae6124cd5bf4defdcada1e8b2 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1eb8d31ae6124cd5bf4defdcada1e8b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5161cc99c47bfbc1f45835cb1d1cb" member_type: VOTER last_known_addr { host: "127.22.58.62" port: 45123 } } peers { permanent_uuid: "5e0fc4cd83084f2eb905d081a292954d" member_type: VOTER last_known_addr { host: "127.22.58.61" port: 40329 } } peers { permanent_uuid: "1eb8d31ae6124cd5bf4defdcada1e8b2" member_type: VOTER last_known_addr { host: "127.22.58.60" port: 34817 } } }
14:05:50.550 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.549885 23004 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1eb8d31ae6124cd5bf4defdcada1e8b2 [sys.catalog]: This master's current role is: LEADER
14:05:50.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.550872 23034 catalog_manager.cc:1383] Generated new cluster ID: a7b07e25188f4dec852c34a6ad19f171
14:05:50.551 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.551162 23034 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
14:05:50.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.575549 23019 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e0fc4cd83084f2eb905d081a292954d [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1eb8d31ae6124cd5bf4defdcada1e8b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5161cc99c47bfbc1f45835cb1d1cb" member_type: VOTER last_known_addr { host: "127.22.58.62" port: 45123 } } peers { permanent_uuid: "5e0fc4cd83084f2eb905d081a292954d" member_type: VOTER last_known_addr { host: "127.22.58.61" port: 40329 } } peers { permanent_uuid: "1eb8d31ae6124cd5bf4defdcada1e8b2" member_type: VOTER last_known_addr { host: "127.22.58.60" port: 34817 } } }
14:05:50.577 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.576323 23019 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e0fc4cd83084f2eb905d081a292954d [sys.catalog]: This master's current role is: FOLLOWER
14:05:50.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.613574 23034 catalog_manager.cc:1406] Generated new certificate authority record
14:05:50.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.621574 23034 catalog_manager.cc:1540] Loading token signing keys...
14:05:50.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.657712 23034 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 1eb8d31ae6124cd5bf4defdcada1e8b2: Generated new TSK 0
14:05:50.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.659313 23034 catalog_manager.cc:1550] Initializing in-progress tserver states...
14:05:50.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.681797 22760 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskVqKZyE/build/tsan/bin/kudu
14:05:50.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskVqKZyE/build/tsan/bin/kudu
14:05:50.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/ts-0/wal
14:05:50.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/ts-0/data
14:05:50.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:05:50.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:05:50.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:05:50.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:05:50.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:05:50.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:05:50.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/ts-0/logs
14:05:50.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/ts-0/data/info.pb
14:05:50.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:05:50.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:05:50.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:05:50.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:05:50.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:05:50.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:05:50.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:05:50.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:05:50.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
14:05:50.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:05:50.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.22.58.1:0
14:05:50.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.22.58.1
14:05:50.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.22.58.1
14:05:50.684 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:05:50.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.22.58.62:45123,127.22.58.61:40329,127.22.58.60:34817
14:05:50.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.22.58.20:39717
14:05:50.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:05:50.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:05:50.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
14:05:50.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.782033 22840 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.22.58.60" port: 34817 } attempt: 7
14:05:50.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.844013 22840 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1de5161cc99c47bfbc1f45835cb1d1cb: Bootstrap starting.
14:05:50.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.866074 22840 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1de5161cc99c47bfbc1f45835cb1d1cb: Neither blocks nor log segments found. Creating new log.
14:05:50.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.892572 22840 log.cc:826] T 00000000000000000000000000000000 P 1de5161cc99c47bfbc1f45835cb1d1cb: Log is configured to *not* fsync() on all Append() calls
14:05:50.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:50.924008 22840 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1de5161cc99c47bfbc1f45835cb1d1cb: No bootstrap required, opened a new log
14:05:51.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:51.087476 22840 raft_consensus.cc:359] T 00000000000000000000000000000000 P 1de5161cc99c47bfbc1f45835cb1d1cb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5161cc99c47bfbc1f45835cb1d1cb" member_type: VOTER last_known_addr { host: "127.22.58.62" port: 45123 } } peers { permanent_uuid: "5e0fc4cd83084f2eb905d081a292954d" member_type: VOTER last_known_addr { host: "127.22.58.61" port: 40329 } } peers { permanent_uuid: "1eb8d31ae6124cd5bf4defdcada1e8b2" member_type: VOTER last_known_addr { host: "127.22.58.60" port: 34817 } }
14:05:51.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:51.088980 22840 raft_consensus.cc:385] T 00000000000000000000000000000000 P 1de5161cc99c47bfbc1f45835cb1d1cb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:05:51.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:51.089561 22840 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1de5161cc99c47bfbc1f45835cb1d1cb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1de5161cc99c47bfbc1f45835cb1d1cb, State: Initialized, Role: FOLLOWER
14:05:51.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:51.091178 22840 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1de5161cc99c47bfbc1f45835cb1d1cb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5161cc99c47bfbc1f45835cb1d1cb" member_type: VOTER last_known_addr { host: "127.22.58.62" port: 45123 } } peers { permanent_uuid: "5e0fc4cd83084f2eb905d081a292954d" member_type: VOTER last_known_addr { host: "127.22.58.61" port: 40329 } } peers { permanent_uuid: "1eb8d31ae6124cd5bf4defdcada1e8b2" member_type: VOTER last_known_addr { host: "127.22.58.60" port: 34817 } }
14:05:51.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:51.125487 23043 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1de5161cc99c47bfbc1f45835cb1d1cb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5161cc99c47bfbc1f45835cb1d1cb" member_type: VOTER last_known_addr { host: "127.22.58.62" port: 45123 } } peers { permanent_uuid: "5e0fc4cd83084f2eb905d081a292954d" member_type: VOTER last_known_addr { host: "127.22.58.61" port: 40329 } } peers { permanent_uuid: "1eb8d31ae6124cd5bf4defdcada1e8b2" member_type: VOTER last_known_addr { host: "127.22.58.60" port: 34817 } } }
14:05:51.127 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:51.126974 23043 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1de5161cc99c47bfbc1f45835cb1d1cb [sys.catalog]: This master's current role is: FOLLOWER
14:05:51.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:51.131615 22815 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1eb8d31ae6124cd5bf4defdcada1e8b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5161cc99c47bfbc1f45835cb1d1cb" is_pre_election: true
14:05:51.133 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:51.132514 22815 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 1de5161cc99c47bfbc1f45835cb1d1cb [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1eb8d31ae6124cd5bf4defdcada1e8b2 in term 0.
14:05:51.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:51.133556 22814 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1eb8d31ae6124cd5bf4defdcada1e8b2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1de5161cc99c47bfbc1f45835cb1d1cb"
14:05:51.140 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:51.134405 22814 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1de5161cc99c47bfbc1f45835cb1d1cb [term 0 FOLLOWER]: Advancing to term 1
14:05:51.144 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:51.143476 22814 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 1de5161cc99c47bfbc1f45835cb1d1cb [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1eb8d31ae6124cd5bf4defdcada1e8b2 in term 1.
14:05:51.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:51.145170 22813 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 1de5161cc99c47bfbc1f45835cb1d1cb [term 1 FOLLOWER]: Refusing update from remote peer 1eb8d31ae6124cd5bf4defdcada1e8b2: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
14:05:51.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:51.150482 23028 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 1eb8d31ae6124cd5bf4defdcada1e8b2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5161cc99c47bfbc1f45835cb1d1cb" member_type: VOTER last_known_addr { host: "127.22.58.62" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
14:05:51.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:51.151576 22840 sys_catalog.cc:565] T 00000000000000000000000000000000 P 1de5161cc99c47bfbc1f45835cb1d1cb [sys.catalog]: configured and running, proceeding with master startup.
14:05:51.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:51.232205 23043 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1de5161cc99c47bfbc1f45835cb1d1cb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1eb8d31ae6124cd5bf4defdcada1e8b2. Latest consensus state: current_term: 1 leader_uuid: "1eb8d31ae6124cd5bf4defdcada1e8b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5161cc99c47bfbc1f45835cb1d1cb" member_type: VOTER last_known_addr { host: "127.22.58.62" port: 45123 } } peers { permanent_uuid: "5e0fc4cd83084f2eb905d081a292954d" member_type: VOTER last_known_addr { host: "127.22.58.61" port: 40329 } } peers { permanent_uuid: "1eb8d31ae6124cd5bf4defdcada1e8b2" member_type: VOTER last_known_addr { host: "127.22.58.60" port: 34817 } } }
14:05:51.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:51.232982 23043 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1de5161cc99c47bfbc1f45835cb1d1cb [sys.catalog]: This master's current role is: FOLLOWER
14:05:51.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:51.232652 23053 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1de5161cc99c47bfbc1f45835cb1d1cb [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1eb8d31ae6124cd5bf4defdcada1e8b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5161cc99c47bfbc1f45835cb1d1cb" member_type: VOTER last_known_addr { host: "127.22.58.62" port: 45123 } } peers { permanent_uuid: "5e0fc4cd83084f2eb905d081a292954d" member_type: VOTER last_known_addr { host: "127.22.58.61" port: 40329 } } peers { permanent_uuid: "1eb8d31ae6124cd5bf4defdcada1e8b2" member_type: VOTER last_known_addr { host: "127.22.58.60" port: 34817 } } }
14:05:51.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:51.241340 23053 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1de5161cc99c47bfbc1f45835cb1d1cb [sys.catalog]: This master's current role is: FOLLOWER
14:05:51.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:51.291792 23063 catalog_manager.cc:1295] Loaded cluster ID: a7b07e25188f4dec852c34a6ad19f171
14:05:51.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:51.292106 23063 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 1de5161cc99c47bfbc1f45835cb1d1cb: loading cluster ID for follower catalog manager: success
14:05:51.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:51.300360 23063 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 1de5161cc99c47bfbc1f45835cb1d1cb: acquiring CA information for follower catalog manager: success
14:05:51.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:51.306193 23063 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 1de5161cc99c47bfbc1f45835cb1d1cb: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
14:05:51.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:51.320963 23040 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:05:51.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:51.322533 23040 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:05:51.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:51.323671 23040 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:05:51.401 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:51.400589 23040 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:05:51.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:51.403136 23040 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.58.1
14:05:51.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:51.452425 23032 catalog_manager.cc:1295] Loaded cluster ID: a7b07e25188f4dec852c34a6ad19f171
14:05:51.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:51.453249 23032 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 5e0fc4cd83084f2eb905d081a292954d: loading cluster ID for follower catalog manager: success
14:05:51.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:51.471645 23032 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 5e0fc4cd83084f2eb905d081a292954d: acquiring CA information for follower catalog manager: success
14:05:51.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:51.482350 23040 tablet_server_runner.cc:78] Tablet server non-default flags:
14:05:51.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:05:51.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.22.58.20:39717
14:05:51.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:05:51.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:05:51.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/ts-0/data
14:05:51.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/ts-0/wal
14:05:51.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:05:51.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:05:51.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.22.58.1:0
14:05:51.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:05:51.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:05:51.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:05:51.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/ts-0/data/info.pb
14:05:51.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.22.58.1
14:05:51.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:05:51.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.22.58.62:45123,127.22.58.61:40329,127.22.58.60:34817
14:05:51.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:05:51.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:05:51.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:05:51.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:05:51.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:05:51.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.22.58.1
14:05:51.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/ts-0/logs
14:05:51.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:05:51.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:05:51.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:05:51.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
14:05:51.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:05:51.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
14:05:51.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:05:51.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 13:43:23 UTC on e7f111948823
14:05:51.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12775
14:05:51.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:05:51.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:51.484840 23032 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 5e0fc4cd83084f2eb905d081a292954d: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
14:05:51.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:51.494180 23040 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:05:51.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:51.497156 23040 file_cache.cc:504] Constructed file cache file cache with capacity 419430
14:05:51.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:51.548010 23066 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:05:51.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:51.784633 23072 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1eb8d31ae6124cd5bf4defdcada1e8b2 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1eb8d31ae6124cd5bf4defdcada1e8b2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5161cc99c47bfbc1f45835cb1d1cb" member_type: VOTER last_known_addr { host: "127.22.58.62" port: 45123 } } peers { permanent_uuid: "5e0fc4cd83084f2eb905d081a292954d" member_type: VOTER last_known_addr { host: "127.22.58.61" port: 40329 } } peers { permanent_uuid: "1eb8d31ae6124cd5bf4defdcada1e8b2" member_type: VOTER last_known_addr { host: "127.22.58.60" port: 34817 } } }
14:05:51.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:51.788710 23072 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1eb8d31ae6124cd5bf4defdcada1e8b2 [sys.catalog]: This master's current role is: LEADER
14:05:53.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:51.553319 23067 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:05:53.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:52.921944 23065 debug-util.cc:398] Leaking SignalData structure 0x7b0800028000 after lost signal to thread 23040
14:05:53.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:53.641191 23065 kernel_stack_watchdog.cc:198] Thread 23040 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 369ms:
14:05:53.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
14:05:53.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
14:05:53.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
14:05:53.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
14:05:53.642 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:53.641754 23040 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 2.090s	user 0.776s	sys 1.145s
14:05:53.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:53.642087 23040 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 2.091s	user 0.776s	sys 1.145s
14:05:53.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:53.648427 23040 server_base.cc:1061] running on GCE node
14:05:53.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:53.650018 23076 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:05:53.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:53.651507 23040 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:05:53.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:53.660266 23040 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:05:53.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:53.662431 23040 hybrid_clock.cc:648] HybridClock initialized: now 1783519553662390 us; error 76 us; skew 500 ppm
14:05:53.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:53.663579 23040 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:05:53.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:53.701148 23040 webserver.cc:533] Webserver started at http://127.22.58.1:44991/ using document root <none> and password file <none>
14:05:53.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:53.702625 23040 fs_manager.cc:362] Metadata directory not provided
14:05:53.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:53.702984 23040 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:05:53.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:53.703567 23040 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:05:53.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:53.710884 23040 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/ts-0/data/instance:
14:05:53.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "df45c5d9f8974e5480402c20f2060dd7"
14:05:53.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:05:53 on dist-test-slave-gws2"
14:05:53.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:53.712595 23040 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/ts-0/wal/instance:
14:05:53.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "df45c5d9f8974e5480402c20f2060dd7"
14:05:53.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:05:53 on dist-test-slave-gws2"
14:05:53.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:53.739974 23040 fs_manager.cc:696] Time spent creating directory manager: real 0.027s	user 0.003s	sys 0.023s
14:05:53.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:53.761041 23081 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:05:53.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:53.762804 23040 fs_manager.cc:730] Time spent opening block manager: real 0.018s	user 0.013s	sys 0.005s
14:05:53.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:53.763276 23040 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/ts-0/data,/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/ts-0/wal
14:05:53.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "df45c5d9f8974e5480402c20f2060dd7"
14:05:53.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:05:53 on dist-test-slave-gws2"
14:05:53.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:53.763893 23040 fs_report.cc:389] FS layout report
14:05:53.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:05:53.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/ts-0/wal
14:05:53.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/ts-0/wal
14:05:53.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/ts-0/data/data
14:05:53.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:05:53.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:05:53.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:05:53.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:05:53.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:05:53.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:05:53.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:05:53.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:05:53.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:05:53.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:05:53.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:05:53.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:53.879354 23040 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:05:53.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:53.881376 23040 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:05:53.882 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:53.881966 23040 kserver.cc:163] Server-wide thread pool size limit: 3276
14:05:53.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:53.892478 23040 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
14:05:53.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:53.905993 23040 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
14:05:53.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:53.906311 23040 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
14:05:53.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:53.906605 23040 ts_tablet_manager.cc:616] Registered 0 tablets
14:05:53.907 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:53.906839 23040 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
14:05:54.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:54.340435 23040 rpc_server.cc:307] RPC server started. Bound to: 127.22.58.1:39871
14:05:54.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:54.340565 23194 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.58.1:39871 every 8 connection(s)
14:05:54.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:54.344188 23040 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/ts-0/data/info.pb
14:05:54.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:54.352640 22760 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskVqKZyE/build/tsan/bin/kudu as pid 23040
14:05:54.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:54.353277 22760 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/ts-0/wal/instance
14:05:54.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:54.370055 22760 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskVqKZyE/build/tsan/bin/kudu
14:05:54.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskVqKZyE/build/tsan/bin/kudu
14:05:54.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/ts-1/wal
14:05:54.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/ts-1/data
14:05:54.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:05:54.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:05:54.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:05:54.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:05:54.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:05:54.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:05:54.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/ts-1/logs
14:05:54.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/ts-1/data/info.pb
14:05:54.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:05:54.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:05:54.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:05:54.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:05:54.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:05:54.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:05:54.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:05:54.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:05:54.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
14:05:54.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:05:54.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.22.58.2:0
14:05:54.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.22.58.2
14:05:54.371 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.22.58.2
14:05:54.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:05:54.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.22.58.62:45123,127.22.58.61:40329,127.22.58.60:34817
14:05:54.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.22.58.20:39717
14:05:54.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:05:54.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:05:54.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
14:05:54.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:54.440009 23198 heartbeater.cc:344] Connected to a master server at 127.22.58.62:45123
14:05:54.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:54.440645 23198 heartbeater.cc:461] Registering TS with master...
14:05:54.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:54.442243 23198 heartbeater.cc:507] Master 127.22.58.62:45123 requested a full tablet report, sending...
14:05:54.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:54.440114 23195 heartbeater.cc:344] Connected to a master server at 127.22.58.61:40329
14:05:54.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:54.444386 23195 heartbeater.cc:461] Registering TS with master...
14:05:54.445 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:54.445317 23195 heartbeater.cc:507] Master 127.22.58.61:40329 requested a full tablet report, sending...
14:05:54.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:54.446717 22804 ts_manager.cc:194] Registered new tserver with Master: df45c5d9f8974e5480402c20f2060dd7 (127.22.58.1:39871)
14:05:54.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:54.449210 22880 ts_manager.cc:194] Registered new tserver with Master: df45c5d9f8974e5480402c20f2060dd7 (127.22.58.1:39871)
14:05:54.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:54.455402 23196 heartbeater.cc:344] Connected to a master server at 127.22.58.60:34817
14:05:54.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:54.455830 23196 heartbeater.cc:461] Registering TS with master...
14:05:54.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:54.457276 23196 heartbeater.cc:507] Master 127.22.58.60:34817 requested a full tablet report, sending...
14:05:54.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:54.460106 22961 ts_manager.cc:194] Registered new tserver with Master: df45c5d9f8974e5480402c20f2060dd7 (127.22.58.1:39871)
14:05:54.463 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:54.463409 22961 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.22.58.1:33751
14:05:54.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:54.784222 23203 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:05:54.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:54.784989 23203 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:05:54.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:54.786053 23203 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:05:54.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:54.820786 23203 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:05:54.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:54.821609 23203 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.58.2
14:05:54.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:54.861577 23203 tablet_server_runner.cc:78] Tablet server non-default flags:
14:05:54.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:05:54.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.22.58.20:39717
14:05:54.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:05:54.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:05:54.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/ts-1/data
14:05:54.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/ts-1/wal
14:05:54.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:05:54.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:05:54.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.22.58.2:0
14:05:54.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:05:54.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:05:54.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:05:54.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/ts-1/data/info.pb
14:05:54.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.22.58.2
14:05:54.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:05:54.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.22.58.62:45123,127.22.58.61:40329,127.22.58.60:34817
14:05:54.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:05:54.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:05:54.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:05:54.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:05:54.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:05:54.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.22.58.2
14:05:54.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/ts-1/logs
14:05:54.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:05:54.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:05:54.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:05:54.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
14:05:54.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:05:54.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
14:05:54.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:05:54.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 13:43:23 UTC on e7f111948823
14:05:54.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12775
14:05:54.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:05:54.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:54.862960 23203 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:05:54.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:54.865278 23203 file_cache.cc:504] Constructed file cache file cache with capacity 419430
14:05:54.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:54.885227 23212 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:05:55.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:55.468011 23196 heartbeater.cc:499] Master 127.22.58.60:34817 was elected leader, sending a full tablet report...
14:05:56.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:54.887663 23213 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:05:56.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:56.286219 23203 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 1.400s	user 0.523s	sys 0.857s
14:05:56.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:56.286603 23203 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 1.401s	user 0.523s	sys 0.857s
14:05:56.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.288362 23203 server_base.cc:1061] running on GCE node
14:05:56.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:56.290620 23218 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:05:56.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.292004 23203 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:05:56.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.294713 23203 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:05:56.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.296114 23203 hybrid_clock.cc:648] HybridClock initialized: now 1783519556296043 us; error 80 us; skew 500 ppm
14:05:56.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.297032 23203 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:05:56.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.305720 23203 webserver.cc:533] Webserver started at http://127.22.58.2:37843/ using document root <none> and password file <none>
14:05:56.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.306850 23203 fs_manager.cc:362] Metadata directory not provided
14:05:56.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.307116 23203 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:05:56.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.307693 23203 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:05:56.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.312394 23203 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/ts-1/data/instance:
14:05:56.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f4cda0dfc9224c0ab833c4e2024b9bc5"
14:05:56.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:05:56 on dist-test-slave-gws2"
14:05:56.313 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.313678 23203 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/ts-1/wal/instance:
14:05:56.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f4cda0dfc9224c0ab833c4e2024b9bc5"
14:05:56.314 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:05:56 on dist-test-slave-gws2"
14:05:56.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.323536 23203 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.011s	sys 0.000s
14:05:56.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.330408 23223 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:05:56.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.332194 23203 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.003s	sys 0.001s
14:05:56.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.332523 23203 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/ts-1/data,/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/ts-1/wal
14:05:56.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f4cda0dfc9224c0ab833c4e2024b9bc5"
14:05:56.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:05:56 on dist-test-slave-gws2"
14:05:56.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.332840 23203 fs_report.cc:389] FS layout report
14:05:56.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:05:56.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/ts-1/wal
14:05:56.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/ts-1/wal
14:05:56.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/ts-1/data/data
14:05:56.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:05:56.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:05:56.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:05:56.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:05:56.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:05:56.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:05:56.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:05:56.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:05:56.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:05:56.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:05:56.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:05:56.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.431456 23203 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:05:56.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.432967 23203 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:05:56.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.433575 23203 kserver.cc:163] Server-wide thread pool size limit: 3276
14:05:56.436 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.436633 23203 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
14:05:56.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.440990 23203 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
14:05:56.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.441254 23203 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
14:05:56.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.441571 23203 ts_tablet_manager.cc:616] Registered 0 tablets
14:05:56.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.441797 23203 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
14:05:56.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.590170 23203 rpc_server.cc:307] RPC server started. Bound to: 127.22.58.2:35329
14:05:56.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.590387 23336 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.58.2:35329 every 8 connection(s)
14:05:56.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.593236 23203 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/ts-1/data/info.pb
14:05:56.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.596958 22760 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskVqKZyE/build/tsan/bin/kudu as pid 23203
14:05:56.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.597429 22760 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/ts-1/wal/instance
14:05:56.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.620241 22760 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskVqKZyE/build/tsan/bin/kudu
14:05:56.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskVqKZyE/build/tsan/bin/kudu
14:05:56.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/ts-2/wal
14:05:56.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/ts-2/data
14:05:56.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:05:56.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:05:56.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:05:56.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:05:56.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:05:56.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:05:56.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/ts-2/logs
14:05:56.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/ts-2/data/info.pb
14:05:56.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:05:56.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:05:56.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:05:56.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:05:56.621 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:05:56.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:05:56.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:05:56.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:05:56.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
14:05:56.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:05:56.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.22.58.3:0
14:05:56.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.22.58.3
14:05:56.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.22.58.3
14:05:56.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:05:56.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.22.58.62:45123,127.22.58.61:40329,127.22.58.60:34817
14:05:56.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.22.58.20:39717
14:05:56.622 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:05:56.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:05:56.623 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
14:05:56.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.646773 23337 heartbeater.cc:344] Connected to a master server at 127.22.58.61:40329
14:05:56.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.647400 23337 heartbeater.cc:461] Registering TS with master...
14:05:56.649 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.648996 23338 heartbeater.cc:344] Connected to a master server at 127.22.58.60:34817
14:05:56.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.649366 23338 heartbeater.cc:461] Registering TS with master...
14:05:56.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.649406 23337 heartbeater.cc:507] Master 127.22.58.61:40329 requested a full tablet report, sending...
14:05:56.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.650243 23339 heartbeater.cc:344] Connected to a master server at 127.22.58.62:45123
14:05:56.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.650398 23338 heartbeater.cc:507] Master 127.22.58.60:34817 requested a full tablet report, sending...
14:05:56.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.650606 23339 heartbeater.cc:461] Registering TS with master...
14:05:56.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.651561 23339 heartbeater.cc:507] Master 127.22.58.62:45123 requested a full tablet report, sending...
14:05:56.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.653671 22961 ts_manager.cc:194] Registered new tserver with Master: f4cda0dfc9224c0ab833c4e2024b9bc5 (127.22.58.2:35329)
14:05:56.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.653753 22880 ts_manager.cc:194] Registered new tserver with Master: f4cda0dfc9224c0ab833c4e2024b9bc5 (127.22.58.2:35329)
14:05:56.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.654829 22804 ts_manager.cc:194] Registered new tserver with Master: f4cda0dfc9224c0ab833c4e2024b9bc5 (127.22.58.2:35329)
14:05:56.656 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:56.655489 22961 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.22.58.2:51027
14:05:56.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:56.961769 23347 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:05:56.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:56.962345 23347 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:05:56.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:56.963019 23347 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:05:56.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:56.995977 23347 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:05:56.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:56.997033 23347 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.22.58.3
14:05:57.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:57.034627 23347 tablet_server_runner.cc:78] Tablet server non-default flags:
14:05:57.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:05:57.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.22.58.20:39717
14:05:57.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:05:57.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:05:57.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/ts-2/data
14:05:57.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/ts-2/wal
14:05:57.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:05:57.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:05:57.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.22.58.3:0
14:05:57.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:05:57.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:05:57.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:05:57.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/ts-2/data/info.pb
14:05:57.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.22.58.3
14:05:57.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:05:57.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.22.58.62:45123,127.22.58.61:40329,127.22.58.60:34817
14:05:57.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:05:57.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:05:57.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:05:57.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:05:57.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:05:57.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.22.58.3
14:05:57.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/ts-2/logs
14:05:57.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:05:57.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:05:57.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:05:57.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
14:05:57.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:05:57.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
14:05:57.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:05:57.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 13:43:23 UTC on e7f111948823
14:05:57.036 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12775
14:05:57.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:05:57.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:57.036454 23347 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:05:57.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:57.038324 23347 file_cache.cc:504] Constructed file cache file cache with capacity 419430
14:05:57.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:57.053771 23353 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:05:57.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:57.659049 23338 heartbeater.cc:499] Master 127.22.58.60:34817 was elected leader, sending a full tablet report...
14:05:58.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:57.059485 23356 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:05:58.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:57.054296 23354 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:05:58.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:58.316958 23355 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1258 milliseconds
14:05:58.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:58.317067 23347 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:05:58.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:58.318320 23347 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:05:58.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:58.321098 23347 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:05:58.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:58.322537 23347 hybrid_clock.cc:648] HybridClock initialized: now 1783519558322474 us; error 77 us; skew 500 ppm
14:05:58.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:58.323388 23347 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:05:58.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:58.329651 23347 webserver.cc:533] Webserver started at http://127.22.58.3:40961/ using document root <none> and password file <none>
14:05:58.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:58.330698 23347 fs_manager.cc:362] Metadata directory not provided
14:05:58.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:58.330957 23347 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:05:58.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:58.331501 23347 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:05:58.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:58.335906 23347 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/ts-2/data/instance:
14:05:58.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "a3562026b7e6436bb92b95243852ed77"
14:05:58.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:05:58 on dist-test-slave-gws2"
14:05:58.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:58.337375 23347 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/ts-2/wal/instance:
14:05:58.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "a3562026b7e6436bb92b95243852ed77"
14:05:58.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:05:58 on dist-test-slave-gws2"
14:05:58.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:58.345292 23347 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.000s	sys 0.007s
14:05:58.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:58.351099 23365 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:05:58.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:58.352288 23347 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.001s
14:05:58.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:58.352579 23347 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/ts-2/data,/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/ts-2/wal
14:05:58.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "a3562026b7e6436bb92b95243852ed77"
14:05:58.352 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:05:58 on dist-test-slave-gws2"
14:05:58.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:58.352891 23347 fs_report.cc:389] FS layout report
14:05:58.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:05:58.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/ts-2/wal
14:05:58.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/ts-2/wal
14:05:58.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/ts-2/data/data
14:05:58.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:05:58.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:05:58.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:05:58.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:05:58.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:05:58.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:05:58.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:05:58.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:05:58.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:05:58.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:05:58.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:05:58.400 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:58.400115 23347 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:05:58.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:58.401585 23347 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:05:58.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:58.402007 23347 kserver.cc:163] Server-wide thread pool size limit: 3276
14:05:58.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:58.404789 23347 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
14:05:58.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:58.409178 23347 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
14:05:58.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:58.409407 23347 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
14:05:58.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:58.409610 23347 ts_tablet_manager.cc:616] Registered 0 tablets
14:05:58.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:58.409759 23347 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
14:05:58.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:58.567019 23347 rpc_server.cc:307] RPC server started. Bound to: 127.22.58.3:42361
14:05:58.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:58.567119 23477 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.22.58.3:42361 every 8 connection(s)
14:05:58.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:58.569655 23347 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/ts-2/data/info.pb
14:05:58.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:58.572445 22760 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskVqKZyE/build/tsan/bin/kudu as pid 23347
14:05:58.574 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:58.573369 22760 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/ts-2/wal/instance
14:05:58.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:58.626250 23478 heartbeater.cc:344] Connected to a master server at 127.22.58.61:40329
14:05:58.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:58.626789 23478 heartbeater.cc:461] Registering TS with master...
14:05:58.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:58.628934 23478 heartbeater.cc:507] Master 127.22.58.61:40329 requested a full tablet report, sending...
14:05:58.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:58.629720 23480 heartbeater.cc:344] Connected to a master server at 127.22.58.62:45123
14:05:58.630 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:58.630050 23480 heartbeater.cc:461] Registering TS with master...
14:05:58.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:58.630885 23480 heartbeater.cc:507] Master 127.22.58.62:45123 requested a full tablet report, sending...
14:05:58.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:58.633936 23479 heartbeater.cc:344] Connected to a master server at 127.22.58.60:34817
14:05:58.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:58.634299 23479 heartbeater.cc:461] Registering TS with master...
14:05:58.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:58.634822 22804 ts_manager.cc:194] Registered new tserver with Master: a3562026b7e6436bb92b95243852ed77 (127.22.58.3:42361)
14:05:58.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:58.634537 22880 ts_manager.cc:194] Registered new tserver with Master: a3562026b7e6436bb92b95243852ed77 (127.22.58.3:42361)
14:05:58.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:58.635286 23479 heartbeater.cc:507] Master 127.22.58.60:34817 requested a full tablet report, sending...
14:05:58.639 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:58.638929 22961 ts_manager.cc:194] Registered new tserver with Master: a3562026b7e6436bb92b95243852ed77 (127.22.58.3:42361)
14:05:58.641 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:58.640911 22961 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.22.58.3:54963
14:05:58.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:58.647151 22760 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
14:05:58.659 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
14:05:58.661 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

14:05:58.671 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.22.58.62"
      port: 45123
    }
    bound_http_address {
      host: "127.22.58.62"
      port: 36183
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.22.58.61"
      port: 40329
    }
    bound_http_address {
      host: "127.22.58.61"
      port: 44491
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.22.58.60"
      port: 34817
    }
    bound_http_address {
      host: "127.22.58.60"
      port: 41583
    }
  }
}

14:05:58.675 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

14:05:58.677 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.22.58.1"
      port: 39871
    }
    bound_http_address {
      host: "127.22.58.1"
      port: 44991
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.22.58.2"
      port: 35329
    }
    bound_http_address {
      host: "127.22.58.2"
      port: 37843
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.22.58.3"
      port: 42361
    }
    bound_http_address {
      host: "127.22.58.3"
      port: 40961
    }
  }
}

14:05:58.677 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
14:05:58.846 [DEBUG - main] (CompositeStrategy.java:59) Unable to load modern Subject methods, relying only on legacy methods
java.lang.NoSuchMethodException: javax.security.auth.Subject.current()
	at java.base/java.lang.Class.getDeclaredMethod(Class.java:2677)
	at org.apache.kudu.client.internals.ModernStrategy.<init>(ModernStrategy.java:51)
	at org.apache.kudu.client.internals.CompositeStrategy.<init>(CompositeStrategy.java:52)
	at org.apache.kudu.client.internals.CompositeStrategy.<clinit>(CompositeStrategy.java:41)
	at org.apache.kudu.client.internals.SecurityManagerCompatibility.get(SecurityManagerCompatibility.java:43)
	at org.apache.kudu.client.SecurityContext.setupSubject(SecurityContext.java:155)
	at org.apache.kudu.client.SecurityContext.<init>(SecurityContext.java:138)
	at org.apache.kudu.client.AsyncKuduClient.<init>(AsyncKuduClient.java:431)
	at org.apache.kudu.client.AsyncKuduClient$AsyncKuduClientBuilder.build(AsyncKuduClient.java:3109)
	at org.apache.kudu.test.KuduTestHarness.before(KuduTestHarness.java:161)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:50)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.doOneAttemptAndReport(RetryRule.java:184)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.evaluate(RetryRule.java:244)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runners.Suite.runChild(Suite.java:128)
	at org.junit.runners.Suite.runChild(Suite.java:27)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
	at org.junit.runner.JUnitCore.runMain(JUnitCore.java:77)
	at org.junit.runner.JUnitCore.main(JUnitCore.java:36)
14:05:58.935 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:05:59.140 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.22.58.62:45123(127.22.58.62:45123)] connecting to peer
14:05:59.191 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.22.58.60:34817(127.22.58.60:34817)] connecting to peer
14:05:59.192 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.22.58.61:40329(127.22.58.61:40329)] connecting to peer
14:05:59.214 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.22.58.62:45123(127.22.58.62:45123)] Successfully connected to peer
14:05:59.219 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.22.58.60:34817(127.22.58.60:34817)] Successfully connected to peer
14:05:59.219 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.22.58.61:40329(127.22.58.61:40329)] Successfully connected to peer
14:05:59.318 [DEBUG - kudu-nio-1] (Negotiator.java:528) SASL mechanism PLAIN chosen for peer 127.22.58.60
14:05:59.323 [DEBUG - kudu-nio-0] (Negotiator.java:528) SASL mechanism PLAIN chosen for peer 127.22.58.62
14:05:59.323 [DEBUG - kudu-nio-2] (Negotiator.java:528) SASL mechanism PLAIN chosen for peer 127.22.58.61
14:05:59.566 [DEBUG - kudu-nio-0] (Negotiator.java:918) Authenticated connection [id: 0x5881aa6b, L:/127.0.0.1:60612 - R:/127.22.58.62:45123] using SASL/PLAIN
14:05:59.568 [DEBUG - kudu-nio-2] (Negotiator.java:918) Authenticated connection [id: 0x4098c5de, L:/127.0.0.1:46898 - R:/127.22.58.61:40329] using SASL/PLAIN
14:05:59.570 [DEBUG - kudu-nio-1] (Negotiator.java:918) Authenticated connection [id: 0x1bdbe5a6, L:/127.0.0.1:36188 - R:/127.22.58.60:34817] using SASL/PLAIN
14:05:59.607 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:05:59.608 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=528), Traces: [0ms] refreshing cache from master, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.58.62:45123, [107ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.58.60:34817, [108ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.58.61:40329, [499ms] Sub RPC ConnectToMaster: received response from server master-127.22.58.61:40329: OK, [499ms] Sub RPC ConnectToMaster: received response from server master-127.22.58.60:34817: OK, [499ms] Sub RPC ConnectToMaster: received response from server master-127.22.58.62:45123: OK, deferred=null) after lookup
14:05:59.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.644761 23479 heartbeater.cc:499] Master 127.22.58.60:34817 was elected leader, sending a full tablet report...
14:05:59.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.660858 22961 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36188:
14:05:59.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "org.apache.kudu.client.TestClientFailoverSupport-KILL"
14:05:59.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
14:05:59.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:05:59.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key"
14:05:59.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
14:05:59.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
14:05:59.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:05:59.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:05:59.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:05:59.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:05:59.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:05:59.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:05:59.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column1_i"
14:05:59.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
14:05:59.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:05:59.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:05:59.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:05:59.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:05:59.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:05:59.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:05:59.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:05:59.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column2_i"
14:05:59.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
14:05:59.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:05:59.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:05:59.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:05:59.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:05:59.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:05:59.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:05:59.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:05:59.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column3_s"
14:05:59.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
14:05:59.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:05:59.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: true
14:05:59.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: DICT_ENCODING
14:05:59.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: LZ4
14:05:59.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 4096
14:05:59.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:05:59.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:05:59.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:05:59.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:05:59.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column4_b"
14:05:59.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BOOL
14:05:59.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:05:59.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:05:59.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:05:59.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:05:59.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:05:59.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:05:59.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
14:05:59.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
14:05:59.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
14:05:59.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
14:05:59.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key"
14:05:59.665 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
14:05:59.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:05:59.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
14:05:59.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:59.666805 22961 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table org.apache.kudu.client.TestClientFailoverSupport-KILL in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
14:05:59.738 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 98be1a8ae0d147efafe7dda9cf112c37
14:05:59.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.764658 23272 tablet_service.cc:1511] Processing CreateTablet for tablet 1351b51b98644daba15a8cc44c66056a (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-KILL [id=98be1a8ae0d147efafe7dda9cf112c37]), partition=RANGE (key) PARTITION UNBOUNDED
14:05:59.767 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.767067 23272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1351b51b98644daba15a8cc44c66056a. 1 dirs total, 0 dirs full, 0 dirs failed
14:05:59.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.776019 23413 tablet_service.cc:1511] Processing CreateTablet for tablet 1351b51b98644daba15a8cc44c66056a (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-KILL [id=98be1a8ae0d147efafe7dda9cf112c37]), partition=RANGE (key) PARTITION UNBOUNDED
14:05:59.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.777140 23130 tablet_service.cc:1511] Processing CreateTablet for tablet 1351b51b98644daba15a8cc44c66056a (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-KILL [id=98be1a8ae0d147efafe7dda9cf112c37]), partition=RANGE (key) PARTITION UNBOUNDED
14:05:59.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.779146 23413 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1351b51b98644daba15a8cc44c66056a. 1 dirs total, 0 dirs full, 0 dirs failed
14:05:59.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.779480 23130 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1351b51b98644daba15a8cc44c66056a. 1 dirs total, 0 dirs full, 0 dirs failed
14:05:59.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.795168 23514 tablet_bootstrap.cc:492] T 1351b51b98644daba15a8cc44c66056a P f4cda0dfc9224c0ab833c4e2024b9bc5: Bootstrap starting.
14:05:59.803 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.803099 23514 tablet_bootstrap.cc:654] T 1351b51b98644daba15a8cc44c66056a P f4cda0dfc9224c0ab833c4e2024b9bc5: Neither blocks nor log segments found. Creating new log.
14:05:59.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.806978 23514 log.cc:826] T 1351b51b98644daba15a8cc44c66056a P f4cda0dfc9224c0ab833c4e2024b9bc5: Log is configured to *not* fsync() on all Append() calls
14:05:59.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.812541 23517 tablet_bootstrap.cc:492] T 1351b51b98644daba15a8cc44c66056a P df45c5d9f8974e5480402c20f2060dd7: Bootstrap starting.
14:05:59.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.813696 23516 tablet_bootstrap.cc:492] T 1351b51b98644daba15a8cc44c66056a P a3562026b7e6436bb92b95243852ed77: Bootstrap starting.
14:05:59.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.813755 23514 tablet_bootstrap.cc:492] T 1351b51b98644daba15a8cc44c66056a P f4cda0dfc9224c0ab833c4e2024b9bc5: No bootstrap required, opened a new log
14:05:59.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.814278 23514 ts_tablet_manager.cc:1403] T 1351b51b98644daba15a8cc44c66056a P f4cda0dfc9224c0ab833c4e2024b9bc5: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.005s
14:05:59.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.820576 23516 tablet_bootstrap.cc:654] T 1351b51b98644daba15a8cc44c66056a P a3562026b7e6436bb92b95243852ed77: Neither blocks nor log segments found. Creating new log.
14:05:59.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.821166 23517 tablet_bootstrap.cc:654] T 1351b51b98644daba15a8cc44c66056a P df45c5d9f8974e5480402c20f2060dd7: Neither blocks nor log segments found. Creating new log.
14:05:59.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.822728 23516 log.cc:826] T 1351b51b98644daba15a8cc44c66056a P a3562026b7e6436bb92b95243852ed77: Log is configured to *not* fsync() on all Append() calls
14:05:59.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.824648 23517 log.cc:826] T 1351b51b98644daba15a8cc44c66056a P df45c5d9f8974e5480402c20f2060dd7: Log is configured to *not* fsync() on all Append() calls
14:05:59.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.830559 23516 tablet_bootstrap.cc:492] T 1351b51b98644daba15a8cc44c66056a P a3562026b7e6436bb92b95243852ed77: No bootstrap required, opened a new log
14:05:59.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.831113 23516 ts_tablet_manager.cc:1403] T 1351b51b98644daba15a8cc44c66056a P a3562026b7e6436bb92b95243852ed77: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.007s
14:05:59.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.831470 23517 tablet_bootstrap.cc:492] T 1351b51b98644daba15a8cc44c66056a P df45c5d9f8974e5480402c20f2060dd7: No bootstrap required, opened a new log
14:05:59.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.832077 23517 ts_tablet_manager.cc:1403] T 1351b51b98644daba15a8cc44c66056a P df45c5d9f8974e5480402c20f2060dd7: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.009s
14:05:59.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.843086 23514 raft_consensus.cc:359] T 1351b51b98644daba15a8cc44c66056a P f4cda0dfc9224c0ab833c4e2024b9bc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4cda0dfc9224c0ab833c4e2024b9bc5" member_type: VOTER last_known_addr { host: "127.22.58.2" port: 35329 } } peers { permanent_uuid: "a3562026b7e6436bb92b95243852ed77" member_type: VOTER last_known_addr { host: "127.22.58.3" port: 42361 } } peers { permanent_uuid: "df45c5d9f8974e5480402c20f2060dd7" member_type: VOTER last_known_addr { host: "127.22.58.1" port: 39871 } }
14:05:59.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.844504 23514 raft_consensus.cc:385] T 1351b51b98644daba15a8cc44c66056a P f4cda0dfc9224c0ab833c4e2024b9bc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:05:59.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.845062 23514 raft_consensus.cc:740] T 1351b51b98644daba15a8cc44c66056a P f4cda0dfc9224c0ab833c4e2024b9bc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f4cda0dfc9224c0ab833c4e2024b9bc5, State: Initialized, Role: FOLLOWER
14:05:59.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.846354 23514 consensus_queue.cc:260] T 1351b51b98644daba15a8cc44c66056a P f4cda0dfc9224c0ab833c4e2024b9bc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4cda0dfc9224c0ab833c4e2024b9bc5" member_type: VOTER last_known_addr { host: "127.22.58.2" port: 35329 } } peers { permanent_uuid: "a3562026b7e6436bb92b95243852ed77" member_type: VOTER last_known_addr { host: "127.22.58.3" port: 42361 } } peers { permanent_uuid: "df45c5d9f8974e5480402c20f2060dd7" member_type: VOTER last_known_addr { host: "127.22.58.1" port: 39871 } }
14:05:59.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.852547 23514 ts_tablet_manager.cc:1434] T 1351b51b98644daba15a8cc44c66056a P f4cda0dfc9224c0ab833c4e2024b9bc5: Time spent starting tablet: real 0.038s	user 0.029s	sys 0.003s
14:05:59.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.863062 23517 raft_consensus.cc:359] T 1351b51b98644daba15a8cc44c66056a P df45c5d9f8974e5480402c20f2060dd7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4cda0dfc9224c0ab833c4e2024b9bc5" member_type: VOTER last_known_addr { host: "127.22.58.2" port: 35329 } } peers { permanent_uuid: "a3562026b7e6436bb92b95243852ed77" member_type: VOTER last_known_addr { host: "127.22.58.3" port: 42361 } } peers { permanent_uuid: "df45c5d9f8974e5480402c20f2060dd7" member_type: VOTER last_known_addr { host: "127.22.58.1" port: 39871 } }
14:05:59.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.864091 23517 raft_consensus.cc:385] T 1351b51b98644daba15a8cc44c66056a P df45c5d9f8974e5480402c20f2060dd7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:05:59.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.864297 23517 raft_consensus.cc:740] T 1351b51b98644daba15a8cc44c66056a P df45c5d9f8974e5480402c20f2060dd7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df45c5d9f8974e5480402c20f2060dd7, State: Initialized, Role: FOLLOWER
14:05:59.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:59.865540 23342 tablet.cc:2406] T 1351b51b98644daba15a8cc44c66056a P f4cda0dfc9224c0ab833c4e2024b9bc5: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:05:59.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.866243 23517 consensus_queue.cc:260] T 1351b51b98644daba15a8cc44c66056a P df45c5d9f8974e5480402c20f2060dd7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4cda0dfc9224c0ab833c4e2024b9bc5" member_type: VOTER last_known_addr { host: "127.22.58.2" port: 35329 } } peers { permanent_uuid: "a3562026b7e6436bb92b95243852ed77" member_type: VOTER last_known_addr { host: "127.22.58.3" port: 42361 } } peers { permanent_uuid: "df45c5d9f8974e5480402c20f2060dd7" member_type: VOTER last_known_addr { host: "127.22.58.1" port: 39871 } }
14:05:59.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.867373 23516 raft_consensus.cc:359] T 1351b51b98644daba15a8cc44c66056a P a3562026b7e6436bb92b95243852ed77 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4cda0dfc9224c0ab833c4e2024b9bc5" member_type: VOTER last_known_addr { host: "127.22.58.2" port: 35329 } } peers { permanent_uuid: "a3562026b7e6436bb92b95243852ed77" member_type: VOTER last_known_addr { host: "127.22.58.3" port: 42361 } } peers { permanent_uuid: "df45c5d9f8974e5480402c20f2060dd7" member_type: VOTER last_known_addr { host: "127.22.58.1" port: 39871 } }
14:05:59.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.868254 23516 raft_consensus.cc:385] T 1351b51b98644daba15a8cc44c66056a P a3562026b7e6436bb92b95243852ed77 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:05:59.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.868554 23516 raft_consensus.cc:740] T 1351b51b98644daba15a8cc44c66056a P a3562026b7e6436bb92b95243852ed77 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a3562026b7e6436bb92b95243852ed77, State: Initialized, Role: FOLLOWER
14:05:59.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.869478 23516 consensus_queue.cc:260] T 1351b51b98644daba15a8cc44c66056a P a3562026b7e6436bb92b95243852ed77 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4cda0dfc9224c0ab833c4e2024b9bc5" member_type: VOTER last_known_addr { host: "127.22.58.2" port: 35329 } } peers { permanent_uuid: "a3562026b7e6436bb92b95243852ed77" member_type: VOTER last_known_addr { host: "127.22.58.3" port: 42361 } } peers { permanent_uuid: "df45c5d9f8974e5480402c20f2060dd7" member_type: VOTER last_known_addr { host: "127.22.58.1" port: 39871 } }
14:05:59.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.874243 23516 ts_tablet_manager.cc:1434] T 1351b51b98644daba15a8cc44c66056a P a3562026b7e6436bb92b95243852ed77: Time spent starting tablet: real 0.043s	user 0.023s	sys 0.013s
14:05:59.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.888307 23517 ts_tablet_manager.cc:1434] T 1351b51b98644daba15a8cc44c66056a P df45c5d9f8974e5480402c20f2060dd7: Time spent starting tablet: real 0.056s	user 0.023s	sys 0.015s
14:05:59.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:05:59.905922 23200 tablet.cc:2406] T 1351b51b98644daba15a8cc44c66056a P df45c5d9f8974e5480402c20f2060dd7: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:05:59.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.970927 23521 raft_consensus.cc:493] T 1351b51b98644daba15a8cc44c66056a P df45c5d9f8974e5480402c20f2060dd7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:05:59.972 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.971391 23521 raft_consensus.cc:515] T 1351b51b98644daba15a8cc44c66056a P df45c5d9f8974e5480402c20f2060dd7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4cda0dfc9224c0ab833c4e2024b9bc5" member_type: VOTER last_known_addr { host: "127.22.58.2" port: 35329 } } peers { permanent_uuid: "a3562026b7e6436bb92b95243852ed77" member_type: VOTER last_known_addr { host: "127.22.58.3" port: 42361 } } peers { permanent_uuid: "df45c5d9f8974e5480402c20f2060dd7" member_type: VOTER last_known_addr { host: "127.22.58.1" port: 39871 } }
14:05:59.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.974025 23521 leader_election.cc:290] T 1351b51b98644daba15a8cc44c66056a P df45c5d9f8974e5480402c20f2060dd7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f4cda0dfc9224c0ab833c4e2024b9bc5 (127.22.58.2:35329), a3562026b7e6436bb92b95243852ed77 (127.22.58.3:42361)
14:05:59.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.987548 23292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1351b51b98644daba15a8cc44c66056a" candidate_uuid: "df45c5d9f8974e5480402c20f2060dd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4cda0dfc9224c0ab833c4e2024b9bc5" is_pre_election: true
14:05:59.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.987540 23433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1351b51b98644daba15a8cc44c66056a" candidate_uuid: "df45c5d9f8974e5480402c20f2060dd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3562026b7e6436bb92b95243852ed77" is_pre_election: true
14:05:59.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.988485 23433 raft_consensus.cc:2468] T 1351b51b98644daba15a8cc44c66056a P a3562026b7e6436bb92b95243852ed77 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df45c5d9f8974e5480402c20f2060dd7 in term 0.
14:05:59.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.988487 23292 raft_consensus.cc:2468] T 1351b51b98644daba15a8cc44c66056a P f4cda0dfc9224c0ab833c4e2024b9bc5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df45c5d9f8974e5480402c20f2060dd7 in term 0.
14:05:59.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.989920 23082 leader_election.cc:304] T 1351b51b98644daba15a8cc44c66056a P df45c5d9f8974e5480402c20f2060dd7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: df45c5d9f8974e5480402c20f2060dd7, f4cda0dfc9224c0ab833c4e2024b9bc5; no voters: 
14:05:59.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.990685 23521 raft_consensus.cc:2804] T 1351b51b98644daba15a8cc44c66056a P df45c5d9f8974e5480402c20f2060dd7 [term 0 FOLLOWER]: Leader pre-election won for term 1
14:05:59.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.990942 23521 raft_consensus.cc:493] T 1351b51b98644daba15a8cc44c66056a P df45c5d9f8974e5480402c20f2060dd7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:05:59.991 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.991137 23521 raft_consensus.cc:3060] T 1351b51b98644daba15a8cc44c66056a P df45c5d9f8974e5480402c20f2060dd7 [term 0 FOLLOWER]: Advancing to term 1
14:05:59.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.995762 23521 raft_consensus.cc:515] T 1351b51b98644daba15a8cc44c66056a P df45c5d9f8974e5480402c20f2060dd7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4cda0dfc9224c0ab833c4e2024b9bc5" member_type: VOTER last_known_addr { host: "127.22.58.2" port: 35329 } } peers { permanent_uuid: "a3562026b7e6436bb92b95243852ed77" member_type: VOTER last_known_addr { host: "127.22.58.3" port: 42361 } } peers { permanent_uuid: "df45c5d9f8974e5480402c20f2060dd7" member_type: VOTER last_known_addr { host: "127.22.58.1" port: 39871 } }
14:05:59.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.997377 23521 leader_election.cc:290] T 1351b51b98644daba15a8cc44c66056a P df45c5d9f8974e5480402c20f2060dd7 [CANDIDATE]: Term 1 election: Requested vote from peers f4cda0dfc9224c0ab833c4e2024b9bc5 (127.22.58.2:35329), a3562026b7e6436bb92b95243852ed77 (127.22.58.3:42361)
14:05:59.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.998220 23292 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1351b51b98644daba15a8cc44c66056a" candidate_uuid: "df45c5d9f8974e5480402c20f2060dd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f4cda0dfc9224c0ab833c4e2024b9bc5"
14:05:59.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.998404 23433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1351b51b98644daba15a8cc44c66056a" candidate_uuid: "df45c5d9f8974e5480402c20f2060dd7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a3562026b7e6436bb92b95243852ed77"
14:05:59.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.998795 23292 raft_consensus.cc:3060] T 1351b51b98644daba15a8cc44c66056a P f4cda0dfc9224c0ab833c4e2024b9bc5 [term 0 FOLLOWER]: Advancing to term 1
14:05:59.999 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:05:59.998939 23433 raft_consensus.cc:3060] T 1351b51b98644daba15a8cc44c66056a P a3562026b7e6436bb92b95243852ed77 [term 0 FOLLOWER]: Advancing to term 1
14:06:00.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:00.006588 23433 raft_consensus.cc:2468] T 1351b51b98644daba15a8cc44c66056a P a3562026b7e6436bb92b95243852ed77 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df45c5d9f8974e5480402c20f2060dd7 in term 1.
14:06:00.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:00.006588 23292 raft_consensus.cc:2468] T 1351b51b98644daba15a8cc44c66056a P f4cda0dfc9224c0ab833c4e2024b9bc5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df45c5d9f8974e5480402c20f2060dd7 in term 1.
14:06:00.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:00.007792 23082 leader_election.cc:304] T 1351b51b98644daba15a8cc44c66056a P df45c5d9f8974e5480402c20f2060dd7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: df45c5d9f8974e5480402c20f2060dd7, f4cda0dfc9224c0ab833c4e2024b9bc5; no voters: 
14:06:00.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:00.008567 23521 raft_consensus.cc:2804] T 1351b51b98644daba15a8cc44c66056a P df45c5d9f8974e5480402c20f2060dd7 [term 1 FOLLOWER]: Leader election won for term 1
14:06:00.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:00.011212 23521 raft_consensus.cc:697] T 1351b51b98644daba15a8cc44c66056a P df45c5d9f8974e5480402c20f2060dd7 [term 1 LEADER]: Becoming Leader. State: Replica: df45c5d9f8974e5480402c20f2060dd7, State: Running, Role: LEADER
14:06:00.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:00.012213 23521 consensus_queue.cc:237] T 1351b51b98644daba15a8cc44c66056a P df45c5d9f8974e5480402c20f2060dd7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4cda0dfc9224c0ab833c4e2024b9bc5" member_type: VOTER last_known_addr { host: "127.22.58.2" port: 35329 } } peers { permanent_uuid: "a3562026b7e6436bb92b95243852ed77" member_type: VOTER last_known_addr { host: "127.22.58.3" port: 42361 } } peers { permanent_uuid: "df45c5d9f8974e5480402c20f2060dd7" member_type: VOTER last_known_addr { host: "127.22.58.1" port: 39871 } }
14:06:00.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:00.022356 22961 catalog_manager.cc:5697] T 1351b51b98644daba15a8cc44c66056a P df45c5d9f8974e5480402c20f2060dd7 reported cstate change: term changed from 0 to 1, leader changed from <none> to df45c5d9f8974e5480402c20f2060dd7 (127.22.58.1). New cstate: current_term: 1 leader_uuid: "df45c5d9f8974e5480402c20f2060dd7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4cda0dfc9224c0ab833c4e2024b9bc5" member_type: VOTER last_known_addr { host: "127.22.58.2" port: 35329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a3562026b7e6436bb92b95243852ed77" member_type: VOTER last_known_addr { host: "127.22.58.3" port: 42361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df45c5d9f8974e5480402c20f2060dd7" member_type: VOTER last_known_addr { host: "127.22.58.1" port: 39871 } health_report { overall_health: HEALTHY } } }
14:06:00.053 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 98be1a8ae0d147efafe7dda9cf112c37
14:06:00.073 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 1351b51b98644daba15a8cc44c66056a for table 'org.apache.kudu.client.TestClientFailoverSupport-KILL' with partition [<start>, <end>)
14:06:00.081 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299992, tablet=1351b51b98644daba15a8cc44c66056a@[a3562026b7e6436bb92b95243852ed77(127.22.58.3:42361),df45c5d9f8974e5480402c20f2060dd7(127.22.58.1:39871)[L],f4cda0dfc9224c0ab833c4e2024b9bc5(127.22.58.2:35329)]}]
14:06:00.082 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=20), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.22.58.60:34817, [9ms] Sub RPC GetTableLocations: received response from server master-127.22.58.60:34817: OK, deferred=null) after lookup
14:06:00.100 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:00.099884 23483 tablet.cc:2406] T 1351b51b98644daba15a8cc44c66056a P a3562026b7e6436bb92b95243852ed77: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:06:00.107 [DEBUG - kudu-nio-1] (Connection.java:748) [peer df45c5d9f8974e5480402c20f2060dd7(127.22.58.1:39871)] connecting to peer
14:06:00.109 [DEBUG - kudu-nio-3] (Connection.java:757) [peer df45c5d9f8974e5480402c20f2060dd7(127.22.58.1:39871)] Successfully connected to peer
14:06:00.175 [DEBUG - kudu-nio-3] (Negotiator.java:918) Authenticated connection [id: 0x88e2d304, L:/127.0.0.1:36886 - R:/127.22.58.1:39871] using TOKEN/null
14:06:00.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:00.189327 23433 raft_consensus.cc:1275] T 1351b51b98644daba15a8cc44c66056a P a3562026b7e6436bb92b95243852ed77 [term 1 FOLLOWER]: Refusing update from remote peer df45c5d9f8974e5480402c20f2060dd7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
14:06:00.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:00.189771 23292 raft_consensus.cc:1275] T 1351b51b98644daba15a8cc44c66056a P f4cda0dfc9224c0ab833c4e2024b9bc5 [term 1 FOLLOWER]: Refusing update from remote peer df45c5d9f8974e5480402c20f2060dd7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
14:06:00.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:00.191354 23525 consensus_queue.cc:1048] T 1351b51b98644daba15a8cc44c66056a P df45c5d9f8974e5480402c20f2060dd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f4cda0dfc9224c0ab833c4e2024b9bc5" member_type: VOTER last_known_addr { host: "127.22.58.2" port: 35329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:06:00.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:00.191936 23521 consensus_queue.cc:1048] T 1351b51b98644daba15a8cc44c66056a P df45c5d9f8974e5480402c20f2060dd7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3562026b7e6436bb92b95243852ed77" member_type: VOTER last_known_addr { host: "127.22.58.3" port: 42361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:06:00.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:00.217308 23530 mvcc.cc:204] Tried to move back new op lower bound from 7305296118519492608 to 7305296117817798656. Current Snapshot: MvccSnapshot[applied={T|T < 7305296118519492608}]
14:06:00.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:00.230000 23529 mvcc.cc:204] Tried to move back new op lower bound from 7305296118519492608 to 7305296117817798656. Current Snapshot: MvccSnapshot[applied={T|T < 7305296118519492608}]
14:06:00.239 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:00.237298 23531 mvcc.cc:204] Tried to move back new op lower bound from 7305296118519492608 to 7305296117817798656. Current Snapshot: MvccSnapshot[applied={T|T < 7305296118519492608}]
14:06:00.550 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 10 rows, more = false) for scanner KuduScanner(table=org.apache.kudu.client.TestClientFailoverSupport-KILL, tablet=1351b51b98644daba15a8cc44c66056a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:06:00.552 [INFO - Time-limited test] (MiniKuduCluster.java:399) Killing master server 127.22.58.60:34817
14:06:00.554 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: stop_daemon {
  id {
    type: MASTER
    index: 2
  }
}

14:06:00.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:00.554828 22760 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskVqKZyE/build/tsan/bin/kudu with pid 22917
14:06:00.603 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.22.58.60:34817(127.22.58.60:34817)] handling channelInactive
14:06:00.604 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.22.58.60:34817(127.22.58.60:34817)] cleaning up while in state READY due to: connection closed
14:06:00.605 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
14:06:00.606 [INFO - Time-limited test] (MiniKuduCluster.java:475) Killing tablet server 127.22.58.1:39871
14:06:00.606 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: stop_daemon {
  id {
    type: TSERVER
    index: 0
  }
}

14:06:00.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:00.607123 22760 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskVqKZyE/build/tsan/bin/kudu with pid 23040
14:06:00.661 [DEBUG - kudu-nio-3] (Connection.java:239) [peer df45c5d9f8974e5480402c20f2060dd7(127.22.58.1:39871)] handling channelInactive
14:06:00.662 [DEBUG - kudu-nio-3] (Connection.java:709) [peer df45c5d9f8974e5480402c20f2060dd7(127.22.58.1:39871)] cleaning up while in state READY due to: connection closed
14:06:00.670 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
14:06:00.671 [DEBUG - Time-limited test] (Connection.java:748) [peer df45c5d9f8974e5480402c20f2060dd7(127.22.58.1:39871)] connecting to peer
14:06:00.677 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer df45c5d9f8974e5480402c20f2060dd7(127.22.58.1:39871): Connection refused: /127.22.58.1:39871
14:06:00.678 [DEBUG - kudu-nio-4] (Connection.java:709) [peer df45c5d9f8974e5480402c20f2060dd7(127.22.58.1:39871)] cleaning up while in state CONNECTING due to: Failed to connect to peer df45c5d9f8974e5480402c20f2060dd7(127.22.58.1:39871): Connection refused: /127.22.58.1:39871
14:06:00.679 [INFO - kudu-nio-4] (AsyncKuduClient.java:2355) Invalidating location df45c5d9f8974e5480402c20f2060dd7(127.22.58.1:39871) for tablet 1351b51b98644daba15a8cc44c66056a: Failed to connect to peer df45c5d9f8974e5480402c20f2060dd7(127.22.58.1:39871): Connection refused: /127.22.58.1:39871
14:06:00.702 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.22.58.60:34817(127.22.58.60:34817)] connecting to peer
14:06:00.704 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817
14:06:00.705 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.22.58.60:34817(127.22.58.60:34817)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817
14:06:00.705 [INFO - kudu-nio-5] (AsyncKuduClient.java:2355) Invalidating location master-127.22.58.60:34817(127.22.58.60:34817) for tablet Kudu Master: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817
14:06:00.724 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.22.58.60:34817(127.22.58.60:34817)] connecting to peer
14:06:00.728 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817
14:06:00.728 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.22.58.60:34817(127.22.58.60:34817)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817
14:06:00.730 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.22.58.60:34817: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817
14:06:00.733 [WARN - kudu-nio-6] (ConnectToCluster.java:305) Unable to find the leader master 127.22.58.62:45123,127.22.58.60:34817,127.22.58.61:40329; will retry
14:06:00.742 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.22.58.60:34817(127.22.58.60:34817)] connecting to peer
14:06:00.745 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817
14:06:00.745 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.22.58.60:34817(127.22.58.60:34817)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817
14:06:00.746 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.22.58.60:34817: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817
14:06:00.747 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.22.58.62:45123,127.22.58.60:34817,127.22.58.61:40329; will retry
14:06:00.762 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.22.58.60:34817(127.22.58.60:34817)] connecting to peer
14:06:00.764 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817
14:06:00.764 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.22.58.60:34817(127.22.58.60:34817)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817
14:06:00.764 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.22.58.60:34817: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817
14:06:00.768 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.22.58.62:45123,127.22.58.60:34817,127.22.58.61:40329; will retry
14:06:00.782 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.22.58.60:34817(127.22.58.60:34817)] connecting to peer
14:06:00.784 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817
14:06:00.784 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.22.58.60:34817(127.22.58.60:34817)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817
14:06:00.784 [INFO - kudu-nio-1] (ConnectToCluster.java:385) Unable to connect to master 127.22.58.60:34817: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817
14:06:00.787 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.22.58.62:45123,127.22.58.60:34817,127.22.58.61:40329; will retry
14:06:00.822 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.22.58.60:34817(127.22.58.60:34817)] connecting to peer
14:06:00.823 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817
14:06:00.824 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.22.58.60:34817(127.22.58.60:34817)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817
14:06:00.824 [INFO - kudu-nio-2] (ConnectToCluster.java:385) Unable to connect to master 127.22.58.60:34817: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817
14:06:00.826 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.22.58.62:45123,127.22.58.60:34817,127.22.58.61:40329; will retry
14:06:00.882 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.22.58.60:34817(127.22.58.60:34817)] connecting to peer
14:06:00.883 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817
14:06:00.883 [DEBUG - kudu-nio-3] (Connection.java:709) [peer master-127.22.58.60:34817(127.22.58.60:34817)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817
14:06:00.884 [INFO - kudu-nio-3] (ConnectToCluster.java:385) Unable to connect to master 127.22.58.60:34817: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817
14:06:00.887 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.22.58.62:45123,127.22.58.60:34817,127.22.58.61:40329; will retry
14:06:00.942 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.22.58.60:34817(127.22.58.60:34817)] connecting to peer
14:06:00.943 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817
14:06:00.944 [DEBUG - kudu-nio-4] (Connection.java:709) [peer master-127.22.58.60:34817(127.22.58.60:34817)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817
14:06:00.944 [INFO - kudu-nio-4] (ConnectToCluster.java:385) Unable to connect to master 127.22.58.60:34817: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817
14:06:00.947 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.22.58.62:45123,127.22.58.60:34817,127.22.58.61:40329; will retry
14:06:01.142 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.22.58.60:34817(127.22.58.60:34817)] connecting to peer
14:06:01.146 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817
14:06:01.146 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.22.58.60:34817(127.22.58.60:34817)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817
14:06:01.146 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.22.58.60:34817: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817
14:06:01.149 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.22.58.62:45123,127.22.58.60:34817,127.22.58.61:40329; will retry
14:06:01.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:01.245626 23479 heartbeater.cc:646] Failed to heartbeat to 127.22.58.60:34817 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.22.58.60:34817: connect: Connection refused (error 111)
14:06:01.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:01.255503 23338 heartbeater.cc:646] Failed to heartbeat to 127.22.58.60:34817 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.22.58.60:34817: connect: Connection refused (error 111)
14:06:01.662 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.22.58.60:34817(127.22.58.60:34817)] connecting to peer
14:06:01.664 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817
14:06:01.664 [DEBUG - kudu-nio-6] (Connection.java:709) [peer master-127.22.58.60:34817(127.22.58.60:34817)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817
14:06:01.664 [INFO - kudu-nio-6] (ConnectToCluster.java:385) Unable to connect to master 127.22.58.60:34817: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817
14:06:01.667 [WARN - kudu-nio-2] (ConnectToCluster.java:305) Unable to find the leader master 127.22.58.62:45123,127.22.58.60:34817,127.22.58.61:40329; will retry
14:06:01.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:01.970733 23545 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1de5161cc99c47bfbc1f45835cb1d1cb [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1eb8d31ae6124cd5bf4defdcada1e8b2)
14:06:01.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:01.971210 23545 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1de5161cc99c47bfbc1f45835cb1d1cb [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5161cc99c47bfbc1f45835cb1d1cb" member_type: VOTER last_known_addr { host: "127.22.58.62" port: 45123 } } peers { permanent_uuid: "5e0fc4cd83084f2eb905d081a292954d" member_type: VOTER last_known_addr { host: "127.22.58.61" port: 40329 } } peers { permanent_uuid: "1eb8d31ae6124cd5bf4defdcada1e8b2" member_type: VOTER last_known_addr { host: "127.22.58.60" port: 34817 } }
14:06:01.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:01.973524 23545 leader_election.cc:290] T 00000000000000000000000000000000 P 1de5161cc99c47bfbc1f45835cb1d1cb [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5e0fc4cd83084f2eb905d081a292954d (127.22.58.61:40329), 1eb8d31ae6124cd5bf4defdcada1e8b2 (127.22.58.60:34817)
14:06:01.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:01.974422 22889 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1de5161cc99c47bfbc1f45835cb1d1cb" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "5e0fc4cd83084f2eb905d081a292954d" is_pre_election: true
14:06:01.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:01.976158 22789 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.58.60:34817: connect: Connection refused (error 111) [suppressed 13 similar messages]
14:06:01.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:01.979212 22789 leader_election.cc:336] T 00000000000000000000000000000000 P 1de5161cc99c47bfbc1f45835cb1d1cb [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1eb8d31ae6124cd5bf4defdcada1e8b2 (127.22.58.60:34817): Network error: Client connection negotiation failed: client connection to 127.22.58.60:34817: connect: Connection refused (error 111)
14:06:01.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:01.979543 22789 leader_election.cc:304] T 00000000000000000000000000000000 P 1de5161cc99c47bfbc1f45835cb1d1cb [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1de5161cc99c47bfbc1f45835cb1d1cb; no voters: 1eb8d31ae6124cd5bf4defdcada1e8b2, 5e0fc4cd83084f2eb905d081a292954d
14:06:01.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:01.980149 23545 raft_consensus.cc:2749] T 00000000000000000000000000000000 P 1de5161cc99c47bfbc1f45835cb1d1cb [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
14:06:01.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:01.985404 23548 raft_consensus.cc:493] T 1351b51b98644daba15a8cc44c66056a P f4cda0dfc9224c0ab833c4e2024b9bc5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df45c5d9f8974e5480402c20f2060dd7)
14:06:01.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:01.985810 23548 raft_consensus.cc:515] T 1351b51b98644daba15a8cc44c66056a P f4cda0dfc9224c0ab833c4e2024b9bc5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4cda0dfc9224c0ab833c4e2024b9bc5" member_type: VOTER last_known_addr { host: "127.22.58.2" port: 35329 } } peers { permanent_uuid: "a3562026b7e6436bb92b95243852ed77" member_type: VOTER last_known_addr { host: "127.22.58.3" port: 42361 } } peers { permanent_uuid: "df45c5d9f8974e5480402c20f2060dd7" member_type: VOTER last_known_addr { host: "127.22.58.1" port: 39871 } }
14:06:01.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:01.988215 23548 leader_election.cc:290] T 1351b51b98644daba15a8cc44c66056a P f4cda0dfc9224c0ab833c4e2024b9bc5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a3562026b7e6436bb92b95243852ed77 (127.22.58.3:42361), df45c5d9f8974e5480402c20f2060dd7 (127.22.58.1:39871)
14:06:01.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:01.992101 23225 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.58.1:39871: connect: Connection refused (error 111)
14:06:01.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:01.996548 23553 raft_consensus.cc:493] T 1351b51b98644daba15a8cc44c66056a P a3562026b7e6436bb92b95243852ed77 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df45c5d9f8974e5480402c20f2060dd7)
14:06:01.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:01.996954 23225 leader_election.cc:336] T 1351b51b98644daba15a8cc44c66056a P f4cda0dfc9224c0ab833c4e2024b9bc5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer df45c5d9f8974e5480402c20f2060dd7 (127.22.58.1:39871): Network error: Client connection negotiation failed: client connection to 127.22.58.1:39871: connect: Connection refused (error 111)
14:06:01.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:01.997464 23553 raft_consensus.cc:515] T 1351b51b98644daba15a8cc44c66056a P a3562026b7e6436bb92b95243852ed77 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4cda0dfc9224c0ab833c4e2024b9bc5" member_type: VOTER last_known_addr { host: "127.22.58.2" port: 35329 } } peers { permanent_uuid: "a3562026b7e6436bb92b95243852ed77" member_type: VOTER last_known_addr { host: "127.22.58.3" port: 42361 } } peers { permanent_uuid: "df45c5d9f8974e5480402c20f2060dd7" member_type: VOTER last_known_addr { host: "127.22.58.1" port: 39871 } }
14:06:02.000 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:02.000002 23433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1351b51b98644daba15a8cc44c66056a" candidate_uuid: "f4cda0dfc9224c0ab833c4e2024b9bc5" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "a3562026b7e6436bb92b95243852ed77" is_pre_election: true
14:06:02.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:02.000566 23433 raft_consensus.cc:2468] T 1351b51b98644daba15a8cc44c66056a P a3562026b7e6436bb92b95243852ed77 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f4cda0dfc9224c0ab833c4e2024b9bc5 in term 1.
14:06:02.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:02.000597 23553 leader_election.cc:290] T 1351b51b98644daba15a8cc44c66056a P a3562026b7e6436bb92b95243852ed77 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f4cda0dfc9224c0ab833c4e2024b9bc5 (127.22.58.2:35329), df45c5d9f8974e5480402c20f2060dd7 (127.22.58.1:39871)
14:06:02.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:02.002336 23228 leader_election.cc:304] T 1351b51b98644daba15a8cc44c66056a P f4cda0dfc9224c0ab833c4e2024b9bc5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a3562026b7e6436bb92b95243852ed77, f4cda0dfc9224c0ab833c4e2024b9bc5; no voters: df45c5d9f8974e5480402c20f2060dd7
14:06:02.004 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:02.003506 23548 raft_consensus.cc:2804] T 1351b51b98644daba15a8cc44c66056a P f4cda0dfc9224c0ab833c4e2024b9bc5 [term 1 FOLLOWER]: Leader pre-election won for term 2
14:06:02.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:02.003975 23548 raft_consensus.cc:493] T 1351b51b98644daba15a8cc44c66056a P f4cda0dfc9224c0ab833c4e2024b9bc5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader df45c5d9f8974e5480402c20f2060dd7)
14:06:02.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:02.004415 23548 raft_consensus.cc:3060] T 1351b51b98644daba15a8cc44c66056a P f4cda0dfc9224c0ab833c4e2024b9bc5 [term 1 FOLLOWER]: Advancing to term 2
14:06:02.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:02.006608 23366 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.58.1:39871: connect: Connection refused (error 111)
14:06:02.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:02.011647 23366 leader_election.cc:336] T 1351b51b98644daba15a8cc44c66056a P a3562026b7e6436bb92b95243852ed77 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer df45c5d9f8974e5480402c20f2060dd7 (127.22.58.1:39871): Network error: Client connection negotiation failed: client connection to 127.22.58.1:39871: connect: Connection refused (error 111)
14:06:02.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:02.011973 23548 raft_consensus.cc:515] T 1351b51b98644daba15a8cc44c66056a P f4cda0dfc9224c0ab833c4e2024b9bc5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4cda0dfc9224c0ab833c4e2024b9bc5" member_type: VOTER last_known_addr { host: "127.22.58.2" port: 35329 } } peers { permanent_uuid: "a3562026b7e6436bb92b95243852ed77" member_type: VOTER last_known_addr { host: "127.22.58.3" port: 42361 } } peers { permanent_uuid: "df45c5d9f8974e5480402c20f2060dd7" member_type: VOTER last_known_addr { host: "127.22.58.1" port: 39871 } }
14:06:02.014 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:02.014086 23548 leader_election.cc:290] T 1351b51b98644daba15a8cc44c66056a P f4cda0dfc9224c0ab833c4e2024b9bc5 [CANDIDATE]: Term 2 election: Requested vote from peers a3562026b7e6436bb92b95243852ed77 (127.22.58.3:42361), df45c5d9f8974e5480402c20f2060dd7 (127.22.58.1:39871)
14:06:02.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:02.015056 23433 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1351b51b98644daba15a8cc44c66056a" candidate_uuid: "f4cda0dfc9224c0ab833c4e2024b9bc5" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "a3562026b7e6436bb92b95243852ed77"
14:06:02.015 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:02.014989 23291 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1351b51b98644daba15a8cc44c66056a" candidate_uuid: "a3562026b7e6436bb92b95243852ed77" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "f4cda0dfc9224c0ab833c4e2024b9bc5" is_pre_election: true
14:06:02.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:02.015688 23433 raft_consensus.cc:3060] T 1351b51b98644daba15a8cc44c66056a P a3562026b7e6436bb92b95243852ed77 [term 1 FOLLOWER]: Advancing to term 2
14:06:02.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:02.015954 23291 raft_consensus.cc:2393] T 1351b51b98644daba15a8cc44c66056a P f4cda0dfc9224c0ab833c4e2024b9bc5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a3562026b7e6436bb92b95243852ed77 in current term 2: Already voted for candidate f4cda0dfc9224c0ab833c4e2024b9bc5 in this term.
14:06:02.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:02.017278 23366 leader_election.cc:304] T 1351b51b98644daba15a8cc44c66056a P a3562026b7e6436bb92b95243852ed77 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a3562026b7e6436bb92b95243852ed77; no voters: df45c5d9f8974e5480402c20f2060dd7, f4cda0dfc9224c0ab833c4e2024b9bc5
14:06:02.019 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:02.019007 23225 leader_election.cc:336] T 1351b51b98644daba15a8cc44c66056a P f4cda0dfc9224c0ab833c4e2024b9bc5 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer df45c5d9f8974e5480402c20f2060dd7 (127.22.58.1:39871): Network error: Client connection negotiation failed: client connection to 127.22.58.1:39871: connect: Connection refused (error 111)
14:06:02.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:02.021723 23433 raft_consensus.cc:2468] T 1351b51b98644daba15a8cc44c66056a P a3562026b7e6436bb92b95243852ed77 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f4cda0dfc9224c0ab833c4e2024b9bc5 in term 2.
14:06:02.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:02.022213 23553 raft_consensus.cc:2749] T 1351b51b98644daba15a8cc44c66056a P a3562026b7e6436bb92b95243852ed77 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
14:06:02.023 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:02.022807 23228 leader_election.cc:304] T 1351b51b98644daba15a8cc44c66056a P f4cda0dfc9224c0ab833c4e2024b9bc5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a3562026b7e6436bb92b95243852ed77, f4cda0dfc9224c0ab833c4e2024b9bc5; no voters: df45c5d9f8974e5480402c20f2060dd7
14:06:02.024 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:02.023764 23548 raft_consensus.cc:2804] T 1351b51b98644daba15a8cc44c66056a P f4cda0dfc9224c0ab833c4e2024b9bc5 [term 2 FOLLOWER]: Leader election won for term 2
14:06:02.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:02.026466 23548 raft_consensus.cc:697] T 1351b51b98644daba15a8cc44c66056a P f4cda0dfc9224c0ab833c4e2024b9bc5 [term 2 LEADER]: Becoming Leader. State: Replica: f4cda0dfc9224c0ab833c4e2024b9bc5, State: Running, Role: LEADER
14:06:02.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:02.027794 23548 consensus_queue.cc:237] T 1351b51b98644daba15a8cc44c66056a P f4cda0dfc9224c0ab833c4e2024b9bc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 1.11, Last appended by leader: 11, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4cda0dfc9224c0ab833c4e2024b9bc5" member_type: VOTER last_known_addr { host: "127.22.58.2" port: 35329 } } peers { permanent_uuid: "a3562026b7e6436bb92b95243852ed77" member_type: VOTER last_known_addr { host: "127.22.58.3" port: 42361 } } peers { permanent_uuid: "df45c5d9f8974e5480402c20f2060dd7" member_type: VOTER last_known_addr { host: "127.22.58.1" port: 39871 } }
14:06:02.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:02.047629 23560 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5e0fc4cd83084f2eb905d081a292954d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1eb8d31ae6124cd5bf4defdcada1e8b2)
14:06:02.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:02.048593 23560 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5e0fc4cd83084f2eb905d081a292954d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5161cc99c47bfbc1f45835cb1d1cb" member_type: VOTER last_known_addr { host: "127.22.58.62" port: 45123 } } peers { permanent_uuid: "5e0fc4cd83084f2eb905d081a292954d" member_type: VOTER last_known_addr { host: "127.22.58.61" port: 40329 } } peers { permanent_uuid: "1eb8d31ae6124cd5bf4defdcada1e8b2" member_type: VOTER last_known_addr { host: "127.22.58.60" port: 34817 } }
14:06:02.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:02.051540 23560 leader_election.cc:290] T 00000000000000000000000000000000 P 5e0fc4cd83084f2eb905d081a292954d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1de5161cc99c47bfbc1f45835cb1d1cb (127.22.58.62:45123), 1eb8d31ae6124cd5bf4defdcada1e8b2 (127.22.58.60:34817)
14:06:02.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:02.052497 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5e0fc4cd83084f2eb905d081a292954d" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "1de5161cc99c47bfbc1f45835cb1d1cb" is_pre_election: true
14:06:02.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:02.053069 22813 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 1de5161cc99c47bfbc1f45835cb1d1cb [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5e0fc4cd83084f2eb905d081a292954d in term 1.
14:06:02.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:02.054494 22866 leader_election.cc:304] T 00000000000000000000000000000000 P 5e0fc4cd83084f2eb905d081a292954d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1de5161cc99c47bfbc1f45835cb1d1cb, 5e0fc4cd83084f2eb905d081a292954d; no voters: 
14:06:02.055 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:02.055388 23560 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5e0fc4cd83084f2eb905d081a292954d [term 1 FOLLOWER]: Leader pre-election won for term 2
14:06:02.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:02.056085 23560 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5e0fc4cd83084f2eb905d081a292954d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1eb8d31ae6124cd5bf4defdcada1e8b2)
14:06:02.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:02.056463 23560 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5e0fc4cd83084f2eb905d081a292954d [term 1 FOLLOWER]: Advancing to term 2
14:06:02.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:02.057637 22864 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.22.58.60:34817: connect: Connection refused (error 111) [suppressed 6 similar messages]
14:06:02.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:02.061803 22864 leader_election.cc:336] T 00000000000000000000000000000000 P 5e0fc4cd83084f2eb905d081a292954d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1eb8d31ae6124cd5bf4defdcada1e8b2 (127.22.58.60:34817): Network error: Client connection negotiation failed: client connection to 127.22.58.60:34817: connect: Connection refused (error 111)
14:06:02.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:02.064468 23560 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5e0fc4cd83084f2eb905d081a292954d [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5161cc99c47bfbc1f45835cb1d1cb" member_type: VOTER last_known_addr { host: "127.22.58.62" port: 45123 } } peers { permanent_uuid: "5e0fc4cd83084f2eb905d081a292954d" member_type: VOTER last_known_addr { host: "127.22.58.61" port: 40329 } } peers { permanent_uuid: "1eb8d31ae6124cd5bf4defdcada1e8b2" member_type: VOTER last_known_addr { host: "127.22.58.60" port: 34817 } }
14:06:02.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:02.066061 23560 leader_election.cc:290] T 00000000000000000000000000000000 P 5e0fc4cd83084f2eb905d081a292954d [CANDIDATE]: Term 2 election: Requested vote from peers 1de5161cc99c47bfbc1f45835cb1d1cb (127.22.58.62:45123), 1eb8d31ae6124cd5bf4defdcada1e8b2 (127.22.58.60:34817)
14:06:02.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:02.066951 22813 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "5e0fc4cd83084f2eb905d081a292954d" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "1de5161cc99c47bfbc1f45835cb1d1cb"
14:06:02.067 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:02.067366 22813 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1de5161cc99c47bfbc1f45835cb1d1cb [term 1 FOLLOWER]: Advancing to term 2
14:06:02.070 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:02.069638 22864 leader_election.cc:336] T 00000000000000000000000000000000 P 5e0fc4cd83084f2eb905d081a292954d [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 1eb8d31ae6124cd5bf4defdcada1e8b2 (127.22.58.60:34817): Network error: Client connection negotiation failed: client connection to 127.22.58.60:34817: connect: Connection refused (error 111)
14:06:02.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:02.072629 22813 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 1de5161cc99c47bfbc1f45835cb1d1cb [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5e0fc4cd83084f2eb905d081a292954d in term 2.
14:06:02.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:02.073745 22866 leader_election.cc:304] T 00000000000000000000000000000000 P 5e0fc4cd83084f2eb905d081a292954d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1de5161cc99c47bfbc1f45835cb1d1cb, 5e0fc4cd83084f2eb905d081a292954d; no voters: 1eb8d31ae6124cd5bf4defdcada1e8b2
14:06:02.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:02.074429 23560 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5e0fc4cd83084f2eb905d081a292954d [term 2 FOLLOWER]: Leader election won for term 2
14:06:02.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:02.075438 23560 raft_consensus.cc:697] T 00000000000000000000000000000000 P 5e0fc4cd83084f2eb905d081a292954d [term 2 LEADER]: Becoming Leader. State: Replica: 5e0fc4cd83084f2eb905d081a292954d, State: Running, Role: LEADER
14:06:02.077 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:02.076437 23560 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5e0fc4cd83084f2eb905d081a292954d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5161cc99c47bfbc1f45835cb1d1cb" member_type: VOTER last_known_addr { host: "127.22.58.62" port: 45123 } } peers { permanent_uuid: "5e0fc4cd83084f2eb905d081a292954d" member_type: VOTER last_known_addr { host: "127.22.58.61" port: 40329 } } peers { permanent_uuid: "1eb8d31ae6124cd5bf4defdcada1e8b2" member_type: VOTER last_known_addr { host: "127.22.58.60" port: 34817 } }
14:06:02.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:02.080344 23563 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e0fc4cd83084f2eb905d081a292954d [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5e0fc4cd83084f2eb905d081a292954d. Latest consensus state: current_term: 2 leader_uuid: "5e0fc4cd83084f2eb905d081a292954d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5161cc99c47bfbc1f45835cb1d1cb" member_type: VOTER last_known_addr { host: "127.22.58.62" port: 45123 } } peers { permanent_uuid: "5e0fc4cd83084f2eb905d081a292954d" member_type: VOTER last_known_addr { host: "127.22.58.61" port: 40329 } } peers { permanent_uuid: "1eb8d31ae6124cd5bf4defdcada1e8b2" member_type: VOTER last_known_addr { host: "127.22.58.60" port: 34817 } } }
14:06:02.081 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:02.081204 23563 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e0fc4cd83084f2eb905d081a292954d [sys.catalog]: This master's current role is: LEADER
14:06:02.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:02.083159 23565 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
14:06:02.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:02.089929 23565 catalog_manager.cc:679] Loaded metadata for table org.apache.kudu.client.TestClientFailoverSupport-KILL [id=98be1a8ae0d147efafe7dda9cf112c37]
14:06:02.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:02.094480 23565 tablet_loader.cc:96] loaded metadata for tablet 1351b51b98644daba15a8cc44c66056a (table org.apache.kudu.client.TestClientFailoverSupport-KILL [id=98be1a8ae0d147efafe7dda9cf112c37])
14:06:02.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:02.095522 23565 catalog_manager.cc:1520] Initializing Kudu cluster ID...
14:06:02.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:02.098170 23565 catalog_manager.cc:1295] Loaded cluster ID: a7b07e25188f4dec852c34a6ad19f171
14:06:02.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:02.098425 23565 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
14:06:02.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:02.101603 23565 catalog_manager.cc:1540] Loading token signing keys...
14:06:02.102 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.22.58.60:34817(127.22.58.60:34817)] connecting to peer
14:06:02.104 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817
14:06:02.104 [DEBUG - kudu-nio-7] (Connection.java:709) [peer master-127.22.58.60:34817(127.22.58.60:34817)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817
14:06:02.104 [INFO - kudu-nio-7] (ConnectToCluster.java:385) Unable to connect to master 127.22.58.60:34817: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817
14:06:02.107 [WARN - kudu-nio-0] (ConnectToCluster.java:305) Unable to find the leader master 127.22.58.62:45123,127.22.58.60:34817,127.22.58.61:40329; will retry
14:06:02.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:02.106310 23565 catalog_manager.cc:6081] T 00000000000000000000000000000000 P 5e0fc4cd83084f2eb905d081a292954d: Loaded TSK: 0
14:06:02.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:02.109055 23565 catalog_manager.cc:1550] Initializing in-progress tserver states...
14:06:02.439 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:02.439474 23433 raft_consensus.cc:1275] T 1351b51b98644daba15a8cc44c66056a P a3562026b7e6436bb92b95243852ed77 [term 2 FOLLOWER]: Refusing update from remote peer f4cda0dfc9224c0ab833c4e2024b9bc5: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 2 index: 12. (index mismatch)
14:06:02.441 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:02.440821 23548 consensus_queue.cc:1048] T 1351b51b98644daba15a8cc44c66056a P f4cda0dfc9224c0ab833c4e2024b9bc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a3562026b7e6436bb92b95243852ed77" member_type: VOTER last_known_addr { host: "127.22.58.3" port: 42361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
14:06:02.444 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:02.443676 23478 heartbeater.cc:499] Master 127.22.58.61:40329 was elected leader, sending a full tablet report...
14:06:02.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:02.452152 22879 catalog_manager.cc:5697] T 1351b51b98644daba15a8cc44c66056a P a3562026b7e6436bb92b95243852ed77 reported cstate change: term changed from 1 to 2, leader changed from df45c5d9f8974e5480402c20f2060dd7 (127.22.58.1) to f4cda0dfc9224c0ab833c4e2024b9bc5 (127.22.58.2). New cstate: current_term: 2 leader_uuid: "f4cda0dfc9224c0ab833c4e2024b9bc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f4cda0dfc9224c0ab833c4e2024b9bc5" member_type: VOTER last_known_addr { host: "127.22.58.2" port: 35329 } } peers { permanent_uuid: "a3562026b7e6436bb92b95243852ed77" member_type: VOTER last_known_addr { host: "127.22.58.3" port: 42361 } } peers { permanent_uuid: "df45c5d9f8974e5480402c20f2060dd7" member_type: VOTER last_known_addr { host: "127.22.58.1" port: 39871 } } }
14:06:02.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:02.458220 23225 consensus_peers.cc:597] T 1351b51b98644daba15a8cc44c66056a P f4cda0dfc9224c0ab833c4e2024b9bc5 -> Peer df45c5d9f8974e5480402c20f2060dd7 (127.22.58.1:39871): Couldn't send request to peer df45c5d9f8974e5480402c20f2060dd7. Status: Network error: Client connection negotiation failed: client connection to 127.22.58.1:39871: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
14:06:02.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:02.466890 22813 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 1de5161cc99c47bfbc1f45835cb1d1cb [term 2 FOLLOWER]: Refusing update from remote peer 5e0fc4cd83084f2eb905d081a292954d: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 2 index: 9. (index mismatch)
14:06:02.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:02.468335 23560 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 5e0fc4cd83084f2eb905d081a292954d [LEADER]: Connected to new peer: Peer: permanent_uuid: "1de5161cc99c47bfbc1f45835cb1d1cb" member_type: VOTER last_known_addr { host: "127.22.58.62" port: 45123 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
14:06:02.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:02.469036 22864 consensus_peers.cc:597] T 00000000000000000000000000000000 P 5e0fc4cd83084f2eb905d081a292954d -> Peer 1eb8d31ae6124cd5bf4defdcada1e8b2 (127.22.58.60:34817): Couldn't send request to peer 1eb8d31ae6124cd5bf4defdcada1e8b2. Status: Network error: Client connection negotiation failed: client connection to 127.22.58.60:34817: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
14:06:02.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:02.474898 23545 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1de5161cc99c47bfbc1f45835cb1d1cb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5e0fc4cd83084f2eb905d081a292954d. Latest consensus state: current_term: 2 leader_uuid: "5e0fc4cd83084f2eb905d081a292954d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5161cc99c47bfbc1f45835cb1d1cb" member_type: VOTER last_known_addr { host: "127.22.58.62" port: 45123 } } peers { permanent_uuid: "5e0fc4cd83084f2eb905d081a292954d" member_type: VOTER last_known_addr { host: "127.22.58.61" port: 40329 } } peers { permanent_uuid: "1eb8d31ae6124cd5bf4defdcada1e8b2" member_type: VOTER last_known_addr { host: "127.22.58.60" port: 34817 } } }
14:06:02.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:02.475661 23545 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1de5161cc99c47bfbc1f45835cb1d1cb [sys.catalog]: This master's current role is: FOLLOWER
14:06:02.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:02.479317 23563 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5e0fc4cd83084f2eb905d081a292954d [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "5e0fc4cd83084f2eb905d081a292954d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5161cc99c47bfbc1f45835cb1d1cb" member_type: VOTER last_known_addr { host: "127.22.58.62" port: 45123 } } peers { permanent_uuid: "5e0fc4cd83084f2eb905d081a292954d" member_type: VOTER last_known_addr { host: "127.22.58.61" port: 40329 } } peers { permanent_uuid: "1eb8d31ae6124cd5bf4defdcada1e8b2" member_type: VOTER last_known_addr { host: "127.22.58.60" port: 34817 } } }
14:06:02.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:02.479930 23563 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5e0fc4cd83084f2eb905d081a292954d [sys.catalog]: This master's current role is: LEADER
14:06:02.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:02.481446 23545 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1de5161cc99c47bfbc1f45835cb1d1cb [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "5e0fc4cd83084f2eb905d081a292954d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1de5161cc99c47bfbc1f45835cb1d1cb" member_type: VOTER last_known_addr { host: "127.22.58.62" port: 45123 } } peers { permanent_uuid: "5e0fc4cd83084f2eb905d081a292954d" member_type: VOTER last_known_addr { host: "127.22.58.61" port: 40329 } } peers { permanent_uuid: "1eb8d31ae6124cd5bf4defdcada1e8b2" member_type: VOTER last_known_addr { host: "127.22.58.60" port: 34817 } } }
14:06:02.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:02.482481 23545 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1de5161cc99c47bfbc1f45835cb1d1cb [sys.catalog]: This master's current role is: FOLLOWER
14:06:03.302 [DEBUG - pool-2-thread-1] (Connection.java:748) [peer master-127.22.58.60:34817(127.22.58.60:34817)] connecting to peer
14:06:03.303 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817
14:06:03.304 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.22.58.60:34817(127.22.58.60:34817)] cleaning up while in state CONNECTING due to: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817
14:06:03.304 [INFO - kudu-nio-0] (ConnectToCluster.java:385) Unable to connect to master 127.22.58.60:34817: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817
14:06:03.309 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:06:03.311 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableLocations, tablet=Kudu Master, attempt=12, TimeoutTracker(timeout=29970, elapsed=2608), Traces: [0ms] sending RPC to server master-127.22.58.60:34817, [4ms] received response from server master-127.22.58.60:34817: Network error: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817, [4ms] delaying RPC due to: Network error: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817, [20ms] refreshing cache from master, [21ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.58.62:45123, [23ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.58.60:34817, [24ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.58.61:40329, [26ms] Sub RPC ConnectToMaster: received response from server master-127.22.58.62:45123: OK, [27ms] Sub RPC ConnectToMaster: received response from server master-127.22.58.60:34817: Network error: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817, [28ms] Sub RPC ConnectToMaster: received response from server master-127.22.58.61:40329: OK, [32ms] delaying RPC due to: Service unavailable: Master config (127.22.58.62:45123,127.22.58.60:34817,127.22.58.61:40329) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817, [40ms] refreshing cache from master, [40ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.58.62:45123, [41ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.58.60:34817, [42ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.58.61:40329, [44ms] Sub RPC ConnectToMaster: received response from server master-127.22.58.60:34817: Network error: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817, [45ms] Sub RPC ConnectToMaster: received response from server master-127.22.58.62:45123: OK, [46ms] Sub RPC ConnectToMaster: received response from server master-127.22.58.61:40329: OK, [47ms] delaying RPC due to: Service unavailable: Master config (127.22.58.62:45123,127.22.58.60:34817,127.22.58.61:40329) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817, [60ms] refreshing cache from master, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.58.62:45123, [61ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.58.60:34817, [62ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.58.61:40329, [63ms] Sub RPC ConnectToMaster: received response from server master-127.22.58.60:34817: Network error: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817, [65ms] Sub RPC ConnectToMaster: received response from server master-127.22.58.62:45123: OK, [66ms] Sub RPC ConnectToMaster: received response from server master-127.22.58.61:40329: OK, [67ms] delaying RPC due to: Service unavailable: Master config (127.22.58.62:45123,127.22.58.60:34817,127.22.58.61:40329) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817, [80ms] refreshing cache from master, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.58.62:45123, [81ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.58.60:34817, [82ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.58.61:40329, [83ms] Sub RPC ConnectToMaster: received response from server master-127.22.58.60:34817: Network error: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817, [85ms] Sub RPC ConnectToMaster: received response from server master-127.22.58.62:45123: OK, [86ms] Sub RPC ConnectToMaster: received response from server master-127.22.58.61:40329: OK, [86ms] delaying RPC due to: Service unavailable: Master config (127.22.58.62:45123,127.22.58.60:34817,127.22.58.61:40329) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817, [120ms] refreshing cache from master, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.58.62:45123, [120ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.58.60:34817, [121ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.58.61:40329, [123ms] Sub RPC ConnectToMaster: received response from server master-127.22.58.60:34817: Network error: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817, [125ms] Sub RPC ConnectToMaster: received response from server master-127.22.58.62:45123: OK, [125ms] Sub RPC ConnectToMaster: received response from server master-127.22.58.61:40329: OK, [125ms] delaying RPC due to: Service unavailable: Master config (127.22.58.62:45123,127.22.58.60:34817,127.22.58.61:40329) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817, [180ms] refreshing cache from master, [180ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.58.62:45123, [181ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.58.60:34817, [182ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.58.61:40329, [183ms] Sub RPC ConnectToMaster: received response from server master-127.22.58.60:34817: Network error: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817, [185ms] Sub RPC ConnectToMaster: received response from server master-127.22.58.62:45123: OK, [186ms] Sub RPC ConnectToMaster: received response from server master-127.22.58.61:40329: OK, [186ms] delaying RPC due to: Service unavailable: Master config (127.22.58.62:45123,127.22.58.60:34817,127.22.58.61:40329) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817, [240ms] refreshing cache from master, [240ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.58.62:45123, [241ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.58.60:34817, [242ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.58.61:40329, [243ms] Sub RPC ConnectToMaster: received response from server master-127.22.58.60:34817: Network error: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817, [244ms] Sub RPC ConnectToMaster: received response from server master-127.22.58.62:45123: OK, [246ms] Sub RPC ConnectToMaster: received response from server master-127.22.58.61:40329: OK, [246ms] delaying RPC due to: Service unavailable: Master config (127.22.58.62:45123,127.22.58.60:34817,127.22.58.61:40329) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817, [440ms] refreshing cache from master, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.58.62:45123, [441ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.58.60:34817, [444ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.58.61:40329, [445ms] Sub RPC ConnectToMaster: received response from server master-127.22.58.60:34817: Network error: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817, [445ms] Sub RPC ConnectToMaster: received response from server master-127.22.58.62:45123: OK, [448ms] Sub RPC ConnectToMaster: received response from server master-127.22.58.61:40329: OK, [448ms] delaying RPC due to: Service unavailable: Master config (127.22.58.62:45123,127.22.58.60:34817,127.22.58.61:40329) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817, [960ms] refreshing cache from master, [960ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.58.62:45123, [961ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.58.60:34817, [962ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.58.61:40329, [963ms] Sub RPC ConnectToMaster: received response from server master-127.22.58.60:34817: Network error: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817, [965ms] Sub RPC ConnectToMaster: received response from server master-127.22.58.62:45123: OK, [966ms] Sub RPC ConnectToMaster: received response from server master-127.22.58.61:40329: OK, [967ms] delaying RPC due to: Service unavailable: Master config (127.22.58.62:45123,127.22.58.60:34817,127.22.58.61:40329) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817, [1400ms] refreshing cache from master, [1400ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.58.62:45123, [1401ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.58.60:34817, [1402ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.58.61:40329, [1403ms] Sub RPC ConnectToMaster: received response from server master-127.22.58.60:34817: Network error: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817, [1406ms] Sub RPC ConnectToMaster: received response from server master-127.22.58.61:40329: OK, [1406ms] Sub RPC ConnectToMaster: received response from server master-127.22.58.62:45123: OK, [1406ms] delaying RPC due to: Service unavailable: Master config (127.22.58.62:45123,127.22.58.60:34817,127.22.58.61:40329) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817, [2600ms] refreshing cache from master, [2600ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.58.62:45123, [2601ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.58.60:34817, [2602ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.58.61:40329, [2603ms] Sub RPC ConnectToMaster: received response from server master-127.22.58.60:34817: Network error: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817, [2604ms] Sub RPC ConnectToMaster: received response from server master-127.22.58.62:45123: OK, [2607ms] Sub RPC ConnectToMaster: received response from server master-127.22.58.61:40329: OK, deferred=Deferred@892183636(state=PENDING, result=null, callback=get tablet locations from the master for table org.apache.kudu.client.TestClientFailoverSupport-KILL -> release master lookup permit -> retry RPC -> (continuation of Deferred@1329434070 after retry RPC after error@2068854322) -> (continuation of Deferred@247729588 after retry RPC after error@1452480316) -> (continuation of Deferred@1969447685 after retry RPC after error@259533373) -> (continuation of Deferred@561987531 after retry RPC after error@1864099375) -> (continuation of Deferred@17750914 after retry RPC after error@1332293724) -> (continuation of Deferred@389078813 after retry RPC after error@665483594) -> (continuation of Deferred@1343186166 after retry RPC after error@1457673595) -> (continuation of Deferred@1195090061 after retry RPC after error@858775817) -> (continuation of Deferred@405543758 after retry RPC after error@1545723069) -> (continuation of Deferred@1183064188 after retry RPC after error@183481868), errback=passthrough -> release master lookup permit -> retry RPC after error -> (continuation of Deferred@1329434070 after retry RPC after error@2068854322) -> (continuation of Deferred@247729588 after retry RPC after error@1452480316) -> (continuation of Deferred@1969447685 after retry RPC after error@259533373) -> (continuation of Deferred@561987531 after retry RPC after error@1864099375) -> (continuation of Deferred@17750914 after retry RPC after error@1332293724) -> (continuation of Deferred@389078813 after retry RPC after error@665483594) -> (continuation of Deferred@1343186166 after retry RPC after error@1457673595) -> (continuation of Deferred@1195090061 after retry RPC after error@858775817) -> (continuation of Deferred@405543758 after retry RPC after error@1545723069) -> (continuation of Deferred@1183064188 after retry RPC after error@183481868))) after lookup
14:06:03.318 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 1351b51b98644daba15a8cc44c66056a for table 'org.apache.kudu.client.TestClientFailoverSupport-KILL' with partition [<start>, <end>)
14:06:03.318 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=1351b51b98644daba15a8cc44c66056a@[a3562026b7e6436bb92b95243852ed77(127.22.58.3:42361),df45c5d9f8974e5480402c20f2060dd7(127.22.58.1:39871),f4cda0dfc9224c0ab833c4e2024b9bc5(127.22.58.2:35329)[L]]}]
14:06:03.320 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=1351b51b98644daba15a8cc44c66056a, attempt=2, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=2648), Traces: [0ms] sending RPC to server df45c5d9f8974e5480402c20f2060dd7, [8ms] received response from server df45c5d9f8974e5480402c20f2060dd7: Network error: Failed to connect to peer df45c5d9f8974e5480402c20f2060dd7(127.22.58.1:39871): Connection refused: /127.22.58.1:39871, [9ms] delaying RPC due to: Network error: Failed to connect to peer df45c5d9f8974e5480402c20f2060dd7(127.22.58.1:39871): Connection refused: /127.22.58.1:39871, [31ms] refreshing cache from master, [31ms] Sub RPC GetTableLocations: sending RPC to server master-127.22.58.60:34817, [35ms] Sub RPC GetTableLocations: received response from server master-127.22.58.60:34817: Network error: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817, [35ms] Sub RPC GetTableLocations: delaying RPC due to: Network error: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817, [51ms] Sub RPC GetTableLocations: refreshing cache from master, [52ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.58.62:45123, [54ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.58.60:34817, [55ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.58.61:40329, [57ms] Sub RPC ConnectToMaster: received response from server master-127.22.58.62:45123: OK, [58ms] Sub RPC ConnectToMaster: received response from server master-127.22.58.60:34817: Network error: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817, [59ms] Sub RPC ConnectToMaster: received response from server master-127.22.58.61:40329: OK, [63ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.22.58.62:45123,127.22.58.60:34817,127.22.58.61:40329) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817, [71ms] Sub RPC GetTableLocations: refreshing cache from master, [71ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.58.62:45123, [72ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.58.60:34817, [73ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.58.61:40329, [75ms] Sub RPC ConnectToMaster: received response from server master-127.22.58.60:34817: Network error: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817, [76ms] Sub RPC ConnectToMaster: received response from server master-127.22.58.62:45123: OK, [77ms] Sub RPC ConnectToMaster: received response from server master-127.22.58.61:40329: OK, [78ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.22.58.62:45123,127.22.58.60:34817,127.22.58.61:40329) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817, [91ms] Sub RPC GetTableLocations: refreshing cache from master, [92ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.58.62:45123, [92ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.58.60:34817, [93ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.58.61:40329, [94ms] Sub RPC ConnectToMaster: received response from server master-127.22.58.60:34817: Network error: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817, [96ms] Sub RPC ConnectToMaster: received response from server master-127.22.58.62:45123: OK, [97ms] Sub RPC ConnectToMaster: received response from server master-127.22.58.61:40329: OK, [98ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.22.58.62:45123,127.22.58.60:34817,127.22.58.61:40329) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817, [111ms] Sub RPC GetTableLocations: refreshing cache from master, [112ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.58.62:45123, [112ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.58.60:34817, [113ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.58.61:40329, [114ms] Sub RPC ConnectToMaster: received response from server master-127.22.58.60:34817: Network error: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817, [116ms] Sub RPC ConnectToMaster: received response from server master-127.22.58.62:45123: OK, [117ms] Sub RPC ConnectToMaster: received response from server master-127.22.58.61:40329: OK, [117ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.22.58.62:45123,127.22.58.60:34817,127.22.58.61:40329) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817, [151ms] Sub RPC GetTableLocations: refreshing cache from master, [151ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.58.62:45123, [151ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.58.60:34817, [152ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.58.61:40329, [154ms] Sub RPC ConnectToMaster: received response from server master-127.22.58.60:34817: Network error: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817, [156ms] Sub RPC ConnectToMaster: received response from server master-127.22.58.62:45123: OK, [156ms] Sub RPC ConnectToMaster: received response from server master-127.22.58.61:40329: OK, [156ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.22.58.62:45123,127.22.58.60:34817,127.22.58.61:40329) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817, [211ms] Sub RPC GetTableLocations: refreshing cache from master, [211ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.58.62:45123, [212ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.58.60:34817, [213ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.58.61:40329, [214ms] Sub RPC ConnectToMaster: received response from server master-127.22.58.60:34817: Network error: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817, [216ms] Sub RPC ConnectToMaster: received response from server master-127.22.58.62:45123: OK, [217ms] Sub RPC ConnectToMaster: received response from server master-127.22.58.61:40329: OK, [217ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.22.58.62:45123,127.22.58.60:34817,127.22.58.61:40329) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817, [271ms] Sub RPC GetTableLocations: refreshing cache from master, [271ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.58.62:45123, [272ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.58.60:34817, [273ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.58.61:40329, [274ms] Sub RPC ConnectToMaster: received response from server master-127.22.58.60:34817: Network error: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817, [275ms] Sub RPC ConnectToMaster: received response from server master-127.22.58.62:45123: OK, [277ms] Sub RPC ConnectToMaster: received response from server master-127.22.58.61:40329: OK, [277ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.22.58.62:45123,127.22.58.60:34817,127.22.58.61:40329) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817, [471ms] Sub RPC GetTableLocations: refreshing cache from master, [472ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.58.62:45123, [472ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.58.60:34817, [475ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.58.61:40329, [476ms] Sub RPC ConnectToMaster: received response from server master-127.22.58.60:34817: Network error: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817, [476ms] Sub RPC ConnectToMaster: received response from server master-127.22.58.62:45123: OK, [479ms] Sub RPC ConnectToMaster: received response from server master-127.22.58.61:40329: OK, [479ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.22.58.62:45123,127.22.58.60:34817,127.22.58.61:40329) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817, [991ms] Sub RPC GetTableLocations: refreshing cache from master, [991ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.58.62:45123, [992ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.58.60:34817, [993ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.58.61:40329, [994ms] Sub RPC ConnectToMaster: received response from server master-127.22.58.60:34817: Network error: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817, [996ms] Sub RPC ConnectToMaster: received response from server master-127.22.58.62:45123: OK, [997ms] Sub RPC ConnectToMaster: received response from server master-127.22.58.61:40329: OK, [998ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.22.58.62:45123,127.22.58.60:34817,127.22.58.61:40329) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817, [1431ms] Sub RPC GetTableLocations: refreshing cache from master, [1431ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.58.62:45123, [1432ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.58.60:34817, [1433ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.58.61:40329, [1434ms] Sub RPC ConnectToMaster: received response from server master-127.22.58.60:34817: Network error: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817, [1437ms] Sub RPC ConnectToMaster: received response from server master-127.22.58.61:40329: OK, [1437ms] Sub RPC ConnectToMaster: received response from server master-127.22.58.62:45123: OK, [1437ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Master config (127.22.58.62:45123,127.22.58.60:34817,127.22.58.61:40329) has no leader. Exceptions received: org.apache.kudu.client.RecoverableException: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817, [2631ms] Sub RPC GetTableLocations: refreshing cache from master, [2631ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.58.62:45123, [2632ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.58.60:34817, [2633ms] Sub RPC ConnectToMaster: sending RPC to server master-127.22.58.61:40329, [2634ms] Sub RPC ConnectToMaster: received response from server master-127.22.58.60:34817: Network error: Failed to connect to peer master-127.22.58.60:34817(127.22.58.60:34817): Connection refused: /127.22.58.60:34817, [2635ms] Sub RPC ConnectToMaster: received response from server master-127.22.58.62:45123: OK, [2638ms] Sub RPC ConnectToMaster: received response from server master-127.22.58.61:40329: OK, [2642ms] Sub RPC GetTableLocations: sending RPC to server master-127.22.58.61:40329, [2647ms] Sub RPC GetTableLocations: received response from server master-127.22.58.61:40329: OK, deferred=Deferred@1201112851(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$235/0x00007fd6e83371b0@303f063b -> passthrough -> wakeup thread Time-limited test, errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@4b7638d2 -> wakeup thread Time-limited test)) after lookup
14:06:03.323 [DEBUG - kudu-nio-2] (Connection.java:748) [peer f4cda0dfc9224c0ab833c4e2024b9bc5(127.22.58.2:35329)] connecting to peer
14:06:03.324 [DEBUG - kudu-nio-1] (Connection.java:757) [peer f4cda0dfc9224c0ab833c4e2024b9bc5(127.22.58.2:35329)] Successfully connected to peer
14:06:03.350 [DEBUG - kudu-nio-1] (Negotiator.java:918) Authenticated connection [id: 0x5ffb40ee, L:/127.0.0.1:59138 - R:/127.22.58.2:35329] using TOKEN/null
14:06:03.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:03.485898 23337 heartbeater.cc:499] Master 127.22.58.61:40329 was elected leader, sending a full tablet report...
14:06:03.560 [DEBUG - kudu-nio-1] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 20 rows, more = false) for scanner KuduScanner(table=org.apache.kudu.client.TestClientFailoverSupport-KILL, tablet=1351b51b98644daba15a8cc44c66056a, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:06:03.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:03.566555 22880 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:46898:
14:06:03.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "org.apache.kudu.client.TestClientFailoverSupport-KILL" }
14:06:03.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:03.567312 22880 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:46898:
14:06:03.567 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "org.apache.kudu.client.TestClientFailoverSupport-KILL" }
14:06:03.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:03.608577 22880 catalog_manager.cc:5984] T 00000000000000000000000000000000 P 5e0fc4cd83084f2eb905d081a292954d: Sending DeleteTablet for 3 replicas of tablet 1351b51b98644daba15a8cc44c66056a
14:06:03.645 [DEBUG - main] (Connection.java:575) [peer master-127.22.58.61:40329(127.22.58.61:40329)] disconnecting while in state READY
14:06:03.646 [DEBUG - main] (Connection.java:575) [peer f4cda0dfc9224c0ab833c4e2024b9bc5(127.22.58.2:35329)] disconnecting while in state READY
14:06:03.649 [DEBUG - kudu-nio-1] (Connection.java:239) [peer f4cda0dfc9224c0ab833c4e2024b9bc5(127.22.58.2:35329)] handling channelInactive
14:06:03.654 [DEBUG - kudu-nio-1] (Connection.java:709) [peer f4cda0dfc9224c0ab833c4e2024b9bc5(127.22.58.2:35329)] cleaning up while in state READY due to: connection closed
14:06:03.655 [DEBUG - main] (Connection.java:575) [peer df45c5d9f8974e5480402c20f2060dd7(127.22.58.1:39871)] disconnecting while in state TERMINATED
14:06:03.655 [DEBUG - main] (Connection.java:575) [peer master-127.22.58.62:45123(127.22.58.62:45123)] disconnecting while in state READY
14:06:03.656 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.22.58.62:45123(127.22.58.62:45123)] handling channelInactive
14:06:03.657 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.22.58.62:45123(127.22.58.62:45123)] cleaning up while in state READY due to: connection closed
14:06:03.658 [DEBUG - main] (Connection.java:575) [peer master-127.22.58.60:34817(127.22.58.60:34817)] disconnecting while in state TERMINATED
14:06:03.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:03.660158 22864 catalog_manager.cc:4755] TS df45c5d9f8974e5480402c20f2060dd7 (127.22.58.1:39871): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1351b51b98644daba15a8cc44c66056a: Network error: Client connection negotiation failed: client connection to 127.22.58.1:39871: connect: Connection refused (error 111)
14:06:03.668 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:06:03.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:03.667636 23413 tablet_service.cc:1558] Processing DeleteTablet for tablet 1351b51b98644daba15a8cc44c66056a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-07-08 14:06:03 UTC) from {username='slave'} at 127.0.0.1:55828
14:06:03.671 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:03.669111 23272 tablet_service.cc:1558] Processing DeleteTablet for tablet 1351b51b98644daba15a8cc44c66056a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-07-08 14:06:03 UTC) from {username='slave'} at 127.0.0.1:59154
14:06:03.676 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.22.58.61:40329(127.22.58.61:40329)] handling channelInactive
14:06:03.676 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.22.58.61:40329(127.22.58.61:40329)] cleaning up while in state READY due to: connection closed
14:06:03.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:03.676982 22760 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskVqKZyE/build/tsan/bin/kudu with pid 23203
14:06:03.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:03.681677 23599 tablet_replica.cc:333] T 1351b51b98644daba15a8cc44c66056a P a3562026b7e6436bb92b95243852ed77: stopping tablet replica
14:06:03.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:03.682498 23599 raft_consensus.cc:2243] T 1351b51b98644daba15a8cc44c66056a P a3562026b7e6436bb92b95243852ed77 [term 2 FOLLOWER]: Raft consensus shutting down.
14:06:03.683 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:03.683557 23599 raft_consensus.cc:2272] T 1351b51b98644daba15a8cc44c66056a P a3562026b7e6436bb92b95243852ed77 [term 2 FOLLOWER]: Raft consensus is shut down!
14:06:03.686 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:03.686331 23599 ts_tablet_manager.cc:1916] T 1351b51b98644daba15a8cc44c66056a P a3562026b7e6436bb92b95243852ed77: Deleting tablet data with delete state TABLET_DATA_DELETED
14:06:03.697 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:03.697503 23599 ts_tablet_manager.cc:1929] T 1351b51b98644daba15a8cc44c66056a P a3562026b7e6436bb92b95243852ed77: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.22
14:06:03.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:03.697813 23599 log.cc:1199] T 1351b51b98644daba15a8cc44c66056a P a3562026b7e6436bb92b95243852ed77: Deleting WAL directory at /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster7503144544093426079/ts-2/wal/wals/1351b51b98644daba15a8cc44c66056a
14:06:03.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:03.698449 23599 ts_tablet_manager.cc:1950] T 1351b51b98644daba15a8cc44c66056a P a3562026b7e6436bb92b95243852ed77: Deleting consensus metadata
14:06:03.701 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:03.700924 22867 catalog_manager.cc:5028] TS a3562026b7e6436bb92b95243852ed77 (127.22.58.3:42361): tablet 1351b51b98644daba15a8cc44c66056a (table org.apache.kudu.client.TestClientFailoverSupport-KILL [id=98be1a8ae0d147efafe7dda9cf112c37]) successfully deleted
14:06:03.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:03.714052 22760 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskVqKZyE/build/tsan/bin/kudu with pid 23347
14:06:03.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:03.744612 22760 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskVqKZyE/build/tsan/bin/kudu with pid 22772
14:06:03.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:03.774783 22760 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskVqKZyE/build/tsan/bin/kudu with pid 22842
14:06:04.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T14:06:04Z chronyd exiting
.14:06:06.213 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1783519566213
14:06:06.217 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
14:06:06.217 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
14:06:06.218 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskVqKZyE/test-tmp
14:06:06.218 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
14:06:06.218 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskVqKZyE/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
14:06:06.221 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

14:06:06.551 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
14:06:06.552 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

14:06:06.556 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:06.555546 23606 mini_oidc.cc:150] Starting JWKS server
14:06:06.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:06.558710 23606 webserver.cc:533] Webserver started at http://127.0.0.1:36973/ using document root <none> and password file <none>
14:06:06.559 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:06.559348 23606 mini_oidc.cc:186] Starting OIDC Discovery server
14:06:06.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:06.561146 23606 webserver.cc:533] Webserver started at http://127.0.0.1:43053/ using document root <none> and password file <none>
14:06:06.610 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T14:06:06Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
14:06:06.611 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T14:06:06Z Disabled control of system clock
14:06:06.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:06.624559 23606 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskVqKZyE/build/tsan/bin/kudu
14:06:06.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskVqKZyE/build/tsan/bin/kudu
14:06:06.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/master-0/wal
14:06:06.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/master-0/data
14:06:06.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:06:06.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:06:06.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:06:06.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:06:06.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:06:06.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:06:06.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/master-0/logs
14:06:06.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/master-0/data/info.pb
14:06:06.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:06:06.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:06:06.625 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:06:06.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:06:06.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:06:06.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:06:06.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:06:06.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:06:06.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
14:06:06.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:06:06.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:06:06.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:06:06.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.23.13.190:33371
14:06:06.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.23.13.190
14:06:06.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:06:06.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.23.13.148:33463
14:06:06.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:06:06.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:06:06.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:06:06.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:06:06.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.23.13.190:33371,127.23.13.189:33209,127.23.13.188:37881
14:06:06.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:06:06.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36973/jwks.json with env {}
14:06:06.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:06.935529 23618 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:06:06.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:06.936177 23618 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:06:06.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:06.936657 23618 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:06:06.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:06.970378 23618 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
14:06:06.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:06.970703 23618 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:06:06.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:06.970901 23618 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
14:06:06.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:06.971102 23618 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
14:06:06.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:06.971300 23618 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
14:06:06.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:06.971441 23618 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:36973/jwks.json
14:06:07.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:07.009246 23618 master_runner.cc:387] Master server non-default flags:
14:06:07.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:06:07.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.23.13.148:33463
14:06:07.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:06:07.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:06:07.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/master-0/data
14:06:07.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/master-0/wal
14:06:07.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:06:07.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.23.13.190:33371,127.23.13.189:33209,127.23.13.188:37881
14:06:07.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:06:07.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:06:07.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:06:07.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.23.13.190:33371
14:06:07.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:06:07.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:06:07.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:06:07.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36973/jwks.json
14:06:07.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:06:07.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:06:07.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/master-0/data/info.pb
14:06:07.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.23.13.190
14:06:07.010 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:06:07.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:06:07.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:06:07.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:06:07.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:06:07.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:06:07.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/master-0/logs
14:06:07.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:06:07.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:06:07.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:06:07.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
14:06:07.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:06:07.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
14:06:07.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:06:07.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 13:43:23 UTC on e7f111948823
14:06:07.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12775
14:06:07.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:06:07.011 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:07.010557 23618 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:06:07.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:07.012346 23618 file_cache.cc:504] Constructed file cache file cache with capacity 419430
14:06:07.026 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:07.025725 23624 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:06:08.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:07.026499 23625 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:06:08.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:07.029510 23627 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:06:08.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:08.254524 23626 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1224 milliseconds
14:06:08.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:08.254734 23618 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:06:08.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:08.256172 23618 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:06:08.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:08.258924 23618 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:06:08.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:08.260339 23618 hybrid_clock.cc:648] HybridClock initialized: now 1783519568260293 us; error 57 us; skew 500 ppm
14:06:08.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:08.261240 23618 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:06:08.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:08.267618 23618 webserver.cc:533] Webserver started at http://127.23.13.190:45831/ using document root <none> and password file <none>
14:06:08.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:08.268669 23618 fs_manager.cc:362] Metadata directory not provided
14:06:08.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:08.268924 23618 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:06:08.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:08.269538 23618 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:06:08.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:08.274012 23618 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/master-0/data/instance:
14:06:08.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1305e72a63eb424da1755bd3609ce7e0"
14:06:08.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:06:08 on dist-test-slave-gws2"
14:06:08.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:08.275547 23618 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/master-0/wal/instance:
14:06:08.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1305e72a63eb424da1755bd3609ce7e0"
14:06:08.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:06:08 on dist-test-slave-gws2"
14:06:08.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:08.283759 23618 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.003s	sys 0.005s
14:06:08.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:08.290261 23634 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:06:08.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:08.291561 23618 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.001s
14:06:08.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:08.291973 23618 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/master-0/data,/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/master-0/wal
14:06:08.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "1305e72a63eb424da1755bd3609ce7e0"
14:06:08.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:06:08 on dist-test-slave-gws2"
14:06:08.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:08.292397 23618 fs_report.cc:389] FS layout report
14:06:08.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:06:08.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/master-0/wal
14:06:08.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/master-0/wal
14:06:08.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/master-0/data/data
14:06:08.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:06:08.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:06:08.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:06:08.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:06:08.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:06:08.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:06:08.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:06:08.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:06:08.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:06:08.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:06:08.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:06:08.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:08.340425 23618 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:06:08.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:08.342080 23618 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:06:08.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:08.342687 23618 kserver.cc:163] Server-wide thread pool size limit: 3276
14:06:08.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:08.413589 23618 rpc_server.cc:307] RPC server started. Bound to: 127.23.13.190:33371
14:06:08.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:08.413750 23685 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.13.190:33371 every 8 connection(s)
14:06:08.418 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:08.418071 23618 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/master-0/data/info.pb
14:06:08.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:08.424593 23606 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskVqKZyE/build/tsan/bin/kudu as pid 23618
14:06:08.425 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:08.425226 23606 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/master-0/wal/instance
14:06:08.426 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:08.426440 23686 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
14:06:08.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:08.430860 23606 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskVqKZyE/build/tsan/bin/kudu
14:06:08.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskVqKZyE/build/tsan/bin/kudu
14:06:08.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/master-1/wal
14:06:08.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/master-1/data
14:06:08.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:06:08.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:06:08.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:06:08.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:06:08.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:06:08.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:06:08.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/master-1/logs
14:06:08.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/master-1/data/info.pb
14:06:08.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:06:08.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:06:08.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:06:08.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:06:08.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:06:08.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:06:08.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:06:08.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:06:08.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
14:06:08.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:06:08.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:06:08.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:06:08.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.23.13.189:33209
14:06:08.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.23.13.189
14:06:08.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:06:08.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.23.13.148:33463
14:06:08.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:06:08.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:06:08.432 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:06:08.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:06:08.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.23.13.190:33371,127.23.13.189:33209,127.23.13.188:37881
14:06:08.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:06:08.433 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36973/jwks.json with env {}
14:06:08.450 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:08.445596 23686 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.13.190" port: 33371 } has no permanent_uuid. Determining permanent_uuid...
14:06:08.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:08.481431 23686 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.13.189" port: 33209 } has no permanent_uuid. Determining permanent_uuid...
14:06:08.484 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:08.484333 23636 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.13.189:33209: connect: Connection refused (error 111)
14:06:08.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:08.489184 23686 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.13.189:33209: Network error: Client connection negotiation failed: client connection to 127.23.13.189:33209: connect: Connection refused (error 111)
14:06:08.539 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:08.538774 23686 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.13.189" port: 33209 } attempt: 1
14:06:08.543 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:08.543435 23686 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.13.189:33209: Network error: Client connection negotiation failed: client connection to 127.23.13.189:33209: connect: Connection refused (error 111)
14:06:08.612 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:08.611976 23686 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.13.189" port: 33209 } attempt: 2
14:06:08.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:08.616463 23686 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.13.189:33209: Network error: Client connection negotiation failed: client connection to 127.23.13.189:33209: connect: Connection refused (error 111)
14:06:08.708 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:08.708012 23686 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.13.189" port: 33209 } attempt: 3
14:06:08.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:08.712805 23686 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.13.189:33209: Network error: Client connection negotiation failed: client connection to 127.23.13.189:33209: connect: Connection refused (error 111)
14:06:08.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:08.785246 23688 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:06:08.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:08.785812 23688 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:06:08.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:08.786271 23688 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:06:08.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:08.819993 23688 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
14:06:08.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:08.820312 23688 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:06:08.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:08.820505 23688 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
14:06:08.820 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:08.820705 23688 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
14:06:08.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:08.820904 23688 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
14:06:08.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:08.821055 23688 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:36973/jwks.json
14:06:08.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:08.856307 23686 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.13.189" port: 33209 } attempt: 4
14:06:08.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:08.861153 23686 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.13.189:33209: Network error: Client connection negotiation failed: client connection to 127.23.13.189:33209: connect: Connection refused (error 111)
14:06:08.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:08.861860 23688 master_runner.cc:387] Master server non-default flags:
14:06:08.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:06:08.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.23.13.148:33463
14:06:08.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:06:08.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:06:08.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/master-1/data
14:06:08.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/master-1/wal
14:06:08.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:06:08.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.23.13.190:33371,127.23.13.189:33209,127.23.13.188:37881
14:06:08.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:06:08.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:06:08.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:06:08.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.23.13.189:33209
14:06:08.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:06:08.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:06:08.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:06:08.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36973/jwks.json
14:06:08.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:06:08.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:06:08.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/master-1/data/info.pb
14:06:08.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.23.13.189
14:06:08.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:06:08.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:06:08.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:06:08.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:06:08.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:06:08.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:06:08.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/master-1/logs
14:06:08.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:06:08.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:06:08.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:06:08.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
14:06:08.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:06:08.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
14:06:08.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:06:08.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 13:43:23 UTC on e7f111948823
14:06:08.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12775
14:06:08.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:06:08.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:08.863466 23688 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:06:08.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:08.865450 23688 file_cache.cc:504] Constructed file cache file cache with capacity 419430
14:06:08.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:08.876819 23697 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:06:09.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:09.160691 23686 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.13.189" port: 33209 } attempt: 5
14:06:09.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:09.168454 23686 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.13.189:33209: Network error: Client connection negotiation failed: client connection to 127.23.13.189:33209: connect: Connection refused (error 111)
14:06:09.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:09.716063 23686 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.13.189" port: 33209 } attempt: 6
14:06:09.727 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:09.727280 23686 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.13.189:33209: Network error: Client connection negotiation failed: client connection to 127.23.13.189:33209: connect: Connection refused (error 111)
14:06:10.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:08.879038 23698 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:06:10.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:10.113888 23700 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:06:10.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:10.115738 23699 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1232 milliseconds
14:06:10.116 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:10.115800 23688 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:06:10.117 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:10.117081 23688 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:06:10.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:10.119709 23688 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:06:10.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:10.121054 23688 hybrid_clock.cc:648] HybridClock initialized: now 1783519570121026 us; error 43 us; skew 500 ppm
14:06:10.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:10.121826 23688 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:06:10.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:10.128675 23688 webserver.cc:533] Webserver started at http://127.23.13.189:43959/ using document root <none> and password file <none>
14:06:10.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:10.129604 23688 fs_manager.cc:362] Metadata directory not provided
14:06:10.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:10.129810 23688 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:06:10.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:10.130201 23688 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:06:10.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:10.134434 23688 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/master-1/data/instance:
14:06:10.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "af6b7cb9ce404981ad40292b0975fe51"
14:06:10.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:06:10 on dist-test-slave-gws2"
14:06:10.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:10.135584 23688 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/master-1/wal/instance:
14:06:10.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "af6b7cb9ce404981ad40292b0975fe51"
14:06:10.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:06:10 on dist-test-slave-gws2"
14:06:10.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:10.142725 23688 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.007s	sys 0.000s
14:06:10.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:10.148602 23709 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:06:10.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:10.149894 23688 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
14:06:10.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:10.150264 23688 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/master-1/data,/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/master-1/wal
14:06:10.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "af6b7cb9ce404981ad40292b0975fe51"
14:06:10.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:06:10 on dist-test-slave-gws2"
14:06:10.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:10.150589 23688 fs_report.cc:389] FS layout report
14:06:10.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:06:10.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/master-1/wal
14:06:10.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/master-1/wal
14:06:10.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/master-1/data/data
14:06:10.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:06:10.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:06:10.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:06:10.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:06:10.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:06:10.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:06:10.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:06:10.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:06:10.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:06:10.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:06:10.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:06:10.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:10.224532 23688 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:06:10.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:10.226172 23688 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:06:10.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:10.226577 23688 kserver.cc:163] Server-wide thread pool size limit: 3276
14:06:10.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:10.299451 23688 rpc_server.cc:307] RPC server started. Bound to: 127.23.13.189:33209
14:06:10.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:10.299542 23760 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.13.189:33209 every 8 connection(s)
14:06:10.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:10.302208 23688 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/master-1/data/info.pb
14:06:10.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:10.307610 23606 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskVqKZyE/build/tsan/bin/kudu as pid 23688
14:06:10.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:10.307976 23606 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/master-1/wal/instance
14:06:10.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:10.308314 23761 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
14:06:10.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:10.309937 23606 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskVqKZyE/build/tsan/bin/kudu
14:06:10.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskVqKZyE/build/tsan/bin/kudu
14:06:10.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/master-2/wal
14:06:10.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/master-2/data
14:06:10.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:06:10.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:06:10.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:06:10.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:06:10.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:06:10.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:06:10.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/master-2/logs
14:06:10.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/master-2/data/info.pb
14:06:10.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:06:10.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:06:10.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:06:10.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:06:10.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:06:10.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:06:10.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:06:10.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:06:10.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
14:06:10.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:06:10.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:06:10.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:06:10.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.23.13.188:37881
14:06:10.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.23.13.188
14:06:10.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:06:10.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.23.13.148:33463
14:06:10.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:06:10.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:06:10.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:06:10.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:06:10.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.23.13.190:33371,127.23.13.189:33209,127.23.13.188:37881
14:06:10.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:06:10.311 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36973/jwks.json with env {}
14:06:10.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:10.323662 23761 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.13.190" port: 33371 } has no permanent_uuid. Determining permanent_uuid...
14:06:10.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:10.350677 23761 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.13.189" port: 33209 } has no permanent_uuid. Determining permanent_uuid...
14:06:10.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:10.366194 23761 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.13.188" port: 37881 } has no permanent_uuid. Determining permanent_uuid...
14:06:10.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:10.369264 23713 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.13.188:37881: connect: Connection refused (error 111)
14:06:10.374 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:10.373872 23761 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.13.188:37881: Network error: Client connection negotiation failed: client connection to 127.23.13.188:37881: connect: Connection refused (error 111)
14:06:10.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:10.423441 23761 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.13.188" port: 37881 } attempt: 1
14:06:10.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:10.428894 23761 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.13.188:37881: Network error: Client connection negotiation failed: client connection to 127.23.13.188:37881: connect: Connection refused (error 111)
14:06:10.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:10.497345 23761 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.13.188" port: 37881 } attempt: 2
14:06:10.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:10.501543 23761 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.13.188:37881: Network error: Client connection negotiation failed: client connection to 127.23.13.188:37881: connect: Connection refused (error 111)
14:06:10.593 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:10.593044 23761 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.13.188" port: 37881 } attempt: 3
14:06:10.598 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:10.597635 23761 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.13.188:37881: Network error: Client connection negotiation failed: client connection to 127.23.13.188:37881: connect: Connection refused (error 111)
14:06:10.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:10.637178 23763 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:06:10.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:10.637910 23763 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:06:10.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:10.638557 23763 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:06:10.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:10.673024 23763 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
14:06:10.673 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:10.673424 23763 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:06:10.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:10.673810 23763 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
14:06:10.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:10.674158 23763 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
14:06:10.674 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:10.674500 23763 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
14:06:10.675 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:10.674796 23763 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:36973/jwks.json
14:06:10.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:10.712678 23763 master_runner.cc:387] Master server non-default flags:
14:06:10.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:06:10.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.23.13.148:33463
14:06:10.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:06:10.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:06:10.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/master-2/data
14:06:10.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/master-2/wal
14:06:10.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:06:10.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.23.13.190:33371,127.23.13.189:33209,127.23.13.188:37881
14:06:10.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:06:10.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:06:10.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:06:10.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.23.13.188:37881
14:06:10.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:06:10.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:06:10.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:06:10.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36973/jwks.json
14:06:10.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:06:10.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:06:10.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/master-2/data/info.pb
14:06:10.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.23.13.188
14:06:10.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:06:10.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:06:10.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:06:10.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:06:10.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:06:10.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:06:10.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/master-2/logs
14:06:10.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:06:10.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:06:10.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:06:10.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
14:06:10.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:06:10.714 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
14:06:10.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:06:10.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 13:43:23 UTC on e7f111948823
14:06:10.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12775
14:06:10.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:06:10.715 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:10.714521 23763 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:06:10.716 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:10.716495 23763 file_cache.cc:504] Constructed file cache file cache with capacity 419430
14:06:10.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:10.728120 23773 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:06:10.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:10.741046 23761 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.13.188" port: 37881 } attempt: 4
14:06:10.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:10.749594 23761 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.13.188:37881: Network error: Client connection negotiation failed: client connection to 127.23.13.188:37881: connect: Connection refused (error 111)
14:06:10.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:10.787988 23686 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.13.189" port: 33209 } attempt: 7
14:06:10.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:10.810925 23686 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.13.188" port: 37881 } has no permanent_uuid. Determining permanent_uuid...
14:06:10.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:10.839402 23686 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.13.188:37881: Network error: Client connection negotiation failed: client connection to 127.23.13.188:37881: connect: Connection refused (error 111)
14:06:10.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:10.897994 23686 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.13.188" port: 37881 } attempt: 1
14:06:10.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:10.906242 23686 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.13.188:37881: Network error: Client connection negotiation failed: client connection to 127.23.13.188:37881: connect: Connection refused (error 111)
14:06:10.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:10.987813 23686 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.13.188" port: 37881 } attempt: 2
14:06:10.997 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:10.996605 23686 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.13.188:37881: Network error: Client connection negotiation failed: client connection to 127.23.13.188:37881: connect: Connection refused (error 111)
14:06:11.053 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:11.049146 23761 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.13.188" port: 37881 } attempt: 5
14:06:11.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:11.057601 23761 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.13.188:37881: Network error: Client connection negotiation failed: client connection to 127.23.13.188:37881: connect: Connection refused (error 111)
14:06:11.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:11.082190 23686 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.13.188" port: 37881 } attempt: 3
14:06:11.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:11.093226 23686 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.13.188:37881: Network error: Client connection negotiation failed: client connection to 127.23.13.188:37881: connect: Connection refused (error 111)
14:06:11.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:11.233786 23686 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.13.188" port: 37881 } attempt: 4
14:06:11.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:11.241914 23686 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.13.188:37881: Network error: Client connection negotiation failed: client connection to 127.23.13.188:37881: connect: Connection refused (error 111)
14:06:11.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:11.525499 23686 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.13.188" port: 37881 } attempt: 5
14:06:11.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:11.533867 23686 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.13.188:37881: Network error: Client connection negotiation failed: client connection to 127.23.13.188:37881: connect: Connection refused (error 111)
14:06:11.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:11.605345 23761 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.13.188" port: 37881 } attempt: 6
14:06:11.634 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:11.633931 23761 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.13.188:37881: Network error: Client connection negotiation failed: client connection to 127.23.13.188:37881: connect: Connection refused (error 111)
14:06:12.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:12.086432 23686 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.13.188" port: 37881 } attempt: 6
14:06:12.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:12.115152 23686 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.23.13.188:37881: Network error: Client connection negotiation failed: client connection to 127.23.13.188:37881: connect: Connection refused (error 111)
14:06:12.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:12.131471 23772 debug-util.cc:398] Leaking SignalData structure 0x7b0800028020 after lost signal to thread 23763
14:06:12.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:12.494096 23763 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.766s	user 0.643s	sys 1.117s
14:06:12.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:12.494449 23763 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.766s	user 0.643s	sys 1.117s
14:06:12.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:10.729070 23774 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:06:12.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:12.496815 23776 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:06:12.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:12.499842 23775 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1767 milliseconds
14:06:12.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:12.499888 23763 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:06:12.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:12.501215 23763 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:06:12.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:12.503720 23763 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:06:12.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:12.505152 23763 hybrid_clock.cc:648] HybridClock initialized: now 1783519572505086 us; error 64 us; skew 500 ppm
14:06:12.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:12.506049 23763 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:06:12.512 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:12.512092 23763 webserver.cc:533] Webserver started at http://127.23.13.188:35865/ using document root <none> and password file <none>
14:06:12.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:12.513094 23763 fs_manager.cc:362] Metadata directory not provided
14:06:12.513 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:12.513355 23763 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:06:12.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:12.513898 23763 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:06:12.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:12.518215 23763 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/master-2/data/instance:
14:06:12.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ab4f66b288014bc3875c2cd2b7d3cfc6"
14:06:12.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:06:12 on dist-test-slave-gws2"
14:06:12.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:12.519461 23763 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/master-2/wal/instance:
14:06:12.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ab4f66b288014bc3875c2cd2b7d3cfc6"
14:06:12.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:06:12 on dist-test-slave-gws2"
14:06:12.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:12.526728 23763 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.001s
14:06:12.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:12.532649 23790 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:06:12.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:12.533797 23763 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.000s
14:06:12.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:12.534188 23763 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/master-2/data,/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/master-2/wal
14:06:12.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ab4f66b288014bc3875c2cd2b7d3cfc6"
14:06:12.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:06:12 on dist-test-slave-gws2"
14:06:12.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:12.534595 23763 fs_report.cc:389] FS layout report
14:06:12.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:06:12.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/master-2/wal
14:06:12.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/master-2/wal
14:06:12.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/master-2/data/data
14:06:12.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:06:12.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:06:12.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:06:12.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:06:12.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:06:12.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:06:12.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:06:12.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:06:12.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:06:12.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:06:12.535 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:06:12.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:12.601671 23763 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:06:12.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:12.603536 23763 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:06:12.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:12.604172 23763 kserver.cc:163] Server-wide thread pool size limit: 3276
14:06:12.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:12.678120 23763 rpc_server.cc:307] RPC server started. Bound to: 127.23.13.188:37881
14:06:12.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:12.678224 23841 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.13.188:37881 every 8 connection(s)
14:06:12.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:12.681054 23763 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/master-2/data/info.pb
14:06:12.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:12.687865 23842 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
14:06:12.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:12.689388 23606 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskVqKZyE/build/tsan/bin/kudu as pid 23763
14:06:12.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:12.689778 23606 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/master-2/wal/instance
14:06:12.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:12.695220 23761 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.13.188" port: 37881 } attempt: 7
14:06:12.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:12.706581 23842 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.13.190" port: 33371 } has no permanent_uuid. Determining permanent_uuid...
14:06:12.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:12.755195 23842 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.13.189" port: 33209 } has no permanent_uuid. Determining permanent_uuid...
14:06:12.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:12.765316 23761 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af6b7cb9ce404981ad40292b0975fe51: Bootstrap starting.
14:06:12.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:12.771004 23842 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.23.13.188" port: 37881 } has no permanent_uuid. Determining permanent_uuid...
14:06:12.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:12.773767 23761 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P af6b7cb9ce404981ad40292b0975fe51: Neither blocks nor log segments found. Creating new log.
14:06:12.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:12.776620 23761 log.cc:826] T 00000000000000000000000000000000 P af6b7cb9ce404981ad40292b0975fe51: Log is configured to *not* fsync() on all Append() calls
14:06:12.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:12.781963 23761 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P af6b7cb9ce404981ad40292b0975fe51: No bootstrap required, opened a new log
14:06:12.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:12.792551 23842 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ab4f66b288014bc3875c2cd2b7d3cfc6: Bootstrap starting.
14:06:12.799 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:12.799054 23842 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ab4f66b288014bc3875c2cd2b7d3cfc6: Neither blocks nor log segments found. Creating new log.
14:06:12.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:12.801083 23842 log.cc:826] T 00000000000000000000000000000000 P ab4f66b288014bc3875c2cd2b7d3cfc6: Log is configured to *not* fsync() on all Append() calls
14:06:12.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:12.806908 23842 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ab4f66b288014bc3875c2cd2b7d3cfc6: No bootstrap required, opened a new log
14:06:12.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:12.807019 23761 raft_consensus.cc:359] T 00000000000000000000000000000000 P af6b7cb9ce404981ad40292b0975fe51 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1305e72a63eb424da1755bd3609ce7e0" member_type: VOTER last_known_addr { host: "127.23.13.190" port: 33371 } } peers { permanent_uuid: "af6b7cb9ce404981ad40292b0975fe51" member_type: VOTER last_known_addr { host: "127.23.13.189" port: 33209 } } peers { permanent_uuid: "ab4f66b288014bc3875c2cd2b7d3cfc6" member_type: VOTER last_known_addr { host: "127.23.13.188" port: 37881 } }
14:06:12.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:12.807632 23761 raft_consensus.cc:385] T 00000000000000000000000000000000 P af6b7cb9ce404981ad40292b0975fe51 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:06:12.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:12.807826 23761 raft_consensus.cc:740] T 00000000000000000000000000000000 P af6b7cb9ce404981ad40292b0975fe51 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: af6b7cb9ce404981ad40292b0975fe51, State: Initialized, Role: FOLLOWER
14:06:12.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:12.808611 23761 consensus_queue.cc:260] T 00000000000000000000000000000000 P af6b7cb9ce404981ad40292b0975fe51 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1305e72a63eb424da1755bd3609ce7e0" member_type: VOTER last_known_addr { host: "127.23.13.190" port: 33371 } } peers { permanent_uuid: "af6b7cb9ce404981ad40292b0975fe51" member_type: VOTER last_known_addr { host: "127.23.13.189" port: 33209 } } peers { permanent_uuid: "ab4f66b288014bc3875c2cd2b7d3cfc6" member_type: VOTER last_known_addr { host: "127.23.13.188" port: 37881 } }
14:06:12.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:12.811367 23855 sys_catalog.cc:455] T 00000000000000000000000000000000 P af6b7cb9ce404981ad40292b0975fe51 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1305e72a63eb424da1755bd3609ce7e0" member_type: VOTER last_known_addr { host: "127.23.13.190" port: 33371 } } peers { permanent_uuid: "af6b7cb9ce404981ad40292b0975fe51" member_type: VOTER last_known_addr { host: "127.23.13.189" port: 33209 } } peers { permanent_uuid: "ab4f66b288014bc3875c2cd2b7d3cfc6" member_type: VOTER last_known_addr { host: "127.23.13.188" port: 37881 } } }
14:06:12.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:12.812453 23855 sys_catalog.cc:458] T 00000000000000000000000000000000 P af6b7cb9ce404981ad40292b0975fe51 [sys.catalog]: This master's current role is: FOLLOWER
14:06:12.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:12.813330 23761 sys_catalog.cc:565] T 00000000000000000000000000000000 P af6b7cb9ce404981ad40292b0975fe51 [sys.catalog]: configured and running, proceeding with master startup.
14:06:12.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:12.831264 23842 raft_consensus.cc:359] T 00000000000000000000000000000000 P ab4f66b288014bc3875c2cd2b7d3cfc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1305e72a63eb424da1755bd3609ce7e0" member_type: VOTER last_known_addr { host: "127.23.13.190" port: 33371 } } peers { permanent_uuid: "af6b7cb9ce404981ad40292b0975fe51" member_type: VOTER last_known_addr { host: "127.23.13.189" port: 33209 } } peers { permanent_uuid: "ab4f66b288014bc3875c2cd2b7d3cfc6" member_type: VOTER last_known_addr { host: "127.23.13.188" port: 37881 } }
14:06:12.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:12.831959 23842 raft_consensus.cc:385] T 00000000000000000000000000000000 P ab4f66b288014bc3875c2cd2b7d3cfc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:06:12.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:12.832261 23842 raft_consensus.cc:740] T 00000000000000000000000000000000 P ab4f66b288014bc3875c2cd2b7d3cfc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab4f66b288014bc3875c2cd2b7d3cfc6, State: Initialized, Role: FOLLOWER
14:06:12.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:12.833262 23842 consensus_queue.cc:260] T 00000000000000000000000000000000 P ab4f66b288014bc3875c2cd2b7d3cfc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1305e72a63eb424da1755bd3609ce7e0" member_type: VOTER last_known_addr { host: "127.23.13.190" port: 33371 } } peers { permanent_uuid: "af6b7cb9ce404981ad40292b0975fe51" member_type: VOTER last_known_addr { host: "127.23.13.189" port: 33209 } } peers { permanent_uuid: "ab4f66b288014bc3875c2cd2b7d3cfc6" member_type: VOTER last_known_addr { host: "127.23.13.188" port: 37881 } }
14:06:12.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:12.837903 23865 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab4f66b288014bc3875c2cd2b7d3cfc6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1305e72a63eb424da1755bd3609ce7e0" member_type: VOTER last_known_addr { host: "127.23.13.190" port: 33371 } } peers { permanent_uuid: "af6b7cb9ce404981ad40292b0975fe51" member_type: VOTER last_known_addr { host: "127.23.13.189" port: 33209 } } peers { permanent_uuid: "ab4f66b288014bc3875c2cd2b7d3cfc6" member_type: VOTER last_known_addr { host: "127.23.13.188" port: 37881 } } }
14:06:12.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:12.839116 23865 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab4f66b288014bc3875c2cd2b7d3cfc6 [sys.catalog]: This master's current role is: FOLLOWER
14:06:12.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:12.839823 23842 sys_catalog.cc:565] T 00000000000000000000000000000000 P ab4f66b288014bc3875c2cd2b7d3cfc6 [sys.catalog]: configured and running, proceeding with master startup.
14:06:12.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:12.848618 23867 catalog_manager.cc:1594] T 00000000000000000000000000000000 P af6b7cb9ce404981ad40292b0975fe51: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
14:06:12.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:12.849375 23867 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
14:06:12.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:12.859742 23796 tablet.cc:2406] T 00000000000000000000000000000000 P ab4f66b288014bc3875c2cd2b7d3cfc6: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:06:12.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:12.844427 23688 master_runner.cc:187] Error getting master registration for 127.23.13.190:33371: OK, instance_id { permanent_uuid: "1305e72a63eb424da1755bd3609ce7e0" instance_seqno: 1783519568394737 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
14:06:12.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:12.889819 23688 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
14:06:12.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:12.893074 23879 catalog_manager.cc:1594] T 00000000000000000000000000000000 P ab4f66b288014bc3875c2cd2b7d3cfc6: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
14:06:12.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:12.893407 23879 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
14:06:12.912 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:12.877403 23763 master_runner.cc:187] Error getting master registration for 127.23.13.190:33371: OK, instance_id { permanent_uuid: "1305e72a63eb424da1755bd3609ce7e0" instance_seqno: 1783519568394737 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
14:06:12.913 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:12.912690 23763 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
14:06:12.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:12.985054 23715 tablet.cc:2406] T 00000000000000000000000000000000 P af6b7cb9ce404981ad40292b0975fe51: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:06:13.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.148725 23686 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.23.13.188" port: 37881 } attempt: 7
14:06:13.170 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.170284 23686 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1305e72a63eb424da1755bd3609ce7e0: Bootstrap starting.
14:06:13.176 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.176533 23686 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1305e72a63eb424da1755bd3609ce7e0: Neither blocks nor log segments found. Creating new log.
14:06:13.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.178427 23686 log.cc:826] T 00000000000000000000000000000000 P 1305e72a63eb424da1755bd3609ce7e0: Log is configured to *not* fsync() on all Append() calls
14:06:13.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.183063 23686 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1305e72a63eb424da1755bd3609ce7e0: No bootstrap required, opened a new log
14:06:13.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.205354 23686 raft_consensus.cc:359] T 00000000000000000000000000000000 P 1305e72a63eb424da1755bd3609ce7e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1305e72a63eb424da1755bd3609ce7e0" member_type: VOTER last_known_addr { host: "127.23.13.190" port: 33371 } } peers { permanent_uuid: "af6b7cb9ce404981ad40292b0975fe51" member_type: VOTER last_known_addr { host: "127.23.13.189" port: 33209 } } peers { permanent_uuid: "ab4f66b288014bc3875c2cd2b7d3cfc6" member_type: VOTER last_known_addr { host: "127.23.13.188" port: 37881 } }
14:06:13.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.206175 23686 raft_consensus.cc:385] T 00000000000000000000000000000000 P 1305e72a63eb424da1755bd3609ce7e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:06:13.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.206489 23686 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1305e72a63eb424da1755bd3609ce7e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1305e72a63eb424da1755bd3609ce7e0, State: Initialized, Role: FOLLOWER
14:06:13.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.207486 23686 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1305e72a63eb424da1755bd3609ce7e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1305e72a63eb424da1755bd3609ce7e0" member_type: VOTER last_known_addr { host: "127.23.13.190" port: 33371 } } peers { permanent_uuid: "af6b7cb9ce404981ad40292b0975fe51" member_type: VOTER last_known_addr { host: "127.23.13.189" port: 33209 } } peers { permanent_uuid: "ab4f66b288014bc3875c2cd2b7d3cfc6" member_type: VOTER last_known_addr { host: "127.23.13.188" port: 37881 } }
14:06:13.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.210588 23883 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1305e72a63eb424da1755bd3609ce7e0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1305e72a63eb424da1755bd3609ce7e0" member_type: VOTER last_known_addr { host: "127.23.13.190" port: 33371 } } peers { permanent_uuid: "af6b7cb9ce404981ad40292b0975fe51" member_type: VOTER last_known_addr { host: "127.23.13.189" port: 33209 } } peers { permanent_uuid: "ab4f66b288014bc3875c2cd2b7d3cfc6" member_type: VOTER last_known_addr { host: "127.23.13.188" port: 37881 } } }
14:06:13.211 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.211615 23883 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1305e72a63eb424da1755bd3609ce7e0 [sys.catalog]: This master's current role is: FOLLOWER
14:06:13.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.212543 23686 sys_catalog.cc:565] T 00000000000000000000000000000000 P 1305e72a63eb424da1755bd3609ce7e0 [sys.catalog]: configured and running, proceeding with master startup.
14:06:13.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.275229 23618 master_runner.cc:264] No leader master found from master 1305e72a63eb424da1755bd3609ce7e0
14:06:13.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.275591 23618 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
14:06:13.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:13.274466 23894 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 1305e72a63eb424da1755bd3609ce7e0: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
14:06:13.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:13.276124 23894 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
14:06:13.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.279270 23865 raft_consensus.cc:493] T 00000000000000000000000000000000 P ab4f66b288014bc3875c2cd2b7d3cfc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:06:13.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.279856 23865 raft_consensus.cc:515] T 00000000000000000000000000000000 P ab4f66b288014bc3875c2cd2b7d3cfc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1305e72a63eb424da1755bd3609ce7e0" member_type: VOTER last_known_addr { host: "127.23.13.190" port: 33371 } } peers { permanent_uuid: "af6b7cb9ce404981ad40292b0975fe51" member_type: VOTER last_known_addr { host: "127.23.13.189" port: 33209 } } peers { permanent_uuid: "ab4f66b288014bc3875c2cd2b7d3cfc6" member_type: VOTER last_known_addr { host: "127.23.13.188" port: 37881 } }
14:06:13.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.282510 23865 leader_election.cc:290] T 00000000000000000000000000000000 P ab4f66b288014bc3875c2cd2b7d3cfc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1305e72a63eb424da1755bd3609ce7e0 (127.23.13.190:33371), af6b7cb9ce404981ad40292b0975fe51 (127.23.13.189:33209)
14:06:13.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.284718 23736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ab4f66b288014bc3875c2cd2b7d3cfc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af6b7cb9ce404981ad40292b0975fe51" is_pre_election: true
14:06:13.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.285620 23736 raft_consensus.cc:2468] T 00000000000000000000000000000000 P af6b7cb9ce404981ad40292b0975fe51 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab4f66b288014bc3875c2cd2b7d3cfc6 in term 0.
14:06:13.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.287258 23792 leader_election.cc:304] T 00000000000000000000000000000000 P ab4f66b288014bc3875c2cd2b7d3cfc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ab4f66b288014bc3875c2cd2b7d3cfc6, af6b7cb9ce404981ad40292b0975fe51; no voters: 
14:06:13.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.289549 23661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ab4f66b288014bc3875c2cd2b7d3cfc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1305e72a63eb424da1755bd3609ce7e0" is_pre_election: true
14:06:13.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.290510 23661 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 1305e72a63eb424da1755bd3609ce7e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ab4f66b288014bc3875c2cd2b7d3cfc6 in term 0.
14:06:13.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.292903 23865 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ab4f66b288014bc3875c2cd2b7d3cfc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
14:06:13.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.293298 23865 raft_consensus.cc:493] T 00000000000000000000000000000000 P ab4f66b288014bc3875c2cd2b7d3cfc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:06:13.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.293622 23865 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ab4f66b288014bc3875c2cd2b7d3cfc6 [term 0 FOLLOWER]: Advancing to term 1
14:06:13.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.302043 23865 raft_consensus.cc:515] T 00000000000000000000000000000000 P ab4f66b288014bc3875c2cd2b7d3cfc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1305e72a63eb424da1755bd3609ce7e0" member_type: VOTER last_known_addr { host: "127.23.13.190" port: 33371 } } peers { permanent_uuid: "af6b7cb9ce404981ad40292b0975fe51" member_type: VOTER last_known_addr { host: "127.23.13.189" port: 33209 } } peers { permanent_uuid: "ab4f66b288014bc3875c2cd2b7d3cfc6" member_type: VOTER last_known_addr { host: "127.23.13.188" port: 37881 } }
14:06:13.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.305279 23661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ab4f66b288014bc3875c2cd2b7d3cfc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1305e72a63eb424da1755bd3609ce7e0"
14:06:13.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.305861 23661 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1305e72a63eb424da1755bd3609ce7e0 [term 0 FOLLOWER]: Advancing to term 1
14:06:13.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.313581 23661 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 1305e72a63eb424da1755bd3609ce7e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab4f66b288014bc3875c2cd2b7d3cfc6 in term 1.
14:06:13.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.316215 23865 leader_election.cc:290] T 00000000000000000000000000000000 P ab4f66b288014bc3875c2cd2b7d3cfc6 [CANDIDATE]: Term 1 election: Requested vote from peers 1305e72a63eb424da1755bd3609ce7e0 (127.23.13.190:33371), af6b7cb9ce404981ad40292b0975fe51 (127.23.13.189:33209)
14:06:13.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.318416 23794 leader_election.cc:304] T 00000000000000000000000000000000 P ab4f66b288014bc3875c2cd2b7d3cfc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1305e72a63eb424da1755bd3609ce7e0, ab4f66b288014bc3875c2cd2b7d3cfc6; no voters: 
14:06:13.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.319655 23865 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ab4f66b288014bc3875c2cd2b7d3cfc6 [term 1 FOLLOWER]: Leader election won for term 1
14:06:13.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.326310 23865 raft_consensus.cc:697] T 00000000000000000000000000000000 P ab4f66b288014bc3875c2cd2b7d3cfc6 [term 1 LEADER]: Becoming Leader. State: Replica: ab4f66b288014bc3875c2cd2b7d3cfc6, State: Running, Role: LEADER
14:06:13.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.327751 23865 consensus_queue.cc:237] T 00000000000000000000000000000000 P ab4f66b288014bc3875c2cd2b7d3cfc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1305e72a63eb424da1755bd3609ce7e0" member_type: VOTER last_known_addr { host: "127.23.13.190" port: 33371 } } peers { permanent_uuid: "af6b7cb9ce404981ad40292b0975fe51" member_type: VOTER last_known_addr { host: "127.23.13.189" port: 33209 } } peers { permanent_uuid: "ab4f66b288014bc3875c2cd2b7d3cfc6" member_type: VOTER last_known_addr { host: "127.23.13.188" port: 37881 } }
14:06:13.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.328975 23736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "ab4f66b288014bc3875c2cd2b7d3cfc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "af6b7cb9ce404981ad40292b0975fe51"
14:06:13.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.329530 23736 raft_consensus.cc:3060] T 00000000000000000000000000000000 P af6b7cb9ce404981ad40292b0975fe51 [term 0 FOLLOWER]: Advancing to term 1
14:06:13.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.336287 23736 raft_consensus.cc:2468] T 00000000000000000000000000000000 P af6b7cb9ce404981ad40292b0975fe51 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ab4f66b288014bc3875c2cd2b7d3cfc6 in term 1.
14:06:13.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.346683 23896 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab4f66b288014bc3875c2cd2b7d3cfc6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ab4f66b288014bc3875c2cd2b7d3cfc6. Latest consensus state: current_term: 1 leader_uuid: "ab4f66b288014bc3875c2cd2b7d3cfc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1305e72a63eb424da1755bd3609ce7e0" member_type: VOTER last_known_addr { host: "127.23.13.190" port: 33371 } } peers { permanent_uuid: "af6b7cb9ce404981ad40292b0975fe51" member_type: VOTER last_known_addr { host: "127.23.13.189" port: 33209 } } peers { permanent_uuid: "ab4f66b288014bc3875c2cd2b7d3cfc6" member_type: VOTER last_known_addr { host: "127.23.13.188" port: 37881 } } }
14:06:13.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.347436 23896 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab4f66b288014bc3875c2cd2b7d3cfc6 [sys.catalog]: This master's current role is: LEADER
14:06:13.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:13.354159 23640 tablet.cc:2406] T 00000000000000000000000000000000 P 1305e72a63eb424da1755bd3609ce7e0: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:06:13.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.357240 23898 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
14:06:13.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.364403 23898 catalog_manager.cc:1520] Initializing Kudu cluster ID...
14:06:13.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.388569 23736 raft_consensus.cc:1275] T 00000000000000000000000000000000 P af6b7cb9ce404981ad40292b0975fe51 [term 1 FOLLOWER]: Refusing update from remote peer ab4f66b288014bc3875c2cd2b7d3cfc6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
14:06:13.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.391117 23896 consensus_queue.cc:1048] T 00000000000000000000000000000000 P ab4f66b288014bc3875c2cd2b7d3cfc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af6b7cb9ce404981ad40292b0975fe51" member_type: VOTER last_known_addr { host: "127.23.13.189" port: 33209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
14:06:13.405 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.404292 23661 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 1305e72a63eb424da1755bd3609ce7e0 [term 1 FOLLOWER]: Refusing update from remote peer ab4f66b288014bc3875c2cd2b7d3cfc6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
14:06:13.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.406368 23865 consensus_queue.cc:1048] T 00000000000000000000000000000000 P ab4f66b288014bc3875c2cd2b7d3cfc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1305e72a63eb424da1755bd3609ce7e0" member_type: VOTER last_known_addr { host: "127.23.13.190" port: 33371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:06:13.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.450349 23883 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1305e72a63eb424da1755bd3609ce7e0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ab4f66b288014bc3875c2cd2b7d3cfc6. Latest consensus state: current_term: 1 leader_uuid: "ab4f66b288014bc3875c2cd2b7d3cfc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1305e72a63eb424da1755bd3609ce7e0" member_type: VOTER last_known_addr { host: "127.23.13.190" port: 33371 } } peers { permanent_uuid: "af6b7cb9ce404981ad40292b0975fe51" member_type: VOTER last_known_addr { host: "127.23.13.189" port: 33209 } } peers { permanent_uuid: "ab4f66b288014bc3875c2cd2b7d3cfc6" member_type: VOTER last_known_addr { host: "127.23.13.188" port: 37881 } } }
14:06:13.451 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.451170 23883 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1305e72a63eb424da1755bd3609ce7e0 [sys.catalog]: This master's current role is: FOLLOWER
14:06:13.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.457670 23899 mvcc.cc:204] Tried to move back new op lower bound from 7305296172577882112 to 7305296172363653120. Current Snapshot: MvccSnapshot[applied={T|T < 7305296172577882112}]
14:06:13.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.468983 23883 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1305e72a63eb424da1755bd3609ce7e0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ab4f66b288014bc3875c2cd2b7d3cfc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1305e72a63eb424da1755bd3609ce7e0" member_type: VOTER last_known_addr { host: "127.23.13.190" port: 33371 } } peers { permanent_uuid: "af6b7cb9ce404981ad40292b0975fe51" member_type: VOTER last_known_addr { host: "127.23.13.189" port: 33209 } } peers { permanent_uuid: "ab4f66b288014bc3875c2cd2b7d3cfc6" member_type: VOTER last_known_addr { host: "127.23.13.188" port: 37881 } } }
14:06:13.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.469717 23883 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1305e72a63eb424da1755bd3609ce7e0 [sys.catalog]: This master's current role is: FOLLOWER
14:06:13.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.469482 23865 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab4f66b288014bc3875c2cd2b7d3cfc6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ab4f66b288014bc3875c2cd2b7d3cfc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1305e72a63eb424da1755bd3609ce7e0" member_type: VOTER last_known_addr { host: "127.23.13.190" port: 33371 } } peers { permanent_uuid: "af6b7cb9ce404981ad40292b0975fe51" member_type: VOTER last_known_addr { host: "127.23.13.189" port: 33209 } } peers { permanent_uuid: "ab4f66b288014bc3875c2cd2b7d3cfc6" member_type: VOTER last_known_addr { host: "127.23.13.188" port: 37881 } } }
14:06:13.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.470196 23865 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab4f66b288014bc3875c2cd2b7d3cfc6 [sys.catalog]: This master's current role is: LEADER
14:06:13.479 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.479417 23898 catalog_manager.cc:1383] Generated new cluster ID: c1bf720155364df793c5b28590f9bf53
14:06:13.480 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.479745 23898 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
14:06:13.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.492038 23900 sys_catalog.cc:455] T 00000000000000000000000000000000 P af6b7cb9ce404981ad40292b0975fe51 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ab4f66b288014bc3875c2cd2b7d3cfc6. Latest consensus state: current_term: 1 leader_uuid: "ab4f66b288014bc3875c2cd2b7d3cfc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1305e72a63eb424da1755bd3609ce7e0" member_type: VOTER last_known_addr { host: "127.23.13.190" port: 33371 } } peers { permanent_uuid: "af6b7cb9ce404981ad40292b0975fe51" member_type: VOTER last_known_addr { host: "127.23.13.189" port: 33209 } } peers { permanent_uuid: "ab4f66b288014bc3875c2cd2b7d3cfc6" member_type: VOTER last_known_addr { host: "127.23.13.188" port: 37881 } } }
14:06:13.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.492753 23900 sys_catalog.cc:458] T 00000000000000000000000000000000 P af6b7cb9ce404981ad40292b0975fe51 [sys.catalog]: This master's current role is: FOLLOWER
14:06:13.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.501820 23896 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab4f66b288014bc3875c2cd2b7d3cfc6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "ab4f66b288014bc3875c2cd2b7d3cfc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1305e72a63eb424da1755bd3609ce7e0" member_type: VOTER last_known_addr { host: "127.23.13.190" port: 33371 } } peers { permanent_uuid: "af6b7cb9ce404981ad40292b0975fe51" member_type: VOTER last_known_addr { host: "127.23.13.189" port: 33209 } } peers { permanent_uuid: "ab4f66b288014bc3875c2cd2b7d3cfc6" member_type: VOTER last_known_addr { host: "127.23.13.188" port: 37881 } } }
14:06:13.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.503749 23902 mvcc.cc:204] Tried to move back new op lower bound from 7305296172577882112 to 7305296172363653120. Current Snapshot: MvccSnapshot[applied={T|T < 7305296172577882112}]
14:06:13.505 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.505095 23896 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab4f66b288014bc3875c2cd2b7d3cfc6 [sys.catalog]: This master's current role is: LEADER
14:06:13.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.514027 23900 sys_catalog.cc:455] T 00000000000000000000000000000000 P af6b7cb9ce404981ad40292b0975fe51 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "ab4f66b288014bc3875c2cd2b7d3cfc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1305e72a63eb424da1755bd3609ce7e0" member_type: VOTER last_known_addr { host: "127.23.13.190" port: 33371 } } peers { permanent_uuid: "af6b7cb9ce404981ad40292b0975fe51" member_type: VOTER last_known_addr { host: "127.23.13.189" port: 33209 } } peers { permanent_uuid: "ab4f66b288014bc3875c2cd2b7d3cfc6" member_type: VOTER last_known_addr { host: "127.23.13.188" port: 37881 } } }
14:06:13.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.515087 23900 sys_catalog.cc:458] T 00000000000000000000000000000000 P af6b7cb9ce404981ad40292b0975fe51 [sys.catalog]: This master's current role is: FOLLOWER
14:06:13.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.552529 23898 catalog_manager.cc:1406] Generated new certificate authority record
14:06:13.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.554725 23898 catalog_manager.cc:1540] Loading token signing keys...
14:06:13.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.606691 23898 catalog_manager.cc:6070] T 00000000000000000000000000000000 P ab4f66b288014bc3875c2cd2b7d3cfc6: Generated new TSK 0
14:06:13.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.607936 23898 catalog_manager.cc:1550] Initializing in-progress tserver states...
14:06:13.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.667398 23606 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskVqKZyE/build/tsan/bin/kudu
14:06:13.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskVqKZyE/build/tsan/bin/kudu
14:06:13.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/ts-0/wal
14:06:13.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/ts-0/data
14:06:13.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:06:13.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:06:13.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:06:13.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:06:13.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:06:13.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:06:13.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/ts-0/logs
14:06:13.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/ts-0/data/info.pb
14:06:13.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:06:13.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:06:13.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:06:13.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:06:13.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:06:13.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:06:13.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:06:13.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:06:13.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
14:06:13.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:06:13.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.23.13.129:0
14:06:13.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.23.13.129
14:06:13.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.23.13.129
14:06:13.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:06:13.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.23.13.190:33371,127.23.13.189:33209,127.23.13.188:37881
14:06:13.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.23.13.148:33463
14:06:13.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:06:13.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:06:13.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
14:06:13.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.855350 23867 catalog_manager.cc:1295] Loaded cluster ID: c1bf720155364df793c5b28590f9bf53
14:06:13.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.856031 23867 catalog_manager.cc:1588] T 00000000000000000000000000000000 P af6b7cb9ce404981ad40292b0975fe51: loading cluster ID for follower catalog manager: success
14:06:13.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.863674 23867 catalog_manager.cc:1610] T 00000000000000000000000000000000 P af6b7cb9ce404981ad40292b0975fe51: acquiring CA information for follower catalog manager: success
14:06:13.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:13.880926 23867 catalog_manager.cc:1638] T 00000000000000000000000000000000 P af6b7cb9ce404981ad40292b0975fe51: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
14:06:14.207 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:14.207208 23909 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:06:14.208 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:14.207909 23909 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:06:14.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:14.208667 23909 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:06:14.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:14.270565 23909 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:06:14.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:14.271998 23909 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.13.129
14:06:14.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:14.281713 23894 catalog_manager.cc:1295] Loaded cluster ID: c1bf720155364df793c5b28590f9bf53
14:06:14.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:14.282318 23894 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 1305e72a63eb424da1755bd3609ce7e0: loading cluster ID for follower catalog manager: success
14:06:14.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:14.298398 23894 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 1305e72a63eb424da1755bd3609ce7e0: acquiring CA information for follower catalog manager: success
14:06:14.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:14.307243 23894 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 1305e72a63eb424da1755bd3609ce7e0: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
14:06:14.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:14.340112 23909 tablet_server_runner.cc:78] Tablet server non-default flags:
14:06:14.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:06:14.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.23.13.148:33463
14:06:14.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:06:14.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:06:14.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/ts-0/data
14:06:14.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/ts-0/wal
14:06:14.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:06:14.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:06:14.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.23.13.129:0
14:06:14.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:06:14.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:06:14.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:06:14.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/ts-0/data/info.pb
14:06:14.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.23.13.129
14:06:14.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:06:14.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.23.13.190:33371,127.23.13.189:33209,127.23.13.188:37881
14:06:14.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:06:14.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:06:14.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:06:14.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:06:14.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:06:14.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.23.13.129
14:06:14.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/ts-0/logs
14:06:14.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:06:14.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:06:14.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:06:14.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
14:06:14.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:06:14.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
14:06:14.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:06:14.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 13:43:23 UTC on e7f111948823
14:06:14.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12775
14:06:14.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:06:14.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:14.341992 23909 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:06:14.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:14.344187 23909 file_cache.cc:504] Constructed file cache file cache with capacity 419430
14:06:14.389 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:14.389328 23915 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:06:16.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:14.397895 23919 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:06:16.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:14.398486 23909 server_base.cc:1061] running on GCE node
14:06:16.028 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:14.396625 23916 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:06:16.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:16.032083 23909 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:06:16.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:16.035146 23909 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:06:16.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:16.036659 23909 hybrid_clock.cc:648] HybridClock initialized: now 1783519576036473 us; error 190 us; skew 500 ppm
14:06:16.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:16.037777 23909 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:06:16.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:16.045733 23909 webserver.cc:533] Webserver started at http://127.23.13.129:44721/ using document root <none> and password file <none>
14:06:16.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:16.046993 23909 fs_manager.cc:362] Metadata directory not provided
14:06:16.047 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:16.047273 23909 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:06:16.048 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:16.047817 23909 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:06:16.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:16.054112 23909 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/ts-0/data/instance:
14:06:16.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "21560e4976404610b2d8df3ce137a035"
14:06:16.054 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:06:16 on dist-test-slave-gws2"
14:06:16.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:16.055634 23909 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/ts-0/wal/instance:
14:06:16.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "21560e4976404610b2d8df3ce137a035"
14:06:16.056 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:06:16 on dist-test-slave-gws2"
14:06:16.066 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:16.065900 23909 fs_manager.cc:696] Time spent creating directory manager: real 0.010s	user 0.006s	sys 0.004s
14:06:16.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:16.073421 23927 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:06:16.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:16.074944 23909 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.006s	sys 0.001s
14:06:16.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:16.075323 23909 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/ts-0/data,/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/ts-0/wal
14:06:16.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "21560e4976404610b2d8df3ce137a035"
14:06:16.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:06:16 on dist-test-slave-gws2"
14:06:16.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:16.075743 23909 fs_report.cc:389] FS layout report
14:06:16.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:06:16.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/ts-0/wal
14:06:16.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/ts-0/wal
14:06:16.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/ts-0/data/data
14:06:16.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:06:16.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:06:16.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:06:16.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:06:16.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:06:16.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:06:16.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:06:16.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:06:16.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:06:16.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:06:16.076 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:06:16.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:16.146968 23909 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:06:16.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:16.149096 23909 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:06:16.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:16.149680 23909 kserver.cc:163] Server-wide thread pool size limit: 3276
14:06:16.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:16.154018 23909 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
14:06:16.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:16.160557 23909 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
14:06:16.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:16.160861 23909 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
14:06:16.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:16.161146 23909 ts_tablet_manager.cc:616] Registered 0 tablets
14:06:16.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:16.161351 23909 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
14:06:16.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:16.336959 23909 rpc_server.cc:307] RPC server started. Bound to: 127.23.13.129:33165
14:06:16.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:16.337100 24039 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.13.129:33165 every 8 connection(s)
14:06:16.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:16.340536 23909 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/ts-0/data/info.pb
14:06:16.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:16.347630 23606 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskVqKZyE/build/tsan/bin/kudu as pid 23909
14:06:16.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:16.348093 23606 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/ts-0/wal/instance
14:06:16.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:16.362906 23606 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskVqKZyE/build/tsan/bin/kudu
14:06:16.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskVqKZyE/build/tsan/bin/kudu
14:06:16.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/ts-1/wal
14:06:16.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/ts-1/data
14:06:16.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:06:16.363 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:06:16.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:06:16.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:06:16.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:06:16.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:06:16.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/ts-1/logs
14:06:16.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/ts-1/data/info.pb
14:06:16.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:06:16.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:06:16.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:06:16.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:06:16.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:06:16.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:06:16.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:06:16.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:06:16.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
14:06:16.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:06:16.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.23.13.130:0
14:06:16.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.23.13.130
14:06:16.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.23.13.130
14:06:16.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:06:16.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.23.13.190:33371,127.23.13.189:33209,127.23.13.188:37881
14:06:16.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.23.13.148:33463
14:06:16.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:06:16.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:06:16.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
14:06:16.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:16.397462 24041 heartbeater.cc:344] Connected to a master server at 127.23.13.189:33209
14:06:16.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:16.397980 24041 heartbeater.cc:461] Registering TS with master...
14:06:16.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:16.399430 24041 heartbeater.cc:507] Master 127.23.13.189:33209 requested a full tablet report, sending...
14:06:16.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:16.403477 23726 ts_manager.cc:194] Registered new tserver with Master: 21560e4976404610b2d8df3ce137a035 (127.23.13.129:33165)
14:06:16.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:16.407984 24040 heartbeater.cc:344] Connected to a master server at 127.23.13.188:37881
14:06:16.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:16.408380 24040 heartbeater.cc:461] Registering TS with master...
14:06:16.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:16.409449 24040 heartbeater.cc:507] Master 127.23.13.188:37881 requested a full tablet report, sending...
14:06:16.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:16.412635 24043 heartbeater.cc:344] Connected to a master server at 127.23.13.190:33371
14:06:16.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:16.412948 24043 heartbeater.cc:461] Registering TS with master...
14:06:16.414 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:16.412796 23807 ts_manager.cc:194] Registered new tserver with Master: 21560e4976404610b2d8df3ce137a035 (127.23.13.129:33165)
14:06:16.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:16.413846 24043 heartbeater.cc:507] Master 127.23.13.190:33371 requested a full tablet report, sending...
14:06:16.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:16.416671 23807 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.23.13.129:38411
14:06:16.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:16.416797 23651 ts_manager.cc:194] Registered new tserver with Master: 21560e4976404610b2d8df3ce137a035 (127.23.13.129:33165)
14:06:16.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:16.736728 24050 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:06:16.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:16.737237 24050 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:06:16.737 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:16.737645 24050 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:06:16.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:16.770285 24050 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:06:16.771 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:16.771101 24050 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.13.130
14:06:16.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:16.810320 24050 tablet_server_runner.cc:78] Tablet server non-default flags:
14:06:16.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:06:16.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.23.13.148:33463
14:06:16.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:06:16.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:06:16.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/ts-1/data
14:06:16.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/ts-1/wal
14:06:16.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:06:16.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:06:16.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.23.13.130:0
14:06:16.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:06:16.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:06:16.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:06:16.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/ts-1/data/info.pb
14:06:16.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.23.13.130
14:06:16.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:06:16.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.23.13.190:33371,127.23.13.189:33209,127.23.13.188:37881
14:06:16.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:06:16.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:06:16.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:06:16.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:06:16.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:06:16.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.23.13.130
14:06:16.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/ts-1/logs
14:06:16.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:06:16.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:06:16.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:06:16.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
14:06:16.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:06:16.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
14:06:16.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:06:16.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 13:43:23 UTC on e7f111948823
14:06:16.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12775
14:06:16.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:06:16.812 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:16.811767 24050 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:06:16.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:16.813319 24050 file_cache.cc:504] Constructed file cache file cache with capacity 419430
14:06:16.826 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:16.825560 24057 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:06:17.424 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:17.420976 24040 heartbeater.cc:499] Master 127.23.13.188:37881 was elected leader, sending a full tablet report...
14:06:18.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:16.827750 24058 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:06:18.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:18.105412 24060 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:06:18.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:18.108310 24059 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1276 milliseconds
14:06:18.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:18.108446 24050 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:06:18.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:18.109622 24050 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:06:18.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:18.112473 24050 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:06:18.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:18.113969 24050 hybrid_clock.cc:648] HybridClock initialized: now 1783519578113876 us; error 102 us; skew 500 ppm
14:06:18.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:18.114985 24050 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:06:18.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:18.121841 24050 webserver.cc:533] Webserver started at http://127.23.13.130:38931/ using document root <none> and password file <none>
14:06:18.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:18.123239 24050 fs_manager.cc:362] Metadata directory not provided
14:06:18.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:18.123581 24050 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:06:18.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:18.124186 24050 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:06:18.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:18.128907 24050 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/ts-1/data/instance:
14:06:18.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "38aad74758f04eb4bb3fa1904c4308ba"
14:06:18.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:06:18 on dist-test-slave-gws2"
14:06:18.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:18.130334 24050 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/ts-1/wal/instance:
14:06:18.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "38aad74758f04eb4bb3fa1904c4308ba"
14:06:18.130 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:06:18 on dist-test-slave-gws2"
14:06:18.138 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:18.138200 24050 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.000s
14:06:18.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:18.144964 24068 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:06:18.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:18.146221 24050 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.001s
14:06:18.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:18.146683 24050 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/ts-1/data,/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/ts-1/wal
14:06:18.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "38aad74758f04eb4bb3fa1904c4308ba"
14:06:18.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:06:18 on dist-test-slave-gws2"
14:06:18.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:18.147089 24050 fs_report.cc:389] FS layout report
14:06:18.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:06:18.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/ts-1/wal
14:06:18.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/ts-1/wal
14:06:18.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/ts-1/data/data
14:06:18.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:06:18.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:06:18.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:06:18.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:06:18.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:06:18.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:06:18.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:06:18.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:06:18.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:06:18.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:06:18.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:06:18.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:18.203855 24050 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:06:18.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:18.205484 24050 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:06:18.206 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:18.206041 24050 kserver.cc:163] Server-wide thread pool size limit: 3276
14:06:18.209 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:18.208868 24050 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
14:06:18.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:18.213155 24050 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
14:06:18.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:18.213418 24050 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
14:06:18.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:18.213737 24050 ts_tablet_manager.cc:616] Registered 0 tablets
14:06:18.214 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:18.213944 24050 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
14:06:18.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:18.365458 24050 rpc_server.cc:307] RPC server started. Bound to: 127.23.13.130:38503
14:06:18.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:18.365576 24180 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.13.130:38503 every 8 connection(s)
14:06:18.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:18.368180 24050 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/ts-1/data/info.pb
14:06:18.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:18.369204 23606 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskVqKZyE/build/tsan/bin/kudu as pid 24050
14:06:18.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:18.369856 23606 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/ts-1/wal/instance
14:06:18.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:18.396783 23606 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskVqKZyE/build/tsan/bin/kudu
14:06:18.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskVqKZyE/build/tsan/bin/kudu
14:06:18.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/ts-2/wal
14:06:18.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/ts-2/data
14:06:18.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:06:18.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:06:18.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:06:18.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:06:18.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:06:18.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:06:18.397 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/ts-2/logs
14:06:18.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/ts-2/data/info.pb
14:06:18.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:06:18.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:06:18.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:06:18.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:06:18.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:06:18.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:06:18.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:06:18.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:06:18.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
14:06:18.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:06:18.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.23.13.131:0
14:06:18.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.23.13.131
14:06:18.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.23.13.131
14:06:18.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:06:18.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.23.13.190:33371,127.23.13.189:33209,127.23.13.188:37881
14:06:18.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.23.13.148:33463
14:06:18.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:06:18.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:06:18.399 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
14:06:18.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:18.439093 24181 heartbeater.cc:344] Connected to a master server at 127.23.13.188:37881
14:06:18.440 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:18.439764 24181 heartbeater.cc:461] Registering TS with master...
14:06:18.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:18.441704 24181 heartbeater.cc:507] Master 127.23.13.188:37881 requested a full tablet report, sending...
14:06:18.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:18.442193 24183 heartbeater.cc:344] Connected to a master server at 127.23.13.190:33371
14:06:18.442 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:18.442574 24183 heartbeater.cc:461] Registering TS with master...
14:06:18.443 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:18.443508 24183 heartbeater.cc:507] Master 127.23.13.190:33371 requested a full tablet report, sending...
14:06:18.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:18.444571 23807 ts_manager.cc:194] Registered new tserver with Master: 38aad74758f04eb4bb3fa1904c4308ba (127.23.13.130:38503)
14:06:18.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:18.446288 23807 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.23.13.130:58247
14:06:18.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:18.449541 23651 ts_manager.cc:194] Registered new tserver with Master: 38aad74758f04eb4bb3fa1904c4308ba (127.23.13.130:38503)
14:06:18.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:18.451872 24182 heartbeater.cc:344] Connected to a master server at 127.23.13.189:33209
14:06:18.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:18.452308 24182 heartbeater.cc:461] Registering TS with master...
14:06:18.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:18.453042 24182 heartbeater.cc:507] Master 127.23.13.189:33209 requested a full tablet report, sending...
14:06:18.456 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:18.455906 23726 ts_manager.cc:194] Registered new tserver with Master: 38aad74758f04eb4bb3fa1904c4308ba (127.23.13.130:38503)
14:06:18.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:18.782724 24188 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:06:18.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:18.783290 24188 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:06:18.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:18.783908 24188 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:06:18.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:18.822062 24188 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:06:18.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:18.823140 24188 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.23.13.131
14:06:18.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:18.863159 24188 tablet_server_runner.cc:78] Tablet server non-default flags:
14:06:18.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:06:18.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.23.13.148:33463
14:06:18.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:06:18.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:06:18.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/ts-2/data
14:06:18.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/ts-2/wal
14:06:18.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:06:18.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:06:18.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.23.13.131:0
14:06:18.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:06:18.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:06:18.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:06:18.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/ts-2/data/info.pb
14:06:18.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.23.13.131
14:06:18.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
14:06:18.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.23.13.190:33371,127.23.13.189:33209,127.23.13.188:37881
14:06:18.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:06:18.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:06:18.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:06:18.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:06:18.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:06:18.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.23.13.131
14:06:18.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/ts-2/logs
14:06:18.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:06:18.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:06:18.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:06:18.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
14:06:18.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:06:18.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
14:06:18.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:06:18.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 13:43:23 UTC on e7f111948823
14:06:18.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12775
14:06:18.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:06:18.865 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:18.864895 24188 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:06:18.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:18.866710 24188 file_cache.cc:504] Constructed file cache file cache with capacity 419430
14:06:18.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:18.879837 24198 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:06:19.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:19.451603 24181 heartbeater.cc:499] Master 127.23.13.188:37881 was elected leader, sending a full tablet report...
14:06:19.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:19.669059 23838 debug-util.cc:398] Leaking SignalData structure 0x7b080003cbe0 after lost signal to thread 23768
14:06:19.670 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:19.670145 23838 debug-util.cc:398] Leaking SignalData structure 0x7b0800070120 after lost signal to thread 23841
14:06:20.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:18.880995 24199 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:06:20.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:20.296444 24200 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1414 milliseconds
14:06:20.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:20.296680 24201 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:06:20.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:20.297261 24188 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:06:20.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:20.312001 24188 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:06:20.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:20.315407 24188 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:06:20.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:20.316948 24188 hybrid_clock.cc:648] HybridClock initialized: now 1783519580316719 us; error 230 us; skew 500 ppm
14:06:20.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:20.318205 24188 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:06:20.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:20.327343 24188 webserver.cc:533] Webserver started at http://127.23.13.131:46629/ using document root <none> and password file <none>
14:06:20.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:20.328907 24188 fs_manager.cc:362] Metadata directory not provided
14:06:20.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:20.329216 24188 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:06:20.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:20.329824 24188 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
14:06:20.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:20.337065 24188 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/ts-2/data/instance:
14:06:20.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "239e806c594c4675809a5f12aa1cd70a"
14:06:20.338 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:06:20 on dist-test-slave-gws2"
14:06:20.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:20.338791 24188 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/ts-2/wal/instance:
14:06:20.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "239e806c594c4675809a5f12aa1cd70a"
14:06:20.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:06:20 on dist-test-slave-gws2"
14:06:20.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:20.350122 24188 fs_manager.cc:696] Time spent creating directory manager: real 0.010s	user 0.009s	sys 0.000s
14:06:20.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:20.358314 24208 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:06:20.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:20.359802 24188 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.003s	sys 0.000s
14:06:20.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:20.360253 24188 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/ts-2/data,/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/ts-2/wal
14:06:20.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "239e806c594c4675809a5f12aa1cd70a"
14:06:20.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:06:20 on dist-test-slave-gws2"
14:06:20.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:20.360728 24188 fs_report.cc:389] FS layout report
14:06:20.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:06:20.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/ts-2/wal
14:06:20.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/ts-2/wal
14:06:20.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/ts-2/data/data
14:06:20.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:06:20.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:06:20.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:06:20.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:06:20.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:06:20.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:06:20.361 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:06:20.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:06:20.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:06:20.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:06:20.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:06:20.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:20.447059 24188 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:06:20.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:20.449059 24188 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:06:20.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:20.449661 24188 kserver.cc:163] Server-wide thread pool size limit: 3276
14:06:20.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:20.453197 24188 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
14:06:20.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:20.457651 24188 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
14:06:20.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:20.457922 24188 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
14:06:20.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:20.458242 24188 ts_tablet_manager.cc:616] Registered 0 tablets
14:06:20.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:20.458457 24188 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
14:06:20.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:20.635262 24188 rpc_server.cc:307] RPC server started. Bound to: 127.23.13.131:45787
14:06:20.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:20.635447 24321 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.13.131:45787 every 8 connection(s)
14:06:20.638 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:20.638346 24188 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/ts-2/data/info.pb
14:06:20.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:20.640149 23606 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskVqKZyE/build/tsan/bin/kudu as pid 24188
14:06:20.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:20.640717 23606 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/ts-2/wal/instance
14:06:20.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:20.707187 24322 heartbeater.cc:344] Connected to a master server at 127.23.13.188:37881
14:06:20.709 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:20.707661 24322 heartbeater.cc:461] Registering TS with master...
14:06:20.712 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:20.711584 24322 heartbeater.cc:507] Master 127.23.13.188:37881 requested a full tablet report, sending...
14:06:20.719 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:20.715211 23806 ts_manager.cc:194] Registered new tserver with Master: 239e806c594c4675809a5f12aa1cd70a (127.23.13.131:45787)
14:06:20.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:20.717836 23806 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.23.13.131:54799
14:06:20.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:20.721400 24323 heartbeater.cc:344] Connected to a master server at 127.23.13.189:33209
14:06:20.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:20.721798 24323 heartbeater.cc:461] Registering TS with master...
14:06:20.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:20.722780 24323 heartbeater.cc:507] Master 127.23.13.189:33209 requested a full tablet report, sending...
14:06:20.726 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:20.726104 23726 ts_manager.cc:194] Registered new tserver with Master: 239e806c594c4675809a5f12aa1cd70a (127.23.13.131:45787)
14:06:20.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:20.728825 24328 heartbeater.cc:344] Connected to a master server at 127.23.13.190:33371
14:06:20.729 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:20.729209 24328 heartbeater.cc:461] Registering TS with master...
14:06:20.730 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:20.729880 24328 heartbeater.cc:507] Master 127.23.13.190:33371 requested a full tablet report, sending...
14:06:20.732 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:20.732553 23651 ts_manager.cc:194] Registered new tserver with Master: 239e806c594c4675809a5f12aa1cd70a (127.23.13.131:45787)
14:06:20.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:20.743909 23606 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
14:06:20.756 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
14:06:20.757 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

14:06:20.759 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.23.13.190"
      port: 33371
    }
    bound_http_address {
      host: "127.23.13.190"
      port: 45831
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.23.13.189"
      port: 33209
    }
    bound_http_address {
      host: "127.23.13.189"
      port: 43959
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.23.13.188"
      port: 37881
    }
    bound_http_address {
      host: "127.23.13.188"
      port: 35865
    }
  }
}

14:06:20.759 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

14:06:20.761 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.23.13.129"
      port: 33165
    }
    bound_http_address {
      host: "127.23.13.129"
      port: 44721
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.23.13.130"
      port: 38503
    }
    bound_http_address {
      host: "127.23.13.130"
      port: 38931
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.23.13.131"
      port: 45787
    }
    bound_http_address {
      host: "127.23.13.131"
      port: 46629
    }
  }
}

14:06:20.761 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
14:06:20.764 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
14:06:20.766 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.23.13.189:33209(127.23.13.189:33209)] connecting to peer
14:06:20.767 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.23.13.188:37881(127.23.13.188:37881)] connecting to peer
14:06:20.771 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.23.13.189:33209(127.23.13.189:33209)] Successfully connected to peer
14:06:20.774 [DEBUG - kudu-nio-0] (Negotiator.java:528) SASL mechanism PLAIN chosen for peer 127.23.13.189
14:06:20.774 [DEBUG - Time-limited test] (Connection.java:748) [peer master-127.23.13.190:33371(127.23.13.190:33371)] connecting to peer
14:06:20.776 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.23.13.188:37881(127.23.13.188:37881)] Successfully connected to peer
14:06:20.784 [DEBUG - kudu-nio-1] (Negotiator.java:528) SASL mechanism PLAIN chosen for peer 127.23.13.188
14:06:20.785 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.23.13.190:33371(127.23.13.190:33371)] Successfully connected to peer
14:06:20.792 [DEBUG - kudu-nio-2] (Negotiator.java:528) SASL mechanism PLAIN chosen for peer 127.23.13.190
14:06:20.806 [DEBUG - kudu-nio-0] (Negotiator.java:918) Authenticated connection [id: 0x94e5f413, L:/127.0.0.1:33694 - R:/127.23.13.189:33209] using SASL/PLAIN
14:06:20.813 [DEBUG - kudu-nio-2] (Negotiator.java:918) Authenticated connection [id: 0x262fe6ba, L:/127.0.0.1:54196 - R:/127.23.13.190:33371] using SASL/PLAIN
14:06:20.827 [DEBUG - kudu-nio-1] (Negotiator.java:918) Authenticated connection [id: 0x48a6895b, L:/127.0.0.1:58308 - R:/127.23.13.188:37881] using SASL/PLAIN
14:06:20.834 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:06:20.835 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=69), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.13.189:33209, [2ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.13.188:37881, [9ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.13.190:33371, [52ms] Sub RPC ConnectToMaster: received response from server master-127.23.13.190:33371: OK, [57ms] Sub RPC ConnectToMaster: received response from server master-127.23.13.189:33209: OK, [68ms] Sub RPC ConnectToMaster: received response from server master-127.23.13.188:37881: OK, deferred=null) after lookup
14:06:20.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:20.837970 23806 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:58308:
14:06:20.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "org.apache.kudu.client.TestClientFailoverSupport-RESTART"
14:06:20.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
14:06:20.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:06:20.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key"
14:06:20.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
14:06:20.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
14:06:20.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:06:20.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:06:20.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:06:20.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:06:20.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:06:20.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:06:20.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column1_i"
14:06:20.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
14:06:20.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:06:20.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:06:20.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:06:20.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:06:20.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:06:20.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:06:20.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:06:20.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column2_i"
14:06:20.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
14:06:20.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:06:20.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:06:20.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:06:20.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:06:20.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:06:20.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:06:20.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:06:20.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column3_s"
14:06:20.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
14:06:20.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:06:20.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: true
14:06:20.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: DICT_ENCODING
14:06:20.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: LZ4
14:06:20.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 4096
14:06:20.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:06:20.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:06:20.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:06:20.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
14:06:20.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column4_b"
14:06:20.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BOOL
14:06:20.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
14:06:20.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
14:06:20.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
14:06:20.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
14:06:20.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
14:06:20.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:06:20.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
14:06:20.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
14:06:20.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
14:06:20.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
14:06:20.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key"
14:06:20.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
14:06:20.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
14:06:20.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
14:06:20.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:20.842465 23806 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table org.apache.kudu.client.TestClientFailoverSupport-RESTART in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
14:06:20.904 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 81d23eddb7f14401bbd5de2f6269cbbe
14:06:20.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:20.979219 24256 tablet_service.cc:1511] Processing CreateTablet for tablet b4a6a56857a449b6b91e7ec5df260bd2 (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-RESTART [id=81d23eddb7f14401bbd5de2f6269cbbe]), partition=RANGE (key) PARTITION UNBOUNDED
14:06:20.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:20.981294 24256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4a6a56857a449b6b91e7ec5df260bd2. 1 dirs total, 0 dirs full, 0 dirs failed
14:06:20.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:20.981285 23975 tablet_service.cc:1511] Processing CreateTablet for tablet b4a6a56857a449b6b91e7ec5df260bd2 (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-RESTART [id=81d23eddb7f14401bbd5de2f6269cbbe]), partition=RANGE (key) PARTITION UNBOUNDED
14:06:20.983 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:20.983528 23975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4a6a56857a449b6b91e7ec5df260bd2. 1 dirs total, 0 dirs full, 0 dirs failed
14:06:20.992 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:20.990885 24116 tablet_service.cc:1511] Processing CreateTablet for tablet b4a6a56857a449b6b91e7ec5df260bd2 (DEFAULT_TABLE table=org.apache.kudu.client.TestClientFailoverSupport-RESTART [id=81d23eddb7f14401bbd5de2f6269cbbe]), partition=RANGE (key) PARTITION UNBOUNDED
14:06:20.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:20.992911 24116 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4a6a56857a449b6b91e7ec5df260bd2. 1 dirs total, 0 dirs full, 0 dirs failed
14:06:21.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.021142 24355 tablet_bootstrap.cc:492] T b4a6a56857a449b6b91e7ec5df260bd2 P 239e806c594c4675809a5f12aa1cd70a: Bootstrap starting.
14:06:21.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.031965 24355 tablet_bootstrap.cc:654] T b4a6a56857a449b6b91e7ec5df260bd2 P 239e806c594c4675809a5f12aa1cd70a: Neither blocks nor log segments found. Creating new log.
14:06:21.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.034111 24356 tablet_bootstrap.cc:492] T b4a6a56857a449b6b91e7ec5df260bd2 P 21560e4976404610b2d8df3ce137a035: Bootstrap starting.
14:06:21.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.036710 24357 tablet_bootstrap.cc:492] T b4a6a56857a449b6b91e7ec5df260bd2 P 38aad74758f04eb4bb3fa1904c4308ba: Bootstrap starting.
14:06:21.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.037608 24355 log.cc:826] T b4a6a56857a449b6b91e7ec5df260bd2 P 239e806c594c4675809a5f12aa1cd70a: Log is configured to *not* fsync() on all Append() calls
14:06:21.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.042725 24356 tablet_bootstrap.cc:654] T b4a6a56857a449b6b91e7ec5df260bd2 P 21560e4976404610b2d8df3ce137a035: Neither blocks nor log segments found. Creating new log.
14:06:21.045 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.045332 24356 log.cc:826] T b4a6a56857a449b6b91e7ec5df260bd2 P 21560e4976404610b2d8df3ce137a035: Log is configured to *not* fsync() on all Append() calls
14:06:21.046 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.046329 24357 tablet_bootstrap.cc:654] T b4a6a56857a449b6b91e7ec5df260bd2 P 38aad74758f04eb4bb3fa1904c4308ba: Neither blocks nor log segments found. Creating new log.
14:06:21.049 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.049172 24357 log.cc:826] T b4a6a56857a449b6b91e7ec5df260bd2 P 38aad74758f04eb4bb3fa1904c4308ba: Log is configured to *not* fsync() on all Append() calls
14:06:21.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.051554 24355 tablet_bootstrap.cc:492] T b4a6a56857a449b6b91e7ec5df260bd2 P 239e806c594c4675809a5f12aa1cd70a: No bootstrap required, opened a new log
14:06:21.052 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.052219 24355 ts_tablet_manager.cc:1403] T b4a6a56857a449b6b91e7ec5df260bd2 P 239e806c594c4675809a5f12aa1cd70a: Time spent bootstrapping tablet: real 0.032s	user 0.017s	sys 0.005s
14:06:21.064 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.064134 24356 tablet_bootstrap.cc:492] T b4a6a56857a449b6b91e7ec5df260bd2 P 21560e4976404610b2d8df3ce137a035: No bootstrap required, opened a new log
14:06:21.065 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.064797 24356 ts_tablet_manager.cc:1403] T b4a6a56857a449b6b91e7ec5df260bd2 P 21560e4976404610b2d8df3ce137a035: Time spent bootstrapping tablet: real 0.031s	user 0.020s	sys 0.007s
14:06:21.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.070828 24357 tablet_bootstrap.cc:492] T b4a6a56857a449b6b91e7ec5df260bd2 P 38aad74758f04eb4bb3fa1904c4308ba: No bootstrap required, opened a new log
14:06:21.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.071620 24357 ts_tablet_manager.cc:1403] T b4a6a56857a449b6b91e7ec5df260bd2 P 38aad74758f04eb4bb3fa1904c4308ba: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.020s
14:06:21.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.086088 24355 raft_consensus.cc:359] T b4a6a56857a449b6b91e7ec5df260bd2 P 239e806c594c4675809a5f12aa1cd70a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "239e806c594c4675809a5f12aa1cd70a" member_type: VOTER last_known_addr { host: "127.23.13.131" port: 45787 } } peers { permanent_uuid: "21560e4976404610b2d8df3ce137a035" member_type: VOTER last_known_addr { host: "127.23.13.129" port: 33165 } } peers { permanent_uuid: "38aad74758f04eb4bb3fa1904c4308ba" member_type: VOTER last_known_addr { host: "127.23.13.130" port: 38503 } }
14:06:21.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.087088 24355 raft_consensus.cc:385] T b4a6a56857a449b6b91e7ec5df260bd2 P 239e806c594c4675809a5f12aa1cd70a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:06:21.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.087441 24355 raft_consensus.cc:740] T b4a6a56857a449b6b91e7ec5df260bd2 P 239e806c594c4675809a5f12aa1cd70a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 239e806c594c4675809a5f12aa1cd70a, State: Initialized, Role: FOLLOWER
14:06:21.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.088662 24355 consensus_queue.cc:260] T b4a6a56857a449b6b91e7ec5df260bd2 P 239e806c594c4675809a5f12aa1cd70a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "239e806c594c4675809a5f12aa1cd70a" member_type: VOTER last_known_addr { host: "127.23.13.131" port: 45787 } } peers { permanent_uuid: "21560e4976404610b2d8df3ce137a035" member_type: VOTER last_known_addr { host: "127.23.13.129" port: 33165 } } peers { permanent_uuid: "38aad74758f04eb4bb3fa1904c4308ba" member_type: VOTER last_known_addr { host: "127.23.13.130" port: 38503 } }
14:06:21.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.095434 24356 raft_consensus.cc:359] T b4a6a56857a449b6b91e7ec5df260bd2 P 21560e4976404610b2d8df3ce137a035 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "239e806c594c4675809a5f12aa1cd70a" member_type: VOTER last_known_addr { host: "127.23.13.131" port: 45787 } } peers { permanent_uuid: "21560e4976404610b2d8df3ce137a035" member_type: VOTER last_known_addr { host: "127.23.13.129" port: 33165 } } peers { permanent_uuid: "38aad74758f04eb4bb3fa1904c4308ba" member_type: VOTER last_known_addr { host: "127.23.13.130" port: 38503 } }
14:06:21.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.096369 24356 raft_consensus.cc:385] T b4a6a56857a449b6b91e7ec5df260bd2 P 21560e4976404610b2d8df3ce137a035 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:06:21.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.096657 24356 raft_consensus.cc:740] T b4a6a56857a449b6b91e7ec5df260bd2 P 21560e4976404610b2d8df3ce137a035 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 21560e4976404610b2d8df3ce137a035, State: Initialized, Role: FOLLOWER
14:06:21.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.097615 24356 consensus_queue.cc:260] T b4a6a56857a449b6b91e7ec5df260bd2 P 21560e4976404610b2d8df3ce137a035 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "239e806c594c4675809a5f12aa1cd70a" member_type: VOTER last_known_addr { host: "127.23.13.131" port: 45787 } } peers { permanent_uuid: "21560e4976404610b2d8df3ce137a035" member_type: VOTER last_known_addr { host: "127.23.13.129" port: 33165 } } peers { permanent_uuid: "38aad74758f04eb4bb3fa1904c4308ba" member_type: VOTER last_known_addr { host: "127.23.13.130" port: 38503 } }
14:06:21.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.101912 24322 heartbeater.cc:499] Master 127.23.13.188:37881 was elected leader, sending a full tablet report...
14:06:21.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.102816 24355 ts_tablet_manager.cc:1434] T b4a6a56857a449b6b91e7ec5df260bd2 P 239e806c594c4675809a5f12aa1cd70a: Time spent starting tablet: real 0.050s	user 0.033s	sys 0.017s
14:06:21.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.106280 24357 raft_consensus.cc:359] T b4a6a56857a449b6b91e7ec5df260bd2 P 38aad74758f04eb4bb3fa1904c4308ba [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "239e806c594c4675809a5f12aa1cd70a" member_type: VOTER last_known_addr { host: "127.23.13.131" port: 45787 } } peers { permanent_uuid: "21560e4976404610b2d8df3ce137a035" member_type: VOTER last_known_addr { host: "127.23.13.129" port: 33165 } } peers { permanent_uuid: "38aad74758f04eb4bb3fa1904c4308ba" member_type: VOTER last_known_addr { host: "127.23.13.130" port: 38503 } }
14:06:21.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.114050 24356 ts_tablet_manager.cc:1434] T b4a6a56857a449b6b91e7ec5df260bd2 P 21560e4976404610b2d8df3ce137a035: Time spent starting tablet: real 0.049s	user 0.027s	sys 0.012s
14:06:21.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.114831 24357 raft_consensus.cc:385] T b4a6a56857a449b6b91e7ec5df260bd2 P 38aad74758f04eb4bb3fa1904c4308ba [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
14:06:21.115 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.115362 24357 raft_consensus.cc:740] T b4a6a56857a449b6b91e7ec5df260bd2 P 38aad74758f04eb4bb3fa1904c4308ba [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 38aad74758f04eb4bb3fa1904c4308ba, State: Initialized, Role: FOLLOWER
14:06:21.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.116698 24357 consensus_queue.cc:260] T b4a6a56857a449b6b91e7ec5df260bd2 P 38aad74758f04eb4bb3fa1904c4308ba [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "239e806c594c4675809a5f12aa1cd70a" member_type: VOTER last_known_addr { host: "127.23.13.131" port: 45787 } } peers { permanent_uuid: "21560e4976404610b2d8df3ce137a035" member_type: VOTER last_known_addr { host: "127.23.13.129" port: 33165 } } peers { permanent_uuid: "38aad74758f04eb4bb3fa1904c4308ba" member_type: VOTER last_known_addr { host: "127.23.13.130" port: 38503 } }
14:06:21.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.133937 24357 ts_tablet_manager.cc:1434] T b4a6a56857a449b6b91e7ec5df260bd2 P 38aad74758f04eb4bb3fa1904c4308ba: Time spent starting tablet: real 0.062s	user 0.030s	sys 0.011s
14:06:21.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:21.148443 24047 tablet.cc:2406] T b4a6a56857a449b6b91e7ec5df260bd2 P 21560e4976404610b2d8df3ce137a035: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:06:21.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:21.176954 24329 tablet.cc:2406] T b4a6a56857a449b6b91e7ec5df260bd2 P 239e806c594c4675809a5f12aa1cd70a: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:06:21.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:21.193739 24189 tablet.cc:2406] T b4a6a56857a449b6b91e7ec5df260bd2 P 38aad74758f04eb4bb3fa1904c4308ba: Can't schedule compaction. Clean time has not been advanced past its initial value.
14:06:21.217 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.217324 24363 raft_consensus.cc:493] T b4a6a56857a449b6b91e7ec5df260bd2 P 38aad74758f04eb4bb3fa1904c4308ba [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
14:06:21.218 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.217820 24363 raft_consensus.cc:515] T b4a6a56857a449b6b91e7ec5df260bd2 P 38aad74758f04eb4bb3fa1904c4308ba [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "239e806c594c4675809a5f12aa1cd70a" member_type: VOTER last_known_addr { host: "127.23.13.131" port: 45787 } } peers { permanent_uuid: "21560e4976404610b2d8df3ce137a035" member_type: VOTER last_known_addr { host: "127.23.13.129" port: 33165 } } peers { permanent_uuid: "38aad74758f04eb4bb3fa1904c4308ba" member_type: VOTER last_known_addr { host: "127.23.13.130" port: 38503 } }
14:06:21.220 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.220433 24363 leader_election.cc:290] T b4a6a56857a449b6b91e7ec5df260bd2 P 38aad74758f04eb4bb3fa1904c4308ba [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 239e806c594c4675809a5f12aa1cd70a (127.23.13.131:45787), 21560e4976404610b2d8df3ce137a035 (127.23.13.129:33165)
14:06:21.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.234123 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a6a56857a449b6b91e7ec5df260bd2" candidate_uuid: "38aad74758f04eb4bb3fa1904c4308ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21560e4976404610b2d8df3ce137a035" is_pre_election: true
14:06:21.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.234462 24276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a6a56857a449b6b91e7ec5df260bd2" candidate_uuid: "38aad74758f04eb4bb3fa1904c4308ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "239e806c594c4675809a5f12aa1cd70a" is_pre_election: true
14:06:21.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.235001 23995 raft_consensus.cc:2468] T b4a6a56857a449b6b91e7ec5df260bd2 P 21560e4976404610b2d8df3ce137a035 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 38aad74758f04eb4bb3fa1904c4308ba in term 0.
14:06:21.235 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.235351 24276 raft_consensus.cc:2468] T b4a6a56857a449b6b91e7ec5df260bd2 P 239e806c594c4675809a5f12aa1cd70a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 38aad74758f04eb4bb3fa1904c4308ba in term 0.
14:06:21.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.236614 24072 leader_election.cc:304] T b4a6a56857a449b6b91e7ec5df260bd2 P 38aad74758f04eb4bb3fa1904c4308ba [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21560e4976404610b2d8df3ce137a035, 38aad74758f04eb4bb3fa1904c4308ba; no voters: 
14:06:21.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.237430 24363 raft_consensus.cc:2804] T b4a6a56857a449b6b91e7ec5df260bd2 P 38aad74758f04eb4bb3fa1904c4308ba [term 0 FOLLOWER]: Leader pre-election won for term 1
14:06:21.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.237779 24363 raft_consensus.cc:493] T b4a6a56857a449b6b91e7ec5df260bd2 P 38aad74758f04eb4bb3fa1904c4308ba [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
14:06:21.238 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.238003 24363 raft_consensus.cc:3060] T b4a6a56857a449b6b91e7ec5df260bd2 P 38aad74758f04eb4bb3fa1904c4308ba [term 0 FOLLOWER]: Advancing to term 1
14:06:21.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.242447 24363 raft_consensus.cc:515] T b4a6a56857a449b6b91e7ec5df260bd2 P 38aad74758f04eb4bb3fa1904c4308ba [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "239e806c594c4675809a5f12aa1cd70a" member_type: VOTER last_known_addr { host: "127.23.13.131" port: 45787 } } peers { permanent_uuid: "21560e4976404610b2d8df3ce137a035" member_type: VOTER last_known_addr { host: "127.23.13.129" port: 33165 } } peers { permanent_uuid: "38aad74758f04eb4bb3fa1904c4308ba" member_type: VOTER last_known_addr { host: "127.23.13.130" port: 38503 } }
14:06:21.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.243996 24363 leader_election.cc:290] T b4a6a56857a449b6b91e7ec5df260bd2 P 38aad74758f04eb4bb3fa1904c4308ba [CANDIDATE]: Term 1 election: Requested vote from peers 239e806c594c4675809a5f12aa1cd70a (127.23.13.131:45787), 21560e4976404610b2d8df3ce137a035 (127.23.13.129:33165)
14:06:21.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.245061 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a6a56857a449b6b91e7ec5df260bd2" candidate_uuid: "38aad74758f04eb4bb3fa1904c4308ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "21560e4976404610b2d8df3ce137a035"
14:06:21.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.245009 24276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a6a56857a449b6b91e7ec5df260bd2" candidate_uuid: "38aad74758f04eb4bb3fa1904c4308ba" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "239e806c594c4675809a5f12aa1cd70a"
14:06:21.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.245549 23995 raft_consensus.cc:3060] T b4a6a56857a449b6b91e7ec5df260bd2 P 21560e4976404610b2d8df3ce137a035 [term 0 FOLLOWER]: Advancing to term 1
14:06:21.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.245582 24276 raft_consensus.cc:3060] T b4a6a56857a449b6b91e7ec5df260bd2 P 239e806c594c4675809a5f12aa1cd70a [term 0 FOLLOWER]: Advancing to term 1
14:06:21.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.250319 23995 raft_consensus.cc:2468] T b4a6a56857a449b6b91e7ec5df260bd2 P 21560e4976404610b2d8df3ce137a035 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38aad74758f04eb4bb3fa1904c4308ba in term 1.
14:06:21.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.251396 24072 leader_election.cc:304] T b4a6a56857a449b6b91e7ec5df260bd2 P 38aad74758f04eb4bb3fa1904c4308ba [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 21560e4976404610b2d8df3ce137a035, 38aad74758f04eb4bb3fa1904c4308ba; no voters: 
14:06:21.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.252121 24363 raft_consensus.cc:2804] T b4a6a56857a449b6b91e7ec5df260bd2 P 38aad74758f04eb4bb3fa1904c4308ba [term 1 FOLLOWER]: Leader election won for term 1
14:06:21.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.253304 24276 raft_consensus.cc:2468] T b4a6a56857a449b6b91e7ec5df260bd2 P 239e806c594c4675809a5f12aa1cd70a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 38aad74758f04eb4bb3fa1904c4308ba in term 1.
14:06:21.255 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.255477 24363 raft_consensus.cc:697] T b4a6a56857a449b6b91e7ec5df260bd2 P 38aad74758f04eb4bb3fa1904c4308ba [term 1 LEADER]: Becoming Leader. State: Replica: 38aad74758f04eb4bb3fa1904c4308ba, State: Running, Role: LEADER
14:06:21.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.256520 24363 consensus_queue.cc:237] T b4a6a56857a449b6b91e7ec5df260bd2 P 38aad74758f04eb4bb3fa1904c4308ba [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "239e806c594c4675809a5f12aa1cd70a" member_type: VOTER last_known_addr { host: "127.23.13.131" port: 45787 } } peers { permanent_uuid: "21560e4976404610b2d8df3ce137a035" member_type: VOTER last_known_addr { host: "127.23.13.129" port: 33165 } } peers { permanent_uuid: "38aad74758f04eb4bb3fa1904c4308ba" member_type: VOTER last_known_addr { host: "127.23.13.130" port: 38503 } }
14:06:21.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.273566 23807 catalog_manager.cc:5697] T b4a6a56857a449b6b91e7ec5df260bd2 P 38aad74758f04eb4bb3fa1904c4308ba reported cstate change: term changed from 0 to 1, leader changed from <none> to 38aad74758f04eb4bb3fa1904c4308ba (127.23.13.130). New cstate: current_term: 1 leader_uuid: "38aad74758f04eb4bb3fa1904c4308ba" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "239e806c594c4675809a5f12aa1cd70a" member_type: VOTER last_known_addr { host: "127.23.13.131" port: 45787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "21560e4976404610b2d8df3ce137a035" member_type: VOTER last_known_addr { host: "127.23.13.129" port: 33165 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "38aad74758f04eb4bb3fa1904c4308ba" member_type: VOTER last_known_addr { host: "127.23.13.130" port: 38503 } health_report { overall_health: HEALTHY } } }
14:06:21.414 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 81d23eddb7f14401bbd5de2f6269cbbe
14:06:21.421 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet b4a6a56857a449b6b91e7ec5df260bd2 for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
14:06:21.422 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=b4a6a56857a449b6b91e7ec5df260bd2@[21560e4976404610b2d8df3ce137a035(127.23.13.129:33165),239e806c594c4675809a5f12aa1cd70a(127.23.13.131:45787),38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503)[L]]}]
14:06:21.422 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=7), Traces: [0ms] refreshing cache from master, [0ms] Sub RPC GetTableLocations: sending RPC to server master-127.23.13.188:37881, [6ms] Sub RPC GetTableLocations: received response from server master-127.23.13.188:37881: OK, deferred=null) after lookup
14:06:21.423 [DEBUG - kudu-nio-1] (Connection.java:748) [peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503)] connecting to peer
14:06:21.428 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503)] Successfully connected to peer
14:06:21.457 [DEBUG - kudu-nio-3] (Negotiator.java:918) Authenticated connection [id: 0x83151c3e, L:/127.0.0.1:52096 - R:/127.23.13.130:38503] using TOKEN/null
14:06:21.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.481608 23995 raft_consensus.cc:1275] T b4a6a56857a449b6b91e7ec5df260bd2 P 21560e4976404610b2d8df3ce137a035 [term 1 FOLLOWER]: Refusing update from remote peer 38aad74758f04eb4bb3fa1904c4308ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
14:06:21.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.484141 24363 consensus_queue.cc:1048] T b4a6a56857a449b6b91e7ec5df260bd2 P 38aad74758f04eb4bb3fa1904c4308ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "21560e4976404610b2d8df3ce137a035" member_type: VOTER last_known_addr { host: "127.23.13.129" port: 33165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
14:06:21.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.497341 24276 raft_consensus.cc:1275] T b4a6a56857a449b6b91e7ec5df260bd2 P 239e806c594c4675809a5f12aa1cd70a [term 1 FOLLOWER]: Refusing update from remote peer 38aad74758f04eb4bb3fa1904c4308ba: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
14:06:21.500 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.499950 24366 consensus_queue.cc:1048] T b4a6a56857a449b6b91e7ec5df260bd2 P 38aad74758f04eb4bb3fa1904c4308ba [LEADER]: Connected to new peer: Peer: permanent_uuid: "239e806c594c4675809a5f12aa1cd70a" member_type: VOTER last_known_addr { host: "127.23.13.131" port: 45787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
14:06:21.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.523824 24371 mvcc.cc:204] Tried to move back new op lower bound from 7305296205722062848 to 7305296204836868096. Current Snapshot: MvccSnapshot[applied={T|T < 7305296205722062848}]
14:06:21.819 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 10 rows, more = false) for scanner KuduScanner(table=org.apache.kudu.client.TestClientFailoverSupport-RESTART, tablet=b4a6a56857a449b6b91e7ec5df260bd2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:06:21.820 [INFO - Time-limited test] (MiniKuduCluster.java:399) Killing master server 127.23.13.188:37881
14:06:21.820 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: stop_daemon {
  id {
    type: MASTER
    index: 2
  }
}

14:06:21.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.821079 23606 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskVqKZyE/build/tsan/bin/kudu with pid 23763
14:06:21.848 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.23.13.188:37881(127.23.13.188:37881)] handling channelInactive
14:06:21.849 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.23.13.188:37881(127.23.13.188:37881)] cleaning up while in state READY due to: connection closed
14:06:21.851 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
14:06:21.851 [INFO - Time-limited test] (MiniKuduCluster.java:380) Starting master server 127.23.13.188:37881
14:06:21.853 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: start_daemon {
  id {
    type: MASTER
    index: 2
  }
}

14:06:21.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:21.854983 23606 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskVqKZyE/build/tsan/bin/kudu
14:06:21.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskVqKZyE/build/tsan/bin/kudu
14:06:21.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/master-2/wal
14:06:21.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/master-2/data
14:06:21.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
14:06:21.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
14:06:21.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
14:06:21.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:06:21.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:06:21.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:06:21.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/master-2/logs
14:06:21.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/master-2/data/info.pb
14:06:21.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:06:21.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
14:06:21.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
14:06:21.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
14:06:21.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
14:06:21.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:06:21.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:06:21.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:06:21.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
14:06:21.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
14:06:21.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:06:21.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:06:21.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.23.13.188:37881
14:06:21.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.23.13.188
14:06:21.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=35865
14:06:21.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.23.13.148:33463
14:06:21.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:06:21.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:06:21.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:06:21.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:06:21.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.23.13.190:33371,127.23.13.189:33209,127.23.13.188:37881
14:06:21.856 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:06:21.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36973/jwks.json with env {}
14:06:22.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:22.187554 24382 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
14:06:22.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:22.188249 24382 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
14:06:22.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:22.188933 24382 flags.cc:432] Enabled unsafe flag: --never_fsync=true
14:06:22.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:22.224926 24382 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
14:06:22.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:22.225301 24382 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
14:06:22.225 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:22.225636 24382 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
14:06:22.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:22.225863 24382 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
14:06:22.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:22.226065 24382 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
14:06:22.226 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:22.226223 24382 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:36973/jwks.json
14:06:22.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:22.266197 24382 master_runner.cc:387] Master server non-default flags:
14:06:22.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
14:06:22.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.23.13.148:33463
14:06:22.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
14:06:22.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
14:06:22.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/master-2/data
14:06:22.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/master-2/wal
14:06:22.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
14:06:22.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.23.13.190:33371,127.23.13.189:33209,127.23.13.188:37881
14:06:22.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
14:06:22.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
14:06:22.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
14:06:22.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.23.13.188:37881
14:06:22.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
14:06:22.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
14:06:22.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
14:06:22.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:36973/jwks.json
14:06:22.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
14:06:22.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
14:06:22.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/master-2/data/info.pb
14:06:22.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.23.13.188
14:06:22.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=35865
14:06:22.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
14:06:22.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
14:06:22.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
14:06:22.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
14:06:22.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
14:06:22.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/master-2/logs
14:06:22.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
14:06:22.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
14:06:22.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
14:06:22.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
14:06:22.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
14:06:22.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 844bedc15e81bd62879377e001142786f7d931d8
14:06:22.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
14:06:22.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 08 Jul 2026 13:43:23 UTC on e7f111948823
14:06:22.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 12775
14:06:22.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
14:06:22.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:22.267984 24382 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
14:06:22.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:22.270129 24382 file_cache.cc:504] Constructed file cache file cache with capacity 419430
14:06:22.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:22.282122 24388 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:06:22.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:22.637452 24181 heartbeater.cc:646] Failed to heartbeat to 127.23.13.188:37881 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.23.13.188:37881: connect: Connection refused (error 111)
14:06:22.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:22.639953 24322 heartbeater.cc:646] Failed to heartbeat to 127.23.13.188:37881 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.23.13.188:37881: connect: Connection refused (error 111)
14:06:22.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:22.649772 24040 heartbeater.cc:646] Failed to heartbeat to 127.23.13.188:37881 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.23.13.188:37881: connect: Connection refused (error 111)
14:06:23.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.199846 24397 raft_consensus.cc:493] T 00000000000000000000000000000000 P af6b7cb9ce404981ad40292b0975fe51 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ab4f66b288014bc3875c2cd2b7d3cfc6)
14:06:23.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.201274 24397 raft_consensus.cc:515] T 00000000000000000000000000000000 P af6b7cb9ce404981ad40292b0975fe51 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1305e72a63eb424da1755bd3609ce7e0" member_type: VOTER last_known_addr { host: "127.23.13.190" port: 33371 } } peers { permanent_uuid: "af6b7cb9ce404981ad40292b0975fe51" member_type: VOTER last_known_addr { host: "127.23.13.189" port: 33209 } } peers { permanent_uuid: "ab4f66b288014bc3875c2cd2b7d3cfc6" member_type: VOTER last_known_addr { host: "127.23.13.188" port: 37881 } }
14:06:23.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.219039 23661 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "af6b7cb9ce404981ad40292b0975fe51" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "1305e72a63eb424da1755bd3609ce7e0" is_pre_election: true
14:06:23.229 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.228654 24397 leader_election.cc:290] T 00000000000000000000000000000000 P af6b7cb9ce404981ad40292b0975fe51 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1305e72a63eb424da1755bd3609ce7e0 (127.23.13.190:33371), ab4f66b288014bc3875c2cd2b7d3cfc6 (127.23.13.188:37881)
14:06:23.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.229768 24399 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1305e72a63eb424da1755bd3609ce7e0 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader ab4f66b288014bc3875c2cd2b7d3cfc6)
14:06:23.233 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.232438 24399 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1305e72a63eb424da1755bd3609ce7e0 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1305e72a63eb424da1755bd3609ce7e0" member_type: VOTER last_known_addr { host: "127.23.13.190" port: 33371 } } peers { permanent_uuid: "af6b7cb9ce404981ad40292b0975fe51" member_type: VOTER last_known_addr { host: "127.23.13.189" port: 33209 } } peers { permanent_uuid: "ab4f66b288014bc3875c2cd2b7d3cfc6" member_type: VOTER last_known_addr { host: "127.23.13.188" port: 37881 } }
14:06:23.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:23.240397 23713 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.13.188:37881: connect: Connection refused (error 111) [suppressed 6 similar messages]
14:06:23.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.248505 24399 leader_election.cc:290] T 00000000000000000000000000000000 P 1305e72a63eb424da1755bd3609ce7e0 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers af6b7cb9ce404981ad40292b0975fe51 (127.23.13.189:33209), ab4f66b288014bc3875c2cd2b7d3cfc6 (127.23.13.188:37881)
14:06:23.251 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:23.250329 23638 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.13.188:37881: connect: Connection refused (error 111) [suppressed 13 similar messages]
14:06:23.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.259792 23735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1305e72a63eb424da1755bd3609ce7e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "af6b7cb9ce404981ad40292b0975fe51" is_pre_election: true
14:06:23.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.260931 23735 raft_consensus.cc:2468] T 00000000000000000000000000000000 P af6b7cb9ce404981ad40292b0975fe51 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1305e72a63eb424da1755bd3609ce7e0 in term 1.
14:06:23.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.265024 23636 leader_election.cc:304] T 00000000000000000000000000000000 P 1305e72a63eb424da1755bd3609ce7e0 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1305e72a63eb424da1755bd3609ce7e0, af6b7cb9ce404981ad40292b0975fe51; no voters: 
14:06:23.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.266084 24399 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1305e72a63eb424da1755bd3609ce7e0 [term 1 FOLLOWER]: Leader pre-election won for term 2
14:06:23.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:23.266737 23638 leader_election.cc:336] T 00000000000000000000000000000000 P 1305e72a63eb424da1755bd3609ce7e0 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ab4f66b288014bc3875c2cd2b7d3cfc6 (127.23.13.188:37881): Network error: Client connection negotiation failed: client connection to 127.23.13.188:37881: connect: Connection refused (error 111)
14:06:23.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.266559 24399 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1305e72a63eb424da1755bd3609ce7e0 [term 1 FOLLOWER]: Starting leader election (detected failure of leader ab4f66b288014bc3875c2cd2b7d3cfc6)
14:06:23.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.267477 24399 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1305e72a63eb424da1755bd3609ce7e0 [term 1 FOLLOWER]: Advancing to term 2
14:06:23.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:23.268043 23713 leader_election.cc:336] T 00000000000000000000000000000000 P af6b7cb9ce404981ad40292b0975fe51 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer ab4f66b288014bc3875c2cd2b7d3cfc6 (127.23.13.188:37881): Network error: Client connection negotiation failed: client connection to 127.23.13.188:37881: connect: Connection refused (error 111)
14:06:23.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.268555 23713 leader_election.cc:304] T 00000000000000000000000000000000 P af6b7cb9ce404981ad40292b0975fe51 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: af6b7cb9ce404981ad40292b0975fe51; no voters: 1305e72a63eb424da1755bd3609ce7e0, ab4f66b288014bc3875c2cd2b7d3cfc6
14:06:23.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.281462 24399 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1305e72a63eb424da1755bd3609ce7e0 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1305e72a63eb424da1755bd3609ce7e0" member_type: VOTER last_known_addr { host: "127.23.13.190" port: 33371 } } peers { permanent_uuid: "af6b7cb9ce404981ad40292b0975fe51" member_type: VOTER last_known_addr { host: "127.23.13.189" port: 33209 } } peers { permanent_uuid: "ab4f66b288014bc3875c2cd2b7d3cfc6" member_type: VOTER last_known_addr { host: "127.23.13.188" port: 37881 } }
14:06:23.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.282956 24397 raft_consensus.cc:2749] T 00000000000000000000000000000000 P af6b7cb9ce404981ad40292b0975fe51 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
14:06:23.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.289721 23735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "1305e72a63eb424da1755bd3609ce7e0" candidate_term: 2 candidate_status { last_received { term: 1 index: 7 } } ignore_live_leader: false dest_uuid: "af6b7cb9ce404981ad40292b0975fe51"
14:06:23.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.290527 23735 raft_consensus.cc:3060] T 00000000000000000000000000000000 P af6b7cb9ce404981ad40292b0975fe51 [term 1 FOLLOWER]: Advancing to term 2
14:06:23.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.301925 23735 raft_consensus.cc:2468] T 00000000000000000000000000000000 P af6b7cb9ce404981ad40292b0975fe51 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1305e72a63eb424da1755bd3609ce7e0 in term 2.
14:06:23.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.303702 23636 leader_election.cc:304] T 00000000000000000000000000000000 P 1305e72a63eb424da1755bd3609ce7e0 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1305e72a63eb424da1755bd3609ce7e0, af6b7cb9ce404981ad40292b0975fe51; no voters: 
14:06:23.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.315999 24399 leader_election.cc:290] T 00000000000000000000000000000000 P 1305e72a63eb424da1755bd3609ce7e0 [CANDIDATE]: Term 2 election: Requested vote from peers af6b7cb9ce404981ad40292b0975fe51 (127.23.13.189:33209), ab4f66b288014bc3875c2cd2b7d3cfc6 (127.23.13.188:37881)
14:06:23.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.316924 24399 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1305e72a63eb424da1755bd3609ce7e0 [term 2 FOLLOWER]: Leader election won for term 2
14:06:23.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.317600 24399 raft_consensus.cc:697] T 00000000000000000000000000000000 P 1305e72a63eb424da1755bd3609ce7e0 [term 2 LEADER]: Becoming Leader. State: Replica: 1305e72a63eb424da1755bd3609ce7e0, State: Running, Role: LEADER
14:06:23.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.318814 24399 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1305e72a63eb424da1755bd3609ce7e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1305e72a63eb424da1755bd3609ce7e0" member_type: VOTER last_known_addr { host: "127.23.13.190" port: 33371 } } peers { permanent_uuid: "af6b7cb9ce404981ad40292b0975fe51" member_type: VOTER last_known_addr { host: "127.23.13.189" port: 33209 } } peers { permanent_uuid: "ab4f66b288014bc3875c2cd2b7d3cfc6" member_type: VOTER last_known_addr { host: "127.23.13.188" port: 37881 } }
14:06:23.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:23.321602 23638 leader_election.cc:336] T 00000000000000000000000000000000 P 1305e72a63eb424da1755bd3609ce7e0 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer ab4f66b288014bc3875c2cd2b7d3cfc6 (127.23.13.188:37881): Network error: Client connection negotiation failed: client connection to 127.23.13.188:37881: connect: Connection refused (error 111)
14:06:23.343 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.333242 24404 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1305e72a63eb424da1755bd3609ce7e0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1305e72a63eb424da1755bd3609ce7e0. Latest consensus state: current_term: 2 leader_uuid: "1305e72a63eb424da1755bd3609ce7e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1305e72a63eb424da1755bd3609ce7e0" member_type: VOTER last_known_addr { host: "127.23.13.190" port: 33371 } } peers { permanent_uuid: "af6b7cb9ce404981ad40292b0975fe51" member_type: VOTER last_known_addr { host: "127.23.13.189" port: 33209 } } peers { permanent_uuid: "ab4f66b288014bc3875c2cd2b7d3cfc6" member_type: VOTER last_known_addr { host: "127.23.13.188" port: 37881 } } }
14:06:23.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.344599 24404 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1305e72a63eb424da1755bd3609ce7e0 [sys.catalog]: This master's current role is: LEADER
14:06:23.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.357445 24406 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
14:06:23.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.416678 24406 catalog_manager.cc:679] Loaded metadata for table org.apache.kudu.client.TestClientFailoverSupport-RESTART [id=81d23eddb7f14401bbd5de2f6269cbbe]
14:06:23.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.448787 24406 tablet_loader.cc:96] loaded metadata for tablet b4a6a56857a449b6b91e7ec5df260bd2 (table org.apache.kudu.client.TestClientFailoverSupport-RESTART [id=81d23eddb7f14401bbd5de2f6269cbbe])
14:06:23.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.455183 24406 catalog_manager.cc:1520] Initializing Kudu cluster ID...
14:06:23.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.465620 24406 catalog_manager.cc:1295] Loaded cluster ID: c1bf720155364df793c5b28590f9bf53
14:06:23.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.483140 24406 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
14:06:23.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.500651 24406 catalog_manager.cc:1540] Loading token signing keys...
14:06:23.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.526927 24406 catalog_manager.cc:6081] T 00000000000000000000000000000000 P 1305e72a63eb424da1755bd3609ce7e0: Loaded TSK: 0
14:06:23.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.534258 24406 catalog_manager.cc:1550] Initializing in-progress tserver states...
14:06:23.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.927287 23735 raft_consensus.cc:1275] T 00000000000000000000000000000000 P af6b7cb9ce404981ad40292b0975fe51 [term 2 FOLLOWER]: Refusing update from remote peer 1305e72a63eb424da1755bd3609ce7e0: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 2 index: 8. (index mismatch)
14:06:23.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.933553 24410 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 1305e72a63eb424da1755bd3609ce7e0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "af6b7cb9ce404981ad40292b0975fe51" member_type: VOTER last_known_addr { host: "127.23.13.189" port: 33209 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
14:06:23.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.959635 24413 sys_catalog.cc:455] T 00000000000000000000000000000000 P af6b7cb9ce404981ad40292b0975fe51 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1305e72a63eb424da1755bd3609ce7e0. Latest consensus state: current_term: 2 leader_uuid: "1305e72a63eb424da1755bd3609ce7e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1305e72a63eb424da1755bd3609ce7e0" member_type: VOTER last_known_addr { host: "127.23.13.190" port: 33371 } } peers { permanent_uuid: "af6b7cb9ce404981ad40292b0975fe51" member_type: VOTER last_known_addr { host: "127.23.13.189" port: 33209 } } peers { permanent_uuid: "ab4f66b288014bc3875c2cd2b7d3cfc6" member_type: VOTER last_known_addr { host: "127.23.13.188" port: 37881 } } }
14:06:23.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.960371 24413 sys_catalog.cc:458] T 00000000000000000000000000000000 P af6b7cb9ce404981ad40292b0975fe51 [sys.catalog]: This master's current role is: FOLLOWER
14:06:23.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.978721 24413 sys_catalog.cc:455] T 00000000000000000000000000000000 P af6b7cb9ce404981ad40292b0975fe51 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "1305e72a63eb424da1755bd3609ce7e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1305e72a63eb424da1755bd3609ce7e0" member_type: VOTER last_known_addr { host: "127.23.13.190" port: 33371 } } peers { permanent_uuid: "af6b7cb9ce404981ad40292b0975fe51" member_type: VOTER last_known_addr { host: "127.23.13.189" port: 33209 } } peers { permanent_uuid: "ab4f66b288014bc3875c2cd2b7d3cfc6" member_type: VOTER last_known_addr { host: "127.23.13.188" port: 37881 } } }
14:06:23.980 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.979420 24413 sys_catalog.cc:458] T 00000000000000000000000000000000 P af6b7cb9ce404981ad40292b0975fe51 [sys.catalog]: This master's current role is: FOLLOWER
14:06:23.985 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.984903 24411 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1305e72a63eb424da1755bd3609ce7e0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "1305e72a63eb424da1755bd3609ce7e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1305e72a63eb424da1755bd3609ce7e0" member_type: VOTER last_known_addr { host: "127.23.13.190" port: 33371 } } peers { permanent_uuid: "af6b7cb9ce404981ad40292b0975fe51" member_type: VOTER last_known_addr { host: "127.23.13.189" port: 33209 } } peers { permanent_uuid: "ab4f66b288014bc3875c2cd2b7d3cfc6" member_type: VOTER last_known_addr { host: "127.23.13.188" port: 37881 } } }
14:06:23.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:23.986032 24411 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1305e72a63eb424da1755bd3609ce7e0 [sys.catalog]: This master's current role is: LEADER
14:06:23.988 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:23.987650 23638 consensus_peers.cc:597] T 00000000000000000000000000000000 P 1305e72a63eb424da1755bd3609ce7e0 -> Peer ab4f66b288014bc3875c2cd2b7d3cfc6 (127.23.13.188:37881): Couldn't send request to peer ab4f66b288014bc3875c2cd2b7d3cfc6. Status: Network error: Client connection negotiation failed: client connection to 127.23.13.188:37881: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
14:06:24.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:23.687453 24387 debug-util.cc:398] Leaking SignalData structure 0x7b0800028020 after lost signal to thread 24382
14:06:24.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:24.257714 24387 kernel_stack_watchdog.cc:198] Thread 24382 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 399ms:
14:06:24.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
14:06:24.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
14:06:24.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
14:06:24.259 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
14:06:24.260 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:22.283689 24389 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:06:24.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:24.261216 24390 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1976 milliseconds
14:06:24.261 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:24.261251 24391 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
14:06:24.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:24.261646 24382 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.977s	user 0.651s	sys 1.162s
14:06:24.263 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:24.262997 24382 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.980s	user 0.652s	sys 1.162s
14:06:24.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:24.263531 24382 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
14:06:24.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:24.267964 24382 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
14:06:24.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:24.272110 24382 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
14:06:24.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:24.273581 24382 hybrid_clock.cc:648] HybridClock initialized: now 1783519584273525 us; error 45 us; skew 500 ppm
14:06:24.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:24.274755 24382 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
14:06:24.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:24.282886 24382 webserver.cc:533] Webserver started at http://127.23.13.188:35865/ using document root <none> and password file <none>
14:06:24.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:24.284370 24382 fs_manager.cc:362] Metadata directory not provided
14:06:24.285 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:24.284771 24382 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
14:06:24.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:24.296355 24382 fs_manager.cc:714] Time spent opening directory manager: real 0.007s	user 0.008s	sys 0.000s
14:06:24.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:24.303627 24423 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
14:06:24.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:24.305176 24382 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.001s	sys 0.003s
14:06:24.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:24.305588 24382 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/master-2/data,/tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/master-2/wal
14:06:24.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "ab4f66b288014bc3875c2cd2b7d3cfc6"
14:06:24.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-07-08 14:06:12 on dist-test-slave-gws2"
14:06:24.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:24.308429 24382 fs_report.cc:389] FS layout report
14:06:24.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
14:06:24.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/master-2/wal
14:06:24.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/master-2/wal
14:06:24.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/master-2/data/data
14:06:24.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
14:06:24.309 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
14:06:24.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
14:06:24.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
14:06:24.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
14:06:24.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
14:06:24.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
14:06:24.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
14:06:24.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
14:06:24.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
14:06:24.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
14:06:24.404 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:24.404357 24382 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
14:06:24.406 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:24.406008 24382 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
14:06:24.407 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:24.406529 24382 kserver.cc:163] Server-wide thread pool size limit: 3276
14:06:24.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:24.504249 24382 rpc_server.cc:307] RPC server started. Bound to: 127.23.13.188:37881
14:06:24.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:24.504315 24474 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.23.13.188:37881 every 8 connection(s)
14:06:24.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:24.507408 24382 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/master-2/data/info.pb
14:06:24.515 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:24.515558 23606 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskVqKZyE/build/tsan/bin/kudu as pid 24382
14:06:24.516 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
14:06:24.517 [INFO - Time-limited test] (MiniKuduCluster.java:475) Killing tablet server 127.23.13.130:38503
14:06:24.517 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: stop_daemon {
  id {
    type: TSERVER
    index: 1
  }
}

14:06:24.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:24.517575 23606 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskVqKZyE/build/tsan/bin/kudu with pid 24050
14:06:24.522 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:24.522257 24475 sys_catalog.cc:263] Verifying existing consensus state
14:06:24.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:24.528115 24475 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ab4f66b288014bc3875c2cd2b7d3cfc6: Bootstrap starting.
14:06:24.553 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503)] handling channelInactive
14:06:24.553 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
14:06:24.553 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503)] cleaning up while in state READY due to: connection closed
14:06:24.554 [DEBUG - Time-limited test] (Connection.java:748) [peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503)] connecting to peer
14:06:24.556 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503
14:06:24.556 [DEBUG - kudu-nio-4] (Connection.java:709) [peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503)] cleaning up while in state CONNECTING due to: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503
14:06:24.556 [INFO - kudu-nio-4] (AsyncKuduClient.java:2355) Invalidating location 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503) for tablet b4a6a56857a449b6b91e7ec5df260bd2: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503
14:06:24.567 [DEBUG - pool-4-thread-1] (Connection.java:748) [peer master-127.23.13.188:37881(127.23.13.188:37881)] connecting to peer
14:06:24.569 [DEBUG - kudu-nio-5] (Connection.java:757) [peer master-127.23.13.188:37881(127.23.13.188:37881)] Successfully connected to peer
14:06:24.576 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:24.576586 24475 log.cc:826] T 00000000000000000000000000000000 P ab4f66b288014bc3875c2cd2b7d3cfc6: Log is configured to *not* fsync() on all Append() calls
14:06:24.582 [DEBUG - kudu-nio-5] (Negotiator.java:528) SASL mechanism PLAIN chosen for peer 127.23.13.188
14:06:24.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:24.607007 24475 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ab4f66b288014bc3875c2cd2b7d3cfc6: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=5 ignored=0} mutations{seen=2 ignored=0} orphaned_commits=0. Pending: 0 replicates
14:06:24.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:24.608059 24475 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ab4f66b288014bc3875c2cd2b7d3cfc6: Bootstrap complete.
14:06:24.610 [DEBUG - kudu-nio-5] (Negotiator.java:918) Authenticated connection [id: 0xb122114a, L:/127.0.0.1:58408 - R:/127.23.13.188:37881] using SASL/PLAIN
14:06:24.615 [DEBUG - kudu-nio-5] (RemoteTablet.java:167) master-127.23.13.188:37881 was demoted as the leader for Kudu Master
14:06:24.632 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
14:06:24.633 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=GetTableLocations, tablet=Kudu Master, attempt=2, TimeoutTracker(timeout=29987, elapsed=66), Traces: [0ms] sending RPC to server master-127.23.13.188:37881, [48ms] delaying RPC due to: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [48ms] received response from server master-127.23.13.188:37881: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [59ms] refreshing cache from master, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.13.189:33209, [59ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.13.188:37881, [60ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.13.190:33371, [63ms] Sub RPC ConnectToMaster: received response from server master-127.23.13.189:33209: OK, [64ms] Sub RPC ConnectToMaster: received response from server master-127.23.13.190:33371: OK, deferred=Deferred@883131613(state=PENDING, result=null, callback=get tablet locations from the master for table org.apache.kudu.client.TestClientFailoverSupport-RESTART -> release master lookup permit -> retry RPC, errback=passthrough -> release master lookup permit -> retry RPC after error)) after lookup
14:06:24.634 [INFO - kudu-nio-5] (ConnectToCluster.java:385) Unable to connect to master 127.23.13.188:37881: Catalog manager is not initialized. State: Starting
14:06:24.639 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet b4a6a56857a449b6b91e7ec5df260bd2 for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
14:06:24.640 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=b4a6a56857a449b6b91e7ec5df260bd2@[21560e4976404610b2d8df3ce137a035(127.23.13.129:33165),239e806c594c4675809a5f12aa1cd70a(127.23.13.131:45787),38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503)[L]]}]
14:06:24.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:24.638945 24328 heartbeater.cc:499] Master 127.23.13.190:33371 was elected leader, sending a full tablet report...
14:06:24.641 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=b4a6a56857a449b6b91e7ec5df260bd2, attempt=2, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=87), Traces: [0ms] sending RPC to server 38aad74758f04eb4bb3fa1904c4308ba, [3ms] received response from server 38aad74758f04eb4bb3fa1904c4308ba: Network error: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503, [3ms] delaying RPC due to: Network error: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503, [13ms] refreshing cache from master, [14ms] Sub RPC GetTableLocations: sending RPC to server master-127.23.13.188:37881, [62ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [62ms] Sub RPC GetTableLocations: received response from server master-127.23.13.188:37881: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [73ms] Sub RPC GetTableLocations: refreshing cache from master, [73ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.13.189:33209, [73ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.13.188:37881, [74ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.13.190:33371, [77ms] Sub RPC ConnectToMaster: received response from server master-127.23.13.189:33209: OK, [78ms] Sub RPC ConnectToMaster: received response from server master-127.23.13.190:33371: OK, [80ms] Sub RPC GetTableLocations: sending RPC to server master-127.23.13.190:33371, [81ms] Sub RPC ConnectToMaster: received response from server master-127.23.13.188:37881: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [86ms] Sub RPC GetTableLocations: received response from server master-127.23.13.190:33371: OK, deferred=Deferred@1707343221(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$235/0x00007fd6e83371b0@6d63cb0c -> passthrough -> wakeup thread Time-limited test, errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@454e2f11 -> wakeup thread Time-limited test)) after lookup
14:06:24.642 [DEBUG - kudu-nio-2] (Connection.java:748) [peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503)] connecting to peer
14:06:24.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:24.641899 24475 raft_consensus.cc:359] T 00000000000000000000000000000000 P ab4f66b288014bc3875c2cd2b7d3cfc6 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1305e72a63eb424da1755bd3609ce7e0" member_type: VOTER last_known_addr { host: "127.23.13.190" port: 33371 } } peers { permanent_uuid: "af6b7cb9ce404981ad40292b0975fe51" member_type: VOTER last_known_addr { host: "127.23.13.189" port: 33209 } } peers { permanent_uuid: "ab4f66b288014bc3875c2cd2b7d3cfc6" member_type: VOTER last_known_addr { host: "127.23.13.188" port: 37881 } }
14:06:24.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:24.645937 24475 raft_consensus.cc:740] T 00000000000000000000000000000000 P ab4f66b288014bc3875c2cd2b7d3cfc6 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ab4f66b288014bc3875c2cd2b7d3cfc6, State: Initialized, Role: FOLLOWER
14:06:24.649 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503
14:06:24.650 [DEBUG - kudu-nio-6] (Connection.java:709) [peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503)] cleaning up while in state CONNECTING due to: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503
14:06:24.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:24.647143 24475 consensus_queue.cc:260] T 00000000000000000000000000000000 P ab4f66b288014bc3875c2cd2b7d3cfc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1305e72a63eb424da1755bd3609ce7e0" member_type: VOTER last_known_addr { host: "127.23.13.190" port: 33371 } } peers { permanent_uuid: "af6b7cb9ce404981ad40292b0975fe51" member_type: VOTER last_known_addr { host: "127.23.13.189" port: 33209 } } peers { permanent_uuid: "ab4f66b288014bc3875c2cd2b7d3cfc6" member_type: VOTER last_known_addr { host: "127.23.13.188" port: 37881 } }
14:06:24.651 [INFO - kudu-nio-6] (AsyncKuduClient.java:2355) Invalidating location 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503) for tablet b4a6a56857a449b6b91e7ec5df260bd2: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503
14:06:24.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:24.659500 24482 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab4f66b288014bc3875c2cd2b7d3cfc6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1305e72a63eb424da1755bd3609ce7e0" member_type: VOTER last_known_addr { host: "127.23.13.190" port: 33371 } } peers { permanent_uuid: "af6b7cb9ce404981ad40292b0975fe51" member_type: VOTER last_known_addr { host: "127.23.13.189" port: 33209 } } peers { permanent_uuid: "ab4f66b288014bc3875c2cd2b7d3cfc6" member_type: VOTER last_known_addr { host: "127.23.13.188" port: 37881 } } }
14:06:24.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:24.660281 24482 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab4f66b288014bc3875c2cd2b7d3cfc6 [sys.catalog]: This master's current role is: FOLLOWER
14:06:24.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:24.663070 24475 sys_catalog.cc:565] T 00000000000000000000000000000000 P ab4f66b288014bc3875c2cd2b7d3cfc6 [sys.catalog]: configured and running, proceeding with master startup.
14:06:24.679 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet b4a6a56857a449b6b91e7ec5df260bd2 for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
14:06:24.679 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=b4a6a56857a449b6b91e7ec5df260bd2@[21560e4976404610b2d8df3ce137a035(127.23.13.129:33165),239e806c594c4675809a5f12aa1cd70a(127.23.13.131:45787),38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503)[L]]}]
14:06:24.680 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=b4a6a56857a449b6b91e7ec5df260bd2, attempt=4, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=126), Traces: [0ms] sending RPC to server 38aad74758f04eb4bb3fa1904c4308ba, [3ms] received response from server 38aad74758f04eb4bb3fa1904c4308ba: Network error: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503, [3ms] delaying RPC due to: Network error: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503, [13ms] refreshing cache from master, [14ms] Sub RPC GetTableLocations: sending RPC to server master-127.23.13.188:37881, [62ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [62ms] Sub RPC GetTableLocations: received response from server master-127.23.13.188:37881: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [73ms] Sub RPC GetTableLocations: refreshing cache from master, [73ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.13.189:33209, [73ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.13.188:37881, [74ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.13.190:33371, [77ms] Sub RPC ConnectToMaster: received response from server master-127.23.13.189:33209: OK, [78ms] Sub RPC ConnectToMaster: received response from server master-127.23.13.190:33371: OK, [80ms] Sub RPC GetTableLocations: sending RPC to server master-127.23.13.190:33371, [81ms] Sub RPC ConnectToMaster: received response from server master-127.23.13.188:37881: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [86ms] Sub RPC GetTableLocations: received response from server master-127.23.13.190:33371: OK, [89ms] sending RPC to server 38aad74758f04eb4bb3fa1904c4308ba, [97ms] received response from server 38aad74758f04eb4bb3fa1904c4308ba: Network error: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503, [98ms] delaying RPC due to: Network error: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503, [113ms] refreshing cache from master, [114ms] Sub RPC GetTableLocations: sending RPC to server master-127.23.13.190:33371, [125ms] Sub RPC GetTableLocations: received response from server master-127.23.13.190:33371: OK, deferred=Deferred@1707343221(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$235/0x00007fd6e83371b0@6d63cb0c -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@883131613 after retry RPC@642214767), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@454e2f11 -> wakeup thread Time-limited test -> (continuation of Deferred@883131613 after retry RPC@642214767))) after lookup
14:06:24.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:24.688784 24043 heartbeater.cc:499] Master 127.23.13.190:33371 was elected leader, sending a full tablet report...
14:06:24.697 [DEBUG - kudu-nio-2] (Connection.java:748) [peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503)] connecting to peer
14:06:24.714 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503
14:06:24.714 [DEBUG - kudu-nio-7] (Connection.java:709) [peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503)] cleaning up while in state CONNECTING due to: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503
14:06:24.714 [INFO - kudu-nio-7] (AsyncKuduClient.java:2355) Invalidating location 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503) for tablet b4a6a56857a449b6b91e7ec5df260bd2: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503
14:06:24.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:24.732700 24322 heartbeater.cc:344] Connected to a master server at 127.23.13.188:37881
14:06:24.734 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:24.733134 24040 heartbeater.cc:344] Connected to a master server at 127.23.13.188:37881
14:06:24.735 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet b4a6a56857a449b6b91e7ec5df260bd2 for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
14:06:24.735 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:24.735662 24497 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
14:06:24.736 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=b4a6a56857a449b6b91e7ec5df260bd2@[21560e4976404610b2d8df3ce137a035(127.23.13.129:33165),239e806c594c4675809a5f12aa1cd70a(127.23.13.131:45787),38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503)[L]]}]
14:06:24.737 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=b4a6a56857a449b6b91e7ec5df260bd2, attempt=6, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=183), Traces: [0ms] sending RPC to server 38aad74758f04eb4bb3fa1904c4308ba, [3ms] received response from server 38aad74758f04eb4bb3fa1904c4308ba: Network error: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503, [3ms] delaying RPC due to: Network error: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503, [13ms] refreshing cache from master, [14ms] Sub RPC GetTableLocations: sending RPC to server master-127.23.13.188:37881, [62ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [62ms] Sub RPC GetTableLocations: received response from server master-127.23.13.188:37881: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [73ms] Sub RPC GetTableLocations: refreshing cache from master, [73ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.13.189:33209, [73ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.13.188:37881, [74ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.13.190:33371, [77ms] Sub RPC ConnectToMaster: received response from server master-127.23.13.189:33209: OK, [78ms] Sub RPC ConnectToMaster: received response from server master-127.23.13.190:33371: OK, [80ms] Sub RPC GetTableLocations: sending RPC to server master-127.23.13.190:33371, [81ms] Sub RPC ConnectToMaster: received response from server master-127.23.13.188:37881: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [86ms] Sub RPC GetTableLocations: received response from server master-127.23.13.190:33371: OK, [89ms] sending RPC to server 38aad74758f04eb4bb3fa1904c4308ba, [97ms] received response from server 38aad74758f04eb4bb3fa1904c4308ba: Network error: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503, [98ms] delaying RPC due to: Network error: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503, [113ms] refreshing cache from master, [114ms] Sub RPC GetTableLocations: sending RPC to server master-127.23.13.190:33371, [125ms] Sub RPC GetTableLocations: received response from server master-127.23.13.190:33371: OK, [144ms] sending RPC to server 38aad74758f04eb4bb3fa1904c4308ba, [161ms] received response from server 38aad74758f04eb4bb3fa1904c4308ba: Network error: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503, [162ms] delaying RPC due to: Network error: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503, [173ms] refreshing cache from master, [173ms] Sub RPC GetTableLocations: sending RPC to server master-127.23.13.190:33371, [182ms] Sub RPC GetTableLocations: received response from server master-127.23.13.190:33371: OK, deferred=Deferred@1707343221(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$235/0x00007fd6e83371b0@6d63cb0c -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@883131613 after retry RPC@642214767) -> (continuation of Deferred@1865615573 after retry RPC@1716780082), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@454e2f11 -> wakeup thread Time-limited test -> (continuation of Deferred@883131613 after retry RPC@642214767) -> (continuation of Deferred@1865615573 after retry RPC@1716780082))) after lookup
14:06:24.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:24.741302 24440 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "239e806c594c4675809a5f12aa1cd70a" instance_seqno: 1783519580593364) as {username='slave'} at 127.23.13.131:50141; Asking this server to re-register.
14:06:24.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:24.741884 24439 master_service.cc:438] Got heartbeat from unknown tserver (permanent_uuid: "21560e4976404610b2d8df3ce137a035" instance_seqno: 1783519576290429) as {username='slave'} at 127.23.13.129:57579; Asking this server to re-register.
14:06:24.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:24.743309 24040 heartbeater.cc:461] Registering TS with master...
14:06:24.744 [DEBUG - kudu-nio-2] (Connection.java:748) [peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503)] connecting to peer
14:06:24.745 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503
14:06:24.746 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503)] cleaning up while in state CONNECTING due to: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503
14:06:24.746 [INFO - kudu-nio-0] (AsyncKuduClient.java:2355) Invalidating location 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503) for tablet b4a6a56857a449b6b91e7ec5df260bd2: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503
14:06:24.747 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:24.745527 24322 heartbeater.cc:461] Registering TS with master...
14:06:24.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:24.748929 24440 ts_manager.cc:194] Registered new tserver with Master: 21560e4976404610b2d8df3ce137a035 (127.23.13.129:33165)
14:06:24.749 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:24.749378 24439 ts_manager.cc:194] Registered new tserver with Master: 239e806c594c4675809a5f12aa1cd70a (127.23.13.131:45787)
14:06:24.870 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet b4a6a56857a449b6b91e7ec5df260bd2 for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
14:06:24.870 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=b4a6a56857a449b6b91e7ec5df260bd2@[21560e4976404610b2d8df3ce137a035(127.23.13.129:33165),239e806c594c4675809a5f12aa1cd70a(127.23.13.131:45787),38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503)[L]]}]
14:06:24.871 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=b4a6a56857a449b6b91e7ec5df260bd2, attempt=8, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=317), Traces: [0ms] sending RPC to server 38aad74758f04eb4bb3fa1904c4308ba, [3ms] received response from server 38aad74758f04eb4bb3fa1904c4308ba: Network error: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503, [3ms] delaying RPC due to: Network error: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503, [13ms] refreshing cache from master, [14ms] Sub RPC GetTableLocations: sending RPC to server master-127.23.13.188:37881, [62ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [62ms] Sub RPC GetTableLocations: received response from server master-127.23.13.188:37881: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [73ms] Sub RPC GetTableLocations: refreshing cache from master, [73ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.13.189:33209, [73ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.13.188:37881, [74ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.13.190:33371, [77ms] Sub RPC ConnectToMaster: received response from server master-127.23.13.189:33209: OK, [78ms] Sub RPC ConnectToMaster: received response from server master-127.23.13.190:33371: OK, [80ms] Sub RPC GetTableLocations: sending RPC to server master-127.23.13.190:33371, [81ms] Sub RPC ConnectToMaster: received response from server master-127.23.13.188:37881: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [86ms] Sub RPC GetTableLocations: received response from server master-127.23.13.190:33371: OK, [89ms] sending RPC to server 38aad74758f04eb4bb3fa1904c4308ba, [97ms] received response from server 38aad74758f04eb4bb3fa1904c4308ba: Network error: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503, [98ms] delaying RPC due to: Network error: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503, [113ms] refreshing cache from master, [114ms] Sub RPC GetTableLocations: sending RPC to server master-127.23.13.190:33371, [125ms] Sub RPC GetTableLocations: received response from server master-127.23.13.190:33371: OK, [144ms] sending RPC to server 38aad74758f04eb4bb3fa1904c4308ba, [161ms] received response from server 38aad74758f04eb4bb3fa1904c4308ba: Network error: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503, [162ms] delaying RPC due to: Network error: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503, [173ms] refreshing cache from master, [173ms] Sub RPC GetTableLocations: sending RPC to server master-127.23.13.190:33371, [182ms] Sub RPC GetTableLocations: received response from server master-127.23.13.190:33371: OK, [190ms] sending RPC to server 38aad74758f04eb4bb3fa1904c4308ba, [193ms] received response from server 38aad74758f04eb4bb3fa1904c4308ba: Network error: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503, [193ms] delaying RPC due to: Network error: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503, [313ms] refreshing cache from master, [313ms] Sub RPC GetTableLocations: sending RPC to server master-127.23.13.190:33371, [317ms] Sub RPC GetTableLocations: received response from server master-127.23.13.190:33371: OK, deferred=Deferred@1707343221(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$235/0x00007fd6e83371b0@6d63cb0c -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@883131613 after retry RPC@642214767) -> (continuation of Deferred@1865615573 after retry RPC@1716780082) -> (continuation of Deferred@1265871270 after retry RPC@850947734), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@454e2f11 -> wakeup thread Time-limited test -> (continuation of Deferred@883131613 after retry RPC@642214767) -> (continuation of Deferred@1865615573 after retry RPC@1716780082) -> (continuation of Deferred@1265871270 after retry RPC@850947734))) after lookup
14:06:24.872 [DEBUG - kudu-nio-2] (Connection.java:748) [peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503)] connecting to peer
14:06:24.873 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503
14:06:24.873 [DEBUG - kudu-nio-1] (Connection.java:709) [peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503)] cleaning up while in state CONNECTING due to: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503
14:06:24.873 [INFO - kudu-nio-1] (AsyncKuduClient.java:2355) Invalidating location 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503) for tablet b4a6a56857a449b6b91e7ec5df260bd2: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503
14:06:24.930 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet b4a6a56857a449b6b91e7ec5df260bd2 for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
14:06:24.930 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=b4a6a56857a449b6b91e7ec5df260bd2@[21560e4976404610b2d8df3ce137a035(127.23.13.129:33165),239e806c594c4675809a5f12aa1cd70a(127.23.13.131:45787),38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503)[L]]}]
14:06:24.931 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=b4a6a56857a449b6b91e7ec5df260bd2, attempt=10, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=377), Traces: [0ms] sending RPC to server 38aad74758f04eb4bb3fa1904c4308ba, [3ms] received response from server 38aad74758f04eb4bb3fa1904c4308ba: Network error: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503, [3ms] delaying RPC due to: Network error: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503, [13ms] refreshing cache from master, [14ms] Sub RPC GetTableLocations: sending RPC to server master-127.23.13.188:37881, [62ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [62ms] Sub RPC GetTableLocations: received response from server master-127.23.13.188:37881: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [73ms] Sub RPC GetTableLocations: refreshing cache from master, [73ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.13.189:33209, [73ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.13.188:37881, [74ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.13.190:33371, [77ms] Sub RPC ConnectToMaster: received response from server master-127.23.13.189:33209: OK, [78ms] Sub RPC ConnectToMaster: received response from server master-127.23.13.190:33371: OK, [80ms] Sub RPC GetTableLocations: sending RPC to server master-127.23.13.190:33371, [81ms] Sub RPC ConnectToMaster: received response from server master-127.23.13.188:37881: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [86ms] Sub RPC GetTableLocations: received response from server master-127.23.13.190:33371: OK, [89ms] sending RPC to server 38aad74758f04eb4bb3fa1904c4308ba, [97ms] received response from server 38aad74758f04eb4bb3fa1904c4308ba: Network error: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503, [98ms] delaying RPC due to: Network error: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503, [113ms] refreshing cache from master, [114ms] Sub RPC GetTableLocations: sending RPC to server master-127.23.13.190:33371, [125ms] Sub RPC GetTableLocations: received response from server master-127.23.13.190:33371: OK, [144ms] sending RPC to server 38aad74758f04eb4bb3fa1904c4308ba, [161ms] received response from server 38aad74758f04eb4bb3fa1904c4308ba: Network error: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503, [162ms] delaying RPC due to: Network error: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503, [173ms] refreshing cache from master, [173ms] Sub RPC GetTableLocations: sending RPC to server master-127.23.13.190:33371, [182ms] Sub RPC GetTableLocations: received response from server master-127.23.13.190:33371: OK, [190ms] sending RPC to server 38aad74758f04eb4bb3fa1904c4308ba, [193ms] received response from server 38aad74758f04eb4bb3fa1904c4308ba: Network error: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503, [193ms] delaying RPC due to: Network error: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503, [313ms] refreshing cache from master, [313ms] Sub RPC GetTableLocations: sending RPC to server master-127.23.13.190:33371, [317ms] Sub RPC GetTableLocations: received response from server master-127.23.13.190:33371: OK, [318ms] sending RPC to server 38aad74758f04eb4bb3fa1904c4308ba, [320ms] received response from server 38aad74758f04eb4bb3fa1904c4308ba: Network error: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503, [320ms] delaying RPC due to: Network error: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503, [373ms] refreshing cache from master, [373ms] Sub RPC GetTableLocations: sending RPC to server master-127.23.13.190:33371, [376ms] Sub RPC GetTableLocations: received response from server master-127.23.13.190:33371: OK, deferred=Deferred@1707343221(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$235/0x00007fd6e83371b0@6d63cb0c -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@883131613 after retry RPC@642214767) -> (continuation of Deferred@1865615573 after retry RPC@1716780082) -> (continuation of Deferred@1265871270 after retry RPC@850947734) -> (continuation of Deferred@2062542657 after retry RPC@189987412), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@454e2f11 -> wakeup thread Time-limited test -> (continuation of Deferred@883131613 after retry RPC@642214767) -> (continuation of Deferred@1865615573 after retry RPC@1716780082) -> (continuation of Deferred@1265871270 after retry RPC@850947734) -> (continuation of Deferred@2062542657 after retry RPC@189987412))) after lookup
14:06:24.931 [DEBUG - kudu-nio-2] (Connection.java:748) [peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503)] connecting to peer
14:06:24.932 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503
14:06:24.932 [DEBUG - kudu-nio-2] (Connection.java:709) [peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503)] cleaning up while in state CONNECTING due to: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503
14:06:24.933 [INFO - kudu-nio-2] (AsyncKuduClient.java:2355) Invalidating location 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503) for tablet b4a6a56857a449b6b91e7ec5df260bd2: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503
14:06:24.993 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:24.992980 24450 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ab4f66b288014bc3875c2cd2b7d3cfc6 [term 1 FOLLOWER]: Advancing to term 2
14:06:25.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.006024 24504 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab4f66b288014bc3875c2cd2b7d3cfc6 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 2 leader_uuid: "1305e72a63eb424da1755bd3609ce7e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1305e72a63eb424da1755bd3609ce7e0" member_type: VOTER last_known_addr { host: "127.23.13.190" port: 33371 } } peers { permanent_uuid: "af6b7cb9ce404981ad40292b0975fe51" member_type: VOTER last_known_addr { host: "127.23.13.189" port: 33209 } } peers { permanent_uuid: "ab4f66b288014bc3875c2cd2b7d3cfc6" member_type: VOTER last_known_addr { host: "127.23.13.188" port: 37881 } } }
14:06:25.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.006975 24504 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab4f66b288014bc3875c2cd2b7d3cfc6 [sys.catalog]: This master's current role is: FOLLOWER
14:06:25.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.008458 24482 sys_catalog.cc:455] T 00000000000000000000000000000000 P ab4f66b288014bc3875c2cd2b7d3cfc6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1305e72a63eb424da1755bd3609ce7e0. Latest consensus state: current_term: 2 leader_uuid: "1305e72a63eb424da1755bd3609ce7e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1305e72a63eb424da1755bd3609ce7e0" member_type: VOTER last_known_addr { host: "127.23.13.190" port: 33371 } } peers { permanent_uuid: "af6b7cb9ce404981ad40292b0975fe51" member_type: VOTER last_known_addr { host: "127.23.13.189" port: 33209 } } peers { permanent_uuid: "ab4f66b288014bc3875c2cd2b7d3cfc6" member_type: VOTER last_known_addr { host: "127.23.13.188" port: 37881 } } }
14:06:25.009 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.008983 24482 sys_catalog.cc:458] T 00000000000000000000000000000000 P ab4f66b288014bc3875c2cd2b7d3cfc6 [sys.catalog]: This master's current role is: FOLLOWER
14:06:25.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.361752 24411 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1305e72a63eb424da1755bd3609ce7e0 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 2 leader_uuid: "1305e72a63eb424da1755bd3609ce7e0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1305e72a63eb424da1755bd3609ce7e0" member_type: VOTER last_known_addr { host: "127.23.13.190" port: 33371 } } peers { permanent_uuid: "af6b7cb9ce404981ad40292b0975fe51" member_type: VOTER last_known_addr { host: "127.23.13.189" port: 33209 } } peers { permanent_uuid: "ab4f66b288014bc3875c2cd2b7d3cfc6" member_type: VOTER last_known_addr { host: "127.23.13.188" port: 37881 } } }
14:06:25.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.362597 24411 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1305e72a63eb424da1755bd3609ce7e0 [sys.catalog]: This master's current role is: LEADER
14:06:25.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.502509 24508 raft_consensus.cc:493] T b4a6a56857a449b6b91e7ec5df260bd2 P 21560e4976404610b2d8df3ce137a035 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 38aad74758f04eb4bb3fa1904c4308ba)
14:06:25.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.503156 24508 raft_consensus.cc:515] T b4a6a56857a449b6b91e7ec5df260bd2 P 21560e4976404610b2d8df3ce137a035 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "239e806c594c4675809a5f12aa1cd70a" member_type: VOTER last_known_addr { host: "127.23.13.131" port: 45787 } } peers { permanent_uuid: "21560e4976404610b2d8df3ce137a035" member_type: VOTER last_known_addr { host: "127.23.13.129" port: 33165 } } peers { permanent_uuid: "38aad74758f04eb4bb3fa1904c4308ba" member_type: VOTER last_known_addr { host: "127.23.13.130" port: 38503 } }
14:06:25.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.505787 24508 leader_election.cc:290] T b4a6a56857a449b6b91e7ec5df260bd2 P 21560e4976404610b2d8df3ce137a035 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 239e806c594c4675809a5f12aa1cd70a (127.23.13.131:45787), 38aad74758f04eb4bb3fa1904c4308ba (127.23.13.130:38503)
14:06:25.510 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:25.509522 23929 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.13.130:38503: connect: Connection refused (error 111)
14:06:25.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:25.513885 23929 leader_election.cc:336] T b4a6a56857a449b6b91e7ec5df260bd2 P 21560e4976404610b2d8df3ce137a035 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 38aad74758f04eb4bb3fa1904c4308ba (127.23.13.130:38503): Network error: Client connection negotiation failed: client connection to 127.23.13.130:38503: connect: Connection refused (error 111)
14:06:25.518 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.517501 24276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a6a56857a449b6b91e7ec5df260bd2" candidate_uuid: "21560e4976404610b2d8df3ce137a035" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "239e806c594c4675809a5f12aa1cd70a" is_pre_election: true
14:06:25.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.519021 23930 leader_election.cc:304] T b4a6a56857a449b6b91e7ec5df260bd2 P 21560e4976404610b2d8df3ce137a035 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 21560e4976404610b2d8df3ce137a035; no voters: 239e806c594c4675809a5f12aa1cd70a, 38aad74758f04eb4bb3fa1904c4308ba
14:06:25.520 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.519733 24508 raft_consensus.cc:2749] T b4a6a56857a449b6b91e7ec5df260bd2 P 21560e4976404610b2d8df3ce137a035 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
14:06:25.550 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet b4a6a56857a449b6b91e7ec5df260bd2 for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
14:06:25.550 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=b4a6a56857a449b6b91e7ec5df260bd2@[21560e4976404610b2d8df3ce137a035(127.23.13.129:33165),239e806c594c4675809a5f12aa1cd70a(127.23.13.131:45787),38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503)[L]]}]
14:06:25.551 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=b4a6a56857a449b6b91e7ec5df260bd2, attempt=12, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=997), Traces: [0ms] sending RPC to server 38aad74758f04eb4bb3fa1904c4308ba, [3ms] received response from server 38aad74758f04eb4bb3fa1904c4308ba: Network error: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503, [3ms] delaying RPC due to: Network error: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503, [13ms] refreshing cache from master, [14ms] Sub RPC GetTableLocations: sending RPC to server master-127.23.13.188:37881, [62ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [62ms] Sub RPC GetTableLocations: received response from server master-127.23.13.188:37881: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [73ms] Sub RPC GetTableLocations: refreshing cache from master, [73ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.13.189:33209, [73ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.13.188:37881, [74ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.13.190:33371, [77ms] Sub RPC ConnectToMaster: received response from server master-127.23.13.189:33209: OK, [78ms] Sub RPC ConnectToMaster: received response from server master-127.23.13.190:33371: OK, [80ms] Sub RPC GetTableLocations: sending RPC to server master-127.23.13.190:33371, [81ms] Sub RPC ConnectToMaster: received response from server master-127.23.13.188:37881: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [86ms] Sub RPC GetTableLocations: received response from server master-127.23.13.190:33371: OK, [89ms] sending RPC to server 38aad74758f04eb4bb3fa1904c4308ba, [97ms] received response from server 38aad74758f04eb4bb3fa1904c4308ba: Network error: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503, [98ms] delaying RPC due to: Network error: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503, [113ms] refreshing cache from master, [114ms] Sub RPC GetTableLocations: sending RPC to server master-127.23.13.190:33371, [125ms] Sub RPC GetTableLocations: received response from server master-127.23.13.190:33371: OK, [144ms] sending RPC to server 38aad74758f04eb4bb3fa1904c4308ba, [161ms] received response from server 38aad74758f04eb4bb3fa1904c4308ba: Network error: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503, [162ms] delaying RPC due to: Network error: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503, [173ms] refreshing cache from master, [173ms] Sub RPC GetTableLocations: sending RPC to server master-127.23.13.190:33371, [182ms] Sub RPC GetTableLocations: received response from server master-127.23.13.190:33371: OK, [190ms] sending RPC to server 38aad74758f04eb4bb3fa1904c4308ba, [193ms] received response from server 38aad74758f04eb4bb3fa1904c4308ba: Network error: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503, [193ms] delaying RPC due to: Network error: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503, [313ms] refreshing cache from master, [313ms] Sub RPC GetTableLocations: sending RPC to server master-127.23.13.190:33371, [317ms] Sub RPC GetTableLocations: received response from server master-127.23.13.190:33371: OK, [318ms] sending RPC to server 38aad74758f04eb4bb3fa1904c4308ba, [320ms] received response from server 38aad74758f04eb4bb3fa1904c4308ba: Network error: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503, [320ms] delaying RPC due to: Network error: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503, [373ms] refreshing cache from master, [373ms] Sub RPC GetTableLocations: sending RPC to server master-127.23.13.190:33371, [376ms] Sub RPC GetTableLocations: received response from server master-127.23.13.190:33371: OK, [378ms] sending RPC to server 38aad74758f04eb4bb3fa1904c4308ba, [379ms] received response from server 38aad74758f04eb4bb3fa1904c4308ba: Network error: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503, [380ms] delaying RPC due to: Network error: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503, [993ms] refreshing cache from master, [993ms] Sub RPC GetTableLocations: sending RPC to server master-127.23.13.190:33371, [997ms] Sub RPC GetTableLocations: received response from server master-127.23.13.190:33371: OK, deferred=Deferred@1707343221(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$235/0x00007fd6e83371b0@6d63cb0c -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@883131613 after retry RPC@642214767) -> (continuation of Deferred@1865615573 after retry RPC@1716780082) -> (continuation of Deferred@1265871270 after retry RPC@850947734) -> (continuation of Deferred@2062542657 after retry RPC@189987412) -> (continuation of Deferred@1958923159 after retry RPC@653536556), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@454e2f11 -> wakeup thread Time-limited test -> (continuation of Deferred@883131613 after retry RPC@642214767) -> (continuation of Deferred@1865615573 after retry RPC@1716780082) -> (continuation of Deferred@1265871270 after retry RPC@850947734) -> (continuation of Deferred@2062542657 after retry RPC@189987412) -> (continuation of Deferred@1958923159 after retry RPC@653536556))) after lookup
14:06:25.552 [DEBUG - kudu-nio-2] (Connection.java:748) [peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503)] connecting to peer
14:06:25.553 [INFO - kudu-nio-3] (Connection.java:429) Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503
14:06:25.553 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503)] cleaning up while in state CONNECTING due to: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503
14:06:25.553 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503) for tablet b4a6a56857a449b6b91e7ec5df260bd2: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503
14:06:25.711 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:25.711369 24471 debug-util.cc:398] Leaking SignalData structure 0x7b0800070060 after lost signal to thread 24383
14:06:25.739 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.738907 24513 raft_consensus.cc:493] T b4a6a56857a449b6b91e7ec5df260bd2 P 239e806c594c4675809a5f12aa1cd70a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 38aad74758f04eb4bb3fa1904c4308ba)
14:06:25.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.739455 24513 raft_consensus.cc:515] T b4a6a56857a449b6b91e7ec5df260bd2 P 239e806c594c4675809a5f12aa1cd70a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "239e806c594c4675809a5f12aa1cd70a" member_type: VOTER last_known_addr { host: "127.23.13.131" port: 45787 } } peers { permanent_uuid: "21560e4976404610b2d8df3ce137a035" member_type: VOTER last_known_addr { host: "127.23.13.129" port: 33165 } } peers { permanent_uuid: "38aad74758f04eb4bb3fa1904c4308ba" member_type: VOTER last_known_addr { host: "127.23.13.130" port: 38503 } }
14:06:25.750 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.749558 24497 catalog_manager.cc:1295] Loaded cluster ID: c1bf720155364df793c5b28590f9bf53
14:06:25.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.752825 24497 catalog_manager.cc:1588] T 00000000000000000000000000000000 P ab4f66b288014bc3875c2cd2b7d3cfc6: loading cluster ID for follower catalog manager: success
14:06:25.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.758438 24513 leader_election.cc:290] T b4a6a56857a449b6b91e7ec5df260bd2 P 239e806c594c4675809a5f12aa1cd70a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 21560e4976404610b2d8df3ce137a035 (127.23.13.129:33165), 38aad74758f04eb4bb3fa1904c4308ba (127.23.13.130:38503)
14:06:25.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.761487 24497 catalog_manager.cc:1610] T 00000000000000000000000000000000 P ab4f66b288014bc3875c2cd2b7d3cfc6: acquiring CA information for follower catalog manager: success
14:06:25.770 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:25.768296 24210 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.23.13.130:38503: connect: Connection refused (error 111)
14:06:25.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:25.775444 24210 leader_election.cc:336] T b4a6a56857a449b6b91e7ec5df260bd2 P 239e806c594c4675809a5f12aa1cd70a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 38aad74758f04eb4bb3fa1904c4308ba (127.23.13.130:38503): Network error: Client connection negotiation failed: client connection to 127.23.13.130:38503: connect: Connection refused (error 111)
14:06:25.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.777462 24497 catalog_manager.cc:1638] T 00000000000000000000000000000000 P ab4f66b288014bc3875c2cd2b7d3cfc6: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
14:06:25.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.778275 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a6a56857a449b6b91e7ec5df260bd2" candidate_uuid: "239e806c594c4675809a5f12aa1cd70a" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "21560e4976404610b2d8df3ce137a035" is_pre_election: true
14:06:25.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.779062 23995 raft_consensus.cc:2468] T b4a6a56857a449b6b91e7ec5df260bd2 P 21560e4976404610b2d8df3ce137a035 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 239e806c594c4675809a5f12aa1cd70a in term 1.
14:06:25.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.780560 24212 leader_election.cc:304] T b4a6a56857a449b6b91e7ec5df260bd2 P 239e806c594c4675809a5f12aa1cd70a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21560e4976404610b2d8df3ce137a035, 239e806c594c4675809a5f12aa1cd70a; no voters: 38aad74758f04eb4bb3fa1904c4308ba
14:06:25.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.781502 24513 raft_consensus.cc:2804] T b4a6a56857a449b6b91e7ec5df260bd2 P 239e806c594c4675809a5f12aa1cd70a [term 1 FOLLOWER]: Leader pre-election won for term 2
14:06:25.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.781878 24513 raft_consensus.cc:493] T b4a6a56857a449b6b91e7ec5df260bd2 P 239e806c594c4675809a5f12aa1cd70a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 38aad74758f04eb4bb3fa1904c4308ba)
14:06:25.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.782224 24513 raft_consensus.cc:3060] T b4a6a56857a449b6b91e7ec5df260bd2 P 239e806c594c4675809a5f12aa1cd70a [term 1 FOLLOWER]: Advancing to term 2
14:06:25.791 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.790148 24513 raft_consensus.cc:515] T b4a6a56857a449b6b91e7ec5df260bd2 P 239e806c594c4675809a5f12aa1cd70a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "239e806c594c4675809a5f12aa1cd70a" member_type: VOTER last_known_addr { host: "127.23.13.131" port: 45787 } } peers { permanent_uuid: "21560e4976404610b2d8df3ce137a035" member_type: VOTER last_known_addr { host: "127.23.13.129" port: 33165 } } peers { permanent_uuid: "38aad74758f04eb4bb3fa1904c4308ba" member_type: VOTER last_known_addr { host: "127.23.13.130" port: 38503 } }
14:06:25.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.793289 23995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4a6a56857a449b6b91e7ec5df260bd2" candidate_uuid: "239e806c594c4675809a5f12aa1cd70a" candidate_term: 2 candidate_status { last_received { term: 1 index: 11 } } ignore_live_leader: false dest_uuid: "21560e4976404610b2d8df3ce137a035"
14:06:25.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.793869 23995 raft_consensus.cc:3060] T b4a6a56857a449b6b91e7ec5df260bd2 P 21560e4976404610b2d8df3ce137a035 [term 1 FOLLOWER]: Advancing to term 2
14:06:25.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:25.797784 24210 leader_election.cc:336] T b4a6a56857a449b6b91e7ec5df260bd2 P 239e806c594c4675809a5f12aa1cd70a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 38aad74758f04eb4bb3fa1904c4308ba (127.23.13.130:38503): Network error: Client connection negotiation failed: client connection to 127.23.13.130:38503: connect: Connection refused (error 111)
14:06:25.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.795307 24513 leader_election.cc:290] T b4a6a56857a449b6b91e7ec5df260bd2 P 239e806c594c4675809a5f12aa1cd70a [CANDIDATE]: Term 2 election: Requested vote from peers 21560e4976404610b2d8df3ce137a035 (127.23.13.129:33165), 38aad74758f04eb4bb3fa1904c4308ba (127.23.13.130:38503)
14:06:25.802 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.802168 23995 raft_consensus.cc:2468] T b4a6a56857a449b6b91e7ec5df260bd2 P 21560e4976404610b2d8df3ce137a035 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 239e806c594c4675809a5f12aa1cd70a in term 2.
14:06:25.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.803491 24212 leader_election.cc:304] T b4a6a56857a449b6b91e7ec5df260bd2 P 239e806c594c4675809a5f12aa1cd70a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 21560e4976404610b2d8df3ce137a035, 239e806c594c4675809a5f12aa1cd70a; no voters: 38aad74758f04eb4bb3fa1904c4308ba
14:06:25.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.804317 24513 raft_consensus.cc:2804] T b4a6a56857a449b6b91e7ec5df260bd2 P 239e806c594c4675809a5f12aa1cd70a [term 2 FOLLOWER]: Leader election won for term 2
14:06:25.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.806317 24513 raft_consensus.cc:697] T b4a6a56857a449b6b91e7ec5df260bd2 P 239e806c594c4675809a5f12aa1cd70a [term 2 LEADER]: Becoming Leader. State: Replica: 239e806c594c4675809a5f12aa1cd70a, State: Running, Role: LEADER
14:06:25.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.807844 24513 consensus_queue.cc:237] T b4a6a56857a449b6b91e7ec5df260bd2 P 239e806c594c4675809a5f12aa1cd70a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 1.11, Last appended by leader: 11, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "239e806c594c4675809a5f12aa1cd70a" member_type: VOTER last_known_addr { host: "127.23.13.131" port: 45787 } } peers { permanent_uuid: "21560e4976404610b2d8df3ce137a035" member_type: VOTER last_known_addr { host: "127.23.13.129" port: 33165 } } peers { permanent_uuid: "38aad74758f04eb4bb3fa1904c4308ba" member_type: VOTER last_known_addr { host: "127.23.13.130" port: 38503 } }
14:06:25.823 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:25.821620 23651 catalog_manager.cc:5697] T b4a6a56857a449b6b91e7ec5df260bd2 P 239e806c594c4675809a5f12aa1cd70a reported cstate change: term changed from 1 to 2, leader changed from 38aad74758f04eb4bb3fa1904c4308ba (127.23.13.130) to 239e806c594c4675809a5f12aa1cd70a (127.23.13.131). New cstate: current_term: 2 leader_uuid: "239e806c594c4675809a5f12aa1cd70a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "239e806c594c4675809a5f12aa1cd70a" member_type: VOTER last_known_addr { host: "127.23.13.131" port: 45787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "21560e4976404610b2d8df3ce137a035" member_type: VOTER last_known_addr { host: "127.23.13.129" port: 33165 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "38aad74758f04eb4bb3fa1904c4308ba" member_type: VOTER last_known_addr { host: "127.23.13.130" port: 38503 } health_report { overall_health: UNKNOWN } } }
14:06:26.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:26.247974 23995 raft_consensus.cc:1275] T b4a6a56857a449b6b91e7ec5df260bd2 P 21560e4976404610b2d8df3ce137a035 [term 2 FOLLOWER]: Refusing update from remote peer 239e806c594c4675809a5f12aa1cd70a: Log matching property violated. Preceding OpId in replica: term: 1 index: 11. Preceding OpId from leader: term: 2 index: 12. (index mismatch)
14:06:26.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:26.249650 24513 consensus_queue.cc:1048] T b4a6a56857a449b6b91e7ec5df260bd2 P 239e806c594c4675809a5f12aa1cd70a [LEADER]: Connected to new peer: Peer: permanent_uuid: "21560e4976404610b2d8df3ce137a035" member_type: VOTER last_known_addr { host: "127.23.13.129" port: 33165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
14:06:26.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:26.288060 24210 consensus_peers.cc:597] T b4a6a56857a449b6b91e7ec5df260bd2 P 239e806c594c4675809a5f12aa1cd70a -> Peer 38aad74758f04eb4bb3fa1904c4308ba (127.23.13.130:38503): Couldn't send request to peer 38aad74758f04eb4bb3fa1904c4308ba. Status: Network error: Client connection negotiation failed: client connection to 127.23.13.130:38503: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
14:06:27.791 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet b4a6a56857a449b6b91e7ec5df260bd2 for table 'org.apache.kudu.client.TestClientFailoverSupport-RESTART' with partition [<start>, <end>)
14:06:27.791 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=b4a6a56857a449b6b91e7ec5df260bd2@[21560e4976404610b2d8df3ce137a035(127.23.13.129:33165),239e806c594c4675809a5f12aa1cd70a(127.23.13.131:45787)[L],38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503)]}]
14:06:27.792 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=b4a6a56857a449b6b91e7ec5df260bd2, attempt=14, sequence_id=11, TimeoutTracker(timeout=30000, elapsed=3238), Traces: [0ms] sending RPC to server 38aad74758f04eb4bb3fa1904c4308ba, [3ms] received response from server 38aad74758f04eb4bb3fa1904c4308ba: Network error: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503, [3ms] delaying RPC due to: Network error: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503, [13ms] refreshing cache from master, [14ms] Sub RPC GetTableLocations: sending RPC to server master-127.23.13.188:37881, [62ms] Sub RPC GetTableLocations: delaying RPC due to: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [62ms] Sub RPC GetTableLocations: received response from server master-127.23.13.188:37881: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [73ms] Sub RPC GetTableLocations: refreshing cache from master, [73ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.13.189:33209, [73ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.13.188:37881, [74ms] Sub RPC ConnectToMaster: sending RPC to server master-127.23.13.190:33371, [77ms] Sub RPC ConnectToMaster: received response from server master-127.23.13.189:33209: OK, [78ms] Sub RPC ConnectToMaster: received response from server master-127.23.13.190:33371: OK, [80ms] Sub RPC GetTableLocations: sending RPC to server master-127.23.13.190:33371, [81ms] Sub RPC ConnectToMaster: received response from server master-127.23.13.188:37881: Service unavailable: Catalog manager is not initialized. State: Starting (error 0), [86ms] Sub RPC GetTableLocations: received response from server master-127.23.13.190:33371: OK, [89ms] sending RPC to server 38aad74758f04eb4bb3fa1904c4308ba, [97ms] received response from server 38aad74758f04eb4bb3fa1904c4308ba: Network error: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503, [98ms] delaying RPC due to: Network error: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503, [113ms] refreshing cache from master, [114ms] Sub RPC GetTableLocations: sending RPC to server master-127.23.13.190:33371, [125ms] Sub RPC GetTableLocations: received response from server master-127.23.13.190:33371: OK, [144ms] sending RPC to server 38aad74758f04eb4bb3fa1904c4308ba, [161ms] received response from server 38aad74758f04eb4bb3fa1904c4308ba: Network error: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503, [162ms] delaying RPC due to: Network error: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503, [173ms] refreshing cache from master, [173ms] Sub RPC GetTableLocations: sending RPC to server master-127.23.13.190:33371, [182ms] Sub RPC GetTableLocations: received response from server master-127.23.13.190:33371: OK, [190ms] sending RPC to server 38aad74758f04eb4bb3fa1904c4308ba, [193ms] received response from server 38aad74758f04eb4bb3fa1904c4308ba: Network error: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503, [193ms] delaying RPC due to: Network error: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503, [313ms] refreshing cache from master, [313ms] Sub RPC GetTableLocations: sending RPC to server master-127.23.13.190:33371, [317ms] Sub RPC GetTableLocations: received response from server master-127.23.13.190:33371: OK, [318ms] sending RPC to server 38aad74758f04eb4bb3fa1904c4308ba, [320ms] received response from server 38aad74758f04eb4bb3fa1904c4308ba: Network error: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503, [320ms] delaying RPC due to: Network error: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503, [373ms] refreshing cache from master, [373ms] Sub RPC GetTableLocations: sending RPC to server master-127.23.13.190:33371, [376ms] Sub RPC GetTableLocations: received response from server master-127.23.13.190:33371: OK, [378ms] sending RPC to server 38aad74758f04eb4bb3fa1904c4308ba, [379ms] received response from server 38aad74758f04eb4bb3fa1904c4308ba: Network error: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503, [380ms] delaying RPC due to: Network error: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503, [993ms] refreshing cache from master, [993ms] Sub RPC GetTableLocations: sending RPC to server master-127.23.13.190:33371, [997ms] Sub RPC GetTableLocations: received response from server master-127.23.13.190:33371: OK, [998ms] sending RPC to server 38aad74758f04eb4bb3fa1904c4308ba, [1000ms] received response from server 38aad74758f04eb4bb3fa1904c4308ba: Network error: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503, [1000ms] delaying RPC due to: Network error: Failed to connect to peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503): Connection refused: /127.23.13.130:38503, [3233ms] refreshing cache from master, [3233ms] Sub RPC GetTableLocations: sending RPC to server master-127.23.13.190:33371, [3237ms] Sub RPC GetTableLocations: received response from server master-127.23.13.190:33371: OK, deferred=Deferred@1707343221(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$235/0x00007fd6e83371b0@6d63cb0c -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@883131613 after retry RPC@642214767) -> (continuation of Deferred@1865615573 after retry RPC@1716780082) -> (continuation of Deferred@1265871270 after retry RPC@850947734) -> (continuation of Deferred@2062542657 after retry RPC@189987412) -> (continuation of Deferred@1958923159 after retry RPC@653536556) -> (continuation of Deferred@1055323179 after retry RPC@972825494), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@454e2f11 -> wakeup thread Time-limited test -> (continuation of Deferred@883131613 after retry RPC@642214767) -> (continuation of Deferred@1865615573 after retry RPC@1716780082) -> (continuation of Deferred@1265871270 after retry RPC@850947734) -> (continuation of Deferred@2062542657 after retry RPC@189987412) -> (continuation of Deferred@1958923159 after retry RPC@653536556) -> (continuation of Deferred@1055323179 after retry RPC@972825494))) after lookup
14:06:27.793 [DEBUG - kudu-nio-2] (Connection.java:748) [peer 239e806c594c4675809a5f12aa1cd70a(127.23.13.131:45787)] connecting to peer
14:06:27.795 [DEBUG - kudu-nio-4] (Connection.java:757) [peer 239e806c594c4675809a5f12aa1cd70a(127.23.13.131:45787)] Successfully connected to peer
14:06:27.829 [DEBUG - kudu-nio-4] (Negotiator.java:918) Authenticated connection [id: 0x1ab052aa, L:/127.0.0.1:55148 - R:/127.23.13.131:45787] using TOKEN/null
14:06:28.031 [DEBUG - kudu-nio-4] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 20 rows, more = false) for scanner KuduScanner(table=org.apache.kudu.client.TestClientFailoverSupport-RESTART, tablet=b4a6a56857a449b6b91e7ec5df260bd2, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
14:06:28.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:28.034228 23651 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:54196:
14:06:28.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "org.apache.kudu.client.TestClientFailoverSupport-RESTART" }
14:06:28.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:28.034958 23651 catalog_manager.cc:2781] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:54196:
14:06:28.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) table { table_name: "org.apache.kudu.client.TestClientFailoverSupport-RESTART" }
14:06:28.068 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:28.067673 24318 debug-util.cc:398] Leaking SignalData structure 0x7b08000ca9a0 after lost signal to thread 24192
14:06:28.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:28.103783 23651 catalog_manager.cc:5984] T 00000000000000000000000000000000 P 1305e72a63eb424da1755bd3609ce7e0: Sending DeleteTablet for 3 replicas of tablet b4a6a56857a449b6b91e7ec5df260bd2
14:06:28.121 [DEBUG - main] (Connection.java:575) [peer master-127.23.13.189:33209(127.23.13.189:33209)] disconnecting while in state READY
14:06:28.121 [DEBUG - main] (Connection.java:575) [peer master-127.23.13.188:37881(127.23.13.188:37881)] disconnecting while in state READY
14:06:28.121 [DEBUG - main] (Connection.java:575) [peer 239e806c594c4675809a5f12aa1cd70a(127.23.13.131:45787)] disconnecting while in state READY
14:06:28.121 [DEBUG - main] (Connection.java:575) [peer master-127.23.13.190:33371(127.23.13.190:33371)] disconnecting while in state READY
14:06:28.121 [DEBUG - main] (Connection.java:575) [peer 38aad74758f04eb4bb3fa1904c4308ba(127.23.13.130:38503)] disconnecting while in state TERMINATED
14:06:28.122 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.23.13.189:33209(127.23.13.189:33209)] handling channelInactive
14:06:28.123 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.23.13.189:33209(127.23.13.189:33209)] cleaning up while in state READY due to: connection closed
14:06:28.123 [DEBUG - kudu-nio-5] (Connection.java:239) [peer master-127.23.13.188:37881(127.23.13.188:37881)] handling channelInactive
14:06:28.124 [DEBUG - kudu-nio-5] (Connection.java:709) [peer master-127.23.13.188:37881(127.23.13.188:37881)] cleaning up while in state READY due to: connection closed
14:06:28.124 [DEBUG - kudu-nio-4] (Connection.java:239) [peer 239e806c594c4675809a5f12aa1cd70a(127.23.13.131:45787)] handling channelInactive
14:06:28.125 [DEBUG - kudu-nio-4] (Connection.java:709) [peer 239e806c594c4675809a5f12aa1cd70a(127.23.13.131:45787)] cleaning up while in state READY due to: connection closed
14:06:28.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:28.128078 24256 tablet_service.cc:1558] Processing DeleteTablet for tablet b4a6a56857a449b6b91e7ec5df260bd2 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-07-08 14:06:28 UTC) from {username='slave'} at 127.0.0.1:55156
14:06:28.132 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2704) Releasing all remaining resources
14:06:28.133 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.23.13.190:33371(127.23.13.190:33371)] handling channelInactive
14:06:28.133 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.23.13.190:33371(127.23.13.190:33371)] cleaning up while in state READY due to: connection closed
14:06:28.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:28.135643 23606 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskVqKZyE/build/tsan/bin/kudu with pid 23909
14:06:28.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:28.149981 23636 catalog_manager.cc:4755] TS 38aad74758f04eb4bb3fa1904c4308ba (127.23.13.130:38503): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet b4a6a56857a449b6b91e7ec5df260bd2: Network error: Client connection negotiation failed: client connection to 127.23.13.130:38503: connect: Connection refused (error 111)
14:06:28.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:28.152032 24561 tablet_replica.cc:333] T b4a6a56857a449b6b91e7ec5df260bd2 P 239e806c594c4675809a5f12aa1cd70a: stopping tablet replica
14:06:28.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:28.153235 24561 raft_consensus.cc:2243] T b4a6a56857a449b6b91e7ec5df260bd2 P 239e806c594c4675809a5f12aa1cd70a [term 2 LEADER]: Raft consensus shutting down.
14:06:28.155 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:28.155136 24561 raft_consensus.cc:2272] T b4a6a56857a449b6b91e7ec5df260bd2 P 239e806c594c4675809a5f12aa1cd70a [term 2 FOLLOWER]: Raft consensus is shut down!
14:06:28.158 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:28.158517 24561 ts_tablet_manager.cc:1916] T b4a6a56857a449b6b91e7ec5df260bd2 P 239e806c594c4675809a5f12aa1cd70a: Deleting tablet data with delete state TABLET_DATA_DELETED
14:06:28.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:28.176964 24561 ts_tablet_manager.cc:1929] T b4a6a56857a449b6b91e7ec5df260bd2 P 239e806c594c4675809a5f12aa1cd70a: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 2.22
14:06:28.177 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:28.177412 24561 log.cc:1199] T b4a6a56857a449b6b91e7ec5df260bd2 P 239e806c594c4675809a5f12aa1cd70a: Deleting WAL directory at /tmp/dist-test-taskVqKZyE/test-tmp/mini-kudu-cluster4464428322058621465/ts-2/wal/wals/b4a6a56857a449b6b91e7ec5df260bd2
14:06:28.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:28.178390 24561 ts_tablet_manager.cc:1950] T b4a6a56857a449b6b91e7ec5df260bd2 P 239e806c594c4675809a5f12aa1cd70a: Deleting consensus metadata
14:06:28.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:28.181870 23637 catalog_manager.cc:5028] TS 239e806c594c4675809a5f12aa1cd70a (127.23.13.131:45787): tablet b4a6a56857a449b6b91e7ec5df260bd2 (table org.apache.kudu.client.TestClientFailoverSupport-RESTART [id=81d23eddb7f14401bbd5de2f6269cbbe]) successfully deleted
14:06:28.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260708 14:06:28.185422 24559 negotiation.cc:336] Failed RPC negotiation. Trace:
14:06:28.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 14:06:28.135200 (+     0us) reactor.cc:730] Submitting negotiation task for client connection to 127.23.13.129:33165 (local address 127.0.0.1:38164)
14:06:28.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 14:06:28.137450 (+  2250us) negotiation.cc:107] Waiting for socket to connect
14:06:28.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 14:06:28.137504 (+    54us) client_negotiation.cc:175] Beginning negotiation
14:06:28.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 14:06:28.137815 (+   311us) client_negotiation.cc:262] Sending NEGOTIATE NegotiatePB request
14:06:28.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 0708 14:06:28.184084 (+ 46269us) negotiation.cc:326] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.23.13.129:33165: BlockingRecv error: recv error from unknown peer: Transport endpoint is not connected (error 107)
14:06:28.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Metrics: {"client-negotiator.queue_time_us":1406}
14:06:28.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:28.191845 23606 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskVqKZyE/build/tsan/bin/kudu with pid 24188
14:06:28.228 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:28.227754 23606 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskVqKZyE/build/tsan/bin/kudu with pid 23618
14:06:28.256 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:28.255753 23606 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskVqKZyE/build/tsan/bin/kudu with pid 23688
14:06:28.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260708 14:06:28.280097 23606 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskVqKZyE/build/tsan/bin/kudu with pid 24382
14:06:29.431 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-07-08T14:06:29Z chronyd exiting

Time: 46.96

OK (2 tests)

