JUnit version 4.13.2
.20:03:01.767 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1786478581758
20:03:01.829 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
20:03:01.892 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
20:03:01.903 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-taskxrU2r1/test-tmp
20:03:01.909 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
20:03:01.912 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-taskxrU2r1/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
20:03:02.156 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

20:03:02.384 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
20:03:02.385 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

20:03:02.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:02.389390 28795 mini_oidc.cc:150] Starting JWKS server
20:03:02.393 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:02.393147 28795 webserver.cc:533] Webserver started at http://127.0.0.1:33415/ using document root <none> and password file <none>
20:03:02.394 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:02.393728 28795 mini_oidc.cc:186] Starting OIDC Discovery server
20:03:02.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:02.396219 28795 webserver.cc:533] Webserver started at http://127.0.0.1:37123/ using document root <none> and password file <none>
20:03:02.452 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-08-11T20:03:02Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
20:03:02.453 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-08-11T20:03:02Z Disabled control of system clock
20:03:02.466 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:02.466089 28795 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskxrU2r1/build/tsan/bin/kudu
20:03:02.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskxrU2r1/build/tsan/bin/kudu
20:03:02.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/master-0/wal
20:03:02.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/master-0/data
20:03:02.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
20:03:02.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
20:03:02.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
20:03:02.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:03:02.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:03:02.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:03:02.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/master-0/logs
20:03:02.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/master-0/data/info.pb
20:03:02.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:03:02.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
20:03:02.471 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
20:03:02.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
20:03:02.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
20:03:02.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:03:02.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:03:02.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:03:02.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
20:03:02.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
20:03:02.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
20:03:02.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
20:03:02.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.28.30.254:41663
20:03:02.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.28.30.254
20:03:02.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:03:02.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.28.30.212:45195
20:03:02.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:03:02.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:03:02.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:03:02.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
20:03:02.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.28.30.254:41663,127.28.30.253:38561,127.28.30.252:34405
20:03:02.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
20:03:02.476 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33415/jwks.json with env {}
20:03:02.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:02.781562 28814 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
20:03:02.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:02.782160 28814 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
20:03:02.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:02.782640 28814 flags.cc:432] Enabled unsafe flag: --never_fsync=true
20:03:02.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:02.816768 28814 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
20:03:02.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:02.817071 28814 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
20:03:02.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:02.817269 28814 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
20:03:02.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:02.817592 28814 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
20:03:02.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:02.817936 28814 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
20:03:02.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:02.818111 28814 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:33415/jwks.json
20:03:02.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:02.856366 28814 master_runner.cc:387] Master server non-default flags:
20:03:02.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/master-0/logs
20:03:02.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:03:02.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
20:03:02.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:03:02.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.28.30.212:45195
20:03:02.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:03:02.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:03:02.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/master-0/data
20:03:02.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/master-0/wal
20:03:02.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
20:03:02.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.28.30.254:41663,127.28.30.253:38561,127.28.30.252:34405
20:03:02.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:03:02.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:03:02.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
20:03:02.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.28.30.254:41663
20:03:02.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
20:03:02.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
20:03:02.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
20:03:02.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33415/jwks.json
20:03:02.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:03:02.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:03:02.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/master-0/data/info.pb
20:03:02.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.28.30.254
20:03:02.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:03:02.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
20:03:02.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:03:02.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
20:03:02.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
20:03:02.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:03:02.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
20:03:02.862 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
20:03:02.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
20:03:02.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 12dab910780628d7c8d59e0ab03bf2fa661d310d
20:03:02.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
20:03:02.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 11 Aug 2026 19:45:48 UTC on e7f111948823
20:03:02.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 13295
20:03:02.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
20:03:02.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:02.858150 28814 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
20:03:02.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:02.860437 28814 file_cache.cc:504] Constructed file cache file cache with capacity 419430
20:03:02.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:02.874286 28821 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:03:04.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:04.277834 28820 debug-util.cc:398] Leaking SignalData structure 0x7b080002ee00 after lost signal to thread 28814
20:03:04.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:04.760682 28820 kernel_stack_watchdog.cc:198] Thread 28814 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 400ms:
20:03:04.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
20:03:04.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
20:03:04.762 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
20:03:04.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
20:03:04.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:04.761090 28814 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.886s	user 0.756s	sys 1.130s
20:03:04.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:04.761530 28814 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.887s	user 0.756s	sys 1.130s
20:03:04.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:02.876155 28822 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:03:04.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:04.762257 28823 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1884 milliseconds
20:03:04.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:04.763737 28824 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:03:04.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:04.763932 28814 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
20:03:04.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:04.769243 28814 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
20:03:04.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:04.772146 28814 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
20:03:04.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:04.773571 28814 hybrid_clock.cc:648] HybridClock initialized: now 1786478584773544 us; error 50 us; skew 500 ppm
20:03:04.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:04.774714 28814 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
20:03:04.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:04.781108 28814 webserver.cc:533] Webserver started at http://127.28.30.254:37359/ using document root <none> and password file <none>
20:03:04.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:04.782222 28814 fs_manager.cc:362] Metadata directory not provided
20:03:04.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:04.782508 28814 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
20:03:04.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:04.783221 28814 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
20:03:04.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:04.787803 28814 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/master-0/data/instance:
20:03:04.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "535d2799517e4e0f8db40ce649706e2a"
20:03:04.789 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-11 20:03:04 on dist-test-slave-tk9z"
20:03:04.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:04.789391 28814 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/master-0/wal/instance:
20:03:04.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "535d2799517e4e0f8db40ce649706e2a"
20:03:04.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-11 20:03:04 on dist-test-slave-tk9z"
20:03:04.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:04.798049 28814 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.004s	sys 0.004s
20:03:04.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:04.804737 28835 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
20:03:04.806 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:04.806499 28814 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.005s	sys 0.001s
20:03:04.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:04.806896 28814 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/master-0/data,/tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/master-0/wal
20:03:04.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "535d2799517e4e0f8db40ce649706e2a"
20:03:04.807 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-11 20:03:04 on dist-test-slave-tk9z"
20:03:04.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:04.807367 28814 fs_report.cc:389] FS layout report
20:03:04.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
20:03:04.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/master-0/wal
20:03:04.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/master-0/wal
20:03:04.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/master-0/data/data
20:03:04.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
20:03:04.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
20:03:04.809 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
20:03:04.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
20:03:04.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
20:03:04.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
20:03:04.810 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
20:03:04.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
20:03:04.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
20:03:04.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
20:03:04.811 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
20:03:04.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:04.864107 28814 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
20:03:04.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:04.865996 28814 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
20:03:04.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:04.866600 28814 kserver.cc:163] Server-wide thread pool size limit: 3276
20:03:04.943 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:04.943305 28814 rpc_server.cc:307] RPC server started. Bound to: 127.28.30.254:41663
20:03:04.944 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:04.943418 28918 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.30.254:41663 every 8 connection(s)
20:03:04.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:04.947110 28814 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/master-0/data/info.pb
20:03:04.954 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:04.954363 28919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
20:03:04.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:04.956728 28795 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskxrU2r1/build/tsan/bin/kudu as pid 28814
20:03:04.957 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:04.957240 28795 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/master-0/wal/instance
20:03:04.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:04.960887 28795 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskxrU2r1/build/tsan/bin/kudu
20:03:04.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskxrU2r1/build/tsan/bin/kudu
20:03:04.961 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/master-1/wal
20:03:04.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/master-1/data
20:03:04.962 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
20:03:04.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
20:03:04.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
20:03:04.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:03:04.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:03:04.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:03:04.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/master-1/logs
20:03:04.965 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/master-1/data/info.pb
20:03:04.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:03:04.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
20:03:04.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
20:03:04.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
20:03:04.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
20:03:04.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:03:04.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:03:04.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:03:04.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
20:03:04.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
20:03:04.968 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
20:03:04.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
20:03:04.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.28.30.253:38561
20:03:04.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.28.30.253
20:03:04.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:03:04.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.28.30.212:45195
20:03:04.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:03:04.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:03:04.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:03:04.969 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
20:03:04.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.28.30.254:41663,127.28.30.253:38561,127.28.30.252:34405
20:03:04.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
20:03:04.970 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33415/jwks.json with env {}
20:03:04.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:04.966594 28919 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.30.254" port: 41663 } has no permanent_uuid. Determining permanent_uuid...
20:03:05.001 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:05.000439 28919 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.30.253" port: 38561 } has no permanent_uuid. Determining permanent_uuid...
20:03:05.003 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:05.003082 28836 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.30.253:38561: connect: Connection refused (error 111)
20:03:05.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:05.007707 28919 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.30.253:38561: Network error: Client connection negotiation failed: client connection to 127.28.30.253:38561: connect: Connection refused (error 111)
20:03:05.058 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:05.057336 28919 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.30.253" port: 38561 } attempt: 1
20:03:05.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:05.061878 28919 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.30.253:38561: Network error: Client connection negotiation failed: client connection to 127.28.30.253:38561: connect: Connection refused (error 111)
20:03:05.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:05.130475 28919 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.30.253" port: 38561 } attempt: 2
20:03:05.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:05.135232 28919 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.30.253:38561: Network error: Client connection negotiation failed: client connection to 127.28.30.253:38561: connect: Connection refused (error 111)
20:03:05.227 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:05.226723 28919 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.30.253" port: 38561 } attempt: 3
20:03:05.231 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:05.231142 28919 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.30.253:38561: Network error: Client connection negotiation failed: client connection to 127.28.30.253:38561: connect: Connection refused (error 111)
20:03:05.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:05.294755 28921 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
20:03:05.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:05.295413 28921 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
20:03:05.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:05.296156 28921 flags.cc:432] Enabled unsafe flag: --never_fsync=true
20:03:05.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:05.340174 28921 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
20:03:05.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:05.340507 28921 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
20:03:05.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:05.340706 28921 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
20:03:05.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:05.340899 28921 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
20:03:05.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:05.341084 28921 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
20:03:05.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:05.341282 28921 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:33415/jwks.json
20:03:05.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:05.374660 28919 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.30.253" port: 38561 } attempt: 4
20:03:05.379 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:05.379204 28919 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.30.253:38561: Network error: Client connection negotiation failed: client connection to 127.28.30.253:38561: connect: Connection refused (error 111)
20:03:05.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:05.379586 28921 master_runner.cc:387] Master server non-default flags:
20:03:05.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/master-1/logs
20:03:05.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:03:05.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
20:03:05.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:03:05.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.28.30.212:45195
20:03:05.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:03:05.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:03:05.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/master-1/data
20:03:05.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/master-1/wal
20:03:05.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
20:03:05.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.28.30.254:41663,127.28.30.253:38561,127.28.30.252:34405
20:03:05.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:03:05.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:03:05.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
20:03:05.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.28.30.253:38561
20:03:05.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
20:03:05.383 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
20:03:05.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
20:03:05.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33415/jwks.json
20:03:05.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:03:05.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:03:05.384 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/master-1/data/info.pb
20:03:05.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.28.30.253
20:03:05.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:03:05.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
20:03:05.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:03:05.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
20:03:05.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
20:03:05.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:03:05.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
20:03:05.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
20:03:05.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
20:03:05.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 12dab910780628d7c8d59e0ab03bf2fa661d310d
20:03:05.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
20:03:05.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 11 Aug 2026 19:45:48 UTC on e7f111948823
20:03:05.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 13295
20:03:05.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
20:03:05.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:05.380897 28921 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
20:03:05.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:05.382768 28921 file_cache.cc:504] Constructed file cache file cache with capacity 419430
20:03:05.398 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:05.397112 28935 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:03:05.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:05.678683 28919 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.30.253" port: 38561 } attempt: 5
20:03:05.685 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:05.684396 28919 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.30.253:38561: Network error: Client connection negotiation failed: client connection to 127.28.30.253:38561: connect: Connection refused (error 111)
20:03:06.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:06.231902 28919 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.30.253" port: 38561 } attempt: 6
20:03:06.242 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:06.241513 28919 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.30.253:38561: Network error: Client connection negotiation failed: client connection to 127.28.30.253:38561: connect: Connection refused (error 111)
20:03:06.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:05.401748 28936 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:03:06.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:05.403385 28938 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:03:06.635 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:06.635340 28921 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
20:03:06.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:06.635983 28937 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
20:03:06.640 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:06.639617 28921 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
20:03:06.643 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:06.643291 28921 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
20:03:06.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:06.644829 28921 hybrid_clock.cc:648] HybridClock initialized: now 1786478586644776 us; error 77 us; skew 500 ppm
20:03:06.646 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:06.646047 28921 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
20:03:06.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:06.653043 28921 webserver.cc:533] Webserver started at http://127.28.30.253:42921/ using document root <none> and password file <none>
20:03:06.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:06.654217 28921 fs_manager.cc:362] Metadata directory not provided
20:03:06.654 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:06.654522 28921 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
20:03:06.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:06.655157 28921 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
20:03:06.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:06.659860 28921 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/master-1/data/instance:
20:03:06.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "2d3a79606fbe42948b90b2bfb77a85fd"
20:03:06.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-11 20:03:06 on dist-test-slave-tk9z"
20:03:06.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:06.661381 28921 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/master-1/wal/instance:
20:03:06.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "2d3a79606fbe42948b90b2bfb77a85fd"
20:03:06.662 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-11 20:03:06 on dist-test-slave-tk9z"
20:03:06.669 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:06.669431 28921 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.009s	sys 0.000s
20:03:06.677 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:06.676630 28959 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
20:03:06.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:06.678436 28921 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.000s	sys 0.005s
20:03:06.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:06.678817 28921 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/master-1/data,/tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/master-1/wal
20:03:06.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "2d3a79606fbe42948b90b2bfb77a85fd"
20:03:06.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-11 20:03:06 on dist-test-slave-tk9z"
20:03:06.679 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:06.679179 28921 fs_report.cc:389] FS layout report
20:03:06.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
20:03:06.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/master-1/wal
20:03:06.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/master-1/wal
20:03:06.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/master-1/data/data
20:03:06.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
20:03:06.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
20:03:06.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
20:03:06.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
20:03:06.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
20:03:06.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
20:03:06.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
20:03:06.681 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
20:03:06.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
20:03:06.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
20:03:06.682 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
20:03:06.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:06.741900 28921 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
20:03:06.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:06.743641 28921 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
20:03:06.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:06.744076 28921 kserver.cc:163] Server-wide thread pool size limit: 3276
20:03:06.821 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:06.821256 28921 rpc_server.cc:307] RPC server started. Bound to: 127.28.30.253:38561
20:03:06.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:06.821349 29048 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.30.253:38561 every 8 connection(s)
20:03:06.824 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:06.824250 28921 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/master-1/data/info.pb
20:03:06.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:06.830420 29049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
20:03:06.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:06.834149 28795 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskxrU2r1/build/tsan/bin/kudu as pid 28921
20:03:06.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:06.834617 28795 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/master-1/wal/instance
20:03:06.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:06.836838 28795 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskxrU2r1/build/tsan/bin/kudu
20:03:06.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskxrU2r1/build/tsan/bin/kudu
20:03:06.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/master-2/wal
20:03:06.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/master-2/data
20:03:06.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
20:03:06.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
20:03:06.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
20:03:06.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:03:06.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:03:06.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:03:06.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/master-2/logs
20:03:06.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/master-2/data/info.pb
20:03:06.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:03:06.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
20:03:06.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
20:03:06.839 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
20:03:06.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
20:03:06.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:03:06.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:03:06.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:03:06.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
20:03:06.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
20:03:06.841 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
20:03:06.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
20:03:06.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.28.30.252:34405
20:03:06.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.28.30.252
20:03:06.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:03:06.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.28.30.212:45195
20:03:06.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:03:06.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:03:06.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:03:06.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
20:03:06.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.28.30.254:41663,127.28.30.253:38561,127.28.30.252:34405
20:03:06.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
20:03:06.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33415/jwks.json with env {}
20:03:06.850 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:06.846119 29049 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.30.254" port: 41663 } has no permanent_uuid. Determining permanent_uuid...
20:03:06.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:06.873538 29049 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.30.253" port: 38561 } has no permanent_uuid. Determining permanent_uuid...
20:03:06.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:06.889421 29049 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.30.252" port: 34405 } has no permanent_uuid. Determining permanent_uuid...
20:03:06.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:06.892295 28963 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.30.252:34405: connect: Connection refused (error 111)
20:03:06.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:06.897320 29049 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.30.252:34405: Network error: Client connection negotiation failed: client connection to 127.28.30.252:34405: connect: Connection refused (error 111)
20:03:06.947 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:06.946861 29049 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.30.252" port: 34405 } attempt: 1
20:03:06.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:06.953168 29049 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.30.252:34405: Network error: Client connection negotiation failed: client connection to 127.28.30.252:34405: connect: Connection refused (error 111)
20:03:07.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:07.021724 29049 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.30.252" port: 34405 } attempt: 2
20:03:07.027 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:07.026467 29049 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.30.252:34405: Network error: Client connection negotiation failed: client connection to 127.28.30.252:34405: connect: Connection refused (error 111)
20:03:07.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:07.118027 29049 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.30.252" port: 34405 } attempt: 3
20:03:07.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:07.122750 29049 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.30.252:34405: Network error: Client connection negotiation failed: client connection to 127.28.30.252:34405: connect: Connection refused (error 111)
20:03:07.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:07.202675 29055 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
20:03:07.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:07.204262 29055 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
20:03:07.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:07.205308 29055 flags.cc:432] Enabled unsafe flag: --never_fsync=true
20:03:07.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:07.243696 29055 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
20:03:07.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:07.244131 29055 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
20:03:07.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:07.244479 29055 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
20:03:07.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:07.244974 29055 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
20:03:07.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:07.245293 29055 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
20:03:07.246 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:07.245572 29055 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:33415/jwks.json
20:03:07.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:07.266305 29049 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.30.252" port: 34405 } attempt: 4
20:03:07.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:07.271142 29049 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.30.252:34405: Network error: Client connection negotiation failed: client connection to 127.28.30.252:34405: connect: Connection refused (error 111)
20:03:07.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:07.290668 29055 master_runner.cc:387] Master server non-default flags:
20:03:07.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/master-2/logs
20:03:07.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:03:07.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
20:03:07.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:03:07.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.28.30.212:45195
20:03:07.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:03:07.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:03:07.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/master-2/data
20:03:07.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/master-2/wal
20:03:07.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
20:03:07.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.28.30.254:41663,127.28.30.253:38561,127.28.30.252:34405
20:03:07.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:03:07.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:03:07.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
20:03:07.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.28.30.252:34405
20:03:07.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
20:03:07.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
20:03:07.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
20:03:07.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:33415/jwks.json
20:03:07.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:03:07.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:03:07.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/master-2/data/info.pb
20:03:07.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.28.30.252
20:03:07.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:03:07.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
20:03:07.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:03:07.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
20:03:07.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
20:03:07.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:03:07.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
20:03:07.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
20:03:07.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
20:03:07.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 12dab910780628d7c8d59e0ab03bf2fa661d310d
20:03:07.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
20:03:07.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 11 Aug 2026 19:45:48 UTC on e7f111948823
20:03:07.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 13295
20:03:07.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
20:03:07.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:07.292071 29055 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
20:03:07.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:07.294463 29055 file_cache.cc:504] Constructed file cache file cache with capacity 419430
20:03:07.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:07.302011 28919 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.30.253" port: 38561 } attempt: 7
20:03:07.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:07.307531 29070 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:03:07.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:07.319370 28919 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.30.252" port: 34405 } has no permanent_uuid. Determining permanent_uuid...
20:03:07.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:07.325793 28919 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.30.252:34405: Network error: Client connection negotiation failed: client connection to 127.28.30.252:34405: connect: Connection refused (error 111)
20:03:07.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:07.384292 28919 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.30.252" port: 34405 } attempt: 1
20:03:07.392 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:07.391433 28919 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.30.252:34405: Network error: Client connection negotiation failed: client connection to 127.28.30.252:34405: connect: Connection refused (error 111)
20:03:07.474 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:07.473075 28919 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.30.252" port: 34405 } attempt: 2
20:03:07.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:07.481207 28919 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.30.252:34405: Network error: Client connection negotiation failed: client connection to 127.28.30.252:34405: connect: Connection refused (error 111)
20:03:07.568 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:07.566875 28919 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.30.252" port: 34405 } attempt: 3
20:03:07.571 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:07.570624 29049 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.30.252" port: 34405 } attempt: 5
20:03:07.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:07.579232 28919 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.30.252:34405: Network error: Client connection negotiation failed: client connection to 127.28.30.252:34405: connect: Connection refused (error 111)
20:03:07.580 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:07.579936 29049 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.30.252:34405: Network error: Client connection negotiation failed: client connection to 127.28.30.252:34405: connect: Connection refused (error 111)
20:03:07.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:07.719936 28919 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.30.252" port: 34405 } attempt: 4
20:03:07.728 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:07.727649 28919 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.30.252:34405: Network error: Client connection negotiation failed: client connection to 127.28.30.252:34405: connect: Connection refused (error 111)
20:03:08.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:08.011288 28919 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.30.252" port: 34405 } attempt: 5
20:03:08.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:08.020160 28919 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.30.252:34405: Network error: Client connection negotiation failed: client connection to 127.28.30.252:34405: connect: Connection refused (error 111)
20:03:08.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:08.127539 29049 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.30.252" port: 34405 } attempt: 6
20:03:08.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:08.138491 29049 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.30.252:34405: Network error: Client connection negotiation failed: client connection to 127.28.30.252:34405: connect: Connection refused (error 111)
20:03:08.573 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:08.572821 28919 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.30.252" port: 34405 } attempt: 6
20:03:08.586 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:08.585901 28919 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.28.30.252:34405: Network error: Client connection negotiation failed: client connection to 127.28.30.252:34405: connect: Connection refused (error 111)
20:03:08.594 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:07.307950 29074 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:03:08.602 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:08.601508 29055 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 1.296s	user 0.487s	sys 0.806s
20:03:08.603 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:08.602596 29055 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 1.298s	user 0.489s	sys 0.808s
20:03:08.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:08.604947 29055 server_base.cc:1061] running on GCE node
20:03:08.607 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:08.606894 29090 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:03:08.609 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:08.609005 29055 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
20:03:08.613 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:08.612526 29055 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
20:03:08.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:08.614475 29055 hybrid_clock.cc:648] HybridClock initialized: now 1786478588614422 us; error 47 us; skew 500 ppm
20:03:08.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:08.615769 29055 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
20:03:08.626 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:08.625461 29055 webserver.cc:533] Webserver started at http://127.28.30.252:33983/ using document root <none> and password file <none>
20:03:08.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:08.627053 29055 fs_manager.cc:362] Metadata directory not provided
20:03:08.627 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:08.627345 29055 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
20:03:08.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:08.627972 29055 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
20:03:08.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:08.635347 29055 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/master-2/data/instance:
20:03:08.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "4a353b7d29034c679576efebd7aa54d1"
20:03:08.636 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-11 20:03:08 on dist-test-slave-tk9z"
20:03:08.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:08.637053 29055 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/master-2/wal/instance:
20:03:08.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "4a353b7d29034c679576efebd7aa54d1"
20:03:08.637 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-11 20:03:08 on dist-test-slave-tk9z"
20:03:08.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:08.648399 29055 fs_manager.cc:696] Time spent creating directory manager: real 0.010s	user 0.004s	sys 0.008s
20:03:08.657 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:08.656976 29099 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
20:03:08.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:08.658737 29055 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.006s	sys 0.000s
20:03:08.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:08.659050 29055 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/master-2/data,/tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/master-2/wal
20:03:08.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "4a353b7d29034c679576efebd7aa54d1"
20:03:08.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-11 20:03:08 on dist-test-slave-tk9z"
20:03:08.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:08.659377 29055 fs_report.cc:389] FS layout report
20:03:08.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
20:03:08.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/master-2/wal
20:03:08.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/master-2/wal
20:03:08.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/master-2/data/data
20:03:08.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
20:03:08.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
20:03:08.660 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
20:03:08.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
20:03:08.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
20:03:08.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
20:03:08.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
20:03:08.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
20:03:08.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
20:03:08.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
20:03:08.661 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
20:03:08.738 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:08.737866 29055 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
20:03:08.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:08.739614 29055 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
20:03:08.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:08.740185 29055 kserver.cc:163] Server-wide thread pool size limit: 3276
20:03:08.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:08.821703 29055 rpc_server.cc:307] RPC server started. Bound to: 127.28.30.252:34405
20:03:08.822 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:08.821874 29174 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.30.252:34405 every 8 connection(s)
20:03:08.825 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:08.825033 29055 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/master-2/data/info.pb
20:03:08.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:08.832302 29175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
20:03:08.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:08.834944 28795 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskxrU2r1/build/tsan/bin/kudu as pid 29055
20:03:08.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:08.835467 28795 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/master-2/wal/instance
20:03:08.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:08.848953 29175 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.30.254" port: 41663 } has no permanent_uuid. Determining permanent_uuid...
20:03:08.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:08.877204 29175 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.30.253" port: 38561 } has no permanent_uuid. Determining permanent_uuid...
20:03:08.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:08.888144 29175 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.28.30.252" port: 34405 } has no permanent_uuid. Determining permanent_uuid...
20:03:08.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:08.905613 29175 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a353b7d29034c679576efebd7aa54d1: Bootstrap starting.
20:03:08.915 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:08.915179 29175 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4a353b7d29034c679576efebd7aa54d1: Neither blocks nor log segments found. Creating new log.
20:03:08.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:08.917974 29175 log.cc:826] T 00000000000000000000000000000000 P 4a353b7d29034c679576efebd7aa54d1: Log is configured to *not* fsync() on all Append() calls
20:03:08.924 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:08.924165 29175 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4a353b7d29034c679576efebd7aa54d1: No bootstrap required, opened a new log
20:03:08.948 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:08.947175 29175 raft_consensus.cc:359] T 00000000000000000000000000000000 P 4a353b7d29034c679576efebd7aa54d1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "535d2799517e4e0f8db40ce649706e2a" member_type: VOTER last_known_addr { host: "127.28.30.254" port: 41663 } } peers { permanent_uuid: "2d3a79606fbe42948b90b2bfb77a85fd" member_type: VOTER last_known_addr { host: "127.28.30.253" port: 38561 } } peers { permanent_uuid: "4a353b7d29034c679576efebd7aa54d1" member_type: VOTER last_known_addr { host: "127.28.30.252" port: 34405 } }
20:03:08.949 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:08.948721 29175 raft_consensus.cc:385] T 00000000000000000000000000000000 P 4a353b7d29034c679576efebd7aa54d1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
20:03:08.950 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:08.949055 29175 raft_consensus.cc:740] T 00000000000000000000000000000000 P 4a353b7d29034c679576efebd7aa54d1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a353b7d29034c679576efebd7aa54d1, State: Initialized, Role: FOLLOWER
20:03:08.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:08.951179 29175 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4a353b7d29034c679576efebd7aa54d1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "535d2799517e4e0f8db40ce649706e2a" member_type: VOTER last_known_addr { host: "127.28.30.254" port: 41663 } } peers { permanent_uuid: "2d3a79606fbe42948b90b2bfb77a85fd" member_type: VOTER last_known_addr { host: "127.28.30.253" port: 38561 } } peers { permanent_uuid: "4a353b7d29034c679576efebd7aa54d1" member_type: VOTER last_known_addr { host: "127.28.30.252" port: 34405 } }
20:03:08.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:08.954325 29193 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a353b7d29034c679576efebd7aa54d1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "535d2799517e4e0f8db40ce649706e2a" member_type: VOTER last_known_addr { host: "127.28.30.254" port: 41663 } } peers { permanent_uuid: "2d3a79606fbe42948b90b2bfb77a85fd" member_type: VOTER last_known_addr { host: "127.28.30.253" port: 38561 } } peers { permanent_uuid: "4a353b7d29034c679576efebd7aa54d1" member_type: VOTER last_known_addr { host: "127.28.30.252" port: 34405 } } }
20:03:08.955 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:08.955399 29193 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a353b7d29034c679576efebd7aa54d1 [sys.catalog]: This master's current role is: FOLLOWER
20:03:08.956 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:08.955687 29175 sys_catalog.cc:565] T 00000000000000000000000000000000 P 4a353b7d29034c679576efebd7aa54d1 [sys.catalog]: configured and running, proceeding with master startup.
20:03:08.989 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:08.988792 29209 catalog_manager.cc:1594] T 00000000000000000000000000000000 P 4a353b7d29034c679576efebd7aa54d1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
20:03:08.990 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:08.989804 29209 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
20:03:08.996 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:08.995848 29110 tablet.cc:2406] T 00000000000000000000000000000000 P 4a353b7d29034c679576efebd7aa54d1: Can't schedule compaction. Clean time has not been advanced past its initial value.
20:03:09.016 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:08.984104 29055 master_runner.cc:187] Error getting master registration for 127.28.30.254:41663: OK, instance_id { permanent_uuid: "535d2799517e4e0f8db40ce649706e2a" instance_seqno: 1786478584923202 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
20:03:09.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.016543 29055 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
20:03:09.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.199131 29049 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.30.252" port: 34405 } attempt: 7
20:03:09.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.222612 29049 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2d3a79606fbe42948b90b2bfb77a85fd: Bootstrap starting.
20:03:09.230 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.230461 29049 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2d3a79606fbe42948b90b2bfb77a85fd: Neither blocks nor log segments found. Creating new log.
20:03:09.234 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.234097 29049 log.cc:826] T 00000000000000000000000000000000 P 2d3a79606fbe42948b90b2bfb77a85fd: Log is configured to *not* fsync() on all Append() calls
20:03:09.240 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.239645 29049 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2d3a79606fbe42948b90b2bfb77a85fd: No bootstrap required, opened a new log
20:03:09.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.268431 29049 raft_consensus.cc:359] T 00000000000000000000000000000000 P 2d3a79606fbe42948b90b2bfb77a85fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "535d2799517e4e0f8db40ce649706e2a" member_type: VOTER last_known_addr { host: "127.28.30.254" port: 41663 } } peers { permanent_uuid: "2d3a79606fbe42948b90b2bfb77a85fd" member_type: VOTER last_known_addr { host: "127.28.30.253" port: 38561 } } peers { permanent_uuid: "4a353b7d29034c679576efebd7aa54d1" member_type: VOTER last_known_addr { host: "127.28.30.252" port: 34405 } }
20:03:09.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.269387 29049 raft_consensus.cc:385] T 00000000000000000000000000000000 P 2d3a79606fbe42948b90b2bfb77a85fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
20:03:09.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.269694 29049 raft_consensus.cc:740] T 00000000000000000000000000000000 P 2d3a79606fbe42948b90b2bfb77a85fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2d3a79606fbe42948b90b2bfb77a85fd, State: Initialized, Role: FOLLOWER
20:03:09.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.270740 29049 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2d3a79606fbe42948b90b2bfb77a85fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "535d2799517e4e0f8db40ce649706e2a" member_type: VOTER last_known_addr { host: "127.28.30.254" port: 41663 } } peers { permanent_uuid: "2d3a79606fbe42948b90b2bfb77a85fd" member_type: VOTER last_known_addr { host: "127.28.30.253" port: 38561 } } peers { permanent_uuid: "4a353b7d29034c679576efebd7aa54d1" member_type: VOTER last_known_addr { host: "127.28.30.252" port: 34405 } }
20:03:09.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.273392 29215 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d3a79606fbe42948b90b2bfb77a85fd [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "535d2799517e4e0f8db40ce649706e2a" member_type: VOTER last_known_addr { host: "127.28.30.254" port: 41663 } } peers { permanent_uuid: "2d3a79606fbe42948b90b2bfb77a85fd" member_type: VOTER last_known_addr { host: "127.28.30.253" port: 38561 } } peers { permanent_uuid: "4a353b7d29034c679576efebd7aa54d1" member_type: VOTER last_known_addr { host: "127.28.30.252" port: 34405 } } }
20:03:09.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.274040 29215 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d3a79606fbe42948b90b2bfb77a85fd [sys.catalog]: This master's current role is: FOLLOWER
20:03:09.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.275460 29049 sys_catalog.cc:565] T 00000000000000000000000000000000 P 2d3a79606fbe42948b90b2bfb77a85fd [sys.catalog]: configured and running, proceeding with master startup.
20:03:09.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.279448 29193 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4a353b7d29034c679576efebd7aa54d1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
20:03:09.280 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.280054 29193 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4a353b7d29034c679576efebd7aa54d1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "535d2799517e4e0f8db40ce649706e2a" member_type: VOTER last_known_addr { host: "127.28.30.254" port: 41663 } } peers { permanent_uuid: "2d3a79606fbe42948b90b2bfb77a85fd" member_type: VOTER last_known_addr { host: "127.28.30.253" port: 38561 } } peers { permanent_uuid: "4a353b7d29034c679576efebd7aa54d1" member_type: VOTER last_known_addr { host: "127.28.30.252" port: 34405 } }
20:03:09.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.286439 29000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4a353b7d29034c679576efebd7aa54d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d3a79606fbe42948b90b2bfb77a85fd" is_pre_election: true
20:03:09.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.287446 29000 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 2d3a79606fbe42948b90b2bfb77a85fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4a353b7d29034c679576efebd7aa54d1 in term 0.
20:03:09.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.287861 29193 leader_election.cc:290] T 00000000000000000000000000000000 P 4a353b7d29034c679576efebd7aa54d1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 535d2799517e4e0f8db40ce649706e2a (127.28.30.254:41663), 2d3a79606fbe42948b90b2bfb77a85fd (127.28.30.253:38561)
20:03:09.290 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.289225 29102 leader_election.cc:304] T 00000000000000000000000000000000 P 4a353b7d29034c679576efebd7aa54d1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d3a79606fbe42948b90b2bfb77a85fd, 4a353b7d29034c679576efebd7aa54d1; no voters: 
20:03:09.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.290267 29193 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 4a353b7d29034c679576efebd7aa54d1 [term 0 FOLLOWER]: Leader pre-election won for term 1
20:03:09.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.291711 29193 raft_consensus.cc:493] T 00000000000000000000000000000000 P 4a353b7d29034c679576efebd7aa54d1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
20:03:09.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.292095 29193 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 4a353b7d29034c679576efebd7aa54d1 [term 0 FOLLOWER]: Advancing to term 1
20:03:09.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.299824 29193 raft_consensus.cc:515] T 00000000000000000000000000000000 P 4a353b7d29034c679576efebd7aa54d1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "535d2799517e4e0f8db40ce649706e2a" member_type: VOTER last_known_addr { host: "127.28.30.254" port: 41663 } } peers { permanent_uuid: "2d3a79606fbe42948b90b2bfb77a85fd" member_type: VOTER last_known_addr { host: "127.28.30.253" port: 38561 } } peers { permanent_uuid: "4a353b7d29034c679576efebd7aa54d1" member_type: VOTER last_known_addr { host: "127.28.30.252" port: 34405 } }
20:03:09.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.304328 29193 leader_election.cc:290] T 00000000000000000000000000000000 P 4a353b7d29034c679576efebd7aa54d1 [CANDIDATE]: Term 1 election: Requested vote from peers 535d2799517e4e0f8db40ce649706e2a (127.28.30.254:41663), 2d3a79606fbe42948b90b2bfb77a85fd (127.28.30.253:38561)
20:03:09.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.304792 29000 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4a353b7d29034c679576efebd7aa54d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2d3a79606fbe42948b90b2bfb77a85fd"
20:03:09.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.305393 29000 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 2d3a79606fbe42948b90b2bfb77a85fd [term 0 FOLLOWER]: Advancing to term 1
20:03:09.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.314484 29000 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 2d3a79606fbe42948b90b2bfb77a85fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a353b7d29034c679576efebd7aa54d1 in term 1.
20:03:09.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.317555 29102 leader_election.cc:304] T 00000000000000000000000000000000 P 4a353b7d29034c679576efebd7aa54d1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2d3a79606fbe42948b90b2bfb77a85fd, 4a353b7d29034c679576efebd7aa54d1; no voters: 
20:03:09.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.318687 29193 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 4a353b7d29034c679576efebd7aa54d1 [term 1 FOLLOWER]: Leader election won for term 1
20:03:09.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.326835 29193 raft_consensus.cc:697] T 00000000000000000000000000000000 P 4a353b7d29034c679576efebd7aa54d1 [term 1 LEADER]: Becoming Leader. State: Replica: 4a353b7d29034c679576efebd7aa54d1, State: Running, Role: LEADER
20:03:09.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.328176 29233 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
20:03:09.329 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.327934 29193 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4a353b7d29034c679576efebd7aa54d1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "535d2799517e4e0f8db40ce649706e2a" member_type: VOTER last_known_addr { host: "127.28.30.254" port: 41663 } } peers { permanent_uuid: "2d3a79606fbe42948b90b2bfb77a85fd" member_type: VOTER last_known_addr { host: "127.28.30.253" port: 38561 } } peers { permanent_uuid: "4a353b7d29034c679576efebd7aa54d1" member_type: VOTER last_known_addr { host: "127.28.30.252" port: 34405 } }
20:03:09.341 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.340559 29231 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a353b7d29034c679576efebd7aa54d1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4a353b7d29034c679576efebd7aa54d1. Latest consensus state: current_term: 1 leader_uuid: "4a353b7d29034c679576efebd7aa54d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "535d2799517e4e0f8db40ce649706e2a" member_type: VOTER last_known_addr { host: "127.28.30.254" port: 41663 } } peers { permanent_uuid: "2d3a79606fbe42948b90b2bfb77a85fd" member_type: VOTER last_known_addr { host: "127.28.30.253" port: 38561 } } peers { permanent_uuid: "4a353b7d29034c679576efebd7aa54d1" member_type: VOTER last_known_addr { host: "127.28.30.252" port: 34405 } } }
20:03:09.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.341404 29231 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a353b7d29034c679576efebd7aa54d1 [sys.catalog]: This master's current role is: LEADER
20:03:09.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.358752 29237 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
20:03:09.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.367551 29237 catalog_manager.cc:1520] Initializing Kudu cluster ID...
20:03:09.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.337451 28921 master_runner.cc:187] Error getting master registration for 127.28.30.254:41663: OK, instance_id { permanent_uuid: "535d2799517e4e0f8db40ce649706e2a" instance_seqno: 1786478584923202 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
20:03:09.369 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.369524 28921 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
20:03:09.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.383909 29000 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 2d3a79606fbe42948b90b2bfb77a85fd [term 1 FOLLOWER]: Refusing update from remote peer 4a353b7d29034c679576efebd7aa54d1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
20:03:09.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.386004 29231 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 4a353b7d29034c679576efebd7aa54d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2d3a79606fbe42948b90b2bfb77a85fd" member_type: VOTER last_known_addr { host: "127.28.30.253" port: 38561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
20:03:09.409 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.407734 29215 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d3a79606fbe42948b90b2bfb77a85fd [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4a353b7d29034c679576efebd7aa54d1. Latest consensus state: current_term: 1 leader_uuid: "4a353b7d29034c679576efebd7aa54d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "535d2799517e4e0f8db40ce649706e2a" member_type: VOTER last_known_addr { host: "127.28.30.254" port: 41663 } } peers { permanent_uuid: "2d3a79606fbe42948b90b2bfb77a85fd" member_type: VOTER last_known_addr { host: "127.28.30.253" port: 38561 } } peers { permanent_uuid: "4a353b7d29034c679576efebd7aa54d1" member_type: VOTER last_known_addr { host: "127.28.30.252" port: 34405 } } }
20:03:09.410 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.409688 29215 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d3a79606fbe42948b90b2bfb77a85fd [sys.catalog]: This master's current role is: FOLLOWER
20:03:09.416 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.415141 29231 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a353b7d29034c679576efebd7aa54d1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4a353b7d29034c679576efebd7aa54d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "535d2799517e4e0f8db40ce649706e2a" member_type: VOTER last_known_addr { host: "127.28.30.254" port: 41663 } } peers { permanent_uuid: "2d3a79606fbe42948b90b2bfb77a85fd" member_type: VOTER last_known_addr { host: "127.28.30.253" port: 38561 } } peers { permanent_uuid: "4a353b7d29034c679576efebd7aa54d1" member_type: VOTER last_known_addr { host: "127.28.30.252" port: 34405 } } }
20:03:09.417 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.415891 29231 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a353b7d29034c679576efebd7aa54d1 [sys.catalog]: This master's current role is: LEADER
20:03:09.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.420337 29237 catalog_manager.cc:1383] Generated new cluster ID: aa2347f3b62249f48da99b7be667511f
20:03:09.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.420612 29237 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
20:03:09.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.444790 29215 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2d3a79606fbe42948b90b2bfb77a85fd [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4a353b7d29034c679576efebd7aa54d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "535d2799517e4e0f8db40ce649706e2a" member_type: VOTER last_known_addr { host: "127.28.30.254" port: 41663 } } peers { permanent_uuid: "2d3a79606fbe42948b90b2bfb77a85fd" member_type: VOTER last_known_addr { host: "127.28.30.253" port: 38561 } } peers { permanent_uuid: "4a353b7d29034c679576efebd7aa54d1" member_type: VOTER last_known_addr { host: "127.28.30.252" port: 34405 } } }
20:03:09.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.445621 29215 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2d3a79606fbe42948b90b2bfb77a85fd [sys.catalog]: This master's current role is: FOLLOWER
20:03:09.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.468312 29237 catalog_manager.cc:1406] Generated new certificate authority record
20:03:09.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.470233 29237 catalog_manager.cc:1540] Loading token signing keys...
20:03:09.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.500680 29237 catalog_manager.cc:6092] T 00000000000000000000000000000000 P 4a353b7d29034c679576efebd7aa54d1: Generated new TSK 0
20:03:09.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.501868 29237 catalog_manager.cc:1550] Initializing in-progress tserver states...
20:03:09.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.524667 28795 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskxrU2r1/build/tsan/bin/kudu
20:03:09.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskxrU2r1/build/tsan/bin/kudu
20:03:09.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/ts-0/wal
20:03:09.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/ts-0/data
20:03:09.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
20:03:09.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
20:03:09.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
20:03:09.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:03:09.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:03:09.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:03:09.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/ts-0/logs
20:03:09.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/ts-0/data/info.pb
20:03:09.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:03:09.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
20:03:09.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
20:03:09.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
20:03:09.526 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
20:03:09.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:03:09.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:03:09.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:03:09.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
20:03:09.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
20:03:09.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.28.30.193:0
20:03:09.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.28.30.193
20:03:09.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.28.30.193
20:03:09.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:03:09.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.28.30.254:41663,127.28.30.253:38561,127.28.30.252:34405
20:03:09.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.28.30.212:45195
20:03:09.527 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:03:09.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:03:09.528 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
20:03:09.620 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.619371 28919 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.28.30.252" port: 34405 } attempt: 7
20:03:09.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.655042 28919 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 535d2799517e4e0f8db40ce649706e2a: Bootstrap starting.
20:03:09.663 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.663144 28919 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 535d2799517e4e0f8db40ce649706e2a: Neither blocks nor log segments found. Creating new log.
20:03:09.666 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.665817 28919 log.cc:826] T 00000000000000000000000000000000 P 535d2799517e4e0f8db40ce649706e2a: Log is configured to *not* fsync() on all Append() calls
20:03:09.678 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.678320 28919 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 535d2799517e4e0f8db40ce649706e2a: No bootstrap required, opened a new log
20:03:09.769 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.766029 28919 raft_consensus.cc:359] T 00000000000000000000000000000000 P 535d2799517e4e0f8db40ce649706e2a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "535d2799517e4e0f8db40ce649706e2a" member_type: VOTER last_known_addr { host: "127.28.30.254" port: 41663 } } peers { permanent_uuid: "2d3a79606fbe42948b90b2bfb77a85fd" member_type: VOTER last_known_addr { host: "127.28.30.253" port: 38561 } } peers { permanent_uuid: "4a353b7d29034c679576efebd7aa54d1" member_type: VOTER last_known_addr { host: "127.28.30.252" port: 34405 } }
20:03:09.772 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.770716 28919 raft_consensus.cc:385] T 00000000000000000000000000000000 P 535d2799517e4e0f8db40ce649706e2a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
20:03:09.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.772228 28919 raft_consensus.cc:740] T 00000000000000000000000000000000 P 535d2799517e4e0f8db40ce649706e2a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 535d2799517e4e0f8db40ce649706e2a, State: Initialized, Role: FOLLOWER
20:03:09.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.777436 28919 consensus_queue.cc:260] T 00000000000000000000000000000000 P 535d2799517e4e0f8db40ce649706e2a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "535d2799517e4e0f8db40ce649706e2a" member_type: VOTER last_known_addr { host: "127.28.30.254" port: 41663 } } peers { permanent_uuid: "2d3a79606fbe42948b90b2bfb77a85fd" member_type: VOTER last_known_addr { host: "127.28.30.253" port: 38561 } } peers { permanent_uuid: "4a353b7d29034c679576efebd7aa54d1" member_type: VOTER last_known_addr { host: "127.28.30.252" port: 34405 } }
20:03:09.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.782997 29251 sys_catalog.cc:455] T 00000000000000000000000000000000 P 535d2799517e4e0f8db40ce649706e2a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "535d2799517e4e0f8db40ce649706e2a" member_type: VOTER last_known_addr { host: "127.28.30.254" port: 41663 } } peers { permanent_uuid: "2d3a79606fbe42948b90b2bfb77a85fd" member_type: VOTER last_known_addr { host: "127.28.30.253" port: 38561 } } peers { permanent_uuid: "4a353b7d29034c679576efebd7aa54d1" member_type: VOTER last_known_addr { host: "127.28.30.252" port: 34405 } } }
20:03:09.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.784099 29251 sys_catalog.cc:458] T 00000000000000000000000000000000 P 535d2799517e4e0f8db40ce649706e2a [sys.catalog]: This master's current role is: FOLLOWER
20:03:09.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.786813 28919 sys_catalog.cc:565] T 00000000000000000000000000000000 P 535d2799517e4e0f8db40ce649706e2a [sys.catalog]: configured and running, proceeding with master startup.
20:03:09.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.787101 28883 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4a353b7d29034c679576efebd7aa54d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "535d2799517e4e0f8db40ce649706e2a"
20:03:09.790 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.788014 28883 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 535d2799517e4e0f8db40ce649706e2a [term 0 FOLLOWER]: Advancing to term 1
20:03:09.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.791079 28884 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "4a353b7d29034c679576efebd7aa54d1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "535d2799517e4e0f8db40ce649706e2a" is_pre_election: true
20:03:09.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.800518 28883 raft_consensus.cc:2468] T 00000000000000000000000000000000 P 535d2799517e4e0f8db40ce649706e2a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4a353b7d29034c679576efebd7aa54d1 in term 1.
20:03:09.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.802556 28881 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 535d2799517e4e0f8db40ce649706e2a [term 1 FOLLOWER]: Refusing update from remote peer 4a353b7d29034c679576efebd7aa54d1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
20:03:09.813 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.811436 29193 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 4a353b7d29034c679576efebd7aa54d1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "535d2799517e4e0f8db40ce649706e2a" member_type: VOTER last_known_addr { host: "127.28.30.254" port: 41663 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
20:03:09.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.901928 29251 sys_catalog.cc:455] T 00000000000000000000000000000000 P 535d2799517e4e0f8db40ce649706e2a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4a353b7d29034c679576efebd7aa54d1. Latest consensus state: current_term: 1 leader_uuid: "4a353b7d29034c679576efebd7aa54d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "535d2799517e4e0f8db40ce649706e2a" member_type: VOTER last_known_addr { host: "127.28.30.254" port: 41663 } } peers { permanent_uuid: "2d3a79606fbe42948b90b2bfb77a85fd" member_type: VOTER last_known_addr { host: "127.28.30.253" port: 38561 } } peers { permanent_uuid: "4a353b7d29034c679576efebd7aa54d1" member_type: VOTER last_known_addr { host: "127.28.30.252" port: 34405 } } }
20:03:09.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.902779 29251 sys_catalog.cc:458] T 00000000000000000000000000000000 P 535d2799517e4e0f8db40ce649706e2a [sys.catalog]: This master's current role is: FOLLOWER
20:03:09.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.927208 29259 sys_catalog.cc:455] T 00000000000000000000000000000000 P 535d2799517e4e0f8db40ce649706e2a [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "4a353b7d29034c679576efebd7aa54d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "535d2799517e4e0f8db40ce649706e2a" member_type: VOTER last_known_addr { host: "127.28.30.254" port: 41663 } } peers { permanent_uuid: "2d3a79606fbe42948b90b2bfb77a85fd" member_type: VOTER last_known_addr { host: "127.28.30.253" port: 38561 } } peers { permanent_uuid: "4a353b7d29034c679576efebd7aa54d1" member_type: VOTER last_known_addr { host: "127.28.30.252" port: 34405 } } }
20:03:09.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:09.928619 29259 sys_catalog.cc:458] T 00000000000000000000000000000000 P 535d2799517e4e0f8db40ce649706e2a [sys.catalog]: This master's current role is: FOLLOWER
20:03:10.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:10.011165 29280 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
20:03:10.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:10.124923 29248 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
20:03:10.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:10.125432 29248 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
20:03:10.126 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:10.125850 29248 flags.cc:432] Enabled unsafe flag: --never_fsync=true
20:03:10.160 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:10.159952 29248 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
20:03:10.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:10.160775 29248 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.30.193
20:03:10.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:10.199299 29248 tablet_server_runner.cc:78] Tablet server non-default flags:
20:03:10.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/ts-0/logs
20:03:10.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:03:10.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
20:03:10.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:03:10.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.28.30.212:45195
20:03:10.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:03:10.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:03:10.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/ts-0/data
20:03:10.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/ts-0/wal
20:03:10.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:03:10.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:03:10.200 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.28.30.193:0
20:03:10.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
20:03:10.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:03:10.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:03:10.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/ts-0/data/info.pb
20:03:10.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.28.30.193
20:03:10.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:03:10.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.28.30.254:41663,127.28.30.253:38561,127.28.30.252:34405
20:03:10.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
20:03:10.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:03:10.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
20:03:10.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
20:03:10.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:03:10.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.28.30.193
20:03:10.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
20:03:10.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
20:03:10.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
20:03:10.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 12dab910780628d7c8d59e0ab03bf2fa661d310d
20:03:10.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
20:03:10.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 11 Aug 2026 19:45:48 UTC on e7f111948823
20:03:10.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 13295
20:03:10.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
20:03:10.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:10.200865 29248 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
20:03:10.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:10.202894 29248 file_cache.cc:504] Constructed file cache file cache with capacity 419430
20:03:10.219 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:10.217597 29288 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:03:10.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:10.264147 29193 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4a353b7d29034c679576efebd7aa54d1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "4a353b7d29034c679576efebd7aa54d1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "535d2799517e4e0f8db40ce649706e2a" member_type: VOTER last_known_addr { host: "127.28.30.254" port: 41663 } } peers { permanent_uuid: "2d3a79606fbe42948b90b2bfb77a85fd" member_type: VOTER last_known_addr { host: "127.28.30.253" port: 38561 } } peers { permanent_uuid: "4a353b7d29034c679576efebd7aa54d1" member_type: VOTER last_known_addr { host: "127.28.30.252" port: 34405 } } }
20:03:10.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:10.266626 29193 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4a353b7d29034c679576efebd7aa54d1 [sys.catalog]: This master's current role is: LEADER
20:03:10.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:10.356217 29233 catalog_manager.cc:1295] Loaded cluster ID: aa2347f3b62249f48da99b7be667511f
20:03:10.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:10.357357 29233 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 2d3a79606fbe42948b90b2bfb77a85fd: loading cluster ID for follower catalog manager: success
20:03:10.385 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:10.384696 29233 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 2d3a79606fbe42948b90b2bfb77a85fd: acquiring CA information for follower catalog manager: success
20:03:10.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:10.414698 29233 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 2d3a79606fbe42948b90b2bfb77a85fd: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
20:03:11.039 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:11.039105 29280 catalog_manager.cc:1295] Loaded cluster ID: aa2347f3b62249f48da99b7be667511f
20:03:11.040 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:11.039419 29280 catalog_manager.cc:1588] T 00000000000000000000000000000000 P 535d2799517e4e0f8db40ce649706e2a: loading cluster ID for follower catalog manager: success
20:03:11.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:11.061621 29280 catalog_manager.cc:1610] T 00000000000000000000000000000000 P 535d2799517e4e0f8db40ce649706e2a: acquiring CA information for follower catalog manager: success
20:03:11.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:11.090348 29280 catalog_manager.cc:1638] T 00000000000000000000000000000000 P 535d2799517e4e0f8db40ce649706e2a: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
20:03:12.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:10.223996 29290 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:03:12.644 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:11.619323 29287 debug-util.cc:398] Leaking SignalData structure 0x7b080002ede0 after lost signal to thread 29248
20:03:12.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:12.643513 29248 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 2.425s	user 0.377s	sys 0.746s
20:03:12.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:12.644976 29248 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 2.427s	user 0.378s	sys 0.746s
20:03:12.645 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:12.645087 29296 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 2423 milliseconds
20:03:12.647 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:12.646823 29301 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:03:12.648 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:12.647743 29248 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
20:03:12.659 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:12.658823 29248 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
20:03:12.664 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:12.664141 29248 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
20:03:12.667 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:12.666528 29248 hybrid_clock.cc:648] HybridClock initialized: now 1786478592666478 us; error 66 us; skew 500 ppm
20:03:12.668 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:12.668248 29248 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
20:03:12.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:12.688956 29248 webserver.cc:533] Webserver started at http://127.28.30.193:38407/ using document root <none> and password file <none>
20:03:12.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:12.691133 29248 fs_manager.cc:362] Metadata directory not provided
20:03:12.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:12.691835 29248 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
20:03:12.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:12.692775 29248 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
20:03:12.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:12.703775 29248 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/ts-0/data/instance:
20:03:12.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "7362c8c4b1c3426e8b9a40f4bdb55b4a"
20:03:12.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-11 20:03:12 on dist-test-slave-tk9z"
20:03:12.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:12.706264 29248 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/ts-0/wal/instance:
20:03:12.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "7362c8c4b1c3426e8b9a40f4bdb55b4a"
20:03:12.706 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-11 20:03:12 on dist-test-slave-tk9z"
20:03:12.725 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:12.725524 29248 fs_manager.cc:696] Time spent creating directory manager: real 0.018s	user 0.009s	sys 0.006s
20:03:12.740 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:12.740481 29320 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
20:03:12.742 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:12.742619 29248 fs_manager.cc:730] Time spent opening block manager: real 0.011s	user 0.005s	sys 0.004s
20:03:12.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:12.743384 29248 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/ts-0/data,/tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/ts-0/wal
20:03:12.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "7362c8c4b1c3426e8b9a40f4bdb55b4a"
20:03:12.744 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-11 20:03:12 on dist-test-slave-tk9z"
20:03:12.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:12.744268 29248 fs_report.cc:389] FS layout report
20:03:12.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
20:03:12.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/ts-0/wal
20:03:12.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/ts-0/wal
20:03:12.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/ts-0/data/data
20:03:12.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
20:03:12.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
20:03:12.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
20:03:12.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
20:03:12.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
20:03:12.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
20:03:12.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
20:03:12.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
20:03:12.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
20:03:12.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
20:03:12.746 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
20:03:12.828 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:12.828157 29248 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
20:03:12.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:12.830859 29248 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
20:03:12.832 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:12.831909 29248 kserver.cc:163] Server-wide thread pool size limit: 3276
20:03:12.842 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:12.841701 29248 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
20:03:12.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:12.859391 29248 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
20:03:12.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:12.860215 29248 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s	user 0.001s	sys 0.001s
20:03:12.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:12.860863 29248 ts_tablet_manager.cc:616] Registered 0 tablets
20:03:12.861 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:12.861654 29248 ts_tablet_manager.cc:595] Time spent register tablets: real 0.001s	user 0.000s	sys 0.000s
20:03:13.168 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:13.168133 29248 rpc_server.cc:307] RPC server started. Bound to: 127.28.30.193:43607
20:03:13.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:13.168251 29486 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.30.193:43607 every 8 connection(s)
20:03:13.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:13.172601 29248 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/ts-0/data/info.pb
20:03:13.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:13.176497 28795 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskxrU2r1/build/tsan/bin/kudu as pid 29248
20:03:13.178 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:13.177254 28795 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/ts-0/wal/instance
20:03:13.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:13.189143 28795 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskxrU2r1/build/tsan/bin/kudu
20:03:13.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskxrU2r1/build/tsan/bin/kudu
20:03:13.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/ts-1/wal
20:03:13.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/ts-1/data
20:03:13.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
20:03:13.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
20:03:13.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
20:03:13.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:03:13.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:03:13.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:03:13.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/ts-1/logs
20:03:13.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/ts-1/data/info.pb
20:03:13.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:03:13.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
20:03:13.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
20:03:13.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
20:03:13.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
20:03:13.190 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:03:13.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:03:13.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:03:13.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
20:03:13.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
20:03:13.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.28.30.194:0
20:03:13.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.28.30.194
20:03:13.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.28.30.194
20:03:13.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:03:13.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.28.30.254:41663,127.28.30.253:38561,127.28.30.252:34405
20:03:13.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.28.30.212:45195
20:03:13.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:03:13.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:03:13.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
20:03:13.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:13.295608 29495 heartbeater.cc:344] Connected to a master server at 127.28.30.254:41663
20:03:13.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:13.296155 29495 heartbeater.cc:461] Registering TS with master...
20:03:13.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:13.297623 29495 heartbeater.cc:507] Master 127.28.30.254:41663 requested a full tablet report, sending...
20:03:13.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:13.299342 29490 heartbeater.cc:344] Connected to a master server at 127.28.30.253:38561
20:03:13.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:13.299703 29490 heartbeater.cc:461] Registering TS with master...
20:03:13.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:13.300683 29490 heartbeater.cc:507] Master 127.28.30.253:38561 requested a full tablet report, sending...
20:03:13.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:13.301756 28870 ts_manager.cc:194] Registered new tserver with Master: 7362c8c4b1c3426e8b9a40f4bdb55b4a (127.28.30.193:43607)
20:03:13.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:13.305974 28987 ts_manager.cc:194] Registered new tserver with Master: 7362c8c4b1c3426e8b9a40f4bdb55b4a (127.28.30.193:43607)
20:03:13.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:13.309526 29488 heartbeater.cc:344] Connected to a master server at 127.28.30.252:34405
20:03:13.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:13.309917 29488 heartbeater.cc:461] Registering TS with master...
20:03:13.312 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:13.311173 29488 heartbeater.cc:507] Master 127.28.30.252:34405 requested a full tablet report, sending...
20:03:13.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:13.314563 29125 ts_manager.cc:194] Registered new tserver with Master: 7362c8c4b1c3426e8b9a40f4bdb55b4a (127.28.30.193:43607)
20:03:13.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:13.318511 29125 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.30.193:38805
20:03:13.704 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:13.704308 29494 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
20:03:13.705 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:13.705598 29494 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
20:03:13.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:13.706761 29494 flags.cc:432] Enabled unsafe flag: --never_fsync=true
20:03:13.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:13.774174 29494 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
20:03:13.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:13.776315 29494 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.30.194
20:03:13.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:13.851415 29494 tablet_server_runner.cc:78] Tablet server non-default flags:
20:03:13.852 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/ts-1/logs
20:03:13.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:03:13.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
20:03:13.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:03:13.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.28.30.212:45195
20:03:13.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:03:13.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:03:13.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/ts-1/data
20:03:13.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/ts-1/wal
20:03:13.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:03:13.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:03:13.853 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.28.30.194:0
20:03:13.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
20:03:13.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:03:13.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:03:13.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/ts-1/data/info.pb
20:03:13.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.28.30.194
20:03:13.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:03:13.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.28.30.254:41663,127.28.30.253:38561,127.28.30.252:34405
20:03:13.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
20:03:13.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:03:13.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
20:03:13.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
20:03:13.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:03:13.854 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.28.30.194
20:03:13.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
20:03:13.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
20:03:13.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
20:03:13.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 12dab910780628d7c8d59e0ab03bf2fa661d310d
20:03:13.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
20:03:13.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 11 Aug 2026 19:45:48 UTC on e7f111948823
20:03:13.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 13295
20:03:13.855 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
20:03:13.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:13.857187 29494 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
20:03:13.860 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:13.860219 29494 file_cache.cc:504] Constructed file cache file cache with capacity 419430
20:03:13.908 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:13.907658 29517 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:03:14.324 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:14.323298 29488 heartbeater.cc:499] Master 127.28.30.252:34405 was elected leader, sending a full tablet report...
20:03:15.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:13.913197 29518 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:03:15.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:15.291735 29494 thread.cc:641] GCE (cloud detector) Time spent creating pthread: real 1.380s	user 0.427s	sys 0.767s
20:03:15.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:15.292431 29494 thread.cc:608] GCE (cloud detector) Time spent starting thread: real 1.381s	user 0.427s	sys 0.767s
20:03:15.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:15.301334 29526 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:03:15.302 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:15.301882 29494 server_base.cc:1061] running on GCE node
20:03:15.303 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:15.303561 29494 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
20:03:15.306 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:15.305920 29494 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
20:03:15.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:15.307314 29494 hybrid_clock.cc:648] HybridClock initialized: now 1786478595307255 us; error 64 us; skew 500 ppm
20:03:15.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:15.308275 29494 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
20:03:15.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:15.318137 29494 webserver.cc:533] Webserver started at http://127.28.30.194:35559/ using document root <none> and password file <none>
20:03:15.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:15.319226 29494 fs_manager.cc:362] Metadata directory not provided
20:03:15.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:15.319490 29494 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
20:03:15.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:15.320052 29494 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
20:03:15.326 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:15.326287 29494 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/ts-1/data/instance:
20:03:15.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "cde67fc5bc2243c48fee169e57ed308f"
20:03:15.327 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-11 20:03:15 on dist-test-slave-tk9z"
20:03:15.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:15.327839 29494 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/ts-1/wal/instance:
20:03:15.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "cde67fc5bc2243c48fee169e57ed308f"
20:03:15.328 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-11 20:03:15 on dist-test-slave-tk9z"
20:03:15.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:15.337594 29494 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.010s	sys 0.000s
20:03:15.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:15.344044 29532 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
20:03:15.345 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:15.345525 29494 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.005s	sys 0.000s
20:03:15.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:15.345930 29494 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/ts-1/data,/tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/ts-1/wal
20:03:15.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "cde67fc5bc2243c48fee169e57ed308f"
20:03:15.346 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-11 20:03:15 on dist-test-slave-tk9z"
20:03:15.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:15.346436 29494 fs_report.cc:389] FS layout report
20:03:15.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
20:03:15.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/ts-1/wal
20:03:15.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/ts-1/wal
20:03:15.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/ts-1/data/data
20:03:15.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
20:03:15.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
20:03:15.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
20:03:15.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
20:03:15.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
20:03:15.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
20:03:15.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
20:03:15.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
20:03:15.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
20:03:15.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
20:03:15.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
20:03:15.454 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:15.453919 29494 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
20:03:15.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:15.456156 29494 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
20:03:15.457 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:15.456776 29494 kserver.cc:163] Server-wide thread pool size limit: 3276
20:03:15.462 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:15.462100 29494 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
20:03:15.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:15.468603 29494 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
20:03:15.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:15.468966 29494 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
20:03:15.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:15.469295 29494 ts_tablet_manager.cc:616] Registered 0 tablets
20:03:15.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:15.469539 29494 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
20:03:15.628 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:15.628392 29494 rpc_server.cc:307] RPC server started. Bound to: 127.28.30.194:41083
20:03:15.629 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:15.628569 29705 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.30.194:41083 every 8 connection(s)
20:03:15.631 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:15.631121 29494 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/ts-1/data/info.pb
20:03:15.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:15.632129 28795 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskxrU2r1/build/tsan/bin/kudu as pid 29494
20:03:15.632 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:15.632611 28795 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/ts-1/wal/instance
20:03:15.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:15.649459 28795 external_mini_cluster.cc:1372] Running /tmp/dist-test-taskxrU2r1/build/tsan/bin/kudu
20:03:15.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-taskxrU2r1/build/tsan/bin/kudu
20:03:15.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/ts-2/wal
20:03:15.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/ts-2/data
20:03:15.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
20:03:15.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
20:03:15.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
20:03:15.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:03:15.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:03:15.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:03:15.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/ts-2/logs
20:03:15.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/ts-2/data/info.pb
20:03:15.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:03:15.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
20:03:15.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
20:03:15.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
20:03:15.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
20:03:15.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:03:15.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:03:15.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:03:15.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
20:03:15.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
20:03:15.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.28.30.195:0
20:03:15.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.28.30.195
20:03:15.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.28.30.195
20:03:15.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:03:15.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.28.30.254:41663,127.28.30.253:38561,127.28.30.252:34405
20:03:15.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.28.30.212:45195
20:03:15.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:03:15.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:03:15.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
20:03:15.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:15.688048 29707 heartbeater.cc:344] Connected to a master server at 127.28.30.252:34405
20:03:15.689 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:15.688769 29707 heartbeater.cc:461] Registering TS with master...
20:03:15.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:15.690614 29707 heartbeater.cc:507] Master 127.28.30.252:34405 requested a full tablet report, sending...
20:03:15.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:15.691757 29710 heartbeater.cc:344] Connected to a master server at 127.28.30.253:38561
20:03:15.692 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:15.692301 29710 heartbeater.cc:461] Registering TS with master...
20:03:15.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:15.693295 29710 heartbeater.cc:507] Master 127.28.30.253:38561 requested a full tablet report, sending...
20:03:15.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:15.693849 29125 ts_manager.cc:194] Registered new tserver with Master: cde67fc5bc2243c48fee169e57ed308f (127.28.30.194:41083)
20:03:15.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:15.694660 29712 heartbeater.cc:344] Connected to a master server at 127.28.30.254:41663
20:03:15.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:15.695016 29712 heartbeater.cc:461] Registering TS with master...
20:03:15.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:15.695673 29125 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.30.194:57103
20:03:15.696 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:15.696075 29712 heartbeater.cc:507] Master 127.28.30.254:41663 requested a full tablet report, sending...
20:03:15.698 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:15.697881 28987 ts_manager.cc:194] Registered new tserver with Master: cde67fc5bc2243c48fee169e57ed308f (127.28.30.194:41083)
20:03:15.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:15.700459 28870 ts_manager.cc:194] Registered new tserver with Master: cde67fc5bc2243c48fee169e57ed308f (127.28.30.194:41083)
20:03:16.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:16.037356 29721 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
20:03:16.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:16.037863 29721 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
20:03:16.038 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:16.038285 29721 flags.cc:432] Enabled unsafe flag: --never_fsync=true
20:03:16.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:16.072252 29721 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
20:03:16.073 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:16.073056 29721 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.28.30.195
20:03:16.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:16.110688 29721 tablet_server_runner.cc:78] Tablet server non-default flags:
20:03:16.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/ts-2/logs
20:03:16.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
20:03:16.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
20:03:16.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
20:03:16.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.28.30.212:45195
20:03:16.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
20:03:16.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
20:03:16.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/ts-2/data
20:03:16.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/ts-2/wal
20:03:16.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
20:03:16.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
20:03:16.111 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.28.30.195:0
20:03:16.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
20:03:16.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
20:03:16.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
20:03:16.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/ts-2/data/info.pb
20:03:16.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.28.30.195
20:03:16.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
20:03:16.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.28.30.254:41663,127.28.30.253:38561,127.28.30.252:34405
20:03:16.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
20:03:16.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
20:03:16.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
20:03:16.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
20:03:16.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
20:03:16.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.28.30.195
20:03:16.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
20:03:16.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
20:03:16.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
20:03:16.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 12dab910780628d7c8d59e0ab03bf2fa661d310d
20:03:16.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
20:03:16.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 11 Aug 2026 19:45:48 UTC on e7f111948823
20:03:16.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 13295
20:03:16.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
20:03:16.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:16.112295 29721 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
20:03:16.114 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:16.113914 29721 file_cache.cc:504] Constructed file cache file cache with capacity 419430
20:03:16.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:16.127957 29740 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:03:16.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:16.473320 29482 debug-util.cc:398] Leaking SignalData structure 0x7b08000ad580 after lost signal to thread 29281
20:03:16.475 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:16.474834 29482 debug-util.cc:398] Leaking SignalData structure 0x7b08000adba0 after lost signal to thread 29486
20:03:16.703 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:16.702546 29707 heartbeater.cc:499] Master 127.28.30.252:34405 was elected leader, sending a full tablet report...
20:03:17.818 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:16.129012 29742 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:03:17.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:17.550436 29739 debug-util.cc:398] Leaking SignalData structure 0x7b080002ede0 after lost signal to thread 29721
20:03:17.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:17.818655 29739 kernel_stack_watchdog.cc:198] Thread 29721 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 419ms:
20:03:17.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
20:03:17.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
20:03:17.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
20:03:17.819 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
20:03:17.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:17.830504 29745 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection timed out after 1701 milliseconds
20:03:17.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:17.831120 29721 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.703s	user 0.002s	sys 0.002s
20:03:17.831 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:17.831476 29721 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.703s	user 0.002s	sys 0.003s
20:03:17.833 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:17.833037 29721 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
20:03:17.834 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:17.833786 29746 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
20:03:17.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:17.835474 29721 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
20:03:17.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:17.845647 29721 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
20:03:17.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:17.847522 29721 hybrid_clock.cc:648] HybridClock initialized: now 1786478597847434 us; error 89 us; skew 500 ppm
20:03:17.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:17.848902 29721 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
20:03:17.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:17.866140 29721 webserver.cc:533] Webserver started at http://127.28.30.195:45349/ using document root <none> and password file <none>
20:03:17.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:17.867291 29721 fs_manager.cc:362] Metadata directory not provided
20:03:17.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:17.867560 29721 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
20:03:17.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:17.868213 29721 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
20:03:17.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:17.873476 29721 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/ts-2/data/instance:
20:03:17.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f15bbca409334646ac14c6848f2e02b8"
20:03:17.874 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-11 20:03:17 on dist-test-slave-tk9z"
20:03:17.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:17.875221 29721 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/ts-2/wal/instance:
20:03:17.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f15bbca409334646ac14c6848f2e02b8"
20:03:17.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-11 20:03:17 on dist-test-slave-tk9z"
20:03:17.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:17.887422 29721 fs_manager.cc:696] Time spent creating directory manager: real 0.011s	user 0.007s	sys 0.004s
20:03:17.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:17.894222 29762 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
20:03:17.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:17.895901 29721 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.002s	sys 0.001s
20:03:17.896 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:17.896368 29721 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/ts-2/data,/tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/ts-2/wal
20:03:17.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "f15bbca409334646ac14c6848f2e02b8"
20:03:17.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-08-11 20:03:17 on dist-test-slave-tk9z"
20:03:17.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:17.896857 29721 fs_report.cc:389] FS layout report
20:03:17.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
20:03:17.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/ts-2/wal
20:03:17.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/ts-2/wal
20:03:17.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/ts-2/data/data
20:03:17.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
20:03:17.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
20:03:17.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
20:03:17.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
20:03:17.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
20:03:17.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
20:03:17.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
20:03:17.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
20:03:17.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
20:03:17.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
20:03:17.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
20:03:17.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:17.964325 29721 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
20:03:17.966 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:17.966145 29721 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
20:03:17.967 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:17.966753 29721 kserver.cc:163] Server-wide thread pool size limit: 3276
20:03:17.971 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:17.970706 29721 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
20:03:17.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:17.976619 29721 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
20:03:17.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:17.977113 29721 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.001s	user 0.001s	sys 0.000s
20:03:17.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:17.977454 29721 ts_tablet_manager.cc:616] Registered 0 tablets
20:03:17.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:17.977684 29721 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
20:03:18.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:18.201990 29721 rpc_server.cc:307] RPC server started. Bound to: 127.28.30.195:41923
20:03:18.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:18.202548 29952 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.30.195:41923 every 8 connection(s)
20:03:18.205 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:18.205134 29721 server_base.cc:1193] Dumped server information to /tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/ts-2/data/info.pb
20:03:18.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:18.208635 28795 external_mini_cluster.cc:1434] Started /tmp/dist-test-taskxrU2r1/build/tsan/bin/kudu as pid 29721
20:03:18.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:18.209225 28795 external_mini_cluster.cc:1448] Reading /tmp/dist-test-taskxrU2r1/test-tmp/mini-kudu-cluster11349018100248817488/ts-2/wal/instance
20:03:18.294 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:18.294299 29954 heartbeater.cc:344] Connected to a master server at 127.28.30.252:34405
20:03:18.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:18.295082 29954 heartbeater.cc:461] Registering TS with master...
20:03:18.298 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:18.297255 29954 heartbeater.cc:507] Master 127.28.30.252:34405 requested a full tablet report, sending...
20:03:18.307 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:18.304562 29124 ts_manager.cc:194] Registered new tserver with Master: f15bbca409334646ac14c6848f2e02b8 (127.28.30.195:41923)
20:03:18.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:18.308322 29124 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.28.30.195:57173
20:03:18.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:18.322578 29963 heartbeater.cc:344] Connected to a master server at 127.28.30.254:41663
20:03:18.323 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:18.323293 29963 heartbeater.cc:461] Registering TS with master...
20:03:18.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:18.324725 29963 heartbeater.cc:507] Master 127.28.30.254:41663 requested a full tablet report, sending...
20:03:18.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:18.329694 28870 ts_manager.cc:194] Registered new tserver with Master: f15bbca409334646ac14c6848f2e02b8 (127.28.30.195:41923)
20:03:18.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:18.332496 29955 heartbeater.cc:344] Connected to a master server at 127.28.30.253:38561
20:03:18.333 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:18.333017 29955 heartbeater.cc:461] Registering TS with master...
20:03:18.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:18.333777 29955 heartbeater.cc:507] Master 127.28.30.253:38561 requested a full tablet report, sending...
20:03:18.340 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:18.338696 28987 ts_manager.cc:194] Registered new tserver with Master: f15bbca409334646ac14c6848f2e02b8 (127.28.30.195:41923)
20:03:18.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:18.349910 28795 external_mini_cluster.cc:955] 3 TS(s) registered with all masters
20:03:18.381 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
20:03:18.382 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

20:03:18.395 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.28.30.254"
      port: 41663
    }
    bound_http_address {
      host: "127.28.30.254"
      port: 37359
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.28.30.253"
      port: 38561
    }
    bound_http_address {
      host: "127.28.30.253"
      port: 42921
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.28.30.252"
      port: 34405
    }
    bound_http_address {
      host: "127.28.30.252"
      port: 33983
    }
  }
}

20:03:18.399 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

20:03:18.403 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.28.30.193"
      port: 43607
    }
    bound_http_address {
      host: "127.28.30.193"
      port: 38407
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.28.30.194"
      port: 41083
    }
    bound_http_address {
      host: "127.28.30.194"
      port: 35559
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.28.30.195"
      port: 41923
    }
    bound_http_address {
      host: "127.28.30.195"
      port: 45349
    }
  }
}

20:03:18.403 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
20:03:18.695 [DEBUG - main] (CompositeStrategy.java:59) Unable to load modern Subject methods, relying only on legacy methods
java.lang.NoSuchMethodException: javax.security.auth.Subject.current()
	at java.base/java.lang.Class.getDeclaredMethod(Class.java:2677)
	at org.apache.kudu.client.internals.ModernStrategy.<init>(ModernStrategy.java:51)
	at org.apache.kudu.client.internals.CompositeStrategy.<init>(CompositeStrategy.java:52)
	at org.apache.kudu.client.internals.CompositeStrategy.<clinit>(CompositeStrategy.java:41)
	at org.apache.kudu.client.internals.SecurityManagerCompatibility.get(SecurityManagerCompatibility.java:43)
	at org.apache.kudu.client.SecurityContext.setupSubject(SecurityContext.java:155)
	at org.apache.kudu.client.SecurityContext.<init>(SecurityContext.java:138)
	at org.apache.kudu.client.AsyncKuduClient.<init>(AsyncKuduClient.java:431)
	at org.apache.kudu.client.AsyncKuduClient$AsyncKuduClientBuilder.build(AsyncKuduClient.java:3109)
	at org.apache.kudu.test.KuduTestHarness.before(KuduTestHarness.java:161)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:50)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.doOneAttemptAndReport(RetryRule.java:184)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.evaluate(RetryRule.java:244)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runners.Suite.runChild(Suite.java:128)
	at org.junit.runners.Suite.runChild(Suite.java:27)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
	at org.junit.runner.JUnitCore.runMain(JUnitCore.java:77)
	at org.junit.runner.JUnitCore.main(JUnitCore.java:36)
20:03:18.778 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
20:03:19.000 [DEBUG - main] (Connection.java:748) [peer master-127.28.30.253:38561(127.28.30.253:38561)] connecting to peer
20:03:19.068 [DEBUG - main] (Connection.java:748) [peer master-127.28.30.254:41663(127.28.30.254:41663)] connecting to peer
20:03:19.070 [DEBUG - main] (Connection.java:748) [peer master-127.28.30.252:34405(127.28.30.252:34405)] connecting to peer
20:03:19.097 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.28.30.252:34405(127.28.30.252:34405)] Successfully connected to peer
20:03:19.098 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.28.30.254:41663(127.28.30.254:41663)] Successfully connected to peer
20:03:19.099 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.28.30.253:38561(127.28.30.253:38561)] Successfully connected to peer
20:03:19.213 [DEBUG - kudu-nio-1] (Negotiator.java:528) SASL mechanism PLAIN chosen for peer 127.28.30.254
20:03:19.216 [DEBUG - kudu-nio-2] (Negotiator.java:528) SASL mechanism PLAIN chosen for peer 127.28.30.252
20:03:19.217 [DEBUG - kudu-nio-0] (Negotiator.java:528) SASL mechanism PLAIN chosen for peer 127.28.30.253
20:03:19.315 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:19.314620 29954 heartbeater.cc:499] Master 127.28.30.252:34405 was elected leader, sending a full tablet report...
20:03:19.524 [DEBUG - kudu-nio-0] (Negotiator.java:918) Authenticated connection [id: 0xdbf4e17e, L:/127.0.0.1:60092 - R:/127.28.30.253:38561] using SASL/PLAIN
20:03:19.524 [DEBUG - kudu-nio-1] (Negotiator.java:918) Authenticated connection [id: 0xa7aabef4, L:/127.0.0.1:36046 - R:/127.28.30.254:41663] using SASL/PLAIN
20:03:19.527 [DEBUG - kudu-nio-2] (Negotiator.java:918) Authenticated connection [id: 0xb79cb7ba, L:/127.0.0.1:59544 - R:/127.28.30.252:34405] using SASL/PLAIN
20:03:19.569 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
20:03:19.570 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=621), Traces: [0ms] refreshing cache from master, [30ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.30.253:38561, [113ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.30.254:41663, [115ms] Sub RPC ConnectToMaster: sending RPC to server master-127.28.30.252:34405, [588ms] Sub RPC ConnectToMaster: received response from server master-127.28.30.253:38561: OK, [590ms] Sub RPC ConnectToMaster: received response from server master-127.28.30.252:34405: OK, [592ms] Sub RPC ConnectToMaster: received response from server master-127.28.30.254:41663: OK, deferred=null) after lookup
20:03:19.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:19.648365 29124 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59544:
20:03:19.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "org.apache.kudu.client.TestLeaderFailover-1786478581079"
20:03:19.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
20:03:19.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
20:03:19.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key"
20:03:19.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
20:03:19.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
20:03:19.650 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
20:03:19.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
20:03:19.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
20:03:19.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
20:03:19.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
20:03:19.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
20:03:19.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column1_i"
20:03:19.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
20:03:19.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
20:03:19.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
20:03:19.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
20:03:19.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
20:03:19.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
20:03:19.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
20:03:19.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
20:03:19.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column2_i"
20:03:19.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
20:03:19.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
20:03:19.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
20:03:19.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
20:03:19.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
20:03:19.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
20:03:19.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
20:03:19.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
20:03:19.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column3_s"
20:03:19.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
20:03:19.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
20:03:19.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: true
20:03:19.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: DICT_ENCODING
20:03:19.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: LZ4
20:03:19.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 4096
20:03:19.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
20:03:19.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
20:03:19.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
20:03:19.652 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
20:03:19.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column4_b"
20:03:19.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BOOL
20:03:19.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
20:03:19.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
20:03:19.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
20:03:19.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
20:03:19.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
20:03:19.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
20:03:19.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
20:03:19.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
20:03:19.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
20:03:19.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
20:03:19.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key"
20:03:19.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
20:03:19.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
20:03:19.653 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
20:03:19.658 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:19.658124 29124 catalog_manager.cc:7099] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table org.apache.kudu.client.TestLeaderFailover-1786478581079 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
20:03:19.788 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 91e29fb92d9c4afdb196970793e3995a
20:03:19.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:19.864657 29840 tablet_service.cc:1511] Processing CreateTablet for tablet 46436b4a5ac447e7ac81a334da9ece1f (DEFAULT_TABLE table=org.apache.kudu.client.TestLeaderFailover-1786478581079 [id=91e29fb92d9c4afdb196970793e3995a]), partition=RANGE (key) PARTITION UNBOUNDED
20:03:19.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:19.867561 29840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46436b4a5ac447e7ac81a334da9ece1f. 1 dirs total, 0 dirs full, 0 dirs failed
20:03:19.870 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:19.869277 29390 tablet_service.cc:1511] Processing CreateTablet for tablet 46436b4a5ac447e7ac81a334da9ece1f (DEFAULT_TABLE table=org.apache.kudu.client.TestLeaderFailover-1786478581079 [id=91e29fb92d9c4afdb196970793e3995a]), partition=RANGE (key) PARTITION UNBOUNDED
20:03:19.875 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:19.873940 29390 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46436b4a5ac447e7ac81a334da9ece1f. 1 dirs total, 0 dirs full, 0 dirs failed
20:03:19.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:19.904945 29613 tablet_service.cc:1511] Processing CreateTablet for tablet 46436b4a5ac447e7ac81a334da9ece1f (DEFAULT_TABLE table=org.apache.kudu.client.TestLeaderFailover-1786478581079 [id=91e29fb92d9c4afdb196970793e3995a]), partition=RANGE (key) PARTITION UNBOUNDED
20:03:19.909 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:19.908900 29613 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46436b4a5ac447e7ac81a334da9ece1f. 1 dirs total, 0 dirs full, 0 dirs failed
20:03:19.920 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:19.920354 30012 tablet_bootstrap.cc:492] T 46436b4a5ac447e7ac81a334da9ece1f P f15bbca409334646ac14c6848f2e02b8: Bootstrap starting.
20:03:19.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:19.934239 30012 tablet_bootstrap.cc:654] T 46436b4a5ac447e7ac81a334da9ece1f P f15bbca409334646ac14c6848f2e02b8: Neither blocks nor log segments found. Creating new log.
20:03:19.939 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:19.939297 30012 log.cc:826] T 46436b4a5ac447e7ac81a334da9ece1f P f15bbca409334646ac14c6848f2e02b8: Log is configured to *not* fsync() on all Append() calls
20:03:19.963 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:19.962215 30012 tablet_bootstrap.cc:492] T 46436b4a5ac447e7ac81a334da9ece1f P f15bbca409334646ac14c6848f2e02b8: No bootstrap required, opened a new log
20:03:19.964 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:19.963991 30012 ts_tablet_manager.cc:1403] T 46436b4a5ac447e7ac81a334da9ece1f P f15bbca409334646ac14c6848f2e02b8: Time spent bootstrapping tablet: real 0.044s	user 0.006s	sys 0.033s
20:03:19.998 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:19.998103 30015 tablet_bootstrap.cc:492] T 46436b4a5ac447e7ac81a334da9ece1f P 7362c8c4b1c3426e8b9a40f4bdb55b4a: Bootstrap starting.
20:03:20.012 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:20.011849 30017 tablet_bootstrap.cc:492] T 46436b4a5ac447e7ac81a334da9ece1f P cde67fc5bc2243c48fee169e57ed308f: Bootstrap starting.
20:03:20.017 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:20.016800 30015 tablet_bootstrap.cc:654] T 46436b4a5ac447e7ac81a334da9ece1f P 7362c8c4b1c3426e8b9a40f4bdb55b4a: Neither blocks nor log segments found. Creating new log.
20:03:20.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:20.019189 30012 raft_consensus.cc:359] T 46436b4a5ac447e7ac81a334da9ece1f P f15bbca409334646ac14c6848f2e02b8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7362c8c4b1c3426e8b9a40f4bdb55b4a" member_type: VOTER last_known_addr { host: "127.28.30.193" port: 43607 } } peers { permanent_uuid: "cde67fc5bc2243c48fee169e57ed308f" member_type: VOTER last_known_addr { host: "127.28.30.194" port: 41083 } } peers { permanent_uuid: "f15bbca409334646ac14c6848f2e02b8" member_type: VOTER last_known_addr { host: "127.28.30.195" port: 41923 } }
20:03:20.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:20.020156 30012 raft_consensus.cc:385] T 46436b4a5ac447e7ac81a334da9ece1f P f15bbca409334646ac14c6848f2e02b8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
20:03:20.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:20.020543 30012 raft_consensus.cc:740] T 46436b4a5ac447e7ac81a334da9ece1f P f15bbca409334646ac14c6848f2e02b8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f15bbca409334646ac14c6848f2e02b8, State: Initialized, Role: FOLLOWER
20:03:20.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:20.021222 30015 log.cc:826] T 46436b4a5ac447e7ac81a334da9ece1f P 7362c8c4b1c3426e8b9a40f4bdb55b4a: Log is configured to *not* fsync() on all Append() calls
20:03:20.022 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:20.022112 30017 tablet_bootstrap.cc:654] T 46436b4a5ac447e7ac81a334da9ece1f P cde67fc5bc2243c48fee169e57ed308f: Neither blocks nor log segments found. Creating new log.
20:03:20.029 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:20.029023 30017 log.cc:826] T 46436b4a5ac447e7ac81a334da9ece1f P cde67fc5bc2243c48fee169e57ed308f: Log is configured to *not* fsync() on all Append() calls
20:03:20.030 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:20.028951 30012 consensus_queue.cc:260] T 46436b4a5ac447e7ac81a334da9ece1f P f15bbca409334646ac14c6848f2e02b8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7362c8c4b1c3426e8b9a40f4bdb55b4a" member_type: VOTER last_known_addr { host: "127.28.30.193" port: 43607 } } peers { permanent_uuid: "cde67fc5bc2243c48fee169e57ed308f" member_type: VOTER last_known_addr { host: "127.28.30.194" port: 41083 } } peers { permanent_uuid: "f15bbca409334646ac14c6848f2e02b8" member_type: VOTER last_known_addr { host: "127.28.30.195" port: 41923 } }
20:03:20.041 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:20.040561 30012 ts_tablet_manager.cc:1434] T 46436b4a5ac447e7ac81a334da9ece1f P f15bbca409334646ac14c6848f2e02b8: Time spent starting tablet: real 0.076s	user 0.030s	sys 0.028s
20:03:20.043 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:20.042243 30015 tablet_bootstrap.cc:492] T 46436b4a5ac447e7ac81a334da9ece1f P 7362c8c4b1c3426e8b9a40f4bdb55b4a: No bootstrap required, opened a new log
20:03:20.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:20.043936 30015 ts_tablet_manager.cc:1403] T 46436b4a5ac447e7ac81a334da9ece1f P 7362c8c4b1c3426e8b9a40f4bdb55b4a: Time spent bootstrapping tablet: real 0.048s	user 0.008s	sys 0.032s
20:03:20.071 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:20.070669 30017 tablet_bootstrap.cc:492] T 46436b4a5ac447e7ac81a334da9ece1f P cde67fc5bc2243c48fee169e57ed308f: No bootstrap required, opened a new log
20:03:20.072 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:20.072100 30017 ts_tablet_manager.cc:1403] T 46436b4a5ac447e7ac81a334da9ece1f P cde67fc5bc2243c48fee169e57ed308f: Time spent bootstrapping tablet: real 0.062s	user 0.020s	sys 0.016s
20:03:20.107 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:20.105767 30015 raft_consensus.cc:359] T 46436b4a5ac447e7ac81a334da9ece1f P 7362c8c4b1c3426e8b9a40f4bdb55b4a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7362c8c4b1c3426e8b9a40f4bdb55b4a" member_type: VOTER last_known_addr { host: "127.28.30.193" port: 43607 } } peers { permanent_uuid: "cde67fc5bc2243c48fee169e57ed308f" member_type: VOTER last_known_addr { host: "127.28.30.194" port: 41083 } } peers { permanent_uuid: "f15bbca409334646ac14c6848f2e02b8" member_type: VOTER last_known_addr { host: "127.28.30.195" port: 41923 } }
20:03:20.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:20.107457 30015 raft_consensus.cc:385] T 46436b4a5ac447e7ac81a334da9ece1f P 7362c8c4b1c3426e8b9a40f4bdb55b4a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
20:03:20.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:20.108081 30015 raft_consensus.cc:740] T 46436b4a5ac447e7ac81a334da9ece1f P 7362c8c4b1c3426e8b9a40f4bdb55b4a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7362c8c4b1c3426e8b9a40f4bdb55b4a, State: Initialized, Role: FOLLOWER
20:03:20.118 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:20.117525 30017 raft_consensus.cc:359] T 46436b4a5ac447e7ac81a334da9ece1f P cde67fc5bc2243c48fee169e57ed308f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7362c8c4b1c3426e8b9a40f4bdb55b4a" member_type: VOTER last_known_addr { host: "127.28.30.193" port: 43607 } } peers { permanent_uuid: "cde67fc5bc2243c48fee169e57ed308f" member_type: VOTER last_known_addr { host: "127.28.30.194" port: 41083 } } peers { permanent_uuid: "f15bbca409334646ac14c6848f2e02b8" member_type: VOTER last_known_addr { host: "127.28.30.195" port: 41923 } }
20:03:20.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:20.118201 30017 raft_consensus.cc:385] T 46436b4a5ac447e7ac81a334da9ece1f P cde67fc5bc2243c48fee169e57ed308f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
20:03:20.119 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:20.118508 30017 raft_consensus.cc:740] T 46436b4a5ac447e7ac81a334da9ece1f P cde67fc5bc2243c48fee169e57ed308f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cde67fc5bc2243c48fee169e57ed308f, State: Initialized, Role: FOLLOWER
20:03:20.120 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:20.119833 30017 consensus_queue.cc:260] T 46436b4a5ac447e7ac81a334da9ece1f P cde67fc5bc2243c48fee169e57ed308f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7362c8c4b1c3426e8b9a40f4bdb55b4a" member_type: VOTER last_known_addr { host: "127.28.30.193" port: 43607 } } peers { permanent_uuid: "cde67fc5bc2243c48fee169e57ed308f" member_type: VOTER last_known_addr { host: "127.28.30.194" port: 41083 } } peers { permanent_uuid: "f15bbca409334646ac14c6848f2e02b8" member_type: VOTER last_known_addr { host: "127.28.30.195" port: 41923 } }
20:03:20.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:20.124138 30017 ts_tablet_manager.cc:1434] T 46436b4a5ac447e7ac81a334da9ece1f P cde67fc5bc2243c48fee169e57ed308f: Time spent starting tablet: real 0.051s	user 0.032s	sys 0.018s
20:03:20.125 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:20.109875 30015 consensus_queue.cc:260] T 46436b4a5ac447e7ac81a334da9ece1f P 7362c8c4b1c3426e8b9a40f4bdb55b4a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7362c8c4b1c3426e8b9a40f4bdb55b4a" member_type: VOTER last_known_addr { host: "127.28.30.193" port: 43607 } } peers { permanent_uuid: "cde67fc5bc2243c48fee169e57ed308f" member_type: VOTER last_known_addr { host: "127.28.30.194" port: 41083 } } peers { permanent_uuid: "f15bbca409334646ac14c6848f2e02b8" member_type: VOTER last_known_addr { host: "127.28.30.195" port: 41923 } }
20:03:20.131 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:20.131299 30015 ts_tablet_manager.cc:1434] T 46436b4a5ac447e7ac81a334da9ece1f P 7362c8c4b1c3426e8b9a40f4bdb55b4a: Time spent starting tablet: real 0.079s	user 0.054s	sys 0.006s
20:03:20.172 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:20.171901 29715 tablet.cc:2406] T 46436b4a5ac447e7ac81a334da9ece1f P cde67fc5bc2243c48fee169e57ed308f: Can't schedule compaction. Clean time has not been advanced past its initial value.
20:03:20.223 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:20.222707 30028 raft_consensus.cc:493] T 46436b4a5ac447e7ac81a334da9ece1f P 7362c8c4b1c3426e8b9a40f4bdb55b4a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
20:03:20.224 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:20.223426 30028 raft_consensus.cc:515] T 46436b4a5ac447e7ac81a334da9ece1f P 7362c8c4b1c3426e8b9a40f4bdb55b4a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7362c8c4b1c3426e8b9a40f4bdb55b4a" member_type: VOTER last_known_addr { host: "127.28.30.193" port: 43607 } } peers { permanent_uuid: "cde67fc5bc2243c48fee169e57ed308f" member_type: VOTER last_known_addr { host: "127.28.30.194" port: 41083 } } peers { permanent_uuid: "f15bbca409334646ac14c6848f2e02b8" member_type: VOTER last_known_addr { host: "127.28.30.195" port: 41923 } }
20:03:20.232 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:20.231940 30028 leader_election.cc:290] T 46436b4a5ac447e7ac81a334da9ece1f P 7362c8c4b1c3426e8b9a40f4bdb55b4a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cde67fc5bc2243c48fee169e57ed308f (127.28.30.194:41083), f15bbca409334646ac14c6848f2e02b8 (127.28.30.195:41923)
20:03:20.236 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:20.236109 30019 raft_consensus.cc:493] T 46436b4a5ac447e7ac81a334da9ece1f P f15bbca409334646ac14c6848f2e02b8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
20:03:20.237 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:20.236781 30019 raft_consensus.cc:515] T 46436b4a5ac447e7ac81a334da9ece1f P f15bbca409334646ac14c6848f2e02b8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7362c8c4b1c3426e8b9a40f4bdb55b4a" member_type: VOTER last_known_addr { host: "127.28.30.193" port: 43607 } } peers { permanent_uuid: "cde67fc5bc2243c48fee169e57ed308f" member_type: VOTER last_known_addr { host: "127.28.30.194" port: 41083 } } peers { permanent_uuid: "f15bbca409334646ac14c6848f2e02b8" member_type: VOTER last_known_addr { host: "127.28.30.195" port: 41923 } }
20:03:20.243 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:20.242261 30019 leader_election.cc:290] T 46436b4a5ac447e7ac81a334da9ece1f P f15bbca409334646ac14c6848f2e02b8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7362c8c4b1c3426e8b9a40f4bdb55b4a (127.28.30.193:43607), cde67fc5bc2243c48fee169e57ed308f (127.28.30.194:41083)
20:03:20.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:20.243647 29636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46436b4a5ac447e7ac81a334da9ece1f" candidate_uuid: "7362c8c4b1c3426e8b9a40f4bdb55b4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cde67fc5bc2243c48fee169e57ed308f" is_pre_election: true
20:03:20.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:20.244781 29636 raft_consensus.cc:2468] T 46436b4a5ac447e7ac81a334da9ece1f P cde67fc5bc2243c48fee169e57ed308f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7362c8c4b1c3426e8b9a40f4bdb55b4a in term 0.
20:03:20.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:20.246860 29328 leader_election.cc:304] T 46436b4a5ac447e7ac81a334da9ece1f P 7362c8c4b1c3426e8b9a40f4bdb55b4a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7362c8c4b1c3426e8b9a40f4bdb55b4a, cde67fc5bc2243c48fee169e57ed308f; no voters: 
20:03:20.248 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:20.247979 30028 raft_consensus.cc:2804] T 46436b4a5ac447e7ac81a334da9ece1f P 7362c8c4b1c3426e8b9a40f4bdb55b4a [term 0 FOLLOWER]: Leader pre-election won for term 1
20:03:20.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:20.248509 30028 raft_consensus.cc:493] T 46436b4a5ac447e7ac81a334da9ece1f P 7362c8c4b1c3426e8b9a40f4bdb55b4a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
20:03:20.249 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:20.249001 30028 raft_consensus.cc:3060] T 46436b4a5ac447e7ac81a334da9ece1f P 7362c8c4b1c3426e8b9a40f4bdb55b4a [term 0 FOLLOWER]: Advancing to term 1
20:03:20.253 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:20.250679 29881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46436b4a5ac447e7ac81a334da9ece1f" candidate_uuid: "7362c8c4b1c3426e8b9a40f4bdb55b4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15bbca409334646ac14c6848f2e02b8" is_pre_election: true
20:03:20.254 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:20.251610 29881 raft_consensus.cc:2468] T 46436b4a5ac447e7ac81a334da9ece1f P f15bbca409334646ac14c6848f2e02b8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7362c8c4b1c3426e8b9a40f4bdb55b4a in term 0.
20:03:20.257 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:20.256985 30028 raft_consensus.cc:515] T 46436b4a5ac447e7ac81a334da9ece1f P 7362c8c4b1c3426e8b9a40f4bdb55b4a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7362c8c4b1c3426e8b9a40f4bdb55b4a" member_type: VOTER last_known_addr { host: "127.28.30.193" port: 43607 } } peers { permanent_uuid: "cde67fc5bc2243c48fee169e57ed308f" member_type: VOTER last_known_addr { host: "127.28.30.194" port: 41083 } } peers { permanent_uuid: "f15bbca409334646ac14c6848f2e02b8" member_type: VOTER last_known_addr { host: "127.28.30.195" port: 41923 } }
20:03:20.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:20.261508 29636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46436b4a5ac447e7ac81a334da9ece1f" candidate_uuid: "7362c8c4b1c3426e8b9a40f4bdb55b4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cde67fc5bc2243c48fee169e57ed308f"
20:03:20.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:20.261771 29881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46436b4a5ac447e7ac81a334da9ece1f" candidate_uuid: "7362c8c4b1c3426e8b9a40f4bdb55b4a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f15bbca409334646ac14c6848f2e02b8"
20:03:20.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:20.262166 29636 raft_consensus.cc:3060] T 46436b4a5ac447e7ac81a334da9ece1f P cde67fc5bc2243c48fee169e57ed308f [term 0 FOLLOWER]: Advancing to term 1
20:03:20.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:20.262437 29881 raft_consensus.cc:3060] T 46436b4a5ac447e7ac81a334da9ece1f P f15bbca409334646ac14c6848f2e02b8 [term 0 FOLLOWER]: Advancing to term 1
20:03:20.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:20.262506 30028 leader_election.cc:290] T 46436b4a5ac447e7ac81a334da9ece1f P 7362c8c4b1c3426e8b9a40f4bdb55b4a [CANDIDATE]: Term 1 election: Requested vote from peers cde67fc5bc2243c48fee169e57ed308f (127.28.30.194:41083), f15bbca409334646ac14c6848f2e02b8 (127.28.30.195:41923)
20:03:20.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:20.262821 29423 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46436b4a5ac447e7ac81a334da9ece1f" candidate_uuid: "f15bbca409334646ac14c6848f2e02b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7362c8c4b1c3426e8b9a40f4bdb55b4a" is_pre_election: true
20:03:20.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:20.264163 29423 raft_consensus.cc:2393] T 46436b4a5ac447e7ac81a334da9ece1f P 7362c8c4b1c3426e8b9a40f4bdb55b4a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f15bbca409334646ac14c6848f2e02b8 in current term 1: Already voted for candidate 7362c8c4b1c3426e8b9a40f4bdb55b4a in this term.
20:03:20.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:20.267016 29635 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46436b4a5ac447e7ac81a334da9ece1f" candidate_uuid: "f15bbca409334646ac14c6848f2e02b8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cde67fc5bc2243c48fee169e57ed308f" is_pre_election: true
20:03:20.269 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:20.269158 29881 raft_consensus.cc:2468] T 46436b4a5ac447e7ac81a334da9ece1f P f15bbca409334646ac14c6848f2e02b8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7362c8c4b1c3426e8b9a40f4bdb55b4a in term 1.
20:03:20.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:20.269420 29768 leader_election.cc:304] T 46436b4a5ac447e7ac81a334da9ece1f P f15bbca409334646ac14c6848f2e02b8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f15bbca409334646ac14c6848f2e02b8; no voters: 7362c8c4b1c3426e8b9a40f4bdb55b4a, cde67fc5bc2243c48fee169e57ed308f
20:03:20.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:20.270057 29636 raft_consensus.cc:2468] T 46436b4a5ac447e7ac81a334da9ece1f P cde67fc5bc2243c48fee169e57ed308f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7362c8c4b1c3426e8b9a40f4bdb55b4a in term 1.
20:03:20.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:20.270519 30019 raft_consensus.cc:2749] T 46436b4a5ac447e7ac81a334da9ece1f P f15bbca409334646ac14c6848f2e02b8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
20:03:20.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:20.270889 29326 leader_election.cc:304] T 46436b4a5ac447e7ac81a334da9ece1f P 7362c8c4b1c3426e8b9a40f4bdb55b4a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7362c8c4b1c3426e8b9a40f4bdb55b4a, f15bbca409334646ac14c6848f2e02b8; no voters: 
20:03:20.272 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:20.271873 30028 raft_consensus.cc:2804] T 46436b4a5ac447e7ac81a334da9ece1f P 7362c8c4b1c3426e8b9a40f4bdb55b4a [term 1 FOLLOWER]: Leader election won for term 1
20:03:20.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:20.273537 30028 raft_consensus.cc:697] T 46436b4a5ac447e7ac81a334da9ece1f P 7362c8c4b1c3426e8b9a40f4bdb55b4a [term 1 LEADER]: Becoming Leader. State: Replica: 7362c8c4b1c3426e8b9a40f4bdb55b4a, State: Running, Role: LEADER
20:03:20.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:20.274662 30028 consensus_queue.cc:237] T 46436b4a5ac447e7ac81a334da9ece1f P 7362c8c4b1c3426e8b9a40f4bdb55b4a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7362c8c4b1c3426e8b9a40f4bdb55b4a" member_type: VOTER last_known_addr { host: "127.28.30.193" port: 43607 } } peers { permanent_uuid: "cde67fc5bc2243c48fee169e57ed308f" member_type: VOTER last_known_addr { host: "127.28.30.194" port: 41083 } } peers { permanent_uuid: "f15bbca409334646ac14c6848f2e02b8" member_type: VOTER last_known_addr { host: "127.28.30.195" port: 41923 } }
20:03:20.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:20.275590 29967 tablet.cc:2406] T 46436b4a5ac447e7ac81a334da9ece1f P f15bbca409334646ac14c6848f2e02b8: Can't schedule compaction. Clean time has not been advanced past its initial value.
20:03:20.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:20.283599 29506 tablet.cc:2406] T 46436b4a5ac447e7ac81a334da9ece1f P 7362c8c4b1c3426e8b9a40f4bdb55b4a: Can't schedule compaction. Clean time has not been advanced past its initial value.
20:03:20.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:20.291008 29124 catalog_manager.cc:5719] T 46436b4a5ac447e7ac81a334da9ece1f P 7362c8c4b1c3426e8b9a40f4bdb55b4a reported cstate change: term changed from 0 to 1, leader changed from <none> to 7362c8c4b1c3426e8b9a40f4bdb55b4a (127.28.30.193). New cstate: current_term: 1 leader_uuid: "7362c8c4b1c3426e8b9a40f4bdb55b4a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7362c8c4b1c3426e8b9a40f4bdb55b4a" member_type: VOTER last_known_addr { host: "127.28.30.193" port: 43607 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cde67fc5bc2243c48fee169e57ed308f" member_type: VOTER last_known_addr { host: "127.28.30.194" port: 41083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f15bbca409334646ac14c6848f2e02b8" member_type: VOTER last_known_addr { host: "127.28.30.195" port: 41923 } health_report { overall_health: UNKNOWN } } }
20:03:20.332 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:894) Opened table 91e29fb92d9c4afdb196970793e3995a
20:03:20.356 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 46436b4a5ac447e7ac81a334da9ece1f for table 'org.apache.kudu.client.TestLeaderFailover-1786478581079' with partition [<start>, <end>)
20:03:20.362 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299994, tablet=46436b4a5ac447e7ac81a334da9ece1f@[7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607)[L],cde67fc5bc2243c48fee169e57ed308f(127.28.30.194:41083),f15bbca409334646ac14c6848f2e02b8(127.28.30.195:41923)]}]
20:03:20.363 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=19), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC GetTableLocations: sending RPC to server master-127.28.30.252:34405, [10ms] Sub RPC GetTableLocations: received response from server master-127.28.30.252:34405: OK, deferred=null) after lookup
20:03:20.372 [DEBUG - kudu-nio-2] (Connection.java:748) [peer 7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607)] connecting to peer
20:03:20.375 [DEBUG - kudu-nio-3] (Connection.java:757) [peer 7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607)] Successfully connected to peer
20:03:20.481 [DEBUG - kudu-nio-3] (Negotiator.java:918) Authenticated connection [id: 0xba90c685, L:/127.0.0.1:55034 - R:/127.28.30.193:43607] using TOKEN/null
20:03:20.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:20.513625 29881 raft_consensus.cc:1275] T 46436b4a5ac447e7ac81a334da9ece1f P f15bbca409334646ac14c6848f2e02b8 [term 1 FOLLOWER]: Refusing update from remote peer 7362c8c4b1c3426e8b9a40f4bdb55b4a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
20:03:20.516 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:20.515293 29636 raft_consensus.cc:1275] T 46436b4a5ac447e7ac81a334da9ece1f P cde67fc5bc2243c48fee169e57ed308f [term 1 FOLLOWER]: Refusing update from remote peer 7362c8c4b1c3426e8b9a40f4bdb55b4a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
20:03:20.517 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:20.516750 30041 consensus_queue.cc:1048] T 46436b4a5ac447e7ac81a334da9ece1f P 7362c8c4b1c3426e8b9a40f4bdb55b4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "f15bbca409334646ac14c6848f2e02b8" member_type: VOTER last_known_addr { host: "127.28.30.195" port: 41923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
20:03:20.521 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:20.518571 30028 consensus_queue.cc:1048] T 46436b4a5ac447e7ac81a334da9ece1f P 7362c8c4b1c3426e8b9a40f4bdb55b4a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cde67fc5bc2243c48fee169e57ed308f" member_type: VOTER last_known_addr { host: "127.28.30.194" port: 41083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
20:03:20.867 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=org.apache.kudu.client.TestLeaderFailover-1786478581079, tablet=46436b4a5ac447e7ac81a334da9ece1f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
20:03:20.880 [INFO - Time-limited test] (MiniKuduCluster.java:475) Killing tablet server 127.28.30.193:43607
20:03:20.882 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: stop_daemon {
  id {
    type: TSERVER
    index: 0
  }
}

20:03:20.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:20.882884 28795 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskxrU2r1/build/tsan/bin/kudu with pid 29248
20:03:20.957 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
20:03:20.960 [DEBUG - kudu-nio-3] (Connection.java:239) [peer 7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607)] handling channelInactive
20:03:20.961 [DEBUG - kudu-nio-3] (Connection.java:709) [peer 7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607)] cleaning up while in state READY due to: connection closed
20:03:20.961 [INFO - kudu-nio-3] (AsyncKuduClient.java:2355) Invalidating location 7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607) for tablet 46436b4a5ac447e7ac81a334da9ece1f: connection closed
20:03:20.976 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 46436b4a5ac447e7ac81a334da9ece1f for table 'org.apache.kudu.client.TestLeaderFailover-1786478581079' with partition [<start>, <end>)
20:03:20.977 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=46436b4a5ac447e7ac81a334da9ece1f@[7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607)[L],cde67fc5bc2243c48fee169e57ed308f(127.28.30.194:41083),f15bbca409334646ac14c6848f2e02b8(127.28.30.195:41923)]}]
20:03:20.977 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=46436b4a5ac447e7ac81a334da9ece1f, attempt=2, sequence_id=4, TimeoutTracker(timeout=30000, elapsed=19), Traces: [0ms] sending RPC to server 7362c8c4b1c3426e8b9a40f4bdb55b4a, [3ms] received response from server 7362c8c4b1c3426e8b9a40f4bdb55b4a: Network error: connection closed, [3ms] delaying RPC due to: Network error: connection closed, [12ms] refreshing cache from master, [13ms] Sub RPC GetTableLocations: sending RPC to server master-127.28.30.252:34405, [18ms] Sub RPC GetTableLocations: received response from server master-127.28.30.252:34405: OK, deferred=Deferred@1826488658(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$235/0x00007fa0dc338000@32ff7373 -> passthrough -> wakeup thread Time-limited test, errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@5550a3fb -> wakeup thread Time-limited test)) after lookup
20:03:20.978 [DEBUG - kudu-nio-2] (Connection.java:748) [peer 7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607)] connecting to peer
20:03:20.981 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer 7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607): Connection refused: /127.28.30.193:43607
20:03:20.982 [DEBUG - kudu-nio-4] (Connection.java:709) [peer 7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607)] cleaning up while in state CONNECTING due to: Failed to connect to peer 7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607): Connection refused: /127.28.30.193:43607
20:03:20.982 [INFO - kudu-nio-4] (AsyncKuduClient.java:2355) Invalidating location 7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607) for tablet 46436b4a5ac447e7ac81a334da9ece1f: Failed to connect to peer 7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607): Connection refused: /127.28.30.193:43607
20:03:20.996 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 46436b4a5ac447e7ac81a334da9ece1f for table 'org.apache.kudu.client.TestLeaderFailover-1786478581079' with partition [<start>, <end>)
20:03:20.996 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=46436b4a5ac447e7ac81a334da9ece1f@[7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607)[L],cde67fc5bc2243c48fee169e57ed308f(127.28.30.194:41083),f15bbca409334646ac14c6848f2e02b8(127.28.30.195:41923)]}]
20:03:20.997 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=46436b4a5ac447e7ac81a334da9ece1f, attempt=4, sequence_id=4, TimeoutTracker(timeout=30000, elapsed=38), Traces: [0ms] sending RPC to server 7362c8c4b1c3426e8b9a40f4bdb55b4a, [3ms] received response from server 7362c8c4b1c3426e8b9a40f4bdb55b4a: Network error: connection closed, [3ms] delaying RPC due to: Network error: connection closed, [12ms] refreshing cache from master, [13ms] Sub RPC GetTableLocations: sending RPC to server master-127.28.30.252:34405, [18ms] Sub RPC GetTableLocations: received response from server master-127.28.30.252:34405: OK, [20ms] sending RPC to server 7362c8c4b1c3426e8b9a40f4bdb55b4a, [24ms] received response from server 7362c8c4b1c3426e8b9a40f4bdb55b4a: Network error: Failed to connect to peer 7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607): Connection refused: /127.28.30.193:43607, [24ms] delaying RPC due to: Network error: Failed to connect to peer 7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607): Connection refused: /127.28.30.193:43607, [32ms] refreshing cache from master, [32ms] Sub RPC GetTableLocations: sending RPC to server master-127.28.30.252:34405, [37ms] Sub RPC GetTableLocations: received response from server master-127.28.30.252:34405: OK, deferred=Deferred@1826488658(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$235/0x00007fa0dc338000@32ff7373 -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@1437667726 after retry RPC@1511426021), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@5550a3fb -> wakeup thread Time-limited test -> (continuation of Deferred@1437667726 after retry RPC@1511426021))) after lookup
20:03:20.998 [DEBUG - kudu-nio-2] (Connection.java:748) [peer 7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607)] connecting to peer
20:03:21.004 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer 7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607): Connection refused: /127.28.30.193:43607
20:03:21.004 [DEBUG - kudu-nio-5] (Connection.java:709) [peer 7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607)] cleaning up while in state CONNECTING due to: Failed to connect to peer 7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607): Connection refused: /127.28.30.193:43607
20:03:21.004 [INFO - kudu-nio-5] (AsyncKuduClient.java:2355) Invalidating location 7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607) for tablet 46436b4a5ac447e7ac81a334da9ece1f: Failed to connect to peer 7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607): Connection refused: /127.28.30.193:43607
20:03:21.015 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 46436b4a5ac447e7ac81a334da9ece1f for table 'org.apache.kudu.client.TestLeaderFailover-1786478581079' with partition [<start>, <end>)
20:03:21.016 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=46436b4a5ac447e7ac81a334da9ece1f@[7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607)[L],cde67fc5bc2243c48fee169e57ed308f(127.28.30.194:41083),f15bbca409334646ac14c6848f2e02b8(127.28.30.195:41923)]}]
20:03:21.017 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=46436b4a5ac447e7ac81a334da9ece1f, attempt=6, sequence_id=4, TimeoutTracker(timeout=30000, elapsed=58), Traces: [0ms] sending RPC to server 7362c8c4b1c3426e8b9a40f4bdb55b4a, [3ms] received response from server 7362c8c4b1c3426e8b9a40f4bdb55b4a: Network error: connection closed, [3ms] delaying RPC due to: Network error: connection closed, [12ms] refreshing cache from master, [13ms] Sub RPC GetTableLocations: sending RPC to server master-127.28.30.252:34405, [18ms] Sub RPC GetTableLocations: received response from server master-127.28.30.252:34405: OK, [20ms] sending RPC to server 7362c8c4b1c3426e8b9a40f4bdb55b4a, [24ms] received response from server 7362c8c4b1c3426e8b9a40f4bdb55b4a: Network error: Failed to connect to peer 7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607): Connection refused: /127.28.30.193:43607, [24ms] delaying RPC due to: Network error: Failed to connect to peer 7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607): Connection refused: /127.28.30.193:43607, [32ms] refreshing cache from master, [32ms] Sub RPC GetTableLocations: sending RPC to server master-127.28.30.252:34405, [37ms] Sub RPC GetTableLocations: received response from server master-127.28.30.252:34405: OK, [39ms] sending RPC to server 7362c8c4b1c3426e8b9a40f4bdb55b4a, [46ms] received response from server 7362c8c4b1c3426e8b9a40f4bdb55b4a: Network error: Failed to connect to peer 7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607): Connection refused: /127.28.30.193:43607, [46ms] delaying RPC due to: Network error: Failed to connect to peer 7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607): Connection refused: /127.28.30.193:43607, [52ms] refreshing cache from master, [52ms] Sub RPC GetTableLocations: sending RPC to server master-127.28.30.252:34405, [57ms] Sub RPC GetTableLocations: received response from server master-127.28.30.252:34405: OK, deferred=Deferred@1826488658(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$235/0x00007fa0dc338000@32ff7373 -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@1437667726 after retry RPC@1511426021) -> (continuation of Deferred@1431127332 after retry RPC@631078918), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@5550a3fb -> wakeup thread Time-limited test -> (continuation of Deferred@1437667726 after retry RPC@1511426021) -> (continuation of Deferred@1431127332 after retry RPC@631078918))) after lookup
20:03:21.017 [DEBUG - kudu-nio-2] (Connection.java:748) [peer 7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607)] connecting to peer
20:03:21.019 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer 7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607): Connection refused: /127.28.30.193:43607
20:03:21.019 [DEBUG - kudu-nio-6] (Connection.java:709) [peer 7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607)] cleaning up while in state CONNECTING due to: Failed to connect to peer 7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607): Connection refused: /127.28.30.193:43607
20:03:21.019 [INFO - kudu-nio-6] (AsyncKuduClient.java:2355) Invalidating location 7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607) for tablet 46436b4a5ac447e7ac81a334da9ece1f: Failed to connect to peer 7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607): Connection refused: /127.28.30.193:43607
20:03:21.114 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 46436b4a5ac447e7ac81a334da9ece1f for table 'org.apache.kudu.client.TestLeaderFailover-1786478581079' with partition [<start>, <end>)
20:03:21.115 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=46436b4a5ac447e7ac81a334da9ece1f@[7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607)[L],cde67fc5bc2243c48fee169e57ed308f(127.28.30.194:41083),f15bbca409334646ac14c6848f2e02b8(127.28.30.195:41923)]}]
20:03:21.115 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=46436b4a5ac447e7ac81a334da9ece1f, attempt=8, sequence_id=4, TimeoutTracker(timeout=30000, elapsed=157), Traces: [0ms] sending RPC to server 7362c8c4b1c3426e8b9a40f4bdb55b4a, [3ms] received response from server 7362c8c4b1c3426e8b9a40f4bdb55b4a: Network error: connection closed, [3ms] delaying RPC due to: Network error: connection closed, [12ms] refreshing cache from master, [13ms] Sub RPC GetTableLocations: sending RPC to server master-127.28.30.252:34405, [18ms] Sub RPC GetTableLocations: received response from server master-127.28.30.252:34405: OK, [20ms] sending RPC to server 7362c8c4b1c3426e8b9a40f4bdb55b4a, [24ms] received response from server 7362c8c4b1c3426e8b9a40f4bdb55b4a: Network error: Failed to connect to peer 7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607): Connection refused: /127.28.30.193:43607, [24ms] delaying RPC due to: Network error: Failed to connect to peer 7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607): Connection refused: /127.28.30.193:43607, [32ms] refreshing cache from master, [32ms] Sub RPC GetTableLocations: sending RPC to server master-127.28.30.252:34405, [37ms] Sub RPC GetTableLocations: received response from server master-127.28.30.252:34405: OK, [39ms] sending RPC to server 7362c8c4b1c3426e8b9a40f4bdb55b4a, [46ms] received response from server 7362c8c4b1c3426e8b9a40f4bdb55b4a: Network error: Failed to connect to peer 7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607): Connection refused: /127.28.30.193:43607, [46ms] delaying RPC due to: Network error: Failed to connect to peer 7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607): Connection refused: /127.28.30.193:43607, [52ms] refreshing cache from master, [52ms] Sub RPC GetTableLocations: sending RPC to server master-127.28.30.252:34405, [57ms] Sub RPC GetTableLocations: received response from server master-127.28.30.252:34405: OK, [59ms] sending RPC to server 7362c8c4b1c3426e8b9a40f4bdb55b4a, [61ms] received response from server 7362c8c4b1c3426e8b9a40f4bdb55b4a: Network error: Failed to connect to peer 7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607): Connection refused: /127.28.30.193:43607, [61ms] delaying RPC due to: Network error: Failed to connect to peer 7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607): Connection refused: /127.28.30.193:43607, [152ms] refreshing cache from master, [152ms] Sub RPC GetTableLocations: sending RPC to server master-127.28.30.252:34405, [156ms] Sub RPC GetTableLocations: received response from server master-127.28.30.252:34405: OK, deferred=Deferred@1826488658(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$235/0x00007fa0dc338000@32ff7373 -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@1437667726 after retry RPC@1511426021) -> (continuation of Deferred@1431127332 after retry RPC@631078918) -> (continuation of Deferred@72138074 after retry RPC@1789858166), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@5550a3fb -> wakeup thread Time-limited test -> (continuation of Deferred@1437667726 after retry RPC@1511426021) -> (continuation of Deferred@1431127332 after retry RPC@631078918) -> (continuation of Deferred@72138074 after retry RPC@1789858166))) after lookup
20:03:21.116 [DEBUG - kudu-nio-2] (Connection.java:748) [peer 7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607)] connecting to peer
20:03:21.118 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer 7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607): Connection refused: /127.28.30.193:43607
20:03:21.118 [DEBUG - kudu-nio-7] (Connection.java:709) [peer 7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607)] cleaning up while in state CONNECTING due to: Failed to connect to peer 7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607): Connection refused: /127.28.30.193:43607
20:03:21.119 [INFO - kudu-nio-7] (AsyncKuduClient.java:2355) Invalidating location 7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607) for tablet 46436b4a5ac447e7ac81a334da9ece1f: Failed to connect to peer 7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607): Connection refused: /127.28.30.193:43607
20:03:21.235 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 46436b4a5ac447e7ac81a334da9ece1f for table 'org.apache.kudu.client.TestLeaderFailover-1786478581079' with partition [<start>, <end>)
20:03:21.236 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=46436b4a5ac447e7ac81a334da9ece1f@[7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607)[L],cde67fc5bc2243c48fee169e57ed308f(127.28.30.194:41083),f15bbca409334646ac14c6848f2e02b8(127.28.30.195:41923)]}]
20:03:21.237 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=46436b4a5ac447e7ac81a334da9ece1f, attempt=10, sequence_id=4, TimeoutTracker(timeout=30000, elapsed=278), Traces: [0ms] sending RPC to server 7362c8c4b1c3426e8b9a40f4bdb55b4a, [3ms] received response from server 7362c8c4b1c3426e8b9a40f4bdb55b4a: Network error: connection closed, [3ms] delaying RPC due to: Network error: connection closed, [12ms] refreshing cache from master, [13ms] Sub RPC GetTableLocations: sending RPC to server master-127.28.30.252:34405, [18ms] Sub RPC GetTableLocations: received response from server master-127.28.30.252:34405: OK, [20ms] sending RPC to server 7362c8c4b1c3426e8b9a40f4bdb55b4a, [24ms] received response from server 7362c8c4b1c3426e8b9a40f4bdb55b4a: Network error: Failed to connect to peer 7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607): Connection refused: /127.28.30.193:43607, [24ms] delaying RPC due to: Network error: Failed to connect to peer 7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607): Connection refused: /127.28.30.193:43607, [32ms] refreshing cache from master, [32ms] Sub RPC GetTableLocations: sending RPC to server master-127.28.30.252:34405, [37ms] Sub RPC GetTableLocations: received response from server master-127.28.30.252:34405: OK, [39ms] sending RPC to server 7362c8c4b1c3426e8b9a40f4bdb55b4a, [46ms] received response from server 7362c8c4b1c3426e8b9a40f4bdb55b4a: Network error: Failed to connect to peer 7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607): Connection refused: /127.28.30.193:43607, [46ms] delaying RPC due to: Network error: Failed to connect to peer 7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607): Connection refused: /127.28.30.193:43607, [52ms] refreshing cache from master, [52ms] Sub RPC GetTableLocations: sending RPC to server master-127.28.30.252:34405, [57ms] Sub RPC GetTableLocations: received response from server master-127.28.30.252:34405: OK, [59ms] sending RPC to server 7362c8c4b1c3426e8b9a40f4bdb55b4a, [61ms] received response from server 7362c8c4b1c3426e8b9a40f4bdb55b4a: Network error: Failed to connect to peer 7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607): Connection refused: /127.28.30.193:43607, [61ms] delaying RPC due to: Network error: Failed to connect to peer 7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607): Connection refused: /127.28.30.193:43607, [152ms] refreshing cache from master, [152ms] Sub RPC GetTableLocations: sending RPC to server master-127.28.30.252:34405, [156ms] Sub RPC GetTableLocations: received response from server master-127.28.30.252:34405: OK, [158ms] sending RPC to server 7362c8c4b1c3426e8b9a40f4bdb55b4a, [160ms] received response from server 7362c8c4b1c3426e8b9a40f4bdb55b4a: Network error: Failed to connect to peer 7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607): Connection refused: /127.28.30.193:43607, [161ms] delaying RPC due to: Network error: Failed to connect to peer 7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607): Connection refused: /127.28.30.193:43607, [272ms] refreshing cache from master, [273ms] Sub RPC GetTableLocations: sending RPC to server master-127.28.30.252:34405, [277ms] Sub RPC GetTableLocations: received response from server master-127.28.30.252:34405: OK, deferred=Deferred@1826488658(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$235/0x00007fa0dc338000@32ff7373 -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@1437667726 after retry RPC@1511426021) -> (continuation of Deferred@1431127332 after retry RPC@631078918) -> (continuation of Deferred@72138074 after retry RPC@1789858166) -> (continuation of Deferred@2115680819 after retry RPC@2029131872), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@5550a3fb -> wakeup thread Time-limited test -> (continuation of Deferred@1437667726 after retry RPC@1511426021) -> (continuation of Deferred@1431127332 after retry RPC@631078918) -> (continuation of Deferred@72138074 after retry RPC@1789858166) -> (continuation of Deferred@2115680819 after retry RPC@2029131872))) after lookup
20:03:21.238 [DEBUG - kudu-nio-2] (Connection.java:748) [peer 7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607)] connecting to peer
20:03:21.239 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer 7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607): Connection refused: /127.28.30.193:43607
20:03:21.239 [DEBUG - kudu-nio-0] (Connection.java:709) [peer 7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607)] cleaning up while in state CONNECTING due to: Failed to connect to peer 7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607): Connection refused: /127.28.30.193:43607
20:03:21.239 [INFO - kudu-nio-0] (AsyncKuduClient.java:2355) Invalidating location 7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607) for tablet 46436b4a5ac447e7ac81a334da9ece1f: Failed to connect to peer 7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607): Connection refused: /127.28.30.193:43607
20:03:22.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:22.265774 30081 raft_consensus.cc:493] T 46436b4a5ac447e7ac81a334da9ece1f P f15bbca409334646ac14c6848f2e02b8 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7362c8c4b1c3426e8b9a40f4bdb55b4a)
20:03:22.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:22.265919 30082 raft_consensus.cc:493] T 46436b4a5ac447e7ac81a334da9ece1f P cde67fc5bc2243c48fee169e57ed308f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7362c8c4b1c3426e8b9a40f4bdb55b4a)
20:03:22.266 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:22.266311 30082 raft_consensus.cc:515] T 46436b4a5ac447e7ac81a334da9ece1f P cde67fc5bc2243c48fee169e57ed308f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7362c8c4b1c3426e8b9a40f4bdb55b4a" member_type: VOTER last_known_addr { host: "127.28.30.193" port: 43607 } } peers { permanent_uuid: "cde67fc5bc2243c48fee169e57ed308f" member_type: VOTER last_known_addr { host: "127.28.30.194" port: 41083 } } peers { permanent_uuid: "f15bbca409334646ac14c6848f2e02b8" member_type: VOTER last_known_addr { host: "127.28.30.195" port: 41923 } }
20:03:22.267 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:22.266268 30081 raft_consensus.cc:515] T 46436b4a5ac447e7ac81a334da9ece1f P f15bbca409334646ac14c6848f2e02b8 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7362c8c4b1c3426e8b9a40f4bdb55b4a" member_type: VOTER last_known_addr { host: "127.28.30.193" port: 43607 } } peers { permanent_uuid: "cde67fc5bc2243c48fee169e57ed308f" member_type: VOTER last_known_addr { host: "127.28.30.194" port: 41083 } } peers { permanent_uuid: "f15bbca409334646ac14c6848f2e02b8" member_type: VOTER last_known_addr { host: "127.28.30.195" port: 41923 } }
20:03:22.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:22.268280 30081 leader_election.cc:290] T 46436b4a5ac447e7ac81a334da9ece1f P f15bbca409334646ac14c6848f2e02b8 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7362c8c4b1c3426e8b9a40f4bdb55b4a (127.28.30.193:43607), cde67fc5bc2243c48fee169e57ed308f (127.28.30.194:41083)
20:03:22.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:22.269718 29636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46436b4a5ac447e7ac81a334da9ece1f" candidate_uuid: "f15bbca409334646ac14c6848f2e02b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cde67fc5bc2243c48fee169e57ed308f" is_pre_election: true
20:03:22.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:22.270429 29636 raft_consensus.cc:2468] T 46436b4a5ac447e7ac81a334da9ece1f P cde67fc5bc2243c48fee169e57ed308f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f15bbca409334646ac14c6848f2e02b8 in term 1.
20:03:22.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:22.270673 30082 leader_election.cc:290] T 46436b4a5ac447e7ac81a334da9ece1f P cde67fc5bc2243c48fee169e57ed308f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7362c8c4b1c3426e8b9a40f4bdb55b4a (127.28.30.193:43607), f15bbca409334646ac14c6848f2e02b8 (127.28.30.195:41923)
20:03:22.273 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:22.272001 29768 leader_election.cc:304] T 46436b4a5ac447e7ac81a334da9ece1f P f15bbca409334646ac14c6848f2e02b8 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: cde67fc5bc2243c48fee169e57ed308f, f15bbca409334646ac14c6848f2e02b8; no voters: 
20:03:22.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:22.273368 30081 raft_consensus.cc:2804] T 46436b4a5ac447e7ac81a334da9ece1f P f15bbca409334646ac14c6848f2e02b8 [term 1 FOLLOWER]: Leader pre-election won for term 2
20:03:22.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:22.273808 30081 raft_consensus.cc:493] T 46436b4a5ac447e7ac81a334da9ece1f P f15bbca409334646ac14c6848f2e02b8 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7362c8c4b1c3426e8b9a40f4bdb55b4a)
20:03:22.275 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:22.274248 30081 raft_consensus.cc:3060] T 46436b4a5ac447e7ac81a334da9ece1f P f15bbca409334646ac14c6848f2e02b8 [term 1 FOLLOWER]: Advancing to term 2
20:03:22.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:22.275306 29535 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.30.193:43607: connect: Connection refused (error 111)
20:03:22.277 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:22.276347 29767 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.30.193:43607: connect: Connection refused (error 111)
20:03:22.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:22.283715 30081 raft_consensus.cc:515] T 46436b4a5ac447e7ac81a334da9ece1f P f15bbca409334646ac14c6848f2e02b8 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7362c8c4b1c3426e8b9a40f4bdb55b4a" member_type: VOTER last_known_addr { host: "127.28.30.193" port: 43607 } } peers { permanent_uuid: "cde67fc5bc2243c48fee169e57ed308f" member_type: VOTER last_known_addr { host: "127.28.30.194" port: 41083 } } peers { permanent_uuid: "f15bbca409334646ac14c6848f2e02b8" member_type: VOTER last_known_addr { host: "127.28.30.195" port: 41923 } }
20:03:22.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:22.286037 29535 leader_election.cc:336] T 46436b4a5ac447e7ac81a334da9ece1f P cde67fc5bc2243c48fee169e57ed308f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7362c8c4b1c3426e8b9a40f4bdb55b4a (127.28.30.193:43607): Network error: Client connection negotiation failed: client connection to 127.28.30.193:43607: connect: Connection refused (error 111)
20:03:22.287 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:22.287038 30081 leader_election.cc:290] T 46436b4a5ac447e7ac81a334da9ece1f P f15bbca409334646ac14c6848f2e02b8 [CANDIDATE]: Term 2 election: Requested vote from peers 7362c8c4b1c3426e8b9a40f4bdb55b4a (127.28.30.193:43607), cde67fc5bc2243c48fee169e57ed308f (127.28.30.194:41083)
20:03:22.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:22.287698 29636 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46436b4a5ac447e7ac81a334da9ece1f" candidate_uuid: "f15bbca409334646ac14c6848f2e02b8" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "cde67fc5bc2243c48fee169e57ed308f"
20:03:22.288 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:22.288233 29636 raft_consensus.cc:3060] T 46436b4a5ac447e7ac81a334da9ece1f P cde67fc5bc2243c48fee169e57ed308f [term 1 FOLLOWER]: Advancing to term 2
20:03:22.289 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:22.288863 29767 leader_election.cc:336] T 46436b4a5ac447e7ac81a334da9ece1f P f15bbca409334646ac14c6848f2e02b8 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7362c8c4b1c3426e8b9a40f4bdb55b4a (127.28.30.193:43607): Network error: Client connection negotiation failed: client connection to 127.28.30.193:43607: connect: Connection refused (error 111)
20:03:22.291 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:22.291555 29767 leader_election.cc:336] T 46436b4a5ac447e7ac81a334da9ece1f P f15bbca409334646ac14c6848f2e02b8 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7362c8c4b1c3426e8b9a40f4bdb55b4a (127.28.30.193:43607): Network error: Client connection negotiation failed: client connection to 127.28.30.193:43607: connect: Connection refused (error 111)
20:03:22.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:22.292507 29881 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46436b4a5ac447e7ac81a334da9ece1f" candidate_uuid: "cde67fc5bc2243c48fee169e57ed308f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f15bbca409334646ac14c6848f2e02b8" is_pre_election: true
20:03:22.293 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:22.293490 29881 raft_consensus.cc:2393] T 46436b4a5ac447e7ac81a334da9ece1f P f15bbca409334646ac14c6848f2e02b8 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cde67fc5bc2243c48fee169e57ed308f in current term 2: Already voted for candidate f15bbca409334646ac14c6848f2e02b8 in this term.
20:03:22.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:22.295013 29534 leader_election.cc:304] T 46436b4a5ac447e7ac81a334da9ece1f P cde67fc5bc2243c48fee169e57ed308f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cde67fc5bc2243c48fee169e57ed308f; no voters: 7362c8c4b1c3426e8b9a40f4bdb55b4a, f15bbca409334646ac14c6848f2e02b8
20:03:22.295 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:22.295352 29636 raft_consensus.cc:2468] T 46436b4a5ac447e7ac81a334da9ece1f P cde67fc5bc2243c48fee169e57ed308f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f15bbca409334646ac14c6848f2e02b8 in term 2.
20:03:22.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:22.295905 30082 raft_consensus.cc:2749] T 46436b4a5ac447e7ac81a334da9ece1f P cde67fc5bc2243c48fee169e57ed308f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
20:03:22.296 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:22.296456 29768 leader_election.cc:304] T 46436b4a5ac447e7ac81a334da9ece1f P f15bbca409334646ac14c6848f2e02b8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: cde67fc5bc2243c48fee169e57ed308f, f15bbca409334646ac14c6848f2e02b8; no voters: 7362c8c4b1c3426e8b9a40f4bdb55b4a
20:03:22.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:22.297103 30081 raft_consensus.cc:2804] T 46436b4a5ac447e7ac81a334da9ece1f P f15bbca409334646ac14c6848f2e02b8 [term 2 FOLLOWER]: Leader election won for term 2
20:03:22.299 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:22.298763 30081 raft_consensus.cc:697] T 46436b4a5ac447e7ac81a334da9ece1f P f15bbca409334646ac14c6848f2e02b8 [term 2 LEADER]: Becoming Leader. State: Replica: f15bbca409334646ac14c6848f2e02b8, State: Running, Role: LEADER
20:03:22.300 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:22.299649 30081 consensus_queue.cc:237] T 46436b4a5ac447e7ac81a334da9ece1f P f15bbca409334646ac14c6848f2e02b8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7362c8c4b1c3426e8b9a40f4bdb55b4a" member_type: VOTER last_known_addr { host: "127.28.30.193" port: 43607 } } peers { permanent_uuid: "cde67fc5bc2243c48fee169e57ed308f" member_type: VOTER last_known_addr { host: "127.28.30.194" port: 41083 } } peers { permanent_uuid: "f15bbca409334646ac14c6848f2e02b8" member_type: VOTER last_known_addr { host: "127.28.30.195" port: 41923 } }
20:03:22.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:22.309093 29124 catalog_manager.cc:5719] T 46436b4a5ac447e7ac81a334da9ece1f P f15bbca409334646ac14c6848f2e02b8 reported cstate change: term changed from 1 to 2, leader changed from 7362c8c4b1c3426e8b9a40f4bdb55b4a (127.28.30.193) to f15bbca409334646ac14c6848f2e02b8 (127.28.30.195). New cstate: current_term: 2 leader_uuid: "f15bbca409334646ac14c6848f2e02b8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7362c8c4b1c3426e8b9a40f4bdb55b4a" member_type: VOTER last_known_addr { host: "127.28.30.193" port: 43607 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cde67fc5bc2243c48fee169e57ed308f" member_type: VOTER last_known_addr { host: "127.28.30.194" port: 41083 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f15bbca409334646ac14c6848f2e02b8" member_type: VOTER last_known_addr { host: "127.28.30.195" port: 41923 } health_report { overall_health: HEALTHY } } }
20:03:22.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:22.723845 29767 consensus_peers.cc:597] T 46436b4a5ac447e7ac81a334da9ece1f P f15bbca409334646ac14c6848f2e02b8 -> Peer 7362c8c4b1c3426e8b9a40f4bdb55b4a (127.28.30.193:43607): Couldn't send request to peer 7362c8c4b1c3426e8b9a40f4bdb55b4a. Status: Network error: Client connection negotiation failed: client connection to 127.28.30.193:43607: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
20:03:22.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:22.773342 29636 raft_consensus.cc:1275] T 46436b4a5ac447e7ac81a334da9ece1f P cde67fc5bc2243c48fee169e57ed308f [term 2 FOLLOWER]: Refusing update from remote peer f15bbca409334646ac14c6848f2e02b8: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
20:03:22.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:22.774976 30081 consensus_queue.cc:1048] T 46436b4a5ac447e7ac81a334da9ece1f P f15bbca409334646ac14c6848f2e02b8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cde67fc5bc2243c48fee169e57ed308f" member_type: VOTER last_known_addr { host: "127.28.30.194" port: 41083 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
20:03:23.076 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2538) Learned about tablet 46436b4a5ac447e7ac81a334da9ece1f for table 'org.apache.kudu.client.TestLeaderFailover-1786478581079' with partition [<start>, <end>)
20:03:23.076 [DEBUG - kudu-nio-2] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=46436b4a5ac447e7ac81a334da9ece1f@[7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607),cde67fc5bc2243c48fee169e57ed308f(127.28.30.194:41083),f15bbca409334646ac14c6848f2e02b8(127.28.30.195:41923)[L]]}]
20:03:23.077 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=46436b4a5ac447e7ac81a334da9ece1f, attempt=12, sequence_id=4, TimeoutTracker(timeout=30000, elapsed=2118), Traces: [0ms] sending RPC to server 7362c8c4b1c3426e8b9a40f4bdb55b4a, [3ms] received response from server 7362c8c4b1c3426e8b9a40f4bdb55b4a: Network error: connection closed, [3ms] delaying RPC due to: Network error: connection closed, [12ms] refreshing cache from master, [13ms] Sub RPC GetTableLocations: sending RPC to server master-127.28.30.252:34405, [18ms] Sub RPC GetTableLocations: received response from server master-127.28.30.252:34405: OK, [20ms] sending RPC to server 7362c8c4b1c3426e8b9a40f4bdb55b4a, [24ms] received response from server 7362c8c4b1c3426e8b9a40f4bdb55b4a: Network error: Failed to connect to peer 7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607): Connection refused: /127.28.30.193:43607, [24ms] delaying RPC due to: Network error: Failed to connect to peer 7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607): Connection refused: /127.28.30.193:43607, [32ms] refreshing cache from master, [32ms] Sub RPC GetTableLocations: sending RPC to server master-127.28.30.252:34405, [37ms] Sub RPC GetTableLocations: received response from server master-127.28.30.252:34405: OK, [39ms] sending RPC to server 7362c8c4b1c3426e8b9a40f4bdb55b4a, [46ms] received response from server 7362c8c4b1c3426e8b9a40f4bdb55b4a: Network error: Failed to connect to peer 7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607): Connection refused: /127.28.30.193:43607, [46ms] delaying RPC due to: Network error: Failed to connect to peer 7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607): Connection refused: /127.28.30.193:43607, [52ms] refreshing cache from master, [52ms] Sub RPC GetTableLocations: sending RPC to server master-127.28.30.252:34405, [57ms] Sub RPC GetTableLocations: received response from server master-127.28.30.252:34405: OK, [59ms] sending RPC to server 7362c8c4b1c3426e8b9a40f4bdb55b4a, [61ms] received response from server 7362c8c4b1c3426e8b9a40f4bdb55b4a: Network error: Failed to connect to peer 7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607): Connection refused: /127.28.30.193:43607, [61ms] delaying RPC due to: Network error: Failed to connect to peer 7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607): Connection refused: /127.28.30.193:43607, [152ms] refreshing cache from master, [152ms] Sub RPC GetTableLocations: sending RPC to server master-127.28.30.252:34405, [156ms] Sub RPC GetTableLocations: received response from server master-127.28.30.252:34405: OK, [158ms] sending RPC to server 7362c8c4b1c3426e8b9a40f4bdb55b4a, [160ms] received response from server 7362c8c4b1c3426e8b9a40f4bdb55b4a: Network error: Failed to connect to peer 7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607): Connection refused: /127.28.30.193:43607, [161ms] delaying RPC due to: Network error: Failed to connect to peer 7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607): Connection refused: /127.28.30.193:43607, [272ms] refreshing cache from master, [273ms] Sub RPC GetTableLocations: sending RPC to server master-127.28.30.252:34405, [277ms] Sub RPC GetTableLocations: received response from server master-127.28.30.252:34405: OK, [279ms] sending RPC to server 7362c8c4b1c3426e8b9a40f4bdb55b4a, [281ms] received response from server 7362c8c4b1c3426e8b9a40f4bdb55b4a: Network error: Failed to connect to peer 7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607): Connection refused: /127.28.30.193:43607, [281ms] delaying RPC due to: Network error: Failed to connect to peer 7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607): Connection refused: /127.28.30.193:43607, [2112ms] refreshing cache from master, [2112ms] Sub RPC GetTableLocations: sending RPC to server master-127.28.30.252:34405, [2117ms] Sub RPC GetTableLocations: received response from server master-127.28.30.252:34405: OK, deferred=Deferred@1826488658(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$235/0x00007fa0dc338000@32ff7373 -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@1437667726 after retry RPC@1511426021) -> (continuation of Deferred@1431127332 after retry RPC@631078918) -> (continuation of Deferred@72138074 after retry RPC@1789858166) -> (continuation of Deferred@2115680819 after retry RPC@2029131872) -> (continuation of Deferred@207513305 after retry RPC@1678204458), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@5550a3fb -> wakeup thread Time-limited test -> (continuation of Deferred@1437667726 after retry RPC@1511426021) -> (continuation of Deferred@1431127332 after retry RPC@631078918) -> (continuation of Deferred@72138074 after retry RPC@1789858166) -> (continuation of Deferred@2115680819 after retry RPC@2029131872) -> (continuation of Deferred@207513305 after retry RPC@1678204458))) after lookup
20:03:23.078 [DEBUG - kudu-nio-2] (Connection.java:748) [peer f15bbca409334646ac14c6848f2e02b8(127.28.30.195:41923)] connecting to peer
20:03:23.080 [DEBUG - kudu-nio-1] (Connection.java:757) [peer f15bbca409334646ac14c6848f2e02b8(127.28.30.195:41923)] Successfully connected to peer
20:03:23.101 [DEBUG - kudu-nio-1] (Negotiator.java:918) Authenticated connection [id: 0x2225245c, L:/127.0.0.1:37208 - R:/127.28.30.195:41923] using TOKEN/null
20:03:23.170 [DEBUG - kudu-nio-1] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 6 rows, more = false) for scanner KuduScanner(table=org.apache.kudu.client.TestLeaderFailover-1786478581079, tablet=46436b4a5ac447e7ac81a334da9ece1f, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
20:03:23.176 [DEBUG - main] (Connection.java:575) [peer master-127.28.30.254:41663(127.28.30.254:41663)] disconnecting while in state READY
20:03:23.178 [DEBUG - main] (Connection.java:575) [peer master-127.28.30.253:38561(127.28.30.253:38561)] disconnecting while in state READY
20:03:23.178 [DEBUG - main] (Connection.java:575) [peer 7362c8c4b1c3426e8b9a40f4bdb55b4a(127.28.30.193:43607)] disconnecting while in state TERMINATED
20:03:23.179 [DEBUG - main] (Connection.java:575) [peer f15bbca409334646ac14c6848f2e02b8(127.28.30.195:41923)] disconnecting while in state READY
20:03:23.179 [DEBUG - main] (Connection.java:575) [peer master-127.28.30.252:34405(127.28.30.252:34405)] disconnecting while in state READY
20:03:23.182 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.28.30.253:38561(127.28.30.253:38561)] handling channelInactive
20:03:23.182 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.28.30.253:38561(127.28.30.253:38561)] cleaning up while in state READY due to: connection closed
20:03:23.182 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.28.30.254:41663(127.28.30.254:41663)] handling channelInactive
20:03:23.182 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.28.30.254:41663(127.28.30.254:41663)] cleaning up while in state READY due to: connection closed
20:03:23.183 [DEBUG - kudu-nio-1] (Connection.java:239) [peer f15bbca409334646ac14c6848f2e02b8(127.28.30.195:41923)] handling channelInactive
20:03:23.183 [DEBUG - kudu-nio-1] (Connection.java:709) [peer f15bbca409334646ac14c6848f2e02b8(127.28.30.195:41923)] cleaning up while in state READY due to: connection closed
20:03:23.182 [DEBUG - kudu-nio-2] (AsyncKuduClient.java:2704) Releasing all remaining resources
20:03:23.184 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.28.30.252:34405(127.28.30.252:34405)] handling channelInactive
20:03:23.185 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.28.30.252:34405(127.28.30.252:34405)] cleaning up while in state READY due to: connection closed
20:03:23.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:23.188417 28795 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskxrU2r1/build/tsan/bin/kudu with pid 29494
20:03:23.247 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:23.247248 28795 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskxrU2r1/build/tsan/bin/kudu with pid 29721
20:03:23.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:23.293800 28795 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskxrU2r1/build/tsan/bin/kudu with pid 28814
20:03:23.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:23.336166 29104 connection.cc:573] client connection to 127.28.30.254:41663 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
20:03:23.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:23.336747 29104 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
20:03:23.342 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:23.337448 28795 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskxrU2r1/build/tsan/bin/kudu with pid 28921
20:03:23.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260811 20:03:23.348655 29104 consensus_peers.cc:597] T 00000000000000000000000000000000 P 4a353b7d29034c679576efebd7aa54d1 -> Peer 535d2799517e4e0f8db40ce649706e2a (127.28.30.254:41663): Couldn't send request to peer 535d2799517e4e0f8db40ce649706e2a. Status: Network error: Client connection negotiation failed: client connection to 127.28.30.254:41663: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
20:03:23.380 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260811 20:03:23.379360 28795 external_mini_cluster.cc:1664] Killing /tmp/dist-test-taskxrU2r1/build/tsan/bin/kudu with pid 29055
20:03:24.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-08-11T20:03:24Z chronyd exiting

Time: 24.546

OK (1 test)

