JUnit version 4.13.2
.08:03:40.181 [DEBUG - main] (RandomUtils.java:49) Using random seed: 1779091420173
08:03:40.224 [INFO - main] (RetryRule.java:138) Creating RetryStatement with result reporter and retry count of 0 (no retries)
08:03:40.278 [INFO - main] (KuduTestHarness.java:155) Creating a new MiniKuduCluster...
08:03:40.289 [INFO - main] (TempDirUtils.java:71) Using the temp directory defined by TEST_TMPDIR: /tmp/dist-test-task7wVUHj/test-tmp
08:03:40.294 [INFO - main] (KuduBinaryLocator.java:83) Using Kudu binary directory specified by system property 'kuduBinDir': ../../../build/tsan/bin
08:03:40.296 [INFO - main] (MiniKuduCluster.java:217) Starting process: [/tmp/dist-test-task7wVUHj/java/build/dist-test/../../../build/tsan/bin/kudu, test, mini_cluster, --serialization=pb]
08:03:40.497 [DEBUG - main] (MiniKuduCluster.java:185) Request: create_cluster {
  num_masters: 3
  num_tservers: 3
  enable_kerberos: false
  cluster_root: "/tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965"
  hms_mode: NONE
  mini_kdc_options {
  }
  principal: "kudu"
  mini_oidc_options {
  }
}

08:03:40.701 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
08:03:40.703 [DEBUG - main] (MiniKuduCluster.java:185) Request: start_cluster {
}

08:03:40.707 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:40.706643 21935 mini_oidc.cc:150] Starting JWKS server
08:03:40.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:40.710064 21935 webserver.cc:533] Webserver started at http://127.0.0.1:42915/ using document root <none> and password file <none>
08:03:40.710 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:40.710520 21935 mini_oidc.cc:186] Starting OIDC Discovery server
08:03:40.713 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:40.712584 21935 webserver.cc:533] Webserver started at http://127.0.0.1:42877/ using document root <none> and password file <none>
08:03:40.763 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T08:03:40Z chronyd version 4.6.1 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -NTS -SECHASH -IPV6 +DEBUG)
08:03:40.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T08:03:40Z Disabled control of system clock
08:03:40.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:40.776077 21935 external_mini_cluster.cc:1366] Running /tmp/dist-test-task7wVUHj/build/tsan/bin/kudu
08:03:40.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-task7wVUHj/build/tsan/bin/kudu
08:03:40.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/master-0/wal
08:03:40.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/master-0/data
08:03:40.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:03:40.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:03:40.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:03:40.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:03:40.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:03:40.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:03:40.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/master-0/logs
08:03:40.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/master-0/data/info.pb
08:03:40.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:03:40.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:03:40.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:03:40.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:03:40.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:03:40.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:03:40.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:03:40.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:03:40.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
08:03:40.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:03:40.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:03:40.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:03:40.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.21.107.254:36655
08:03:40.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.21.107.254
08:03:40.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:03:40.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.21.107.212:41023
08:03:40.784 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:03:40.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:03:40.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:03:40.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:03:40.785 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.21.107.254:36655,127.21.107.253:44373,127.21.107.252:37903
08:03:40.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:03:40.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:42915/jwks.json with env {}
08:03:41.074 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:41.073840 21948 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:03:41.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:41.074383 21948 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:03:41.075 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:41.074841 21948 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:03:41.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:41.108004 21948 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
08:03:41.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:41.108284 21948 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:03:41.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:41.108475 21948 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
08:03:41.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:41.108803 21948 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
08:03:41.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:41.109145 21948 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
08:03:41.110 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:41.109421 21948 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:42915/jwks.json
08:03:41.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:41.145932 21948 master_runner.cc:387] Master server non-default flags:
08:03:41.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:03:41.146 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.21.107.212:41023
08:03:41.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:03:41.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:03:41.147 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/master-0/data
08:03:41.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/master-0/wal
08:03:41.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:03:41.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.21.107.254:36655,127.21.107.253:44373,127.21.107.252:37903
08:03:41.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:03:41.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:03:41.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:03:41.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.21.107.254:36655
08:03:41.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:03:41.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:03:41.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:03:41.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:42915/jwks.json
08:03:41.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:03:41.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:03:41.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/master-0/data/info.pb
08:03:41.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.21.107.254
08:03:41.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:03:41.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:03:41.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:03:41.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:03:41.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:03:41.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:03:41.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/master-0/logs
08:03:41.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:03:41.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:03:41.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:03:41.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
08:03:41.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:03:41.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:03:41.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:03:41.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:03:41.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:03:41.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:03:41.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:41.147253 21948 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:03:41.154 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:41.149399 21948 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:03:41.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:41.160768 21954 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:03:42.892 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:42.565286 21953 debug-util.cc:398] Leaking SignalData structure 0x7b08000271e0 after lost signal to thread 21948
08:03:42.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:42.892148 21953 kernel_stack_watchdog.cc:198] Thread 21948 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 401ms:
08:03:42.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
08:03:42.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
08:03:42.893 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
08:03:42.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
08:03:42.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:41.162658 21955 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:03:42.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:42.893399 21948 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.732s	user 0.623s	sys 1.108s
08:03:42.894 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:42.893780 21948 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.732s	user 0.623s	sys 1.108s
08:03:42.897 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:42.897102 21956 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1729 milliseconds
08:03:42.898 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:42.898532 21957 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:03:42.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:42.898586 21948 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:03:42.899 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:42.899698 21948 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:03:42.902 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:42.901979 21948 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:03:42.903 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:42.903311 21948 hybrid_clock.cc:648] HybridClock initialized: now 1779091422903264 us; error 43 us; skew 500 ppm
08:03:42.904 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:42.904204 21948 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:03:42.910 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:42.910058 21948 webserver.cc:533] Webserver started at http://127.21.107.254:40143/ using document root <none> and password file <none>
08:03:42.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:42.910931 21948 fs_manager.cc:362] Metadata directory not provided
08:03:42.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:42.911109 21948 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:03:42.911 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:42.911580 21948 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:03:42.916 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:42.915913 21948 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/master-0/data/instance:
08:03:42.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "39a0718204d34e9696b9c97d166909ad"
08:03:42.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:03:42 on dist-test-slave-ls2g"
08:03:42.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:42.917197 21948 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/master-0/wal/instance:
08:03:42.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "39a0718204d34e9696b9c97d166909ad"
08:03:42.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:03:42 on dist-test-slave-ls2g"
08:03:42.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:42.926134 21948 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.005s	sys 0.002s
08:03:42.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:42.932004 21964 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:03:42.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:42.933259 21948 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.003s
08:03:42.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:42.933616 21948 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/master-0/data,/tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/master-0/wal
08:03:42.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "39a0718204d34e9696b9c97d166909ad"
08:03:42.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:03:42 on dist-test-slave-ls2g"
08:03:42.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:42.934000 21948 fs_report.cc:389] FS layout report
08:03:42.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:03:42.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/master-0/wal
08:03:42.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/master-0/wal
08:03:42.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/master-0/data/data
08:03:42.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:03:42.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:03:42.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:03:42.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:03:42.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:03:42.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:03:42.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:03:42.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:03:42.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:03:42.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:03:42.937 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:03:43.006 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:43.006009 21948 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:03:43.007 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:43.007529 21948 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:03:43.008 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:43.007923 21948 kserver.cc:163] Server-wide thread pool size limit: 3276
08:03:43.079 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:43.079269 21948 rpc_server.cc:307] RPC server started. Bound to: 127.21.107.254:36655
08:03:43.080 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:43.079362 22015 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.107.254:36655 every 8 connection(s)
08:03:43.082 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:43.081997 21948 server_base.cc:1193] Dumped server information to /tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/master-0/data/info.pb
08:03:43.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:43.086992 21935 external_mini_cluster.cc:1428] Started /tmp/dist-test-task7wVUHj/build/tsan/bin/kudu as pid 21948
08:03:43.087 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:43.087464 21935 external_mini_cluster.cc:1442] Reading /tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/master-0/wal/instance
08:03:43.088 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:43.087792 22016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
08:03:43.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:43.091131 21935 external_mini_cluster.cc:1366] Running /tmp/dist-test-task7wVUHj/build/tsan/bin/kudu
08:03:43.091 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-task7wVUHj/build/tsan/bin/kudu
08:03:43.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/master-1/wal
08:03:43.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/master-1/data
08:03:43.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:03:43.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:03:43.092 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:03:43.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:03:43.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:03:43.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:03:43.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/master-1/logs
08:03:43.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/master-1/data/info.pb
08:03:43.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:03:43.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:03:43.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:03:43.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:03:43.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:03:43.094 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:03:43.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:03:43.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:03:43.095 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
08:03:43.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:03:43.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:03:43.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:03:43.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.21.107.253:44373
08:03:43.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.21.107.253
08:03:43.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:03:43.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.21.107.212:41023
08:03:43.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:03:43.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:03:43.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:03:43.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:03:43.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.21.107.254:36655,127.21.107.253:44373,127.21.107.252:37903
08:03:43.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:03:43.098 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:42915/jwks.json with env {}
08:03:43.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:43.100739 22016 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.107.254" port: 36655 } has no permanent_uuid. Determining permanent_uuid...
08:03:43.129 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:43.129154 22016 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.107.253" port: 44373 } has no permanent_uuid. Determining permanent_uuid...
08:03:43.132 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:43.131752 21968 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.107.253:44373: connect: Connection refused (error 111)
08:03:43.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:43.135818 22016 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.107.253:44373: Network error: Client connection negotiation failed: client connection to 127.21.107.253:44373: connect: Connection refused (error 111)
08:03:43.186 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:43.185269 22016 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.107.253" port: 44373 } attempt: 1
08:03:43.189 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:43.189270 22016 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.107.253:44373: Network error: Client connection negotiation failed: client connection to 127.21.107.253:44373: connect: Connection refused (error 111)
08:03:43.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:43.257675 22016 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.107.253" port: 44373 } attempt: 2
08:03:43.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:43.261564 22016 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.107.253:44373: Network error: Client connection negotiation failed: client connection to 127.21.107.253:44373: connect: Connection refused (error 111)
08:03:43.353 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:43.353024 22016 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.107.253" port: 44373 } attempt: 3
08:03:43.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:43.357967 22016 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.107.253:44373: Network error: Client connection negotiation failed: client connection to 127.21.107.253:44373: connect: Connection refused (error 111)
08:03:43.402 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:43.402128 22018 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:03:43.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:43.402711 22018 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:03:43.403 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:43.403415 22018 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:03:43.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:43.446400 22018 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
08:03:43.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:43.446678 22018 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:03:43.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:43.446868 22018 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
08:03:43.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:43.447049 22018 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
08:03:43.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:43.447229 22018 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
08:03:43.447 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:43.447432 22018 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:42915/jwks.json
08:03:43.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:43.484510 22018 master_runner.cc:387] Master server non-default flags:
08:03:43.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:03:43.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.21.107.212:41023
08:03:43.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:03:43.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:03:43.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/master-1/data
08:03:43.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/master-1/wal
08:03:43.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:03:43.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.21.107.254:36655,127.21.107.253:44373,127.21.107.252:37903
08:03:43.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:03:43.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:03:43.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:03:43.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.21.107.253:44373
08:03:43.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:03:43.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:03:43.487 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:03:43.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:42915/jwks.json
08:03:43.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:03:43.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:03:43.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/master-1/data/info.pb
08:03:43.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.21.107.253
08:03:43.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:03:43.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:03:43.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:03:43.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:03:43.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:03:43.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:03:43.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/master-1/logs
08:03:43.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:03:43.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:03:43.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:03:43.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
08:03:43.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:03:43.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:03:43.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:03:43.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:03:43.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:03:43.491 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:03:43.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:43.485793 22018 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:03:43.492 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:43.487455 22018 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:03:43.501 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:43.500825 22027 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:03:43.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:43.501507 22016 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.107.253" port: 44373 } attempt: 4
08:03:43.508 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:43.507685 22016 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.107.253:44373: Network error: Client connection negotiation failed: client connection to 127.21.107.253:44373: connect: Connection refused (error 111)
08:03:43.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:43.807101 22016 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.107.253" port: 44373 } attempt: 5
08:03:43.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:43.813815 22016 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.107.253:44373: Network error: Client connection negotiation failed: client connection to 127.21.107.253:44373: connect: Connection refused (error 111)
08:03:44.362 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.361364 22016 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.107.253" port: 44373 } attempt: 6
08:03:44.377 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:44.376238 22016 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.107.253:44373: Network error: Client connection negotiation failed: client connection to 127.21.107.253:44373: connect: Connection refused (error 111)
08:03:44.754 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:43.502789 22028 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:03:44.755 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:43.505600 22030 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:03:44.759 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:44.759562 22029 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1250 milliseconds
08:03:44.760 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.759709 22018 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:03:44.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.761198 22018 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:03:44.764 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.764243 22018 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:03:44.765 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.765594 22018 hybrid_clock.cc:648] HybridClock initialized: now 1779091424765556 us; error 72 us; skew 500 ppm
08:03:44.766 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.766434 22018 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:03:44.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.772704 22018 webserver.cc:533] Webserver started at http://127.21.107.253:40635/ using document root <none> and password file <none>
08:03:44.773 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.773597 22018 fs_manager.cc:362] Metadata directory not provided
08:03:44.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.773842 22018 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:03:44.774 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.774209 22018 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:03:44.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.778489 22018 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/master-1/data/instance:
08:03:44.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "cfc2dea447cb440baf16b45c0c409ac2"
08:03:44.779 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:03:44 on dist-test-slave-ls2g"
08:03:44.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.779685 22018 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/master-1/wal/instance:
08:03:44.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "cfc2dea447cb440baf16b45c0c409ac2"
08:03:44.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:03:44 on dist-test-slave-ls2g"
08:03:44.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.786860 22018 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.007s	sys 0.001s
08:03:44.792 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.792218 22039 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:03:44.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.793304 22018 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.000s
08:03:44.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.793690 22018 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/master-1/data,/tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/master-1/wal
08:03:44.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "cfc2dea447cb440baf16b45c0c409ac2"
08:03:44.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:03:44 on dist-test-slave-ls2g"
08:03:44.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.793994 22018 fs_report.cc:389] FS layout report
08:03:44.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:03:44.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/master-1/wal
08:03:44.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/master-1/wal
08:03:44.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/master-1/data/data
08:03:44.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:03:44.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:03:44.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:03:44.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:03:44.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:03:44.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:03:44.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:03:44.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:03:44.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:03:44.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:03:44.796 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:03:44.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.844090 22018 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:03:44.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.845515 22018 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:03:44.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.845939 22018 kserver.cc:163] Server-wide thread pool size limit: 3276
08:03:44.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.916752 22018 rpc_server.cc:307] RPC server started. Bound to: 127.21.107.253:44373
08:03:44.917 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.916839 22090 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.107.253:44373 every 8 connection(s)
08:03:44.919 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.919540 22018 server_base.cc:1193] Dumped server information to /tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/master-1/data/info.pb
08:03:44.926 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.925954 22091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
08:03:44.928 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.928453 21935 external_mini_cluster.cc:1428] Started /tmp/dist-test-task7wVUHj/build/tsan/bin/kudu as pid 22018
08:03:44.929 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.928875 21935 external_mini_cluster.cc:1442] Reading /tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/master-1/wal/instance
08:03:44.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.931043 21935 external_mini_cluster.cc:1366] Running /tmp/dist-test-task7wVUHj/build/tsan/bin/kudu
08:03:44.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-task7wVUHj/build/tsan/bin/kudu
08:03:44.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/master-2/wal
08:03:44.931 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/master-2/data
08:03:44.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:03:44.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:03:44.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:03:44.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:03:44.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:03:44.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:03:44.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/master-2/logs
08:03:44.932 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/master-2/data/info.pb
08:03:44.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:03:44.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:03:44.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:03:44.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:03:44.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:03:44.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:03:44.933 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:03:44.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:03:44.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) master
08:03:44.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:03:44.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:03:44.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:03:44.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.21.107.252:37903
08:03:44.934 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.21.107.252
08:03:44.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:03:44.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.21.107.212:41023
08:03:44.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:03:44.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:03:44.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:03:44.935 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:03:44.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.21.107.254:36655,127.21.107.253:44373,127.21.107.252:37903
08:03:44.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:03:44.936 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:42915/jwks.json with env {}
08:03:44.940 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.938344 22091 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.107.254" port: 36655 } has no permanent_uuid. Determining permanent_uuid...
08:03:44.960 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.959767 22091 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.107.253" port: 44373 } has no permanent_uuid. Determining permanent_uuid...
08:03:44.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:44.973774 22091 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.107.252" port: 37903 } has no permanent_uuid. Determining permanent_uuid...
08:03:44.976 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:44.976043 22043 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.107.252:37903: connect: Connection refused (error 111)
08:03:44.981 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:44.981055 22091 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.107.252:37903: Network error: Client connection negotiation failed: client connection to 127.21.107.252:37903: connect: Connection refused (error 111)
08:03:45.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:45.030596 22091 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.107.252" port: 37903 } attempt: 1
08:03:45.035 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:45.034682 22091 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.107.252:37903: Network error: Client connection negotiation failed: client connection to 127.21.107.252:37903: connect: Connection refused (error 111)
08:03:45.103 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:45.103173 22091 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.107.252" port: 37903 } attempt: 2
08:03:45.108 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:45.107671 22091 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.107.252:37903: Network error: Client connection negotiation failed: client connection to 127.21.107.252:37903: connect: Connection refused (error 111)
08:03:45.199 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:45.199110 22091 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.107.252" port: 37903 } attempt: 3
08:03:45.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:45.203470 22091 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.107.252:37903: Network error: Client connection negotiation failed: client connection to 127.21.107.252:37903: connect: Connection refused (error 111)
08:03:45.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:45.243546 22093 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:03:45.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:45.244163 22093 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:03:45.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:45.244652 22093 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:03:45.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:45.277822 22093 flags.cc:432] Enabled experimental flag: --ipki_ca_key_size=768
08:03:45.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:45.278086 22093 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:03:45.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:45.278278 22093 flags.cc:432] Enabled experimental flag: --tsk_num_rsa_bits=512
08:03:45.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:45.278460 22093 flags.cc:432] Enabled experimental flag: --rpc_reuseport=true
08:03:45.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:45.278637 22093 flags.cc:432] Enabled experimental flag: --enable_jwt_token_auth=true
08:03:45.278 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:45.278789 22093 flags.cc:432] Enabled experimental flag: --jwks_url=http://localhost:42915/jwks.json
08:03:45.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:45.315948 22093 master_runner.cc:387] Master server non-default flags:
08:03:45.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:03:45.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.21.107.212:41023
08:03:45.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:03:45.316 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:03:45.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/master-2/data
08:03:45.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/master-2/wal
08:03:45.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_ca_key_size=768
08:03:45.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --master_addresses=127.21.107.254:36655,127.21.107.253:44373,127.21.107.252:37903
08:03:45.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:03:45.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:03:45.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tsk_num_rsa_bits=512
08:03:45.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.21.107.252:37903
08:03:45.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_reuseport=true
08:03:45.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:03:45.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_jwt_token_auth=true
08:03:45.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --jwks_url=http://localhost:42915/jwks.json
08:03:45.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:03:45.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:03:45.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/master-2/data/info.pb
08:03:45.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.21.107.252
08:03:45.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:03:45.319 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:03:45.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:03:45.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:03:45.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:03:45.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:03:45.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/master-2/logs
08:03:45.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:03:45.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:03:45.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:03:45.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Master server version:
08:03:45.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:03:45.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:03:45.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:03:45.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:03:45.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:03:45.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:03:45.321 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:45.317314 22093 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:03:45.322 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:45.319284 22093 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:03:45.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:45.330775 22103 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:03:45.347 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:45.346907 22091 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.107.252" port: 37903 } attempt: 4
08:03:45.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:45.351128 22091 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.107.252:37903: Network error: Client connection negotiation failed: client connection to 127.21.107.252:37903: connect: Connection refused (error 111)
08:03:45.437 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:45.436844 22016 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.107.253" port: 44373 } attempt: 7
08:03:45.449 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:45.449230 22016 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.107.252" port: 37903 } has no permanent_uuid. Determining permanent_uuid...
08:03:45.455 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:45.455549 22016 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.107.252:37903: Network error: Client connection negotiation failed: client connection to 127.21.107.252:37903: connect: Connection refused (error 111)
08:03:45.514 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:45.513943 22016 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.107.252" port: 37903 } attempt: 1
08:03:45.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:45.518666 22016 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.107.252:37903: Network error: Client connection negotiation failed: client connection to 127.21.107.252:37903: connect: Connection refused (error 111)
08:03:45.600 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:45.600051 22016 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.107.252" port: 37903 } attempt: 2
08:03:45.604 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:45.604559 22016 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.107.252:37903: Network error: Client connection negotiation failed: client connection to 127.21.107.252:37903: connect: Connection refused (error 111)
08:03:45.651 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:45.650774 22091 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.107.252" port: 37903 } attempt: 5
08:03:45.655 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:45.655061 22091 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.107.252:37903: Network error: Client connection negotiation failed: client connection to 127.21.107.252:37903: connect: Connection refused (error 111)
08:03:45.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:45.689960 22016 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.107.252" port: 37903 } attempt: 3
08:03:45.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:45.694495 22016 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.107.252:37903: Network error: Client connection negotiation failed: client connection to 127.21.107.252:37903: connect: Connection refused (error 111)
08:03:45.835 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:45.834944 22016 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.107.252" port: 37903 } attempt: 4
08:03:45.840 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:45.839797 22016 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.107.252:37903: Network error: Client connection negotiation failed: client connection to 127.21.107.252:37903: connect: Connection refused (error 111)
08:03:46.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.123173 22016 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.107.252" port: 37903 } attempt: 5
08:03:46.128 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:46.127768 22016 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.107.252:37903: Network error: Client connection negotiation failed: client connection to 127.21.107.252:37903: connect: Connection refused (error 111)
08:03:46.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.202642 22091 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.107.252" port: 37903 } attempt: 6
08:03:46.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:46.209961 22091 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.107.252:37903: Network error: Client connection negotiation failed: client connection to 127.21.107.252:37903: connect: Connection refused (error 111)
08:03:46.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:45.333271 22104 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:03:46.524 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:45.334465 22106 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:03:46.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:46.524523 22105 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
08:03:46.525 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.524672 22093 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:03:46.529 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.528754 22093 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:03:46.532 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.531814 22093 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:03:46.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.533232 22093 hybrid_clock.cc:648] HybridClock initialized: now 1779091426533184 us; error 70 us; skew 500 ppm
08:03:46.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.534052 22093 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:03:46.540 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.540637 22093 webserver.cc:533] Webserver started at http://127.21.107.252:33087/ using document root <none> and password file <none>
08:03:46.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.541468 22093 fs_manager.cc:362] Metadata directory not provided
08:03:46.541 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.541718 22093 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:03:46.542 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.542119 22093 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:03:46.546 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.546487 22093 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/master-2/data/instance:
08:03:46.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "796bdab7947648839320ff60c5fcaaf9"
08:03:46.547 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:03:46 on dist-test-slave-ls2g"
08:03:46.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.547748 22093 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/master-2/wal/instance:
08:03:46.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "796bdab7947648839320ff60c5fcaaf9"
08:03:46.548 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:03:46 on dist-test-slave-ls2g"
08:03:46.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.555018 22093 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.008s	sys 0.000s
08:03:46.560 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.560312 22117 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:03:46.561 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.561375 22093 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
08:03:46.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.561704 22093 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/master-2/data,/tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/master-2/wal
08:03:46.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "796bdab7947648839320ff60c5fcaaf9"
08:03:46.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:03:46 on dist-test-slave-ls2g"
08:03:46.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.562045 22093 fs_report.cc:389] FS layout report
08:03:46.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:03:46.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/master-2/wal
08:03:46.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/master-2/wal
08:03:46.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/master-2/data/data
08:03:46.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:03:46.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:03:46.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:03:46.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:03:46.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:03:46.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:03:46.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:03:46.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:03:46.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:03:46.563 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:03:46.564 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:03:46.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.614570 22093 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:03:46.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.616024 22093 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:03:46.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.616410 22093 kserver.cc:163] Server-wide thread pool size limit: 3276
08:03:46.680 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.680164 22016 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.107.252" port: 37903 } attempt: 6
08:03:46.688 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:46.687676 22016 consensus_peers.cc:760] Error getting permanent uuid from config peer 127.21.107.252:37903: Network error: Client connection negotiation failed: client connection to 127.21.107.252:37903: connect: Connection refused (error 111)
08:03:46.690 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.690567 22093 rpc_server.cc:307] RPC server started. Bound to: 127.21.107.252:37903
08:03:46.691 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.690683 22171 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.107.252:37903 every 8 connection(s)
08:03:46.693 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.693025 22093 server_base.cc:1193] Dumped server information to /tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/master-2/data/info.pb
08:03:46.694 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.694384 21935 external_mini_cluster.cc:1428] Started /tmp/dist-test-task7wVUHj/build/tsan/bin/kudu as pid 22093
08:03:46.695 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.694952 21935 external_mini_cluster.cc:1442] Reading /tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/master-2/wal/instance
08:03:46.700 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.700146 22172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
08:03:46.720 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.717103 22172 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.107.254" port: 36655 } has no permanent_uuid. Determining permanent_uuid...
08:03:46.743 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.743234 22172 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.107.253" port: 44373 } has no permanent_uuid. Determining permanent_uuid...
08:03:46.753 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.752954 22172 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.21.107.252" port: 37903 } has no permanent_uuid. Determining permanent_uuid...
08:03:46.768 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.768448 22172 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 796bdab7947648839320ff60c5fcaaf9: Bootstrap starting.
08:03:46.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.775012 22172 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 796bdab7947648839320ff60c5fcaaf9: Neither blocks nor log segments found. Creating new log.
08:03:46.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.776623 22172 log.cc:826] T 00000000000000000000000000000000 P 796bdab7947648839320ff60c5fcaaf9: Log is configured to *not* fsync() on all Append() calls
08:03:46.781 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.780740 22172 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 796bdab7947648839320ff60c5fcaaf9: No bootstrap required, opened a new log
08:03:46.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.799710 22172 raft_consensus.cc:359] T 00000000000000000000000000000000 P 796bdab7947648839320ff60c5fcaaf9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39a0718204d34e9696b9c97d166909ad" member_type: VOTER last_known_addr { host: "127.21.107.254" port: 36655 } } peers { permanent_uuid: "cfc2dea447cb440baf16b45c0c409ac2" member_type: VOTER last_known_addr { host: "127.21.107.253" port: 44373 } } peers { permanent_uuid: "796bdab7947648839320ff60c5fcaaf9" member_type: VOTER last_known_addr { host: "127.21.107.252" port: 37903 } }
08:03:46.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.800287 22172 raft_consensus.cc:385] T 00000000000000000000000000000000 P 796bdab7947648839320ff60c5fcaaf9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:03:46.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.800473 22172 raft_consensus.cc:740] T 00000000000000000000000000000000 P 796bdab7947648839320ff60c5fcaaf9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 796bdab7947648839320ff60c5fcaaf9, State: Initialized, Role: FOLLOWER
08:03:46.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.801152 22172 consensus_queue.cc:260] T 00000000000000000000000000000000 P 796bdab7947648839320ff60c5fcaaf9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39a0718204d34e9696b9c97d166909ad" member_type: VOTER last_known_addr { host: "127.21.107.254" port: 36655 } } peers { permanent_uuid: "cfc2dea447cb440baf16b45c0c409ac2" member_type: VOTER last_known_addr { host: "127.21.107.253" port: 44373 } } peers { permanent_uuid: "796bdab7947648839320ff60c5fcaaf9" member_type: VOTER last_known_addr { host: "127.21.107.252" port: 37903 } }
08:03:46.804 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.803680 22182 sys_catalog.cc:455] T 00000000000000000000000000000000 P 796bdab7947648839320ff60c5fcaaf9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39a0718204d34e9696b9c97d166909ad" member_type: VOTER last_known_addr { host: "127.21.107.254" port: 36655 } } peers { permanent_uuid: "cfc2dea447cb440baf16b45c0c409ac2" member_type: VOTER last_known_addr { host: "127.21.107.253" port: 44373 } } peers { permanent_uuid: "796bdab7947648839320ff60c5fcaaf9" member_type: VOTER last_known_addr { host: "127.21.107.252" port: 37903 } } }
08:03:46.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.804698 22182 sys_catalog.cc:458] T 00000000000000000000000000000000 P 796bdab7947648839320ff60c5fcaaf9 [sys.catalog]: This master's current role is: FOLLOWER
08:03:46.805 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.805609 22172 sys_catalog.cc:565] T 00000000000000000000000000000000 P 796bdab7947648839320ff60c5fcaaf9 [sys.catalog]: configured and running, proceeding with master startup.
08:03:46.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:46.829959 22193 catalog_manager.cc:1593] T 00000000000000000000000000000000 P 796bdab7947648839320ff60c5fcaaf9: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
08:03:46.830 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:46.830289 22193 catalog_manager.cc:883] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
08:03:46.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.825037 22093 master_runner.cc:187] Error getting master registration for 127.21.107.254:36655: OK, instance_id { permanent_uuid: "39a0718204d34e9696b9c97d166909ad" instance_seqno: 1779091423059935 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
08:03:46.846 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:46.845769 22093 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
08:03:46.871 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:46.871394 22123 tablet.cc:2404] T 00000000000000000000000000000000 P 796bdab7947648839320ff60c5fcaaf9: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:03:47.161 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.160962 22182 raft_consensus.cc:493] T 00000000000000000000000000000000 P 796bdab7947648839320ff60c5fcaaf9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:03:47.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.161372 22182 raft_consensus.cc:515] T 00000000000000000000000000000000 P 796bdab7947648839320ff60c5fcaaf9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39a0718204d34e9696b9c97d166909ad" member_type: VOTER last_known_addr { host: "127.21.107.254" port: 36655 } } peers { permanent_uuid: "cfc2dea447cb440baf16b45c0c409ac2" member_type: VOTER last_known_addr { host: "127.21.107.253" port: 44373 } } peers { permanent_uuid: "796bdab7947648839320ff60c5fcaaf9" member_type: VOTER last_known_addr { host: "127.21.107.252" port: 37903 } }
08:03:47.164 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.163851 22182 leader_election.cc:290] T 00000000000000000000000000000000 P 796bdab7947648839320ff60c5fcaaf9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 39a0718204d34e9696b9c97d166909ad (127.21.107.254:36655), cfc2dea447cb440baf16b45c0c409ac2 (127.21.107.253:44373)
08:03:47.271 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.270507 22091 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.107.252" port: 37903 } attempt: 7
08:03:47.301 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.300616 22091 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cfc2dea447cb440baf16b45c0c409ac2: Bootstrap starting.
08:03:47.308 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.307930 22091 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P cfc2dea447cb440baf16b45c0c409ac2: Neither blocks nor log segments found. Creating new log.
08:03:47.310 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.310102 22091 log.cc:826] T 00000000000000000000000000000000 P cfc2dea447cb440baf16b45c0c409ac2: Log is configured to *not* fsync() on all Append() calls
08:03:47.320 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.319671 22091 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P cfc2dea447cb440baf16b45c0c409ac2: No bootstrap required, opened a new log
08:03:47.348 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.347675 22091 raft_consensus.cc:359] T 00000000000000000000000000000000 P cfc2dea447cb440baf16b45c0c409ac2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39a0718204d34e9696b9c97d166909ad" member_type: VOTER last_known_addr { host: "127.21.107.254" port: 36655 } } peers { permanent_uuid: "cfc2dea447cb440baf16b45c0c409ac2" member_type: VOTER last_known_addr { host: "127.21.107.253" port: 44373 } } peers { permanent_uuid: "796bdab7947648839320ff60c5fcaaf9" member_type: VOTER last_known_addr { host: "127.21.107.252" port: 37903 } }
08:03:47.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.348428 22091 raft_consensus.cc:385] T 00000000000000000000000000000000 P cfc2dea447cb440baf16b45c0c409ac2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:03:47.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.348712 22091 raft_consensus.cc:740] T 00000000000000000000000000000000 P cfc2dea447cb440baf16b45c0c409ac2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfc2dea447cb440baf16b45c0c409ac2, State: Initialized, Role: FOLLOWER
08:03:47.350 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.349674 22091 consensus_queue.cc:260] T 00000000000000000000000000000000 P cfc2dea447cb440baf16b45c0c409ac2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39a0718204d34e9696b9c97d166909ad" member_type: VOTER last_known_addr { host: "127.21.107.254" port: 36655 } } peers { permanent_uuid: "cfc2dea447cb440baf16b45c0c409ac2" member_type: VOTER last_known_addr { host: "127.21.107.253" port: 44373 } } peers { permanent_uuid: "796bdab7947648839320ff60c5fcaaf9" member_type: VOTER last_known_addr { host: "127.21.107.252" port: 37903 } }
08:03:47.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.353493 22198 sys_catalog.cc:455] T 00000000000000000000000000000000 P cfc2dea447cb440baf16b45c0c409ac2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39a0718204d34e9696b9c97d166909ad" member_type: VOTER last_known_addr { host: "127.21.107.254" port: 36655 } } peers { permanent_uuid: "cfc2dea447cb440baf16b45c0c409ac2" member_type: VOTER last_known_addr { host: "127.21.107.253" port: 44373 } } peers { permanent_uuid: "796bdab7947648839320ff60c5fcaaf9" member_type: VOTER last_known_addr { host: "127.21.107.252" port: 37903 } } }
08:03:47.354 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.354573 22198 sys_catalog.cc:458] T 00000000000000000000000000000000 P cfc2dea447cb440baf16b45c0c409ac2 [sys.catalog]: This master's current role is: FOLLOWER
08:03:47.355 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.355123 22091 sys_catalog.cc:565] T 00000000000000000000000000000000 P cfc2dea447cb440baf16b45c0c409ac2 [sys.catalog]: configured and running, proceeding with master startup.
08:03:47.356 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.356165 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "796bdab7947648839320ff60c5fcaaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfc2dea447cb440baf16b45c0c409ac2" is_pre_election: true
08:03:47.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.356863 22066 raft_consensus.cc:2468] T 00000000000000000000000000000000 P cfc2dea447cb440baf16b45c0c409ac2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 796bdab7947648839320ff60c5fcaaf9 in term 0.
08:03:47.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.358144 22121 leader_election.cc:304] T 00000000000000000000000000000000 P 796bdab7947648839320ff60c5fcaaf9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 796bdab7947648839320ff60c5fcaaf9, cfc2dea447cb440baf16b45c0c409ac2; no voters: 
08:03:47.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.358968 22182 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 796bdab7947648839320ff60c5fcaaf9 [term 0 FOLLOWER]: Leader pre-election won for term 1
08:03:47.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.359315 22182 raft_consensus.cc:493] T 00000000000000000000000000000000 P 796bdab7947648839320ff60c5fcaaf9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:03:47.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.359637 22182 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 796bdab7947648839320ff60c5fcaaf9 [term 0 FOLLOWER]: Advancing to term 1
08:03:47.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.367908 22182 raft_consensus.cc:515] T 00000000000000000000000000000000 P 796bdab7947648839320ff60c5fcaaf9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39a0718204d34e9696b9c97d166909ad" member_type: VOTER last_known_addr { host: "127.21.107.254" port: 36655 } } peers { permanent_uuid: "cfc2dea447cb440baf16b45c0c409ac2" member_type: VOTER last_known_addr { host: "127.21.107.253" port: 44373 } } peers { permanent_uuid: "796bdab7947648839320ff60c5fcaaf9" member_type: VOTER last_known_addr { host: "127.21.107.252" port: 37903 } }
08:03:47.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.372761 22066 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "796bdab7947648839320ff60c5fcaaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfc2dea447cb440baf16b45c0c409ac2"
08:03:47.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.373582 22066 raft_consensus.cc:3060] T 00000000000000000000000000000000 P cfc2dea447cb440baf16b45c0c409ac2 [term 0 FOLLOWER]: Advancing to term 1
08:03:47.381 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.380846 22066 raft_consensus.cc:2468] T 00000000000000000000000000000000 P cfc2dea447cb440baf16b45c0c409ac2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 796bdab7947648839320ff60c5fcaaf9 in term 1.
08:03:47.382 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.382051 22121 leader_election.cc:304] T 00000000000000000000000000000000 P 796bdab7947648839320ff60c5fcaaf9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 796bdab7947648839320ff60c5fcaaf9, cfc2dea447cb440baf16b45c0c409ac2; no voters: 
08:03:47.388 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.388305 22182 leader_election.cc:290] T 00000000000000000000000000000000 P 796bdab7947648839320ff60c5fcaaf9 [CANDIDATE]: Term 1 election: Requested vote from peers 39a0718204d34e9696b9c97d166909ad (127.21.107.254:36655), cfc2dea447cb440baf16b45c0c409ac2 (127.21.107.253:44373)
08:03:47.390 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.389608 22182 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 796bdab7947648839320ff60c5fcaaf9 [term 1 FOLLOWER]: Leader election won for term 1
08:03:47.391 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.390942 22182 raft_consensus.cc:697] T 00000000000000000000000000000000 P 796bdab7947648839320ff60c5fcaaf9 [term 1 LEADER]: Becoming Leader. State: Replica: 796bdab7947648839320ff60c5fcaaf9, State: Running, Role: LEADER
08:03:47.396 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.392616 22182 consensus_queue.cc:237] T 00000000000000000000000000000000 P 796bdab7947648839320ff60c5fcaaf9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39a0718204d34e9696b9c97d166909ad" member_type: VOTER last_known_addr { host: "127.21.107.254" port: 36655 } } peers { permanent_uuid: "cfc2dea447cb440baf16b45c0c409ac2" member_type: VOTER last_known_addr { host: "127.21.107.253" port: 44373 } } peers { permanent_uuid: "796bdab7947648839320ff60c5fcaaf9" member_type: VOTER last_known_addr { host: "127.21.107.252" port: 37903 } }
08:03:47.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.414667 22204 sys_catalog.cc:455] T 00000000000000000000000000000000 P 796bdab7947648839320ff60c5fcaaf9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 796bdab7947648839320ff60c5fcaaf9. Latest consensus state: current_term: 1 leader_uuid: "796bdab7947648839320ff60c5fcaaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39a0718204d34e9696b9c97d166909ad" member_type: VOTER last_known_addr { host: "127.21.107.254" port: 36655 } } peers { permanent_uuid: "cfc2dea447cb440baf16b45c0c409ac2" member_type: VOTER last_known_addr { host: "127.21.107.253" port: 44373 } } peers { permanent_uuid: "796bdab7947648839320ff60c5fcaaf9" member_type: VOTER last_known_addr { host: "127.21.107.252" port: 37903 } } }
08:03:47.415 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.415246 22204 sys_catalog.cc:458] T 00000000000000000000000000000000 P 796bdab7947648839320ff60c5fcaaf9 [sys.catalog]: This master's current role is: LEADER
08:03:47.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.420702 22210 catalog_manager.cc:1510] Loading table and tablet metadata into memory...
08:03:47.428 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.428371 22212 catalog_manager.cc:805] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
08:03:47.429 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.428426 22210 catalog_manager.cc:1519] Initializing Kudu cluster ID...
08:03:47.446 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.444974 22066 raft_consensus.cc:1275] T 00000000000000000000000000000000 P cfc2dea447cb440baf16b45c0c409ac2 [term 1 FOLLOWER]: Refusing update from remote peer 796bdab7947648839320ff60c5fcaaf9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
08:03:47.448 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.446702 22204 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 796bdab7947648839320ff60c5fcaaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfc2dea447cb440baf16b45c0c409ac2" member_type: VOTER last_known_addr { host: "127.21.107.253" port: 44373 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
08:03:47.465 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.432511 22018 master_runner.cc:187] Error getting master registration for 127.21.107.254:36655: OK, instance_id { permanent_uuid: "39a0718204d34e9696b9c97d166909ad" instance_seqno: 1779091423059935 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
08:03:47.467 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.466548 22018 master_runner.cc:419] Couldn't verify the masters in the cluster. Trying again...
08:03:47.481 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.481034 22198 sys_catalog.cc:455] T 00000000000000000000000000000000 P cfc2dea447cb440baf16b45c0c409ac2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 796bdab7947648839320ff60c5fcaaf9. Latest consensus state: current_term: 1 leader_uuid: "796bdab7947648839320ff60c5fcaaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39a0718204d34e9696b9c97d166909ad" member_type: VOTER last_known_addr { host: "127.21.107.254" port: 36655 } } peers { permanent_uuid: "cfc2dea447cb440baf16b45c0c409ac2" member_type: VOTER last_known_addr { host: "127.21.107.253" port: 44373 } } peers { permanent_uuid: "796bdab7947648839320ff60c5fcaaf9" member_type: VOTER last_known_addr { host: "127.21.107.252" port: 37903 } } }
08:03:47.482 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.482143 22198 sys_catalog.cc:458] T 00000000000000000000000000000000 P cfc2dea447cb440baf16b45c0c409ac2 [sys.catalog]: This master's current role is: FOLLOWER
08:03:47.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.482935 22213 mvcc.cc:204] Tried to move back new op lower bound from 7287158486798266368 to 7287158486633111552. Current Snapshot: MvccSnapshot[applied={T|T < 7287158486798266368}]
08:03:47.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.484848 22182 sys_catalog.cc:455] T 00000000000000000000000000000000 P 796bdab7947648839320ff60c5fcaaf9 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "796bdab7947648839320ff60c5fcaaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39a0718204d34e9696b9c97d166909ad" member_type: VOTER last_known_addr { host: "127.21.107.254" port: 36655 } } peers { permanent_uuid: "cfc2dea447cb440baf16b45c0c409ac2" member_type: VOTER last_known_addr { host: "127.21.107.253" port: 44373 } } peers { permanent_uuid: "796bdab7947648839320ff60c5fcaaf9" member_type: VOTER last_known_addr { host: "127.21.107.252" port: 37903 } } }
08:03:47.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.485505 22182 sys_catalog.cc:458] T 00000000000000000000000000000000 P 796bdab7947648839320ff60c5fcaaf9 [sys.catalog]: This master's current role is: LEADER
08:03:47.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.489784 22210 catalog_manager.cc:1382] Generated new cluster ID: 4aea24a9e0ae4eae9a0008093e5de90d
08:03:47.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.490038 22210 catalog_manager.cc:1530] Initializing Kudu internal certificate authority...
08:03:47.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.492305 22198 sys_catalog.cc:455] T 00000000000000000000000000000000 P cfc2dea447cb440baf16b45c0c409ac2 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "796bdab7947648839320ff60c5fcaaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39a0718204d34e9696b9c97d166909ad" member_type: VOTER last_known_addr { host: "127.21.107.254" port: 36655 } } peers { permanent_uuid: "cfc2dea447cb440baf16b45c0c409ac2" member_type: VOTER last_known_addr { host: "127.21.107.253" port: 44373 } } peers { permanent_uuid: "796bdab7947648839320ff60c5fcaaf9" member_type: VOTER last_known_addr { host: "127.21.107.252" port: 37903 } } }
08:03:47.493 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.492983 22198 sys_catalog.cc:458] T 00000000000000000000000000000000 P cfc2dea447cb440baf16b45c0c409ac2 [sys.catalog]: This master's current role is: FOLLOWER
08:03:47.552 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.552294 22210 catalog_manager.cc:1405] Generated new certificate authority record
08:03:47.555 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.554754 22210 catalog_manager.cc:1539] Loading token signing keys...
08:03:47.585 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.585415 22210 catalog_manager.cc:6069] T 00000000000000000000000000000000 P 796bdab7947648839320ff60c5fcaaf9: Generated new TSK 0
08:03:47.587 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.587056 22210 catalog_manager.cc:1549] Initializing in-progress tserver states...
08:03:47.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.614135 21935 external_mini_cluster.cc:1366] Running /tmp/dist-test-task7wVUHj/build/tsan/bin/kudu
08:03:47.614 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-task7wVUHj/build/tsan/bin/kudu
08:03:47.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/ts-0/wal
08:03:47.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/ts-0/data
08:03:47.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:03:47.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:03:47.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:03:47.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:03:47.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:03:47.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:03:47.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/ts-0/logs
08:03:47.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/ts-0/data/info.pb
08:03:47.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:03:47.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:03:47.615 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:03:47.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:03:47.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:03:47.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:03:47.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:03:47.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:03:47.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
08:03:47.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:03:47.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.21.107.193:0
08:03:47.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.21.107.193
08:03:47.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.21.107.193
08:03:47.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:03:47.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.21.107.254:36655,127.21.107.253:44373,127.21.107.252:37903
08:03:47.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.21.107.212:41023
08:03:47.616 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:03:47.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:03:47.617 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
08:03:47.721 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.721057 22016 consensus_peers.cc:770] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.21.107.252" port: 37903 } attempt: 7
08:03:47.761 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.761026 22016 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 39a0718204d34e9696b9c97d166909ad: Bootstrap starting.
08:03:47.780 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.780368 22016 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 39a0718204d34e9696b9c97d166909ad: Neither blocks nor log segments found. Creating new log.
08:03:47.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.782593 22016 log.cc:826] T 00000000000000000000000000000000 P 39a0718204d34e9696b9c97d166909ad: Log is configured to *not* fsync() on all Append() calls
08:03:47.798 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.797190 22016 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 39a0718204d34e9696b9c97d166909ad: No bootstrap required, opened a new log
08:03:47.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.863914 22016 raft_consensus.cc:359] T 00000000000000000000000000000000 P 39a0718204d34e9696b9c97d166909ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39a0718204d34e9696b9c97d166909ad" member_type: VOTER last_known_addr { host: "127.21.107.254" port: 36655 } } peers { permanent_uuid: "cfc2dea447cb440baf16b45c0c409ac2" member_type: VOTER last_known_addr { host: "127.21.107.253" port: 44373 } } peers { permanent_uuid: "796bdab7947648839320ff60c5fcaaf9" member_type: VOTER last_known_addr { host: "127.21.107.252" port: 37903 } }
08:03:47.867 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.866988 22016 raft_consensus.cc:385] T 00000000000000000000000000000000 P 39a0718204d34e9696b9c97d166909ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:03:47.868 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.868067 22016 raft_consensus.cc:740] T 00000000000000000000000000000000 P 39a0718204d34e9696b9c97d166909ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 39a0718204d34e9696b9c97d166909ad, State: Initialized, Role: FOLLOWER
08:03:47.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.870682 22016 consensus_queue.cc:260] T 00000000000000000000000000000000 P 39a0718204d34e9696b9c97d166909ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39a0718204d34e9696b9c97d166909ad" member_type: VOTER last_known_addr { host: "127.21.107.254" port: 36655 } } peers { permanent_uuid: "cfc2dea447cb440baf16b45c0c409ac2" member_type: VOTER last_known_addr { host: "127.21.107.253" port: 44373 } } peers { permanent_uuid: "796bdab7947648839320ff60c5fcaaf9" member_type: VOTER last_known_addr { host: "127.21.107.252" port: 37903 } }
08:03:47.876 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.875980 22221 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39a0718204d34e9696b9c97d166909ad [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39a0718204d34e9696b9c97d166909ad" member_type: VOTER last_known_addr { host: "127.21.107.254" port: 36655 } } peers { permanent_uuid: "cfc2dea447cb440baf16b45c0c409ac2" member_type: VOTER last_known_addr { host: "127.21.107.253" port: 44373 } } peers { permanent_uuid: "796bdab7947648839320ff60c5fcaaf9" member_type: VOTER last_known_addr { host: "127.21.107.252" port: 37903 } } }
08:03:47.877 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.876756 22221 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39a0718204d34e9696b9c97d166909ad [sys.catalog]: This master's current role is: FOLLOWER
08:03:47.885 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.882349 21989 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 39a0718204d34e9696b9c97d166909ad [term 0 FOLLOWER]: Advancing to term 1
08:03:47.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.885881 21990 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "796bdab7947648839320ff60c5fcaaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a0718204d34e9696b9c97d166909ad"
08:03:47.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.886354 21991 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "796bdab7947648839320ff60c5fcaaf9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "39a0718204d34e9696b9c97d166909ad" is_pre_election: true
08:03:47.889 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.887486 22016 sys_catalog.cc:565] T 00000000000000000000000000000000 P 39a0718204d34e9696b9c97d166909ad [sys.catalog]: configured and running, proceeding with master startup.
08:03:47.901 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.900991 21989 raft_consensus.cc:1275] T 00000000000000000000000000000000 P 39a0718204d34e9696b9c97d166909ad [term 1 FOLLOWER]: Refusing update from remote peer 796bdab7947648839320ff60c5fcaaf9: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
08:03:47.906 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.905079 22204 consensus_queue.cc:1048] T 00000000000000000000000000000000 P 796bdab7947648839320ff60c5fcaaf9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "39a0718204d34e9696b9c97d166909ad" member_type: VOTER last_known_addr { host: "127.21.107.254" port: 36655 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
08:03:47.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.972522 22221 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39a0718204d34e9696b9c97d166909ad [sys.catalog]: SysCatalogTable state changed. Reason: New leader 796bdab7947648839320ff60c5fcaaf9. Latest consensus state: current_term: 1 leader_uuid: "796bdab7947648839320ff60c5fcaaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39a0718204d34e9696b9c97d166909ad" member_type: VOTER last_known_addr { host: "127.21.107.254" port: 36655 } } peers { permanent_uuid: "cfc2dea447cb440baf16b45c0c409ac2" member_type: VOTER last_known_addr { host: "127.21.107.253" port: 44373 } } peers { permanent_uuid: "796bdab7947648839320ff60c5fcaaf9" member_type: VOTER last_known_addr { host: "127.21.107.252" port: 37903 } } }
08:03:47.973 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.973248 22221 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39a0718204d34e9696b9c97d166909ad [sys.catalog]: This master's current role is: FOLLOWER
08:03:47.974 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.972638 22226 sys_catalog.cc:455] T 00000000000000000000000000000000 P 39a0718204d34e9696b9c97d166909ad [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "796bdab7947648839320ff60c5fcaaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39a0718204d34e9696b9c97d166909ad" member_type: VOTER last_known_addr { host: "127.21.107.254" port: 36655 } } peers { permanent_uuid: "cfc2dea447cb440baf16b45c0c409ac2" member_type: VOTER last_known_addr { host: "127.21.107.253" port: 44373 } } peers { permanent_uuid: "796bdab7947648839320ff60c5fcaaf9" member_type: VOTER last_known_addr { host: "127.21.107.252" port: 37903 } } }
08:03:47.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:47.974895 22226 sys_catalog.cc:458] T 00000000000000000000000000000000 P 39a0718204d34e9696b9c97d166909ad [sys.catalog]: This master's current role is: FOLLOWER
08:03:48.020 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:48.020118 22237 catalog_manager.cc:1294] Loaded cluster ID: 4aea24a9e0ae4eae9a0008093e5de90d
08:03:48.021 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:48.020920 22237 catalog_manager.cc:1587] T 00000000000000000000000000000000 P 39a0718204d34e9696b9c97d166909ad: loading cluster ID for follower catalog manager: success
08:03:48.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:48.030943 22237 catalog_manager.cc:1609] T 00000000000000000000000000000000 P 39a0718204d34e9696b9c97d166909ad: acquiring CA information for follower catalog manager: success
08:03:48.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:48.039007 22237 catalog_manager.cc:1637] T 00000000000000000000000000000000 P 39a0718204d34e9696b9c97d166909ad: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
08:03:48.104 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:48.103940 22218 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:03:48.105 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:48.105010 22218 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:03:48.106 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:48.105996 22218 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:03:48.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:48.162722 22218 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:03:48.163 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:48.163677 22218 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.107.193
08:03:48.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:48.201094 22218 tablet_server_runner.cc:78] Tablet server non-default flags:
08:03:48.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:03:48.201 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.21.107.212:41023
08:03:48.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:03:48.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:03:48.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/ts-0/data
08:03:48.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/ts-0/wal
08:03:48.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:03:48.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:03:48.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.21.107.193:0
08:03:48.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:03:48.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:03:48.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:03:48.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/ts-0/data/info.pb
08:03:48.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.21.107.193
08:03:48.202 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:03:48.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.21.107.254:36655,127.21.107.253:44373,127.21.107.252:37903
08:03:48.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:03:48.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:03:48.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:03:48.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:03:48.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:03:48.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.21.107.193
08:03:48.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/ts-0/logs
08:03:48.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:03:48.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:03:48.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:03:48.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
08:03:48.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:03:48.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:03:48.203 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:03:48.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:03:48.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:03:48.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:03:48.204 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:48.202819 22218 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:03:48.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:48.205032 22218 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:03:48.221 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:48.221100 22244 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:03:48.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:48.467810 22212 catalog_manager.cc:1294] Loaded cluster ID: 4aea24a9e0ae4eae9a0008093e5de90d
08:03:48.470 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:48.468693 22212 catalog_manager.cc:1587] T 00000000000000000000000000000000 P cfc2dea447cb440baf16b45c0c409ac2: loading cluster ID for follower catalog manager: success
08:03:48.483 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:48.483103 22212 catalog_manager.cc:1609] T 00000000000000000000000000000000 P cfc2dea447cb440baf16b45c0c409ac2: acquiring CA information for follower catalog manager: success
08:03:48.519 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:48.518961 22212 catalog_manager.cc:1637] T 00000000000000000000000000000000 P cfc2dea447cb440baf16b45c0c409ac2: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
08:03:48.533 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:48.532155 22204 sys_catalog.cc:455] T 00000000000000000000000000000000 P 796bdab7947648839320ff60c5fcaaf9 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "796bdab7947648839320ff60c5fcaaf9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "39a0718204d34e9696b9c97d166909ad" member_type: VOTER last_known_addr { host: "127.21.107.254" port: 36655 } } peers { permanent_uuid: "cfc2dea447cb440baf16b45c0c409ac2" member_type: VOTER last_known_addr { host: "127.21.107.253" port: 44373 } } peers { permanent_uuid: "796bdab7947648839320ff60c5fcaaf9" member_type: VOTER last_known_addr { host: "127.21.107.252" port: 37903 } } }
08:03:48.534 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:48.533807 22204 sys_catalog.cc:458] T 00000000000000000000000000000000 P 796bdab7947648839320ff60c5fcaaf9 [sys.catalog]: This master's current role is: LEADER
08:03:50.083 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:49.623260 22243 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 22218
08:03:50.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:50.084834 22247 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:03:50.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:50.080936 22218 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.858s	user 0.405s	sys 0.767s
08:03:50.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:50.086025 22218 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.863s	user 0.405s	sys 0.767s
08:03:50.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:48.222908 22245 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:03:50.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:50.090132 22246 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection timed out after 1867 milliseconds
08:03:50.090 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:50.090142 22218 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:03:50.093 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:50.091588 22218 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:03:50.102 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:50.101791 22218 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:03:50.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:50.105500 22218 hybrid_clock.cc:648] HybridClock initialized: now 1779091430105420 us; error 75 us; skew 500 ppm
08:03:50.109 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:50.106586 22218 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:03:50.134 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:50.134261 22218 webserver.cc:533] Webserver started at http://127.21.107.193:40789/ using document root <none> and password file <none>
08:03:50.135 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:50.135679 22218 fs_manager.cc:362] Metadata directory not provided
08:03:50.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:50.136138 22218 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:03:50.137 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:50.136830 22218 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:03:50.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:50.143253 22218 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/ts-0/data/instance:
08:03:50.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d3cee23376664c3ebde0c65d62c69886"
08:03:50.143 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:03:50 on dist-test-slave-ls2g"
08:03:50.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:50.144974 22218 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/ts-0/wal/instance:
08:03:50.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d3cee23376664c3ebde0c65d62c69886"
08:03:50.145 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:03:50 on dist-test-slave-ls2g"
08:03:50.167 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:50.167397 22218 fs_manager.cc:696] Time spent creating directory manager: real 0.021s	user 0.009s	sys 0.011s
08:03:50.181 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:50.180898 22258 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:03:50.182 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:50.182480 22218 fs_manager.cc:730] Time spent opening block manager: real 0.010s	user 0.004s	sys 0.004s
08:03:50.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:50.183073 22218 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/ts-0/data,/tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/ts-0/wal
08:03:50.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "d3cee23376664c3ebde0c65d62c69886"
08:03:50.183 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:03:50 on dist-test-slave-ls2g"
08:03:50.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:50.183812 22218 fs_report.cc:389] FS layout report
08:03:50.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:03:50.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/ts-0/wal
08:03:50.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/ts-0/wal
08:03:50.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/ts-0/data/data
08:03:50.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:03:50.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:03:50.184 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:03:50.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:03:50.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:03:50.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:03:50.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:03:50.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:03:50.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:03:50.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:03:50.185 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:03:50.262 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:50.262413 22218 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:03:50.264 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:50.264321 22218 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:03:50.265 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:50.264859 22218 kserver.cc:163] Server-wide thread pool size limit: 3276
08:03:50.268 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:50.268374 22218 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
08:03:50.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:50.274281 22218 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
08:03:50.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:50.274556 22218 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
08:03:50.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:50.276515 22218 ts_tablet_manager.cc:616] Registered 0 tablets
08:03:50.276 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:50.276758 22218 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
08:03:50.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:50.468647 22218 rpc_server.cc:307] RPC server started. Bound to: 127.21.107.193:37893
08:03:50.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:50.468775 22371 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.107.193:37893 every 8 connection(s)
08:03:50.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:50.473389 22218 server_base.cc:1193] Dumped server information to /tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/ts-0/data/info.pb
08:03:50.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:50.481060 21935 external_mini_cluster.cc:1428] Started /tmp/dist-test-task7wVUHj/build/tsan/bin/kudu as pid 22218
08:03:50.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:50.481493 21935 external_mini_cluster.cc:1442] Reading /tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/ts-0/wal/instance
08:03:50.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:50.496227 21935 external_mini_cluster.cc:1366] Running /tmp/dist-test-task7wVUHj/build/tsan/bin/kudu
08:03:50.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-task7wVUHj/build/tsan/bin/kudu
08:03:50.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/ts-1/wal
08:03:50.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/ts-1/data
08:03:50.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:03:50.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:03:50.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:03:50.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:03:50.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:03:50.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:03:50.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/ts-1/logs
08:03:50.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/ts-1/data/info.pb
08:03:50.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:03:50.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:03:50.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:03:50.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:03:50.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:03:50.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:03:50.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:03:50.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:03:50.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
08:03:50.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:03:50.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.21.107.194:0
08:03:50.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.21.107.194
08:03:50.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.21.107.194
08:03:50.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:03:50.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.21.107.254:36655,127.21.107.253:44373,127.21.107.252:37903
08:03:50.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.21.107.212:41023
08:03:50.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:03:50.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:03:50.498 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
08:03:50.569 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:50.568403 22372 heartbeater.cc:344] Connected to a master server at 127.21.107.252:37903
08:03:50.570 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:50.568877 22372 heartbeater.cc:461] Registering TS with master...
08:03:50.572 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:50.570935 22372 heartbeater.cc:507] Master 127.21.107.252:37903 requested a full tablet report, sending...
08:03:50.578 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:50.576548 22134 ts_manager.cc:194] Registered new tserver with Master: d3cee23376664c3ebde0c65d62c69886 (127.21.107.193:37893)
08:03:50.579 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:50.579624 22134 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.21.107.193:49679
08:03:50.589 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:50.589103 22373 heartbeater.cc:344] Connected to a master server at 127.21.107.253:44373
08:03:50.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:50.589779 22373 heartbeater.cc:461] Registering TS with master...
08:03:50.590 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:50.590608 22373 heartbeater.cc:507] Master 127.21.107.253:44373 requested a full tablet report, sending...
08:03:50.595 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:50.594939 22056 ts_manager.cc:194] Registered new tserver with Master: d3cee23376664c3ebde0c65d62c69886 (127.21.107.193:37893)
08:03:50.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:50.604655 22377 heartbeater.cc:344] Connected to a master server at 127.21.107.254:36655
08:03:50.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:50.605000 22377 heartbeater.cc:461] Registering TS with master...
08:03:50.605 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:50.605659 22377 heartbeater.cc:507] Master 127.21.107.254:36655 requested a full tablet report, sending...
08:03:50.608 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:50.608568 21981 ts_manager.cc:194] Registered new tserver with Master: d3cee23376664c3ebde0c65d62c69886 (127.21.107.193:37893)
08:03:51.031 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:51.031122 22376 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:03:51.032 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:51.031785 22376 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:03:51.033 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:51.032802 22376 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:03:51.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:51.084044 22376 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:03:51.086 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:51.086009 22376 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.107.194
08:03:51.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:51.149129 22376 tablet_server_runner.cc:78] Tablet server non-default flags:
08:03:51.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:03:51.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.21.107.212:41023
08:03:51.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:03:51.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:03:51.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/ts-1/data
08:03:51.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/ts-1/wal
08:03:51.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:03:51.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:03:51.150 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.21.107.194:0
08:03:51.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:03:51.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:03:51.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:03:51.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/ts-1/data/info.pb
08:03:51.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.21.107.194
08:03:51.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:03:51.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.21.107.254:36655,127.21.107.253:44373,127.21.107.252:37903
08:03:51.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:03:51.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:03:51.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:03:51.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:03:51.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:03:51.151 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.21.107.194
08:03:51.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/ts-1/logs
08:03:51.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:03:51.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:03:51.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:03:51.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
08:03:51.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:03:51.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:03:51.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:03:51.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:03:51.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:03:51.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:03:51.152 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:51.150826 22376 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:03:51.153 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:51.153048 22376 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:03:51.169 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:51.168800 22389 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:03:51.584 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:51.583830 22372 heartbeater.cc:499] Master 127.21.107.252:37903 was elected leader, sending a full tablet report...
08:03:52.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:52.571123 22388 debug-util.cc:398] Leaking SignalData structure 0x7b08000271c0 after lost signal to thread 22376
08:03:52.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:52.774785 22388 kernel_stack_watchdog.cc:198] Thread 22376 stuck at /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/util/thread.cc:642 for 398ms:
08:03:52.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Kernel stack:
08:03:52.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) (could not read kernel stack)
08:03:52.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) User stack:
08:03:52.775 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) <Timed out: thread did not respond: maybe it is blocking signals>
08:03:52.776 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:51.170753 22390 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:03:52.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:52.777522 22391 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1604 milliseconds
08:03:52.777 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:52.777459 22376 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.607s	user 0.002s	sys 0.000s
08:03:52.778 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:52.777858 22376 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.607s	user 0.002s	sys 0.000s
08:03:52.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:52.782214 22393 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:03:52.782 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:52.782316 22376 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:03:52.783 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:52.783645 22376 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:03:52.786 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:52.785771 22376 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:03:52.787 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:52.787175 22376 hybrid_clock.cc:648] HybridClock initialized: now 1779091432787114 us; error 32 us; skew 500 ppm
08:03:52.788 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:52.788065 22376 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:03:52.794 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:52.794065 22376 webserver.cc:533] Webserver started at http://127.21.107.194:35975/ using document root <none> and password file <none>
08:03:52.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:52.794981 22376 fs_manager.cc:362] Metadata directory not provided
08:03:52.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:52.795223 22376 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:03:52.795 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:52.795768 22376 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:03:52.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:52.800236 22376 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/ts-1/data/instance:
08:03:52.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "096dba2e582d4091842ed6ec55ca4ff4"
08:03:52.800 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:03:52 on dist-test-slave-ls2g"
08:03:52.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:52.801404 22376 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/ts-1/wal/instance:
08:03:52.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "096dba2e582d4091842ed6ec55ca4ff4"
08:03:52.801 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:03:52 on dist-test-slave-ls2g"
08:03:52.808 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:52.808717 22376 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.002s	sys 0.004s
08:03:52.814 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:52.814113 22402 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:03:52.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:52.815164 22376 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
08:03:52.815 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:52.815552 22376 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/ts-1/data,/tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/ts-1/wal
08:03:52.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "096dba2e582d4091842ed6ec55ca4ff4"
08:03:52.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:03:52 on dist-test-slave-ls2g"
08:03:52.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:52.815920 22376 fs_report.cc:389] FS layout report
08:03:52.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:03:52.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/ts-1/wal
08:03:52.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/ts-1/wal
08:03:52.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/ts-1/data/data
08:03:52.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:03:52.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:03:52.816 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:03:52.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:03:52.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:03:52.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:03:52.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:03:52.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:03:52.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:03:52.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:03:52.817 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:03:52.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:52.878504 22376 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:03:52.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:52.880137 22376 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:03:52.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:52.880666 22376 kserver.cc:163] Server-wide thread pool size limit: 3276
08:03:52.883 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:52.883319 22376 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
08:03:52.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:52.887465 22376 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
08:03:52.887 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:52.887698 22376 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
08:03:52.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:52.888041 22376 ts_tablet_manager.cc:616] Registered 0 tablets
08:03:52.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:52.888243 22376 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
08:03:53.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.034107 22376 rpc_server.cc:307] RPC server started. Bound to: 127.21.107.194:40521
08:03:53.034 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.034242 22515 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.107.194:40521 every 8 connection(s)
08:03:53.037 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.036923 22376 server_base.cc:1193] Dumped server information to /tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/ts-1/data/info.pb
08:03:53.044 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.043708 21935 external_mini_cluster.cc:1428] Started /tmp/dist-test-task7wVUHj/build/tsan/bin/kudu as pid 22376
08:03:53.051 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.044441 21935 external_mini_cluster.cc:1442] Reading /tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/ts-1/wal/instance
08:03:53.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.060444 21935 external_mini_cluster.cc:1366] Running /tmp/dist-test-task7wVUHj/build/tsan/bin/kudu
08:03:53.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) /tmp/dist-test-task7wVUHj/build/tsan/bin/kudu
08:03:53.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/ts-2/wal
08:03:53.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/ts-2/data
08:03:53.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --block_manager=log
08:03:53.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=localhost
08:03:53.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync
08:03:53.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:03:53.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:03:53.061 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:03:53.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/ts-2/logs
08:03:53.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/ts-2/data/info.pb
08:03:53.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:03:53.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports
08:03:53.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags
08:03:53.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags
08:03:53.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr
08:03:53.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:03:53.062 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:03:53.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:03:53.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) tserver
08:03:53.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) run
08:03:53.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.21.107.195:0
08:03:53.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.21.107.195
08:03:53.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.21.107.195
08:03:53.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:03:53.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.21.107.254:36655,127.21.107.253:44373,127.21.107.252:37903
08:03:53.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.21.107.212:41023
08:03:53.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:03:53.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:03:53.063 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin with env {}
08:03:53.084 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.082856 22516 heartbeater.cc:344] Connected to a master server at 127.21.107.252:37903
08:03:53.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.083355 22516 heartbeater.cc:461] Registering TS with master...
08:03:53.085 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.084692 22516 heartbeater.cc:507] Master 127.21.107.252:37903 requested a full tablet report, sending...
08:03:53.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.087339 22134 ts_manager.cc:194] Registered new tserver with Master: 096dba2e582d4091842ed6ec55ca4ff4 (127.21.107.194:40521)
08:03:53.089 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.089160 22134 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.21.107.194:57623
08:03:53.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.096231 22517 heartbeater.cc:344] Connected to a master server at 127.21.107.253:44373
08:03:53.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.096527 22517 heartbeater.cc:461] Registering TS with master...
08:03:53.097 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.097208 22518 heartbeater.cc:344] Connected to a master server at 127.21.107.254:36655
08:03:53.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.097543 22518 heartbeater.cc:461] Registering TS with master...
08:03:53.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.097222 22517 heartbeater.cc:507] Master 127.21.107.253:44373 requested a full tablet report, sending...
08:03:53.099 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.098201 22518 heartbeater.cc:507] Master 127.21.107.254:36655 requested a full tablet report, sending...
08:03:53.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.100921 22056 ts_manager.cc:194] Registered new tserver with Master: 096dba2e582d4091842ed6ec55ca4ff4 (127.21.107.194:40521)
08:03:53.101 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.101065 21981 ts_manager.cc:194] Registered new tserver with Master: 096dba2e582d4091842ed6ec55ca4ff4 (127.21.107.194:40521)
08:03:53.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:53.386076 22526 flags.cc:432] Enabled unsafe flag: --openssl_security_level_override=0
08:03:53.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:53.386561 22526 flags.cc:432] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
08:03:53.387 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:53.386961 22526 flags.cc:432] Enabled unsafe flag: --never_fsync=true
08:03:53.421 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:53.421368 22526 flags.cc:432] Enabled experimental flag: --ipki_server_key_size=768
08:03:53.422 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:53.422176 22526 flags.cc:432] Enabled experimental flag: --local_ip_for_outbound_sockets=127.21.107.195
08:03:53.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.457814 22526 tablet_server_runner.cc:78] Tablet server non-default flags:
08:03:53.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_poll_interval_ms=100
08:03:53.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --builtin_ntp_servers=127.21.107.212:41023
08:03:53.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ntp_initial_sync_wait_secs=10
08:03:53.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --time_source=builtin
08:03:53.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_data_dirs=/tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/ts-2/data
08:03:53.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --fs_wal_dir=/tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/ts-2/wal
08:03:53.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --ipki_server_key_size=768
08:03:53.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --openssl_security_level_override=0
08:03:53.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_bind_addresses=127.21.107.195:0
08:03:53.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --rpc_server_allow_ephemeral_ports=true
08:03:53.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --metrics_log_interval_ms=1000
08:03:53.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_format=pb
08:03:53.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --server_dump_info_path=/tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/ts-2/data/info.pb
08:03:53.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_interface=127.21.107.195
08:03:53.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --webserver_port=0
08:03:53.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --tserver_master_addrs=127.21.107.254:36655,127.21.107.253:44373,127.21.107.252:37903
08:03:53.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --never_fsync=true
08:03:53.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --redact=none
08:03:53.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_experimental_flags=true
08:03:53.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --unlock_unsafe_flags=true
08:03:53.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --enable_minidumps=false
08:03:53.458 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --local_ip_for_outbound_sockets=127.21.107.195
08:03:53.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --log_dir=/tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/ts-2/logs
08:03:53.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logbuflevel=-1
08:03:53.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --logtostderr=true
08:03:53.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 
08:03:53.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Tablet server version:
08:03:53.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) kudu 1.19.0-SNAPSHOT
08:03:53.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) revision 66827b15b158c37363c37baa160f29a0ca1f1e63
08:03:53.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build type FASTDEBUG
08:03:53.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) built by None at 18 May 2026 07:43:25 UTC on e7f111948823
08:03:53.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) build id 11955
08:03:53.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) TSAN enabled
08:03:53.459 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.459003 22526 env_posix.cc:2267] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
08:03:53.460 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:53.460469 22526 file_cache.cc:492] Constructed file cache file cache with capacity 419430
08:03:53.473 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:53.472563 22533 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:03:54.096 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.095078 22516 heartbeater.cc:499] Master 127.21.107.252:37903 was elected leader, sending a full tablet report...
08:03:54.836 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:53.474221 22534 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:03:54.838 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:54.838272 22536 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
08:03:54.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:54.842764 22535 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Resolving timed out after 1366 milliseconds
08:03:54.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:54.843508 22526 thread.cc:641] OpenStack (cloud detector) Time spent creating pthread: real 1.370s	user 0.483s	sys 0.863s
08:03:54.843 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:54.843722 22526 thread.cc:608] OpenStack (cloud detector) Time spent starting thread: real 1.370s	user 0.483s	sys 0.863s
08:03:54.844 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.843889 22526 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
08:03:54.845 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.844997 22526 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
08:03:54.847 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.847208 22526 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
08:03:54.848 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.848577 22526 hybrid_clock.cc:648] HybridClock initialized: now 1779091434848529 us; error 56 us; skew 500 ppm
08:03:54.849 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.849408 22526 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
08:03:54.857 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.856945 22526 webserver.cc:533] Webserver started at http://127.21.107.195:45401/ using document root <none> and password file <none>
08:03:54.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.858250 22526 fs_manager.cc:362] Metadata directory not provided
08:03:54.858 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.858500 22526 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
08:03:54.859 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.859007 22526 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
08:03:54.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.863389 22526 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/ts-2/data/instance:
08:03:54.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c602ffda950b4301ae9823b652d6432c"
08:03:54.863 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:03:54 on dist-test-slave-ls2g"
08:03:54.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.864548 22526 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/ts-2/wal/instance:
08:03:54.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c602ffda950b4301ae9823b652d6432c"
08:03:54.864 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:03:54 on dist-test-slave-ls2g"
08:03:54.872 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.872103 22526 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.004s	sys 0.004s
08:03:54.878 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.877889 22546 log_block_manager.cc:3869] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
08:03:54.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.879113 22526 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.001s
08:03:54.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.879467 22526 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/ts-2/data,/tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/ts-2/wal
08:03:54.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) uuid: "c602ffda950b4301ae9823b652d6432c"
08:03:54.879 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) format_stamp: "Formatted at 2026-05-18 08:03:54 on dist-test-slave-ls2g"
08:03:54.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.879832 22526 fs_report.cc:389] FS layout report
08:03:54.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) --------------------
08:03:54.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) wal directory: /tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/ts-2/wal
08:03:54.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) metadata directory: /tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/ts-2/wal
08:03:54.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 1 data directories: /tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/ts-2/data/data
08:03:54.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live blocks: 0
08:03:54.880 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes: 0
08:03:54.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total live bytes (after alignment): 0
08:03:54.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total number of LBM containers: 0 (0 full)
08:03:54.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for missing blocks
08:03:54.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Did not check for orphaned blocks
08:03:54.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM containers with extra space: 0 (0 repaired)
08:03:54.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total full LBM container extra space in bytes: 0 (0 repaired)
08:03:54.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total incomplete LBM containers: 0 (0 repaired)
08:03:54.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total LBM partial records: 0 (0 repaired)
08:03:54.881 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
08:03:54.977 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.977473 22526 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
08:03:54.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.979117 22526 env_posix.cc:2267] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
08:03:54.979 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.979656 22526 kserver.cc:163] Server-wide thread pool size limit: 3276
08:03:54.982 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.982431 22526 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
08:03:54.986 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.986521 22526 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
08:03:54.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.986748 22526 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
08:03:54.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.987077 22526 ts_tablet_manager.cc:616] Registered 0 tablets
08:03:54.987 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:54.987277 22526 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
08:03:55.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:55.136296 22526 rpc_server.cc:307] RPC server started. Bound to: 127.21.107.195:38661
08:03:55.136 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:55.136408 22658 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.21.107.195:38661 every 8 connection(s)
08:03:55.139 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:55.138895 22526 server_base.cc:1193] Dumped server information to /tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/ts-2/data/info.pb
08:03:55.148 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:55.145543 21935 external_mini_cluster.cc:1428] Started /tmp/dist-test-task7wVUHj/build/tsan/bin/kudu as pid 22526
08:03:55.149 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:55.146134 21935 external_mini_cluster.cc:1442] Reading /tmp/dist-test-task7wVUHj/test-tmp/mini-kudu-cluster7913841365715148965/ts-2/wal/instance
08:03:55.188 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:55.187825 22659 heartbeater.cc:344] Connected to a master server at 127.21.107.252:37903
08:03:55.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:55.188321 22659 heartbeater.cc:461] Registering TS with master...
08:03:55.191 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:55.188766 22660 heartbeater.cc:344] Connected to a master server at 127.21.107.253:44373
08:03:55.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:55.189073 22660 heartbeater.cc:461] Registering TS with master...
08:03:55.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:55.189071 22661 heartbeater.cc:344] Connected to a master server at 127.21.107.254:36655
08:03:55.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:55.189493 22661 heartbeater.cc:461] Registering TS with master...
08:03:55.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:55.189715 22659 heartbeater.cc:507] Master 127.21.107.252:37903 requested a full tablet report, sending...
08:03:55.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:55.190110 22660 heartbeater.cc:507] Master 127.21.107.253:44373 requested a full tablet report, sending...
08:03:55.192 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:55.190366 22661 heartbeater.cc:507] Master 127.21.107.254:36655 requested a full tablet report, sending...
08:03:55.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:55.192370 22134 ts_manager.cc:194] Registered new tserver with Master: c602ffda950b4301ae9823b652d6432c (127.21.107.195:38661)
08:03:55.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:55.192693 22056 ts_manager.cc:194] Registered new tserver with Master: c602ffda950b4301ae9823b652d6432c (127.21.107.195:38661)
08:03:55.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:55.193181 21981 ts_manager.cc:194] Registered new tserver with Master: c602ffda950b4301ae9823b652d6432c (127.21.107.195:38661)
08:03:55.194 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:55.194032 22134 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.21.107.195:58773
08:03:55.213 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:55.213423 21935 external_mini_cluster.cc:949] 3 TS(s) registered with all masters
08:03:55.225 [DEBUG - main] (MiniKuduCluster.java:195) Response: 
08:03:55.227 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_masters {
}

08:03:55.241 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_masters {
  masters {
    id {
      type: MASTER
      index: 0
    }
    bound_rpc_address {
      host: "127.21.107.254"
      port: 36655
    }
    bound_http_address {
      host: "127.21.107.254"
      port: 40143
    }
  }
  masters {
    id {
      type: MASTER
      index: 1
    }
    bound_rpc_address {
      host: "127.21.107.253"
      port: 44373
    }
    bound_http_address {
      host: "127.21.107.253"
      port: 40635
    }
  }
  masters {
    id {
      type: MASTER
      index: 2
    }
    bound_rpc_address {
      host: "127.21.107.252"
      port: 37903
    }
    bound_http_address {
      host: "127.21.107.252"
      port: 33087
    }
  }
}

08:03:55.244 [DEBUG - main] (MiniKuduCluster.java:185) Request: get_tservers {
}

08:03:55.247 [DEBUG - main] (MiniKuduCluster.java:195) Response: get_tservers {
  tservers {
    id {
      type: TSERVER
      index: 0
    }
    bound_rpc_address {
      host: "127.21.107.193"
      port: 37893
    }
    bound_http_address {
      host: "127.21.107.193"
      port: 40789
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 1
    }
    bound_rpc_address {
      host: "127.21.107.194"
      port: 40521
    }
    bound_http_address {
      host: "127.21.107.194"
      port: 35975
    }
  }
  tservers {
    id {
      type: TSERVER
      index: 2
    }
    bound_rpc_address {
      host: "127.21.107.195"
      port: 38661
    }
    bound_http_address {
      host: "127.21.107.195"
      port: 45401
    }
  }
}

08:03:55.247 [INFO - main] (KuduTestHarness.java:157) Creating a new Kudu client...
08:03:55.422 [DEBUG - main] (CompositeStrategy.java:59) Unable to load modern Subject methods, relying only on legacy methods
java.lang.NoSuchMethodException: javax.security.auth.Subject.current()
	at java.base/java.lang.Class.getDeclaredMethod(Class.java:2677)
	at org.apache.kudu.client.internals.ModernStrategy.<init>(ModernStrategy.java:51)
	at org.apache.kudu.client.internals.CompositeStrategy.<init>(CompositeStrategy.java:52)
	at org.apache.kudu.client.internals.CompositeStrategy.<clinit>(CompositeStrategy.java:41)
	at org.apache.kudu.client.internals.SecurityManagerCompatibility.get(SecurityManagerCompatibility.java:43)
	at org.apache.kudu.client.SecurityContext.setupSubject(SecurityContext.java:155)
	at org.apache.kudu.client.SecurityContext.<init>(SecurityContext.java:138)
	at org.apache.kudu.client.AsyncKuduClient.<init>(AsyncKuduClient.java:431)
	at org.apache.kudu.client.AsyncKuduClient$AsyncKuduClientBuilder.build(AsyncKuduClient.java:3109)
	at org.apache.kudu.test.KuduTestHarness.before(KuduTestHarness.java:161)
	at org.junit.rules.ExternalResource$1.evaluate(ExternalResource.java:50)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.doOneAttemptAndReport(RetryRule.java:184)
	at org.apache.kudu.test.junit.RetryRule$RetryStatement.evaluate(RetryRule.java:244)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100)
	at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103)
	at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runners.Suite.runChild(Suite.java:128)
	at org.junit.runners.Suite.runChild(Suite.java:27)
	at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331)
	at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79)
	at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329)
	at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66)
	at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293)
	at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306)
	at org.junit.runners.ParentRunner.run(ParentRunner.java:413)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:137)
	at org.junit.runner.JUnitCore.run(JUnitCore.java:115)
	at org.junit.runner.JUnitCore.runMain(JUnitCore.java:77)
	at org.junit.runner.JUnitCore.main(JUnitCore.java:36)
08:03:55.471 [DEBUG - main] (SecurityUtil.java:122) Could not login via JAAS. Using no credentials: Unable to obtain Principal Name for authentication 
08:03:55.624 [DEBUG - main] (Connection.java:748) [peer master-127.21.107.253:44373(127.21.107.253:44373)] connecting to peer
08:03:55.672 [DEBUG - main] (Connection.java:748) [peer master-127.21.107.252:37903(127.21.107.252:37903)] connecting to peer
08:03:55.683 [DEBUG - main] (Connection.java:748) [peer master-127.21.107.254:36655(127.21.107.254:36655)] connecting to peer
08:03:55.692 [DEBUG - kudu-nio-1] (Connection.java:757) [peer master-127.21.107.252:37903(127.21.107.252:37903)] Successfully connected to peer
08:03:55.699 [DEBUG - kudu-nio-0] (Connection.java:757) [peer master-127.21.107.253:44373(127.21.107.253:44373)] Successfully connected to peer
08:03:55.712 [DEBUG - kudu-nio-2] (Connection.java:757) [peer master-127.21.107.254:36655(127.21.107.254:36655)] Successfully connected to peer
08:03:55.809 [DEBUG - kudu-nio-1] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.107.252
08:03:55.809 [DEBUG - kudu-nio-2] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.107.254
08:03:55.811 [DEBUG - kudu-nio-0] (Negotiator.java:529) SASL mechanism PLAIN chosen for peer 127.21.107.253
08:03:56.022 [DEBUG - kudu-nio-2] (Negotiator.java:919) Authenticated connection [id: 0x629e7123, L:/127.0.0.1:36474 - R:/127.21.107.254:36655] using SASL/PLAIN
08:03:56.022 [DEBUG - kudu-nio-1] (Negotiator.java:919) Authenticated connection [id: 0x0abb21ed, L:/127.0.0.1:57232 - R:/127.21.107.252:37903] using SASL/PLAIN
08:03:56.022 [DEBUG - kudu-nio-0] (Negotiator.java:919) Authenticated connection [id: 0x7fe2878e, L:/127.0.0.1:51246 - R:/127.21.107.253:44373] using SASL/PLAIN
08:03:56.062 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet Kudu Master for table 'Kudu Master' with partition [<start>, <end>)
08:03:56.063 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=CreateTable, tablet=null, attempt=1, TimeoutTracker(timeout=50000, elapsed=477), Traces: [0ms] refreshing cache from master, [25ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.107.253:44373, [83ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.107.252:37903, [93ms] Sub RPC ConnectToMaster: sending RPC to server master-127.21.107.254:36655, [449ms] Sub RPC ConnectToMaster: received response from server master-127.21.107.254:36655: OK, [449ms] Sub RPC ConnectToMaster: received response from server master-127.21.107.253:44373: OK, [450ms] Sub RPC ConnectToMaster: received response from server master-127.21.107.252:37903: OK, deferred=null) after lookup
08:03:56.121 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.114709 22134 catalog_manager.cc:2282] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57232:
08:03:56.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) name: "org.apache.kudu.client.TestLeaderFailover-1779091419560"
08:03:56.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) schema {
08:03:56.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:03:56.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "key"
08:03:56.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
08:03:56.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: true
08:03:56.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:03:56.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:03:56.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:03:56.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:03:56.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:03:56.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:03:56.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column1_i"
08:03:56.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
08:03:56.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
08:03:56.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:03:56.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:03:56.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:03:56.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:03:56.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:03:56.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:03:56.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column2_i"
08:03:56.122 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: INT32
08:03:56.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
08:03:56.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:03:56.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:03:56.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:03:56.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:03:56.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:03:56.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:03:56.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column3_s"
08:03:56.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: STRING
08:03:56.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
08:03:56.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: true
08:03:56.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     encoding: DICT_ENCODING
08:03:56.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     compression: LZ4
08:03:56.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 4096
08:03:56.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:03:56.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:03:56.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:03:56.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   columns {
08:03:56.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     name: "column4_b"
08:03:56.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     type: BOOL
08:03:56.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_key: false
08:03:56.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_nullable: false
08:03:56.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     cfile_block_size: 0
08:03:56.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     immutable: false
08:03:56.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     is_auto_incrementing: false
08:03:56.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:03:56.123 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
08:03:56.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) partition_schema {
08:03:56.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   range_schema {
08:03:56.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     columns {
08:03:56.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)       name: "key"
08:03:56.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)     }
08:03:56.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751)   }
08:03:56.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) }
08:03:56.124 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:56.118795 22134 catalog_manager.cc:7058] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table org.apache.kudu.client.TestLeaderFailover-1779091419560 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
08:03:56.186 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 22de228b8b0240018b43ab428a517fd8
08:03:56.197 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.196839 22659 heartbeater.cc:499] Master 127.21.107.252:37903 was elected leader, sending a full tablet report...
08:03:56.210 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.210106 22594 tablet_service.cc:1511] Processing CreateTablet for tablet 2b50ed00865449b19804635d13d1bd58 (DEFAULT_TABLE table=org.apache.kudu.client.TestLeaderFailover-1779091419560 [id=22de228b8b0240018b43ab428a517fd8]), partition=RANGE (key) PARTITION UNBOUNDED
08:03:56.212 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.211755 22594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b50ed00865449b19804635d13d1bd58. 1 dirs total, 0 dirs full, 0 dirs failed
08:03:56.241 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.241269 22692 tablet_bootstrap.cc:492] T 2b50ed00865449b19804635d13d1bd58 P c602ffda950b4301ae9823b652d6432c: Bootstrap starting.
08:03:56.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.243448 22451 tablet_service.cc:1511] Processing CreateTablet for tablet 2b50ed00865449b19804635d13d1bd58 (DEFAULT_TABLE table=org.apache.kudu.client.TestLeaderFailover-1779091419560 [id=22de228b8b0240018b43ab428a517fd8]), partition=RANGE (key) PARTITION UNBOUNDED
08:03:56.244 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.243687 22307 tablet_service.cc:1511] Processing CreateTablet for tablet 2b50ed00865449b19804635d13d1bd58 (DEFAULT_TABLE table=org.apache.kudu.client.TestLeaderFailover-1779091419560 [id=22de228b8b0240018b43ab428a517fd8]), partition=RANGE (key) PARTITION UNBOUNDED
08:03:56.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.245067 22451 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b50ed00865449b19804635d13d1bd58. 1 dirs total, 0 dirs full, 0 dirs failed
08:03:56.245 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.245556 22307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b50ed00865449b19804635d13d1bd58. 1 dirs total, 0 dirs full, 0 dirs failed
08:03:56.250 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.249747 22692 tablet_bootstrap.cc:654] T 2b50ed00865449b19804635d13d1bd58 P c602ffda950b4301ae9823b652d6432c: Neither blocks nor log segments found. Creating new log.
08:03:56.252 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.252121 22692 log.cc:826] T 2b50ed00865449b19804635d13d1bd58 P c602ffda950b4301ae9823b652d6432c: Log is configured to *not* fsync() on all Append() calls
08:03:56.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.257813 22692 tablet_bootstrap.cc:492] T 2b50ed00865449b19804635d13d1bd58 P c602ffda950b4301ae9823b652d6432c: No bootstrap required, opened a new log
08:03:56.258 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.258309 22692 ts_tablet_manager.cc:1403] T 2b50ed00865449b19804635d13d1bd58 P c602ffda950b4301ae9823b652d6432c: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.006s
08:03:56.270 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.270277 22694 tablet_bootstrap.cc:492] T 2b50ed00865449b19804635d13d1bd58 P d3cee23376664c3ebde0c65d62c69886: Bootstrap starting.
08:03:56.274 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.274312 22695 tablet_bootstrap.cc:492] T 2b50ed00865449b19804635d13d1bd58 P 096dba2e582d4091842ed6ec55ca4ff4: Bootstrap starting.
08:03:56.279 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.278839 22694 tablet_bootstrap.cc:654] T 2b50ed00865449b19804635d13d1bd58 P d3cee23376664c3ebde0c65d62c69886: Neither blocks nor log segments found. Creating new log.
08:03:56.281 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.281143 22694 log.cc:826] T 2b50ed00865449b19804635d13d1bd58 P d3cee23376664c3ebde0c65d62c69886: Log is configured to *not* fsync() on all Append() calls
08:03:56.282 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.281862 22695 tablet_bootstrap.cc:654] T 2b50ed00865449b19804635d13d1bd58 P 096dba2e582d4091842ed6ec55ca4ff4: Neither blocks nor log segments found. Creating new log.
08:03:56.283 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.282687 22692 raft_consensus.cc:359] T 2b50ed00865449b19804635d13d1bd58 P c602ffda950b4301ae9823b652d6432c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c602ffda950b4301ae9823b652d6432c" member_type: VOTER last_known_addr { host: "127.21.107.195" port: 38661 } } peers { permanent_uuid: "096dba2e582d4091842ed6ec55ca4ff4" member_type: VOTER last_known_addr { host: "127.21.107.194" port: 40521 } } peers { permanent_uuid: "d3cee23376664c3ebde0c65d62c69886" member_type: VOTER last_known_addr { host: "127.21.107.193" port: 37893 } }
08:03:56.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.283697 22692 raft_consensus.cc:385] T 2b50ed00865449b19804635d13d1bd58 P c602ffda950b4301ae9823b652d6432c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:03:56.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.284178 22692 raft_consensus.cc:740] T 2b50ed00865449b19804635d13d1bd58 P c602ffda950b4301ae9823b652d6432c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c602ffda950b4301ae9823b652d6432c, State: Initialized, Role: FOLLOWER
08:03:56.284 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.284344 22695 log.cc:826] T 2b50ed00865449b19804635d13d1bd58 P 096dba2e582d4091842ed6ec55ca4ff4: Log is configured to *not* fsync() on all Append() calls
08:03:56.286 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.285307 22692 consensus_queue.cc:260] T 2b50ed00865449b19804635d13d1bd58 P c602ffda950b4301ae9823b652d6432c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c602ffda950b4301ae9823b652d6432c" member_type: VOTER last_known_addr { host: "127.21.107.195" port: 38661 } } peers { permanent_uuid: "096dba2e582d4091842ed6ec55ca4ff4" member_type: VOTER last_known_addr { host: "127.21.107.194" port: 40521 } } peers { permanent_uuid: "d3cee23376664c3ebde0c65d62c69886" member_type: VOTER last_known_addr { host: "127.21.107.193" port: 37893 } }
08:03:56.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.291990 22694 tablet_bootstrap.cc:492] T 2b50ed00865449b19804635d13d1bd58 P d3cee23376664c3ebde0c65d62c69886: No bootstrap required, opened a new log
08:03:56.292 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.292475 22694 ts_tablet_manager.cc:1403] T 2b50ed00865449b19804635d13d1bd58 P d3cee23376664c3ebde0c65d62c69886: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.007s
08:03:56.297 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.297281 22692 ts_tablet_manager.cc:1434] T 2b50ed00865449b19804635d13d1bd58 P c602ffda950b4301ae9823b652d6432c: Time spent starting tablet: real 0.039s	user 0.031s	sys 0.002s
08:03:56.304 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.304558 22695 tablet_bootstrap.cc:492] T 2b50ed00865449b19804635d13d1bd58 P 096dba2e582d4091842ed6ec55ca4ff4: No bootstrap required, opened a new log
08:03:56.305 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.305696 22695 ts_tablet_manager.cc:1403] T 2b50ed00865449b19804635d13d1bd58 P 096dba2e582d4091842ed6ec55ca4ff4: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.005s
08:03:56.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.316443 22694 raft_consensus.cc:359] T 2b50ed00865449b19804635d13d1bd58 P d3cee23376664c3ebde0c65d62c69886 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c602ffda950b4301ae9823b652d6432c" member_type: VOTER last_known_addr { host: "127.21.107.195" port: 38661 } } peers { permanent_uuid: "096dba2e582d4091842ed6ec55ca4ff4" member_type: VOTER last_known_addr { host: "127.21.107.194" port: 40521 } } peers { permanent_uuid: "d3cee23376664c3ebde0c65d62c69886" member_type: VOTER last_known_addr { host: "127.21.107.193" port: 37893 } }
08:03:56.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.317099 22694 raft_consensus.cc:385] T 2b50ed00865449b19804635d13d1bd58 P d3cee23376664c3ebde0c65d62c69886 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:03:56.317 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.317409 22694 raft_consensus.cc:740] T 2b50ed00865449b19804635d13d1bd58 P d3cee23376664c3ebde0c65d62c69886 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3cee23376664c3ebde0c65d62c69886, State: Initialized, Role: FOLLOWER
08:03:56.318 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.318229 22694 consensus_queue.cc:260] T 2b50ed00865449b19804635d13d1bd58 P d3cee23376664c3ebde0c65d62c69886 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c602ffda950b4301ae9823b652d6432c" member_type: VOTER last_known_addr { host: "127.21.107.195" port: 38661 } } peers { permanent_uuid: "096dba2e582d4091842ed6ec55ca4ff4" member_type: VOTER last_known_addr { host: "127.21.107.194" port: 40521 } } peers { permanent_uuid: "d3cee23376664c3ebde0c65d62c69886" member_type: VOTER last_known_addr { host: "127.21.107.193" port: 37893 } }
08:03:56.325 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.324331 22694 ts_tablet_manager.cc:1434] T 2b50ed00865449b19804635d13d1bd58 P d3cee23376664c3ebde0c65d62c69886: Time spent starting tablet: real 0.032s	user 0.027s	sys 0.003s
08:03:56.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.329466 22695 raft_consensus.cc:359] T 2b50ed00865449b19804635d13d1bd58 P 096dba2e582d4091842ed6ec55ca4ff4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c602ffda950b4301ae9823b652d6432c" member_type: VOTER last_known_addr { host: "127.21.107.195" port: 38661 } } peers { permanent_uuid: "096dba2e582d4091842ed6ec55ca4ff4" member_type: VOTER last_known_addr { host: "127.21.107.194" port: 40521 } } peers { permanent_uuid: "d3cee23376664c3ebde0c65d62c69886" member_type: VOTER last_known_addr { host: "127.21.107.193" port: 37893 } }
08:03:56.330 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.330600 22695 raft_consensus.cc:385] T 2b50ed00865449b19804635d13d1bd58 P 096dba2e582d4091842ed6ec55ca4ff4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
08:03:56.331 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.330935 22695 raft_consensus.cc:740] T 2b50ed00865449b19804635d13d1bd58 P 096dba2e582d4091842ed6ec55ca4ff4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 096dba2e582d4091842ed6ec55ca4ff4, State: Initialized, Role: FOLLOWER
08:03:56.332 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.331797 22695 consensus_queue.cc:260] T 2b50ed00865449b19804635d13d1bd58 P 096dba2e582d4091842ed6ec55ca4ff4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c602ffda950b4301ae9823b652d6432c" member_type: VOTER last_known_addr { host: "127.21.107.195" port: 38661 } } peers { permanent_uuid: "096dba2e582d4091842ed6ec55ca4ff4" member_type: VOTER last_known_addr { host: "127.21.107.194" port: 40521 } } peers { permanent_uuid: "d3cee23376664c3ebde0c65d62c69886" member_type: VOTER last_known_addr { host: "127.21.107.193" port: 37893 } }
08:03:56.335 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.335492 22695 ts_tablet_manager.cc:1434] T 2b50ed00865449b19804635d13d1bd58 P 096dba2e582d4091842ed6ec55ca4ff4: Time spent starting tablet: real 0.030s	user 0.023s	sys 0.004s
08:03:56.423 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:56.423022 22666 tablet.cc:2404] T 2b50ed00865449b19804635d13d1bd58 P c602ffda950b4301ae9823b652d6432c: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:03:56.468 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.468204 22699 raft_consensus.cc:493] T 2b50ed00865449b19804635d13d1bd58 P d3cee23376664c3ebde0c65d62c69886 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
08:03:56.469 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.468768 22699 raft_consensus.cc:515] T 2b50ed00865449b19804635d13d1bd58 P d3cee23376664c3ebde0c65d62c69886 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c602ffda950b4301ae9823b652d6432c" member_type: VOTER last_known_addr { host: "127.21.107.195" port: 38661 } } peers { permanent_uuid: "096dba2e582d4091842ed6ec55ca4ff4" member_type: VOTER last_known_addr { host: "127.21.107.194" port: 40521 } } peers { permanent_uuid: "d3cee23376664c3ebde0c65d62c69886" member_type: VOTER last_known_addr { host: "127.21.107.193" port: 37893 } }
08:03:56.472 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.471896 22699 leader_election.cc:290] T 2b50ed00865449b19804635d13d1bd58 P d3cee23376664c3ebde0c65d62c69886 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c602ffda950b4301ae9823b652d6432c (127.21.107.195:38661), 096dba2e582d4091842ed6ec55ca4ff4 (127.21.107.194:40521)
08:03:56.485 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.484696 22614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b50ed00865449b19804635d13d1bd58" candidate_uuid: "d3cee23376664c3ebde0c65d62c69886" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c602ffda950b4301ae9823b652d6432c" is_pre_election: true
08:03:56.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.485651 22614 raft_consensus.cc:2468] T 2b50ed00865449b19804635d13d1bd58 P c602ffda950b4301ae9823b652d6432c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3cee23376664c3ebde0c65d62c69886 in term 0.
08:03:56.486 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.485965 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b50ed00865449b19804635d13d1bd58" candidate_uuid: "d3cee23376664c3ebde0c65d62c69886" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "096dba2e582d4091842ed6ec55ca4ff4" is_pre_election: true
08:03:56.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.486819 22471 raft_consensus.cc:2468] T 2b50ed00865449b19804635d13d1bd58 P 096dba2e582d4091842ed6ec55ca4ff4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3cee23376664c3ebde0c65d62c69886 in term 0.
08:03:56.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.487320 22262 leader_election.cc:304] T 2b50ed00865449b19804635d13d1bd58 P d3cee23376664c3ebde0c65d62c69886 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c602ffda950b4301ae9823b652d6432c, d3cee23376664c3ebde0c65d62c69886; no voters: 
08:03:56.488 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.488399 22699 raft_consensus.cc:2804] T 2b50ed00865449b19804635d13d1bd58 P d3cee23376664c3ebde0c65d62c69886 [term 0 FOLLOWER]: Leader pre-election won for term 1
08:03:56.489 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.488729 22699 raft_consensus.cc:493] T 2b50ed00865449b19804635d13d1bd58 P d3cee23376664c3ebde0c65d62c69886 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
08:03:56.490 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.489070 22699 raft_consensus.cc:3060] T 2b50ed00865449b19804635d13d1bd58 P d3cee23376664c3ebde0c65d62c69886 [term 0 FOLLOWER]: Advancing to term 1
08:03:56.494 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.494448 22699 raft_consensus.cc:515] T 2b50ed00865449b19804635d13d1bd58 P d3cee23376664c3ebde0c65d62c69886 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c602ffda950b4301ae9823b652d6432c" member_type: VOTER last_known_addr { host: "127.21.107.195" port: 38661 } } peers { permanent_uuid: "096dba2e582d4091842ed6ec55ca4ff4" member_type: VOTER last_known_addr { host: "127.21.107.194" port: 40521 } } peers { permanent_uuid: "d3cee23376664c3ebde0c65d62c69886" member_type: VOTER last_known_addr { host: "127.21.107.193" port: 37893 } }
08:03:56.496 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.496237 22699 leader_election.cc:290] T 2b50ed00865449b19804635d13d1bd58 P d3cee23376664c3ebde0c65d62c69886 [CANDIDATE]: Term 1 election: Requested vote from peers c602ffda950b4301ae9823b652d6432c (127.21.107.195:38661), 096dba2e582d4091842ed6ec55ca4ff4 (127.21.107.194:40521)
08:03:56.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.496645 22614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b50ed00865449b19804635d13d1bd58" candidate_uuid: "d3cee23376664c3ebde0c65d62c69886" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c602ffda950b4301ae9823b652d6432c"
08:03:56.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.496955 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b50ed00865449b19804635d13d1bd58" candidate_uuid: "d3cee23376664c3ebde0c65d62c69886" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "096dba2e582d4091842ed6ec55ca4ff4"
08:03:56.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.497123 22614 raft_consensus.cc:3060] T 2b50ed00865449b19804635d13d1bd58 P c602ffda950b4301ae9823b652d6432c [term 0 FOLLOWER]: Advancing to term 1
08:03:56.497 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.497470 22471 raft_consensus.cc:3060] T 2b50ed00865449b19804635d13d1bd58 P 096dba2e582d4091842ed6ec55ca4ff4 [term 0 FOLLOWER]: Advancing to term 1
08:03:56.502 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.501832 22471 raft_consensus.cc:2468] T 2b50ed00865449b19804635d13d1bd58 P 096dba2e582d4091842ed6ec55ca4ff4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3cee23376664c3ebde0c65d62c69886 in term 1.
08:03:56.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.502813 22261 leader_election.cc:304] T 2b50ed00865449b19804635d13d1bd58 P d3cee23376664c3ebde0c65d62c69886 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 096dba2e582d4091842ed6ec55ca4ff4, d3cee23376664c3ebde0c65d62c69886; no voters: 
08:03:56.503 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.503549 22699 raft_consensus.cc:2804] T 2b50ed00865449b19804635d13d1bd58 P d3cee23376664c3ebde0c65d62c69886 [term 1 FOLLOWER]: Leader election won for term 1
08:03:56.504 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.503719 22614 raft_consensus.cc:2468] T 2b50ed00865449b19804635d13d1bd58 P c602ffda950b4301ae9823b652d6432c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate d3cee23376664c3ebde0c65d62c69886 in term 1.
08:03:56.506 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.505930 22699 raft_consensus.cc:697] T 2b50ed00865449b19804635d13d1bd58 P d3cee23376664c3ebde0c65d62c69886 [term 1 LEADER]: Becoming Leader. State: Replica: d3cee23376664c3ebde0c65d62c69886, State: Running, Role: LEADER
08:03:56.507 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.507247 22699 consensus_queue.cc:237] T 2b50ed00865449b19804635d13d1bd58 P d3cee23376664c3ebde0c65d62c69886 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c602ffda950b4301ae9823b652d6432c" member_type: VOTER last_known_addr { host: "127.21.107.195" port: 38661 } } peers { permanent_uuid: "096dba2e582d4091842ed6ec55ca4ff4" member_type: VOTER last_known_addr { host: "127.21.107.194" port: 40521 } } peers { permanent_uuid: "d3cee23376664c3ebde0c65d62c69886" member_type: VOTER last_known_addr { host: "127.21.107.193" port: 37893 } }
08:03:56.523 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.520478 22134 catalog_manager.cc:5696] T 2b50ed00865449b19804635d13d1bd58 P d3cee23376664c3ebde0c65d62c69886 reported cstate change: term changed from 0 to 1, leader changed from <none> to d3cee23376664c3ebde0c65d62c69886 (127.21.107.193). New cstate: current_term: 1 leader_uuid: "d3cee23376664c3ebde0c65d62c69886" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c602ffda950b4301ae9823b652d6432c" member_type: VOTER last_known_addr { host: "127.21.107.195" port: 38661 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "096dba2e582d4091842ed6ec55ca4ff4" member_type: VOTER last_known_addr { host: "127.21.107.194" port: 40521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3cee23376664c3ebde0c65d62c69886" member_type: VOTER last_known_addr { host: "127.21.107.193" port: 37893 } health_report { overall_health: HEALTHY } } }
08:03:56.562 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:56.562481 22521 tablet.cc:2404] T 2b50ed00865449b19804635d13d1bd58 P 096dba2e582d4091842ed6ec55ca4ff4: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:03:56.565 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:56.564823 22380 tablet.cc:2404] T 2b50ed00865449b19804635d13d1bd58 P d3cee23376664c3ebde0c65d62c69886: Can't schedule compaction. Clean time has not been advanced past its initial value.
08:03:56.605 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:894) Opened table 22de228b8b0240018b43ab428a517fd8
08:03:56.622 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 2b50ed00865449b19804635d13d1bd58 for table 'org.apache.kudu.client.TestLeaderFailover-1779091419560' with partition [<start>, <end>)
08:03:56.634 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299988, tablet=2b50ed00865449b19804635d13d1bd58@[096dba2e582d4091842ed6ec55ca4ff4(127.21.107.194:40521),c602ffda950b4301ae9823b652d6432c(127.21.107.195:38661),d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893)[L]]}]
08:03:56.635 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=null, attempt=1, sequence_id=-1, TimeoutTracker(timeout=30000, elapsed=21), Traces: [0ms] refreshing cache from master, [1ms] Sub RPC GetTableLocations: sending RPC to server master-127.21.107.252:37903, [8ms] Sub RPC GetTableLocations: received response from server master-127.21.107.252:37903: OK, deferred=null) after lookup
08:03:56.646 [DEBUG - kudu-nio-1] (Connection.java:748) [peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893)] connecting to peer
08:03:56.648 [DEBUG - kudu-nio-3] (Connection.java:757) [peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893)] Successfully connected to peer
08:03:56.707 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0xb3047456, L:/127.0.0.1:55384 - R:/127.21.107.193:37893] using TOKEN/null
08:03:56.722 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.721776 22471 raft_consensus.cc:1275] T 2b50ed00865449b19804635d13d1bd58 P 096dba2e582d4091842ed6ec55ca4ff4 [term 1 FOLLOWER]: Refusing update from remote peer d3cee23376664c3ebde0c65d62c69886: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
08:03:56.723 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.722060 22614 raft_consensus.cc:1275] T 2b50ed00865449b19804635d13d1bd58 P c602ffda950b4301ae9823b652d6432c [term 1 FOLLOWER]: Refusing update from remote peer d3cee23376664c3ebde0c65d62c69886: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
08:03:56.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.723742 22703 consensus_queue.cc:1048] T 2b50ed00865449b19804635d13d1bd58 P d3cee23376664c3ebde0c65d62c69886 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c602ffda950b4301ae9823b652d6432c" member_type: VOTER last_known_addr { host: "127.21.107.195" port: 38661 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
08:03:56.724 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.724519 22699 consensus_queue.cc:1048] T 2b50ed00865449b19804635d13d1bd58 P d3cee23376664c3ebde0c65d62c69886 [LEADER]: Connected to new peer: Peer: permanent_uuid: "096dba2e582d4091842ed6ec55ca4ff4" member_type: VOTER last_known_addr { host: "127.21.107.194" port: 40521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
08:03:56.745 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.744903 22711 mvcc.cc:204] Tried to move back new op lower bound from 7287158524796596224 to 7287158523940511744. Current Snapshot: MvccSnapshot[applied={T|T < 7287158524796596224}]
08:03:56.793 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.793321 22713 mvcc.cc:204] Tried to move back new op lower bound from 7287158524796596224 to 7287158523940511744. Current Snapshot: MvccSnapshot[applied={T|T < 7287158524796596224}]
08:03:56.884 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 3 rows, more = false) for scanner KuduScanner(table=org.apache.kudu.client.TestLeaderFailover-1779091419560, tablet=2b50ed00865449b19804635d13d1bd58, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:03:56.886 [INFO - Time-limited test] (MiniKuduCluster.java:475) Killing tablet server 127.21.107.193:37893
08:03:56.887 [DEBUG - Time-limited test] (MiniKuduCluster.java:185) Request: stop_daemon {
  id {
    type: TSERVER
    index: 0
  }
}

08:03:56.888 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:56.888309 21935 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task7wVUHj/build/tsan/bin/kudu with pid 22218
08:03:56.919 [DEBUG - kudu-nio-3] (Connection.java:239) [peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893)] handling channelInactive
08:03:56.920 [DEBUG - kudu-nio-3] (Connection.java:709) [peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893)] cleaning up while in state READY due to: connection closed
08:03:56.925 [DEBUG - Time-limited test] (MiniKuduCluster.java:195) Response: 
08:03:56.926 [DEBUG - Time-limited test] (Connection.java:748) [peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893)] connecting to peer
08:03:56.929 [INFO - kudu-nio-4] (Connection.java:429) Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893
08:03:56.929 [DEBUG - kudu-nio-4] (Connection.java:709) [peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893)] cleaning up while in state CONNECTING due to: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893
08:03:56.930 [INFO - kudu-nio-4] (AsyncKuduClient.java:2355) Invalidating location d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893) for tablet 2b50ed00865449b19804635d13d1bd58: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893
08:03:56.951 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 2b50ed00865449b19804635d13d1bd58 for table 'org.apache.kudu.client.TestLeaderFailover-1779091419560' with partition [<start>, <end>)
08:03:56.952 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=2b50ed00865449b19804635d13d1bd58@[096dba2e582d4091842ed6ec55ca4ff4(127.21.107.194:40521),c602ffda950b4301ae9823b652d6432c(127.21.107.195:38661),d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893)[L]]}]
08:03:56.952 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=2b50ed00865449b19804635d13d1bd58, attempt=2, sequence_id=4, TimeoutTracker(timeout=30000, elapsed=26), Traces: [0ms] sending RPC to server d3cee23376664c3ebde0c65d62c69886, [4ms] received response from server d3cee23376664c3ebde0c65d62c69886: Network error: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893, [4ms] delaying RPC due to: Network error: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893, [20ms] refreshing cache from master, [21ms] Sub RPC GetTableLocations: sending RPC to server master-127.21.107.252:37903, [25ms] Sub RPC GetTableLocations: received response from server master-127.21.107.252:37903: OK, deferred=Deferred@321083860(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$230/0x00007f4ccc336df8@55c6d43c -> passthrough -> wakeup thread Time-limited test, errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@6d465cac -> wakeup thread Time-limited test)) after lookup
08:03:56.953 [DEBUG - kudu-nio-1] (Connection.java:748) [peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893)] connecting to peer
08:03:56.958 [INFO - kudu-nio-5] (Connection.java:429) Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893
08:03:56.958 [DEBUG - kudu-nio-5] (Connection.java:709) [peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893)] cleaning up while in state CONNECTING due to: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893
08:03:56.958 [INFO - kudu-nio-5] (AsyncKuduClient.java:2355) Invalidating location d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893) for tablet 2b50ed00865449b19804635d13d1bd58: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893
08:03:56.971 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 2b50ed00865449b19804635d13d1bd58 for table 'org.apache.kudu.client.TestLeaderFailover-1779091419560' with partition [<start>, <end>)
08:03:56.972 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=2b50ed00865449b19804635d13d1bd58@[096dba2e582d4091842ed6ec55ca4ff4(127.21.107.194:40521),c602ffda950b4301ae9823b652d6432c(127.21.107.195:38661),d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893)[L]]}]
08:03:56.972 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=2b50ed00865449b19804635d13d1bd58, attempt=4, sequence_id=4, TimeoutTracker(timeout=30000, elapsed=46), Traces: [0ms] sending RPC to server d3cee23376664c3ebde0c65d62c69886, [4ms] received response from server d3cee23376664c3ebde0c65d62c69886: Network error: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893, [4ms] delaying RPC due to: Network error: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893, [20ms] refreshing cache from master, [21ms] Sub RPC GetTableLocations: sending RPC to server master-127.21.107.252:37903, [25ms] Sub RPC GetTableLocations: received response from server master-127.21.107.252:37903: OK, [27ms] sending RPC to server d3cee23376664c3ebde0c65d62c69886, [32ms] received response from server d3cee23376664c3ebde0c65d62c69886: Network error: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893, [32ms] delaying RPC due to: Network error: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893, [40ms] refreshing cache from master, [40ms] Sub RPC GetTableLocations: sending RPC to server master-127.21.107.252:37903, [45ms] Sub RPC GetTableLocations: received response from server master-127.21.107.252:37903: OK, deferred=Deferred@321083860(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$230/0x00007f4ccc336df8@55c6d43c -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@2082738110 after retry RPC@1362658613), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@6d465cac -> wakeup thread Time-limited test -> (continuation of Deferred@2082738110 after retry RPC@1362658613))) after lookup
08:03:56.973 [DEBUG - kudu-nio-1] (Connection.java:748) [peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893)] connecting to peer
08:03:56.975 [INFO - kudu-nio-6] (Connection.java:429) Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893
08:03:56.975 [DEBUG - kudu-nio-6] (Connection.java:709) [peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893)] cleaning up while in state CONNECTING due to: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893
08:03:56.976 [INFO - kudu-nio-6] (AsyncKuduClient.java:2355) Invalidating location d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893) for tablet 2b50ed00865449b19804635d13d1bd58: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893
08:03:56.991 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 2b50ed00865449b19804635d13d1bd58 for table 'org.apache.kudu.client.TestLeaderFailover-1779091419560' with partition [<start>, <end>)
08:03:56.991 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=2b50ed00865449b19804635d13d1bd58@[096dba2e582d4091842ed6ec55ca4ff4(127.21.107.194:40521),c602ffda950b4301ae9823b652d6432c(127.21.107.195:38661),d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893)[L]]}]
08:03:56.992 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=2b50ed00865449b19804635d13d1bd58, attempt=6, sequence_id=4, TimeoutTracker(timeout=30000, elapsed=65), Traces: [0ms] sending RPC to server d3cee23376664c3ebde0c65d62c69886, [4ms] received response from server d3cee23376664c3ebde0c65d62c69886: Network error: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893, [4ms] delaying RPC due to: Network error: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893, [20ms] refreshing cache from master, [21ms] Sub RPC GetTableLocations: sending RPC to server master-127.21.107.252:37903, [25ms] Sub RPC GetTableLocations: received response from server master-127.21.107.252:37903: OK, [27ms] sending RPC to server d3cee23376664c3ebde0c65d62c69886, [32ms] received response from server d3cee23376664c3ebde0c65d62c69886: Network error: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893, [32ms] delaying RPC due to: Network error: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893, [40ms] refreshing cache from master, [40ms] Sub RPC GetTableLocations: sending RPC to server master-127.21.107.252:37903, [45ms] Sub RPC GetTableLocations: received response from server master-127.21.107.252:37903: OK, [47ms] sending RPC to server d3cee23376664c3ebde0c65d62c69886, [50ms] received response from server d3cee23376664c3ebde0c65d62c69886: Network error: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893, [50ms] delaying RPC due to: Network error: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893, [60ms] refreshing cache from master, [61ms] Sub RPC GetTableLocations: sending RPC to server master-127.21.107.252:37903, [64ms] Sub RPC GetTableLocations: received response from server master-127.21.107.252:37903: OK, deferred=Deferred@321083860(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$230/0x00007f4ccc336df8@55c6d43c -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@2082738110 after retry RPC@1362658613) -> (continuation of Deferred@2071139885 after retry RPC@318728924), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@6d465cac -> wakeup thread Time-limited test -> (continuation of Deferred@2082738110 after retry RPC@1362658613) -> (continuation of Deferred@2071139885 after retry RPC@318728924))) after lookup
08:03:56.992 [DEBUG - kudu-nio-1] (Connection.java:748) [peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893)] connecting to peer
08:03:56.994 [INFO - kudu-nio-7] (Connection.java:429) Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893
08:03:56.995 [DEBUG - kudu-nio-7] (Connection.java:709) [peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893)] cleaning up while in state CONNECTING due to: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893
08:03:56.995 [INFO - kudu-nio-7] (AsyncKuduClient.java:2355) Invalidating location d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893) for tablet 2b50ed00865449b19804635d13d1bd58: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893
08:03:57.112 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 2b50ed00865449b19804635d13d1bd58 for table 'org.apache.kudu.client.TestLeaderFailover-1779091419560' with partition [<start>, <end>)
08:03:57.112 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=2b50ed00865449b19804635d13d1bd58@[096dba2e582d4091842ed6ec55ca4ff4(127.21.107.194:40521),c602ffda950b4301ae9823b652d6432c(127.21.107.195:38661),d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893)[L]]}]
08:03:57.113 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=2b50ed00865449b19804635d13d1bd58, attempt=8, sequence_id=4, TimeoutTracker(timeout=30000, elapsed=187), Traces: [0ms] sending RPC to server d3cee23376664c3ebde0c65d62c69886, [4ms] received response from server d3cee23376664c3ebde0c65d62c69886: Network error: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893, [4ms] delaying RPC due to: Network error: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893, [20ms] refreshing cache from master, [21ms] Sub RPC GetTableLocations: sending RPC to server master-127.21.107.252:37903, [25ms] Sub RPC GetTableLocations: received response from server master-127.21.107.252:37903: OK, [27ms] sending RPC to server d3cee23376664c3ebde0c65d62c69886, [32ms] received response from server d3cee23376664c3ebde0c65d62c69886: Network error: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893, [32ms] delaying RPC due to: Network error: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893, [40ms] refreshing cache from master, [40ms] Sub RPC GetTableLocations: sending RPC to server master-127.21.107.252:37903, [45ms] Sub RPC GetTableLocations: received response from server master-127.21.107.252:37903: OK, [47ms] sending RPC to server d3cee23376664c3ebde0c65d62c69886, [50ms] received response from server d3cee23376664c3ebde0c65d62c69886: Network error: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893, [50ms] delaying RPC due to: Network error: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893, [60ms] refreshing cache from master, [61ms] Sub RPC GetTableLocations: sending RPC to server master-127.21.107.252:37903, [64ms] Sub RPC GetTableLocations: received response from server master-127.21.107.252:37903: OK, [66ms] sending RPC to server d3cee23376664c3ebde0c65d62c69886, [69ms] received response from server d3cee23376664c3ebde0c65d62c69886: Network error: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893, [69ms] delaying RPC due to: Network error: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893, [181ms] refreshing cache from master, [181ms] Sub RPC GetTableLocations: sending RPC to server master-127.21.107.252:37903, [185ms] Sub RPC GetTableLocations: received response from server master-127.21.107.252:37903: OK, deferred=Deferred@321083860(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$230/0x00007f4ccc336df8@55c6d43c -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@2082738110 after retry RPC@1362658613) -> (continuation of Deferred@2071139885 after retry RPC@318728924) -> (continuation of Deferred@1768595495 after retry RPC@2046340552), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@6d465cac -> wakeup thread Time-limited test -> (continuation of Deferred@2082738110 after retry RPC@1362658613) -> (continuation of Deferred@2071139885 after retry RPC@318728924) -> (continuation of Deferred@1768595495 after retry RPC@2046340552))) after lookup
08:03:57.114 [DEBUG - kudu-nio-1] (Connection.java:748) [peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893)] connecting to peer
08:03:57.116 [INFO - kudu-nio-0] (Connection.java:429) Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893
08:03:57.116 [DEBUG - kudu-nio-0] (Connection.java:709) [peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893)] cleaning up while in state CONNECTING due to: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893
08:03:57.116 [INFO - kudu-nio-0] (AsyncKuduClient.java:2355) Invalidating location d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893) for tablet 2b50ed00865449b19804635d13d1bd58: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893
08:03:57.611 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 2b50ed00865449b19804635d13d1bd58 for table 'org.apache.kudu.client.TestLeaderFailover-1779091419560' with partition [<start>, <end>)
08:03:57.611 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=2b50ed00865449b19804635d13d1bd58@[096dba2e582d4091842ed6ec55ca4ff4(127.21.107.194:40521),c602ffda950b4301ae9823b652d6432c(127.21.107.195:38661),d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893)[L]]}]
08:03:57.612 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=2b50ed00865449b19804635d13d1bd58, attempt=10, sequence_id=4, TimeoutTracker(timeout=30000, elapsed=686), Traces: [0ms] sending RPC to server d3cee23376664c3ebde0c65d62c69886, [4ms] received response from server d3cee23376664c3ebde0c65d62c69886: Network error: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893, [4ms] delaying RPC due to: Network error: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893, [20ms] refreshing cache from master, [21ms] Sub RPC GetTableLocations: sending RPC to server master-127.21.107.252:37903, [25ms] Sub RPC GetTableLocations: received response from server master-127.21.107.252:37903: OK, [27ms] sending RPC to server d3cee23376664c3ebde0c65d62c69886, [32ms] received response from server d3cee23376664c3ebde0c65d62c69886: Network error: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893, [32ms] delaying RPC due to: Network error: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893, [40ms] refreshing cache from master, [40ms] Sub RPC GetTableLocations: sending RPC to server master-127.21.107.252:37903, [45ms] Sub RPC GetTableLocations: received response from server master-127.21.107.252:37903: OK, [47ms] sending RPC to server d3cee23376664c3ebde0c65d62c69886, [50ms] received response from server d3cee23376664c3ebde0c65d62c69886: Network error: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893, [50ms] delaying RPC due to: Network error: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893, [60ms] refreshing cache from master, [61ms] Sub RPC GetTableLocations: sending RPC to server master-127.21.107.252:37903, [64ms] Sub RPC GetTableLocations: received response from server master-127.21.107.252:37903: OK, [66ms] sending RPC to server d3cee23376664c3ebde0c65d62c69886, [69ms] received response from server d3cee23376664c3ebde0c65d62c69886: Network error: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893, [69ms] delaying RPC due to: Network error: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893, [181ms] refreshing cache from master, [181ms] Sub RPC GetTableLocations: sending RPC to server master-127.21.107.252:37903, [185ms] Sub RPC GetTableLocations: received response from server master-127.21.107.252:37903: OK, [188ms] sending RPC to server d3cee23376664c3ebde0c65d62c69886, [190ms] received response from server d3cee23376664c3ebde0c65d62c69886: Network error: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893, [190ms] delaying RPC due to: Network error: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893, [681ms] refreshing cache from master, [681ms] Sub RPC GetTableLocations: sending RPC to server master-127.21.107.252:37903, [685ms] Sub RPC GetTableLocations: received response from server master-127.21.107.252:37903: OK, deferred=Deferred@321083860(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$230/0x00007f4ccc336df8@55c6d43c -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@2082738110 after retry RPC@1362658613) -> (continuation of Deferred@2071139885 after retry RPC@318728924) -> (continuation of Deferred@1768595495 after retry RPC@2046340552) -> (continuation of Deferred@736185286 after retry RPC@399193503), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@6d465cac -> wakeup thread Time-limited test -> (continuation of Deferred@2082738110 after retry RPC@1362658613) -> (continuation of Deferred@2071139885 after retry RPC@318728924) -> (continuation of Deferred@1768595495 after retry RPC@2046340552) -> (continuation of Deferred@736185286 after retry RPC@399193503))) after lookup
08:03:57.613 [DEBUG - kudu-nio-1] (Connection.java:748) [peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893)] connecting to peer
08:03:57.614 [INFO - kudu-nio-1] (Connection.java:429) Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893
08:03:57.614 [DEBUG - kudu-nio-1] (Connection.java:709) [peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893)] cleaning up while in state CONNECTING due to: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893
08:03:57.614 [INFO - kudu-nio-1] (AsyncKuduClient.java:2355) Invalidating location d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893) for tablet 2b50ed00865449b19804635d13d1bd58: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893
08:03:57.711 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 2b50ed00865449b19804635d13d1bd58 for table 'org.apache.kudu.client.TestLeaderFailover-1779091419560' with partition [<start>, <end>)
08:03:57.712 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=2b50ed00865449b19804635d13d1bd58@[096dba2e582d4091842ed6ec55ca4ff4(127.21.107.194:40521),c602ffda950b4301ae9823b652d6432c(127.21.107.195:38661),d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893)[L]]}]
08:03:57.712 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=2b50ed00865449b19804635d13d1bd58, attempt=12, sequence_id=4, TimeoutTracker(timeout=30000, elapsed=786), Traces: [0ms] sending RPC to server d3cee23376664c3ebde0c65d62c69886, [4ms] received response from server d3cee23376664c3ebde0c65d62c69886: Network error: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893, [4ms] delaying RPC due to: Network error: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893, [20ms] refreshing cache from master, [21ms] Sub RPC GetTableLocations: sending RPC to server master-127.21.107.252:37903, [25ms] Sub RPC GetTableLocations: received response from server master-127.21.107.252:37903: OK, [27ms] sending RPC to server d3cee23376664c3ebde0c65d62c69886, [32ms] received response from server d3cee23376664c3ebde0c65d62c69886: Network error: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893, [32ms] delaying RPC due to: Network error: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893, [40ms] refreshing cache from master, [40ms] Sub RPC GetTableLocations: sending RPC to server master-127.21.107.252:37903, [45ms] Sub RPC GetTableLocations: received response from server master-127.21.107.252:37903: OK, [47ms] sending RPC to server d3cee23376664c3ebde0c65d62c69886, [50ms] received response from server d3cee23376664c3ebde0c65d62c69886: Network error: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893, [50ms] delaying RPC due to: Network error: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893, [60ms] refreshing cache from master, [61ms] Sub RPC GetTableLocations: sending RPC to server master-127.21.107.252:37903, [64ms] Sub RPC GetTableLocations: received response from server master-127.21.107.252:37903: OK, [66ms] sending RPC to server d3cee23376664c3ebde0c65d62c69886, [69ms] received response from server d3cee23376664c3ebde0c65d62c69886: Network error: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893, [69ms] delaying RPC due to: Network error: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893, [181ms] refreshing cache from master, [181ms] Sub RPC GetTableLocations: sending RPC to server master-127.21.107.252:37903, [185ms] Sub RPC GetTableLocations: received response from server master-127.21.107.252:37903: OK, [188ms] sending RPC to server d3cee23376664c3ebde0c65d62c69886, [190ms] received response from server d3cee23376664c3ebde0c65d62c69886: Network error: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893, [190ms] delaying RPC due to: Network error: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893, [681ms] refreshing cache from master, [681ms] Sub RPC GetTableLocations: sending RPC to server master-127.21.107.252:37903, [685ms] Sub RPC GetTableLocations: received response from server master-127.21.107.252:37903: OK, [686ms] sending RPC to server d3cee23376664c3ebde0c65d62c69886, [688ms] received response from server d3cee23376664c3ebde0c65d62c69886: Network error: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893, [688ms] delaying RPC due to: Network error: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893, [780ms] refreshing cache from master, [780ms] Sub RPC GetTableLocations: sending RPC to server master-127.21.107.252:37903, [785ms] Sub RPC GetTableLocations: received response from server master-127.21.107.252:37903: OK, deferred=Deferred@321083860(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$230/0x00007f4ccc336df8@55c6d43c -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@2082738110 after retry RPC@1362658613) -> (continuation of Deferred@2071139885 after retry RPC@318728924) -> (continuation of Deferred@1768595495 after retry RPC@2046340552) -> (continuation of Deferred@736185286 after retry RPC@399193503) -> (continuation of Deferred@1403726814 after retry RPC@664278730), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@6d465cac -> wakeup thread Time-limited test -> (continuation of Deferred@2082738110 after retry RPC@1362658613) -> (continuation of Deferred@2071139885 after retry RPC@318728924) -> (continuation of Deferred@1768595495 after retry RPC@2046340552) -> (continuation of Deferred@736185286 after retry RPC@399193503) -> (continuation of Deferred@1403726814 after retry RPC@664278730))) after lookup
08:03:57.713 [DEBUG - kudu-nio-1] (Connection.java:748) [peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893)] connecting to peer
08:03:57.714 [INFO - kudu-nio-2] (Connection.java:429) Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893
08:03:57.714 [DEBUG - kudu-nio-2] (Connection.java:709) [peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893)] cleaning up while in state CONNECTING due to: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893
08:03:57.715 [INFO - kudu-nio-2] (AsyncKuduClient.java:2355) Invalidating location d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893) for tablet 2b50ed00865449b19804635d13d1bd58: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893
08:03:58.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:58.333817 22725 raft_consensus.cc:493] T 2b50ed00865449b19804635d13d1bd58 P c602ffda950b4301ae9823b652d6432c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3cee23376664c3ebde0c65d62c69886)
08:03:58.334 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:58.334206 22725 raft_consensus.cc:515] T 2b50ed00865449b19804635d13d1bd58 P c602ffda950b4301ae9823b652d6432c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c602ffda950b4301ae9823b652d6432c" member_type: VOTER last_known_addr { host: "127.21.107.195" port: 38661 } } peers { permanent_uuid: "096dba2e582d4091842ed6ec55ca4ff4" member_type: VOTER last_known_addr { host: "127.21.107.194" port: 40521 } } peers { permanent_uuid: "d3cee23376664c3ebde0c65d62c69886" member_type: VOTER last_known_addr { host: "127.21.107.193" port: 37893 } }
08:03:58.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:58.335578 22726 raft_consensus.cc:493] T 2b50ed00865449b19804635d13d1bd58 P 096dba2e582d4091842ed6ec55ca4ff4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader d3cee23376664c3ebde0c65d62c69886)
08:03:58.336 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:58.336053 22726 raft_consensus.cc:515] T 2b50ed00865449b19804635d13d1bd58 P 096dba2e582d4091842ed6ec55ca4ff4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c602ffda950b4301ae9823b652d6432c" member_type: VOTER last_known_addr { host: "127.21.107.195" port: 38661 } } peers { permanent_uuid: "096dba2e582d4091842ed6ec55ca4ff4" member_type: VOTER last_known_addr { host: "127.21.107.194" port: 40521 } } peers { permanent_uuid: "d3cee23376664c3ebde0c65d62c69886" member_type: VOTER last_known_addr { host: "127.21.107.193" port: 37893 } }
08:03:58.337 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:58.336848 22725 leader_election.cc:290] T 2b50ed00865449b19804635d13d1bd58 P c602ffda950b4301ae9823b652d6432c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 096dba2e582d4091842ed6ec55ca4ff4 (127.21.107.194:40521), d3cee23376664c3ebde0c65d62c69886 (127.21.107.193:37893)
08:03:58.339 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:58.338804 22726 leader_election.cc:290] T 2b50ed00865449b19804635d13d1bd58 P 096dba2e582d4091842ed6ec55ca4ff4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c602ffda950b4301ae9823b652d6432c (127.21.107.195:38661), d3cee23376664c3ebde0c65d62c69886 (127.21.107.193:37893)
08:03:58.344 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:58.342869 22549 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.107.193:37893: connect: Connection refused (error 111)
08:03:58.349 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:58.348378 22406 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.21.107.193:37893: connect: Connection refused (error 111)
08:03:58.351 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:58.350505 22549 leader_election.cc:336] T 2b50ed00865449b19804635d13d1bd58 P c602ffda950b4301ae9823b652d6432c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d3cee23376664c3ebde0c65d62c69886 (127.21.107.193:37893): Network error: Client connection negotiation failed: client connection to 127.21.107.193:37893: connect: Connection refused (error 111)
08:03:58.357 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:58.357321 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b50ed00865449b19804635d13d1bd58" candidate_uuid: "c602ffda950b4301ae9823b652d6432c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "096dba2e582d4091842ed6ec55ca4ff4" is_pre_election: true
08:03:58.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:58.357960 22471 raft_consensus.cc:2468] T 2b50ed00865449b19804635d13d1bd58 P 096dba2e582d4091842ed6ec55ca4ff4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c602ffda950b4301ae9823b652d6432c in term 1.
08:03:58.358 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:58.358002 22406 leader_election.cc:336] T 2b50ed00865449b19804635d13d1bd58 P 096dba2e582d4091842ed6ec55ca4ff4 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer d3cee23376664c3ebde0c65d62c69886 (127.21.107.193:37893): Network error: Client connection negotiation failed: client connection to 127.21.107.193:37893: connect: Connection refused (error 111)
08:03:58.359 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:58.359028 22549 leader_election.cc:304] T 2b50ed00865449b19804635d13d1bd58 P c602ffda950b4301ae9823b652d6432c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 096dba2e582d4091842ed6ec55ca4ff4, c602ffda950b4301ae9823b652d6432c; no voters: d3cee23376664c3ebde0c65d62c69886
08:03:58.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:58.359694 22725 raft_consensus.cc:2804] T 2b50ed00865449b19804635d13d1bd58 P c602ffda950b4301ae9823b652d6432c [term 1 FOLLOWER]: Leader pre-election won for term 2
08:03:58.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:58.360009 22725 raft_consensus.cc:493] T 2b50ed00865449b19804635d13d1bd58 P c602ffda950b4301ae9823b652d6432c [term 1 FOLLOWER]: Starting leader election (detected failure of leader d3cee23376664c3ebde0c65d62c69886)
08:03:58.360 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:58.360236 22725 raft_consensus.cc:3060] T 2b50ed00865449b19804635d13d1bd58 P c602ffda950b4301ae9823b652d6432c [term 1 FOLLOWER]: Advancing to term 2
08:03:58.364 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:58.364516 22614 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b50ed00865449b19804635d13d1bd58" candidate_uuid: "096dba2e582d4091842ed6ec55ca4ff4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c602ffda950b4301ae9823b652d6432c" is_pre_election: true
08:03:58.365 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:58.365145 22725 raft_consensus.cc:515] T 2b50ed00865449b19804635d13d1bd58 P c602ffda950b4301ae9823b652d6432c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c602ffda950b4301ae9823b652d6432c" member_type: VOTER last_known_addr { host: "127.21.107.195" port: 38661 } } peers { permanent_uuid: "096dba2e582d4091842ed6ec55ca4ff4" member_type: VOTER last_known_addr { host: "127.21.107.194" port: 40521 } } peers { permanent_uuid: "d3cee23376664c3ebde0c65d62c69886" member_type: VOTER last_known_addr { host: "127.21.107.193" port: 37893 } }
08:03:58.366 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:58.366210 22614 raft_consensus.cc:2393] T 2b50ed00865449b19804635d13d1bd58 P c602ffda950b4301ae9823b652d6432c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 096dba2e582d4091842ed6ec55ca4ff4 in current term 2: Already voted for candidate c602ffda950b4301ae9823b652d6432c in this term.
08:03:58.367 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:58.366943 22725 leader_election.cc:290] T 2b50ed00865449b19804635d13d1bd58 P c602ffda950b4301ae9823b652d6432c [CANDIDATE]: Term 2 election: Requested vote from peers 096dba2e582d4091842ed6ec55ca4ff4 (127.21.107.194:40521), d3cee23376664c3ebde0c65d62c69886 (127.21.107.193:37893)
08:03:58.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:58.367781 22471 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2b50ed00865449b19804635d13d1bd58" candidate_uuid: "c602ffda950b4301ae9823b652d6432c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "096dba2e582d4091842ed6ec55ca4ff4"
08:03:58.368 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:58.368198 22471 raft_consensus.cc:3060] T 2b50ed00865449b19804635d13d1bd58 P 096dba2e582d4091842ed6ec55ca4ff4 [term 1 FOLLOWER]: Advancing to term 2
08:03:58.370 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:58.370021 22407 leader_election.cc:304] T 2b50ed00865449b19804635d13d1bd58 P 096dba2e582d4091842ed6ec55ca4ff4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 096dba2e582d4091842ed6ec55ca4ff4; no voters: c602ffda950b4301ae9823b652d6432c, d3cee23376664c3ebde0c65d62c69886
08:03:58.372 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:58.371765 22549 leader_election.cc:336] T 2b50ed00865449b19804635d13d1bd58 P c602ffda950b4301ae9823b652d6432c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer d3cee23376664c3ebde0c65d62c69886 (127.21.107.193:37893): Network error: Client connection negotiation failed: client connection to 127.21.107.193:37893: connect: Connection refused (error 111)
08:03:58.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:58.372833 22471 raft_consensus.cc:2468] T 2b50ed00865449b19804635d13d1bd58 P 096dba2e582d4091842ed6ec55ca4ff4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c602ffda950b4301ae9823b652d6432c in term 2.
08:03:58.373 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:58.373201 22726 raft_consensus.cc:2749] T 2b50ed00865449b19804635d13d1bd58 P 096dba2e582d4091842ed6ec55ca4ff4 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
08:03:58.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:58.373724 22549 leader_election.cc:304] T 2b50ed00865449b19804635d13d1bd58 P c602ffda950b4301ae9823b652d6432c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 096dba2e582d4091842ed6ec55ca4ff4, c602ffda950b4301ae9823b652d6432c; no voters: d3cee23376664c3ebde0c65d62c69886
08:03:58.375 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:58.374487 22725 raft_consensus.cc:2804] T 2b50ed00865449b19804635d13d1bd58 P c602ffda950b4301ae9823b652d6432c [term 2 FOLLOWER]: Leader election won for term 2
08:03:58.376 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:58.376336 22725 raft_consensus.cc:697] T 2b50ed00865449b19804635d13d1bd58 P c602ffda950b4301ae9823b652d6432c [term 2 LEADER]: Becoming Leader. State: Replica: c602ffda950b4301ae9823b652d6432c, State: Running, Role: LEADER
08:03:58.378 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:58.377372 22725 consensus_queue.cc:237] T 2b50ed00865449b19804635d13d1bd58 P c602ffda950b4301ae9823b652d6432c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c602ffda950b4301ae9823b652d6432c" member_type: VOTER last_known_addr { host: "127.21.107.195" port: 38661 } } peers { permanent_uuid: "096dba2e582d4091842ed6ec55ca4ff4" member_type: VOTER last_known_addr { host: "127.21.107.194" port: 40521 } } peers { permanent_uuid: "d3cee23376664c3ebde0c65d62c69886" member_type: VOTER last_known_addr { host: "127.21.107.193" port: 37893 } }
08:03:58.386 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:58.385473 22133 catalog_manager.cc:5696] T 2b50ed00865449b19804635d13d1bd58 P c602ffda950b4301ae9823b652d6432c reported cstate change: term changed from 1 to 2, leader changed from d3cee23376664c3ebde0c65d62c69886 (127.21.107.193) to c602ffda950b4301ae9823b652d6432c (127.21.107.195). New cstate: current_term: 2 leader_uuid: "c602ffda950b4301ae9823b652d6432c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c602ffda950b4301ae9823b652d6432c" member_type: VOTER last_known_addr { host: "127.21.107.195" port: 38661 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "096dba2e582d4091842ed6ec55ca4ff4" member_type: VOTER last_known_addr { host: "127.21.107.194" port: 40521 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3cee23376664c3ebde0c65d62c69886" member_type: VOTER last_known_addr { host: "127.21.107.193" port: 37893 } health_report { overall_health: UNKNOWN } } }
08:03:58.951 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:58.951084 22471 raft_consensus.cc:1275] T 2b50ed00865449b19804635d13d1bd58 P 096dba2e582d4091842ed6ec55ca4ff4 [term 2 FOLLOWER]: Refusing update from remote peer c602ffda950b4301ae9823b652d6432c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
08:03:58.953 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:58.952491 22747 consensus_queue.cc:1048] T 2b50ed00865449b19804635d13d1bd58 P c602ffda950b4301ae9823b652d6432c [LEADER]: Connected to new peer: Peer: permanent_uuid: "096dba2e582d4091842ed6ec55ca4ff4" member_type: VOTER last_known_addr { host: "127.21.107.194" port: 40521 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
08:03:58.975 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) W20260518 08:03:58.975013 22549 consensus_peers.cc:597] T 2b50ed00865449b19804635d13d1bd58 P c602ffda950b4301ae9823b652d6432c -> Peer d3cee23376664c3ebde0c65d62c69886 (127.21.107.193:37893): Couldn't send request to peer d3cee23376664c3ebde0c65d62c69886. Status: Network error: Client connection negotiation failed: client connection to 127.21.107.193:37893: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
08:03:59.731 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:2538) Learned about tablet 2b50ed00865449b19804635d13d1bd58 for table 'org.apache.kudu.client.TestLeaderFailover-1779091419560' with partition [<start>, <end>)
08:03:59.731 [DEBUG - kudu-nio-1] (TableLocationsCache.java:192) Discovered table locations:	[Tablet{lowerBoundPartitionKey=0x, upperBoundPartitionKey=0x, ttl=299999, tablet=2b50ed00865449b19804635d13d1bd58@[096dba2e582d4091842ed6ec55ca4ff4(127.21.107.194:40521),c602ffda950b4301ae9823b652d6432c(127.21.107.195:38661)[L],d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893)]}]
08:03:59.732 [DEBUG - kudu-nio-1] (AsyncKuduClient.java:1488) Retrying sending RPC KuduRpc(method=Write, tablet=2b50ed00865449b19804635d13d1bd58, attempt=14, sequence_id=4, TimeoutTracker(timeout=30000, elapsed=2806), Traces: [0ms] sending RPC to server d3cee23376664c3ebde0c65d62c69886, [4ms] received response from server d3cee23376664c3ebde0c65d62c69886: Network error: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893, [4ms] delaying RPC due to: Network error: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893, [20ms] refreshing cache from master, [21ms] Sub RPC GetTableLocations: sending RPC to server master-127.21.107.252:37903, [25ms] Sub RPC GetTableLocations: received response from server master-127.21.107.252:37903: OK, [27ms] sending RPC to server d3cee23376664c3ebde0c65d62c69886, [32ms] received response from server d3cee23376664c3ebde0c65d62c69886: Network error: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893, [32ms] delaying RPC due to: Network error: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893, [40ms] refreshing cache from master, [40ms] Sub RPC GetTableLocations: sending RPC to server master-127.21.107.252:37903, [45ms] Sub RPC GetTableLocations: received response from server master-127.21.107.252:37903: OK, [47ms] sending RPC to server d3cee23376664c3ebde0c65d62c69886, [50ms] received response from server d3cee23376664c3ebde0c65d62c69886: Network error: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893, [50ms] delaying RPC due to: Network error: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893, [60ms] refreshing cache from master, [61ms] Sub RPC GetTableLocations: sending RPC to server master-127.21.107.252:37903, [64ms] Sub RPC GetTableLocations: received response from server master-127.21.107.252:37903: OK, [66ms] sending RPC to server d3cee23376664c3ebde0c65d62c69886, [69ms] received response from server d3cee23376664c3ebde0c65d62c69886: Network error: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893, [69ms] delaying RPC due to: Network error: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893, [181ms] refreshing cache from master, [181ms] Sub RPC GetTableLocations: sending RPC to server master-127.21.107.252:37903, [185ms] Sub RPC GetTableLocations: received response from server master-127.21.107.252:37903: OK, [188ms] sending RPC to server d3cee23376664c3ebde0c65d62c69886, [190ms] received response from server d3cee23376664c3ebde0c65d62c69886: Network error: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893, [190ms] delaying RPC due to: Network error: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893, [681ms] refreshing cache from master, [681ms] Sub RPC GetTableLocations: sending RPC to server master-127.21.107.252:37903, [685ms] Sub RPC GetTableLocations: received response from server master-127.21.107.252:37903: OK, [686ms] sending RPC to server d3cee23376664c3ebde0c65d62c69886, [688ms] received response from server d3cee23376664c3ebde0c65d62c69886: Network error: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893, [688ms] delaying RPC due to: Network error: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893, [780ms] refreshing cache from master, [780ms] Sub RPC GetTableLocations: sending RPC to server master-127.21.107.252:37903, [785ms] Sub RPC GetTableLocations: received response from server master-127.21.107.252:37903: OK, [787ms] sending RPC to server d3cee23376664c3ebde0c65d62c69886, [789ms] received response from server d3cee23376664c3ebde0c65d62c69886: Network error: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893, [789ms] delaying RPC due to: Network error: Failed to connect to peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893): Connection refused: /127.21.107.193:37893, [2800ms] refreshing cache from master, [2801ms] Sub RPC GetTableLocations: sending RPC to server master-127.21.107.252:37903, [2805ms] Sub RPC GetTableLocations: received response from server master-127.21.107.252:37903: OK, deferred=Deferred@321083860(state=PENDING, result=null, callback=org.apache.kudu.client.AsyncKuduSession$$Lambda$230/0x00007f4ccc336df8@55c6d43c -> passthrough -> wakeup thread Time-limited test -> (continuation of Deferred@2082738110 after retry RPC@1362658613) -> (continuation of Deferred@2071139885 after retry RPC@318728924) -> (continuation of Deferred@1768595495 after retry RPC@2046340552) -> (continuation of Deferred@736185286 after retry RPC@399193503) -> (continuation of Deferred@1403726814 after retry RPC@664278730) -> (continuation of Deferred@777331222 after retry RPC@1234980688), errback=passthrough -> org.apache.kudu.client.AsyncKuduSession$SingleOperationErrCallback@6d465cac -> wakeup thread Time-limited test -> (continuation of Deferred@2082738110 after retry RPC@1362658613) -> (continuation of Deferred@2071139885 after retry RPC@318728924) -> (continuation of Deferred@1768595495 after retry RPC@2046340552) -> (continuation of Deferred@736185286 after retry RPC@399193503) -> (continuation of Deferred@1403726814 after retry RPC@664278730) -> (continuation of Deferred@777331222 after retry RPC@1234980688))) after lookup
08:03:59.734 [DEBUG - kudu-nio-1] (Connection.java:748) [peer c602ffda950b4301ae9823b652d6432c(127.21.107.195:38661)] connecting to peer
08:03:59.735 [DEBUG - kudu-nio-3] (Connection.java:757) [peer c602ffda950b4301ae9823b652d6432c(127.21.107.195:38661)] Successfully connected to peer
08:03:59.761 [DEBUG - kudu-nio-3] (Negotiator.java:919) Authenticated connection [id: 0x5f5d7f82, L:/127.0.0.1:49472 - R:/127.21.107.195:38661] using TOKEN/null
08:03:59.819 [DEBUG - kudu-nio-3] (AsyncKuduScanner.java:1370) AsyncKuduScanner$Response(scannerId = "", data = RowwiseRowResultIterator for 6 rows, more = false) for scanner KuduScanner(table=org.apache.kudu.client.TestLeaderFailover-1779091419560, tablet=2b50ed00865449b19804635d13d1bd58, scannerId=null, scanRequestTimeout=30000, startPrimaryKey=<start>, endPrimaryKey=<end>, lastPrimaryKey=<last>)
08:03:59.825 [DEBUG - main] (Connection.java:575) [peer d3cee23376664c3ebde0c65d62c69886(127.21.107.193:37893)] disconnecting while in state TERMINATED
08:03:59.826 [DEBUG - main] (Connection.java:575) [peer master-127.21.107.253:44373(127.21.107.253:44373)] disconnecting while in state READY
08:03:59.827 [DEBUG - main] (Connection.java:575) [peer master-127.21.107.254:36655(127.21.107.254:36655)] disconnecting while in state READY
08:03:59.827 [DEBUG - main] (Connection.java:575) [peer master-127.21.107.252:37903(127.21.107.252:37903)] disconnecting while in state READY
08:03:59.828 [DEBUG - main] (Connection.java:575) [peer c602ffda950b4301ae9823b652d6432c(127.21.107.195:38661)] disconnecting while in state READY
08:03:59.830 [DEBUG - kudu-nio-0] (Connection.java:239) [peer master-127.21.107.253:44373(127.21.107.253:44373)] handling channelInactive
08:03:59.830 [DEBUG - kudu-nio-2] (Connection.java:239) [peer master-127.21.107.254:36655(127.21.107.254:36655)] handling channelInactive
08:03:59.830 [DEBUG - kudu-nio-0] (Connection.java:709) [peer master-127.21.107.253:44373(127.21.107.253:44373)] cleaning up while in state READY due to: connection closed
08:03:59.830 [DEBUG - kudu-nio-2] (Connection.java:709) [peer master-127.21.107.254:36655(127.21.107.254:36655)] cleaning up while in state READY due to: connection closed
08:03:59.830 [DEBUG - kudu-nio-1] (Connection.java:239) [peer master-127.21.107.252:37903(127.21.107.252:37903)] handling channelInactive
08:03:59.831 [DEBUG - kudu-nio-1] (Connection.java:709) [peer master-127.21.107.252:37903(127.21.107.252:37903)] cleaning up while in state READY due to: connection closed
08:03:59.831 [DEBUG - kudu-nio-3] (Connection.java:239) [peer c602ffda950b4301ae9823b652d6432c(127.21.107.195:38661)] handling channelInactive
08:03:59.831 [DEBUG - kudu-nio-3] (Connection.java:709) [peer c602ffda950b4301ae9823b652d6432c(127.21.107.195:38661)] cleaning up while in state READY due to: connection closed
08:03:59.831 [DEBUG - main] (AsyncKuduClient.java:2704) Releasing all remaining resources
08:03:59.837 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:59.836763 21935 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task7wVUHj/build/tsan/bin/kudu with pid 22376
08:03:59.866 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:59.866336 21935 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task7wVUHj/build/tsan/bin/kudu with pid 22526
08:03:59.890 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:59.889753 21935 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task7wVUHj/build/tsan/bin/kudu with pid 21948
08:03:59.918 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:59.918530 21935 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task7wVUHj/build/tsan/bin/kudu with pid 22018
08:03:59.946 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) I20260518 08:03:59.945709 21935 external_mini_cluster.cc:1658] Killing /tmp/dist-test-task7wVUHj/build/tsan/bin/kudu with pid 22093
08:04:01.112 [INFO - cluster stderr printer] (MiniKuduCluster.java:751) 2026-05-18T08:04:01Z chronyd exiting

Time: 22.627

OK (1 test)

